-- Logs begin at Thu 2022-10-27 09:25:36 UTC, end at Thu 2022-10-27 11:50:02 UTC. -- Oct 27 09:57:09.616992 n-d-854663-10 systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 09:57:09.627011 n-d-854663-10 devstack@n-api.service[104850]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 09:57:09 2022] *** Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: nodename: n-d-854663-10 Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: machine: x86_64 Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: clock source: unix Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: pcre jit disabled Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: detected number of CPU cores: 4 Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: current working directory: / Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: detected binary path: /usr/bin/uwsgi-core Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: your processes number limit is 47680 Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: your memory page size is 4096 bytes Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: detected max file descriptor number: 2048 Oct 27 09:57:09.629459 n-d-854663-10 devstack@n-api.service[104850]: lock engine: pthread robust mutexes Oct 27 09:57:09.630408 n-d-854663-10 devstack@n-api.service[104850]: thunder lock: enabled Oct 27 09:57:09.630408 n-d-854663-10 devstack@n-api.service[104850]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 09:57:09.630408 n-d-854663-10 devstack@n-api.service[104850]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 09:57:09.669385 n-d-854663-10 devstack@n-api.service[104850]: Python main interpreter initialized at 0x5609b5c7c9c0 Oct 27 09:57:09.669385 n-d-854663-10 devstack@n-api.service[104850]: python threads support enabled Oct 27 09:57:09.669385 n-d-854663-10 devstack@n-api.service[104850]: your server socket listen backlog is limited to 100 connections Oct 27 09:57:09.669385 n-d-854663-10 devstack@n-api.service[104850]: your mercy for graceful operations on workers is 90 seconds Oct 27 09:57:09.669723 n-d-854663-10 devstack@n-api.service[104850]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 09:57:09.669723 n-d-854663-10 devstack@n-api.service[104850]: *** Operational MODE: preforking *** Oct 27 09:57:09.669973 n-d-854663-10 devstack@n-api.service[104850]: *** uWSGI is running in multiple interpreter mode *** Oct 27 09:57:09.669973 n-d-854663-10 devstack@n-api.service[104850]: spawned uWSGI master process (pid: 104850) Oct 27 09:57:09.670176 n-d-854663-10 systemd[1]: Started Devstack devstack@n-api.service. Oct 27 09:57:09.671350 n-d-854663-10 devstack@n-api.service[104850]: spawned uWSGI worker 1 (pid: 104851, cores: 1) Oct 27 09:57:09.671350 n-d-854663-10 devstack@n-api.service[104850]: spawned uWSGI worker 2 (pid: 104852, cores: 1) Oct 27 09:57:09.671350 n-d-854663-10 devstack@n-api.service[104850]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 09:57:10.322245 n-d-854663-10 devstack@n-api.service[104851]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 09:57:10.322932 n-d-854663-10 devstack@n-api.service[104852]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 09:57:11.379335 n-d-854663-10 devstack@n-api.service[104851]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:57:11.379335 n-d-854663-10 devstack@n-api.service[104851]: from cryptography.utils import int_from_bytes Oct 27 09:57:11.379972 n-d-854663-10 devstack@n-api.service[104852]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:57:11.379972 n-d-854663-10 devstack@n-api.service[104852]: from cryptography.utils import int_from_bytes Oct 27 09:57:11.380381 n-d-854663-10 devstack@n-api.service[104851]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:57:11.380381 n-d-854663-10 devstack@n-api.service[104851]: from cryptography.utils import int_from_bytes Oct 27 09:57:11.380493 n-d-854663-10 devstack@n-api.service[104852]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:57:11.380493 n-d-854663-10 devstack@n-api.service[104852]: from cryptography.utils import int_from_bytes Oct 27 09:57:13.842696 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 09:57:13.843437 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 09:57:13.843544 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 09:57:13.843544 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 09:57:13.843966 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 09:57:13.843966 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 09:57:13.844111 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 09:57:13.844200 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 09:57:13.844285 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 09:57:13.844368 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.844529 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 09:57:13.844713 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.844939 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.845100 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.845265 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.845410 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.845545 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.845640 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.845893 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.846037 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.846202 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.846296 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.846567 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.846788 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.846920 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.847269 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.847377 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.847594 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.847691 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.847850 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.847987 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.848167 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.848299 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854663-10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.848494 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854663-10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.848622 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.848835 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.848930 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.849141 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.849239 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.849448 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.849548 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.849754 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.849850 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.850061 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.850155 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.850375 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.850481 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.850677 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.850890 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.851162 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.851301 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.851474 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.851593 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.851774 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.851899 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.852075 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.852232 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.852405 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.852537 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.852768 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.852904 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.853041 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.853165 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.853380 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.853479 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.853658 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.853749 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.853975 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.854107 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.854277 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.854426 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854663-10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.854680 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854663-10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.854765 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.854991 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.855083 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.855299 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.855395 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.855606 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.855689 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.855992 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.856136 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.856297 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.856436 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.856596 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.856733 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.856943 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.857052 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.857244 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.857336 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.857551 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.857646 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.857858 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.857951 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.858168 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.858261 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.858480 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.858574 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.858771 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.858857 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.859068 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.859180 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.859366 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.859460 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.859665 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.859759 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.859957 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.860053 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.860247 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.860343 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.860490 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.860576 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.860804 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.860891 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.861112 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.861220 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.861421 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.861513 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.861731 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.861829 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.862016 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.862232 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.862378 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.862492 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.862626 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.862772 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.862930 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.863018 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.863153 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.863336 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.863448 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.863644 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.863735 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.863950 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.864044 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.864252 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.864338 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.864556 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.864649 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.864884 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.864980 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.865180 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.865271 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.865478 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.865563 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.865781 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.865873 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.866090 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.866180 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.866387 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.866516 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.866696 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.866782 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.866996 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.867089 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.867309 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.867404 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.867605 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.867695 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.867936 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.868035 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.868238 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.868324 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.868534 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.868624 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.868867 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.868975 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.869179 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.869264 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.869479 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.869567 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.869775 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.869873 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.870072 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.870158 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.870370 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.870456 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.870670 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.870771 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.870973 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.871065 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.871217 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.871315 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.871511 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.871607 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.871806 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.871892 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.872102 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.872194 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.872416 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.872511 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.872711 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.872811 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.873008 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.873094 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.873299 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.873386 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.873596 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.873690 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.873886 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.873983 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.874191 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.874276 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.874486 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.874577 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.874782 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.874876 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.875078 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.875174 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.875372 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.875464 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.875671 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.875777 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.875962 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.876047 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.876255 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.876341 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.876552 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.876649 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.876876 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.877006 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.877189 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.877395 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.877494 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.877842 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.877960 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.878137 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.878287 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.878440 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.878589 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.878741 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.878914 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.879065 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.879212 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.879369 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.879507 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.879668 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.879812 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.879988 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.880115 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.880289 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.880414 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.880594 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.880762 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.880948 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.881071 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.881250 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.881355 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.881550 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.881665 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.881870 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.881970 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.882160 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.882257 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.882464 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.882596 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.882773 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.882861 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.883077 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.883171 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.883378 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.883469 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.883681 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.883773 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.883967 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.884063 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.884263 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.884348 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.884555 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.884646 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.884884 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.884983 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.885180 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.885280 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.885495 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.885597 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.885807 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.885901 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.886115 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.886212 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.886417 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.886502 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.886714 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.886816 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.887020 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.887110 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.887346 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:57:13.887443 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.887660 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.887752 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.887992 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.888086 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.888295 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.888386 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.888620 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.888862 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.888960 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.889048 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.889268 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.889366 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.889575 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.889665 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.889878 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.889971 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.890184 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.890279 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.890485 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.890577 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.890787 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.890872 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.891097 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.891196 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.891406 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.891500 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.891712 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.891806 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.892030 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.892131 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.892338 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.892424 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.892645 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.892756 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.892985 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.893159 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.893311 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.893432 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.893618 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.893706 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.893937 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.894026 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.894255 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.894362 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.894556 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.894648 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.894892 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.894986 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.895238 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.895324 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.895548 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.895632 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.895871 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.895964 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.896190 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.896282 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.896538 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.896623 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.896883 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.896972 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.897192 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.897278 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.897501 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.897647 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.897837 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.897973 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.898160 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.898291 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.898479 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.898606 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.898795 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.898915 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.899103 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.899243 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.899424 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.899554 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.899741 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.899862 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.900054 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.900153 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.900363 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.900458 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.900707 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.900837 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.901024 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.901125 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.901366 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.901471 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.901679 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.901763 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.901998 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.902083 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.902313 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.902414 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.902621 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.902728 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.902935 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.903025 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.903248 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.903365 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.903553 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.903651 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.903850 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.903935 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.904150 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.904237 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.904452 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.904546 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.904780 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.904868 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.905088 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.905175 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.905396 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.905481 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.905715 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.905801 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.906020 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.906113 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.906336 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.906426 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.906632 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.906734 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.906942 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.907028 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.907252 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.907337 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.907557 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.907651 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.907854 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.907951 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.908155 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.908240 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.908466 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.908567 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.908791 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.908940 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.909257 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.909364 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.909562 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.909672 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.909868 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.909958 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.910180 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.910273 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.910477 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.910563 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.910777 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.910863 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.911084 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.911170 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.911389 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.911485 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.911692 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.911783 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.911997 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.912098 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.912307 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.912393 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.912618 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.912740 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.912948 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.913047 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.913253 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.913339 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.913561 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.913654 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.913890 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.913989 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.914188 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.914274 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.914507 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.914591 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.914821 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.914915 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.915132 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.915225 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.915754 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.915844 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.916056 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.916151 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.916352 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.916436 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.916654 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.916831 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.916979 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.917075 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.917286 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.917378 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.917594 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.917688 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.917897 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.917991 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.918202 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.918288 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.918498 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.918593 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.918796 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.918882 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.919095 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.919179 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.919402 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.919486 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.919700 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.919786 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.919998 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.920087 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.920293 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.920378 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.920593 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.920696 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.920937 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.921023 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.921255 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.921352 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.921585 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.921669 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.921897 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.921990 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.922214 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.922375 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.922517 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.922615 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.922824 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.922919 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.923127 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.923222 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.923430 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.923559 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.923735 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.923820 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.924036 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.924129 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.924339 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.924425 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.924702 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.924949 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.925050 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.925270 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.925435 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.925577 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.925747 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.925896 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.926071 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.926205 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.926379 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.926518 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.926699 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.926819 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.927004 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.927129 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.927318 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.927450 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.927660 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.927778 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.927992 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.928079 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.928305 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.928390 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.928731 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.928870 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.928976 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.929080 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.929247 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.929337 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.929554 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.929655 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.929863 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.929955 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.930164 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.930264 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.930467 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.930566 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.930783 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.930876 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.931097 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.931182 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.931414 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.931507 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.931723 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.931808 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.932042 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.932128 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.932352 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.932446 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.932650 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.932791 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.932980 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.933075 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.933291 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.933379 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.933615 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.933700 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.933921 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.934008 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.934227 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.934324 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.934532 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.934620 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.934836 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.934920 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.935140 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.935227 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.935443 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.935529 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.935743 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.935828 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.936044 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.936138 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.936344 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.936431 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.936649 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.936766 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.936984 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.937078 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.937292 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.937385 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.937597 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.937692 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.937900 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.937999 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.938200 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.938284 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.938497 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.938592 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.938794 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.938881 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.939092 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.939177 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.939399 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.939493 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.939699 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.939790 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.940012 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.940193 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.940369 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.940487 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.940682 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.940790 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.940983 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.941069 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.941293 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.941380 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.941594 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.941679 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.941890 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.941982 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.942189 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.942276 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.942492 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.942578 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.942793 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.942879 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.943110 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.943196 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.943410 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.943496 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.943716 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.943808 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.944026 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.944111 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.944327 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.944413 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.944633 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.944783 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.944961 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.945046 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.945265 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.945356 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.945571 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.945667 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.945874 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.945958 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.946173 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.946265 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.946478 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.946576 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.946781 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.946870 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.947084 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.947169 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.947387 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.947491 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.947690 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.947776 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.947988 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.948072 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.948290 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.948377 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.948592 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.948738 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.948928 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.949013 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.949230 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.949327 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.949539 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.949625 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.949852 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.950122 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.950412 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.950511 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.950740 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.950825 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.951052 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.951219 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.951366 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.951452 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.951690 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.951785 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.952012 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.952112 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.952337 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.952422 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.952640 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.952756 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.952960 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.953054 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.953263 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.953349 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.953559 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.953657 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.953858 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.953943 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.954159 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.954242 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.954455 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.954542 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.954755 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.954849 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.955056 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.955149 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.955357 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.955450 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.955650 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.955769 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.955981 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.956086 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.956272 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.956365 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.956570 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.956710 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.956895 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.957025 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.957206 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.957323 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.957509 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.957633 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.957817 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.957932 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.958116 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.958244 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.958434 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.958546 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.958739 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.958827 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.959040 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.959126 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.959345 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.959437 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.959645 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.959732 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.959982 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.960075 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.960284 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.960375 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.960620 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.960729 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.960973 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.961059 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.961270 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.961377 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.961571 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.961657 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.961887 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.961979 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.962209 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.962304 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.962510 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.962596 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.962811 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.962895 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.963109 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.963205 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.963413 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.963505 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.963709 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.963795 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.964009 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.964111 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.964310 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.964403 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.964612 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.964757 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.964942 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.965039 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.965239 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.965325 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.965535 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.965620 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.965829 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.965915 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.966126 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.966211 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.966424 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.966510 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.966720 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.966806 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.967017 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.967109 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.967315 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.967408 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.967614 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.967707 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.967909 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.967995 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.968205 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.968299 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.968499 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.968584 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.968820 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.968907 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.969116 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.969216 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.969414 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.969517 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.969711 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.969795 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.970009 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.970102 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.970312 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.970442 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.970617 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.970702 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.970921 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.971017 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.971238 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.971324 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.971671 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.971766 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.971973 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.972073 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.972273 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.972360 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.972576 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.972682 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.972898 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.972987 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.973204 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.973290 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.973511 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.973595 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.973819 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.973906 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.974118 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.974213 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.974417 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.974510 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.974735 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.974851 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.974996 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.975082 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.975291 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.975385 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.975604 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.975698 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.975883 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.975968 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.976177 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.976272 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.976477 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.976562 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.976797 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.976884 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.977096 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.977190 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.977393 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.977485 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.977699 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.977792 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.977995 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.978095 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.978292 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.978377 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.978585 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.978669 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.978886 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.978978 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.979201 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.979293 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.979511 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.979595 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.979833 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.979919 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.980142 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.980227 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.980452 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.980537 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.980781 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.980873 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.981087 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.981172 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.981394 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.981477 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.981690 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.981776 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.981992 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.982076 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.982295 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.982379 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.982600 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.982686 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.982892 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.982983 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.983187 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.983282 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.983485 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.983558 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.983792 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.983877 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.984094 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.984188 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.984398 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.984527 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.984734 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.984835 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.985052 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.985159 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.985349 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.985435 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.985648 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.985733 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.985949 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.986043 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.986246 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.986330 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.986548 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.986641 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.986847 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.986932 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.987275 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.987370 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.987586 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.987677 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.987897 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.987993 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.988207 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.988292 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.988512 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.988600 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.988834 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.988929 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.989144 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.989228 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.989437 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.989523 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.989736 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.989822 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.990036 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.990121 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.990340 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.990433 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.990638 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.990723 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.990941 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.991025 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.991236 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.991329 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.991537 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.991622 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.991831 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.991914 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.992132 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.992248 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.992556 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.992643 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.992883 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.992967 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.993180 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.993278 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.993481 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.993575 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.993781 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.993865 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.994085 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.994171 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.994387 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.994487 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.994681 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.994775 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.994983 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.995120 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.995381 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.995466 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.995684 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.995769 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.995986 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.996073 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.996284 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.996375 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.996580 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.996721 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.996906 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.996993 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.997214 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.997301 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.997511 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.997604 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.997809 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.997895 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.998105 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.998190 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.998403 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.998496 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.998703 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.998787 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.999009 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.999094 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.999326 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.999420 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.999706 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:13.999798 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.000006 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.000092 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.000314 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.000410 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.000724 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.000823 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.001029 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.001117 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.001338 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.001432 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.001653 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.001745 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.001968 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.002062 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.002272 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.002356 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.002578 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.002730 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.002922 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.003020 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.003237 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.003335 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.003545 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.003631 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.003847 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.003934 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.004152 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.004246 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.004449 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.004539 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.004776 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.004873 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.005088 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.005216 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.005394 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.005484 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.005699 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.005783 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.006018 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.006113 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.006401 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.006496 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.006704 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.006790 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.007017 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.007113 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.007331 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.007425 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.007628 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.007714 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.007925 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.008021 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.008226 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.008311 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.008519 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.008602 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.008841 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.008949 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.009142 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.009228 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.009441 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.009527 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.009743 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.009831 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.010044 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.010130 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.010343 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.010436 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.010639 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.010727 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.010933 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.011026 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.011229 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.011321 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.011531 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.011618 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.011831 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.011917 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.012139 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.012223 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.012444 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.012537 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.012784 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.012875 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.013080 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.013219 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.013393 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.013478 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.013693 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.013794 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.013987 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.014087 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.014285 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.014372 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.014582 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.014678 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.014881 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.014978 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.015196 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.015282 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.015501 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.015586 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.015815 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.015910 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.016142 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.016267 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.016441 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.016535 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.016780 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.016871 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.017100 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.017184 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.017486 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.017570 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.017804 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.017890 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.018114 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.018212 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.018447 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.018673 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.018814 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.018977 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.019064 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.019276 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.019359 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.019581 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.019675 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.019881 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.019966 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.020182 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.020266 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.020478 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.020565 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.020801 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.020890 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.021100 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.021195 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.021396 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.021480 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.021691 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.021775 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.022005 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.022088 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.022303 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.022387 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.022618 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.022709 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.022919 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.023002 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.023215 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.023299 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.023513 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.023647 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.023806 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.023898 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.024140 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.024225 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.024435 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.024533 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.024790 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.024892 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.025080 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.025179 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.025398 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.025493 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.025705 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.025799 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.026013 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.026097 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.026316 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.026398 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.026622 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.026725 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.026928 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.027014 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.027230 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.027313 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.027537 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.027630 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.027836 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.027920 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.028146 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.028259 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.028450 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.028538 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.028780 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.028872 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.029291 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.029383 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.029615 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.029702 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.029921 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.030007 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.030227 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.030312 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.030533 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.030619 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.030836 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.030935 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.031141 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.031236 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.031445 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.031532 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.031748 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.031840 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.032055 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.032154 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.032354 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.032440 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.032690 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.032777 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.033009 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.033104 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.033325 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.033419 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.033653 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.033785 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.034053 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.034221 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.034371 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.034547 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.034694 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.034866 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.035023 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.035172 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.035333 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.035524 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.035657 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.035833 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.035962 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.036143 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.036275 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.036451 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.036593 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.036784 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.036939 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.037099 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.037249 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.037411 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.037557 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.037715 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.037869 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.038044 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.038204 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.038356 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.038497 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.038665 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.038806 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.038967 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.039124 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.039408 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.039507 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.039720 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.039805 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.040045 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.040129 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.040711 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.040809 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.041028 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.041118 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.041341 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.041424 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.041648 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.041739 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.041959 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.042173 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.042475 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.042568 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.042782 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.042867 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.043105 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.043195 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.043422 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.043506 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.043756 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.043850 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.044048 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.044131 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.044372 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.044472 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.044686 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.044777 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.045008 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.045139 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.045290 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.045388 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.045596 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.045700 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.045893 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.045977 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.046191 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.046285 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.046499 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.046582 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.046800 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.046891 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.047093 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.047189 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.047406 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.047490 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.047706 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.047930 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.048226 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.048320 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.048569 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.048698 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.048909 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.048994 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.049239 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.049333 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.049577 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.049711 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.049876 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.049974 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.050200 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.050295 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.050516 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.050601 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.050817 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.050910 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.051137 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.051226 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.051447 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.051530 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.051754 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.051846 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.052057 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.052140 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.052361 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.052454 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.052706 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.052807 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.052990 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.053073 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.053303 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.053395 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.053598 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.053696 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.053893 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.053989 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.054215 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.054332 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.054516 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.054615 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.054820 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.054915 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.055117 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.055254 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.055415 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.055499 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.055715 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.055810 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.056009 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.056093 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.056315 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.056407 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.056608 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.056722 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.056943 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.057028 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.057239 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.057325 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.057542 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.057631 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.057834 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.057917 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.058149 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.058239 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.058485 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.058568 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.058786 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.058886 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.059077 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.059167 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.059394 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.059484 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.059693 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.059787 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.059991 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.060080 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.060300 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.060383 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.060613 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.060754 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.060957 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.061042 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.061264 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.061367 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.061563 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.061665 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.061908 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.061991 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.062225 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.062445 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.062746 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.062832 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.063090 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.063181 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.063412 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.063503 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.063735 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.063821 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.064040 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.064124 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.064347 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.064432 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.064655 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.064774 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.064985 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.065173 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.065408 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.065581 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.065721 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.065899 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.066032 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.066206 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.066343 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.066514 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.066651 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.066818 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.066959 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.067123 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.067265 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.067427 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.067570 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.067729 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.067877 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.068032 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.068184 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.068334 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.068488 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.068677 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.068820 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.068955 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.069130 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.069257 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.069437 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.069563 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.069748 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.069868 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.070088 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.070175 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.070407 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.070493 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.070729 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.070827 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.071043 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.071129 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.071358 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.071444 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.071666 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.071760 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.071972 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.072057 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.072274 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.072359 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.072577 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.072716 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.072906 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.073043 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.073234 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.073355 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.073546 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.073681 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.073849 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.074004 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.074290 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.074525 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.074847 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.074940 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.075173 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.075278 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.075499 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.075654 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.075814 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.075952 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.076138 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.076224 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.076455 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.076550 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.076788 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.076878 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.077095 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.077180 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.077409 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.077506 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.077715 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.077802 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.078063 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.078150 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.078390 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.078486 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.078717 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.078812 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.079023 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.079109 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.079328 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.079424 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.079636 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.079722 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.079933 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.080025 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.080238 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.080325 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.080545 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.080634 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.080899 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.080996 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.081203 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.081345 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.081501 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.081587 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.081801 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.081895 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.082096 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.082194 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.082396 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.082482 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.082696 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.082793 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.082989 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.083075 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.083289 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.083375 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.083583 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.083681 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.083879 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.083965 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.084175 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.084266 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.084469 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.084563 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.084784 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.084875 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.085082 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.085236 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.085382 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.085567 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.085658 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.085745 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.085956 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.086042 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.086249 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.086411 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.086545 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.086631 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.086837 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.086921 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.087159 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.087253 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.087481 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.087566 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.087786 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.087871 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.088096 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.088191 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.088423 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.088524 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.088723 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.088813 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.089027 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.089121 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.089340 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.089425 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.089647 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.089732 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.089951 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.090044 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.090252 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.090339 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.090571 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.090664 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.090870 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.090955 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.091171 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.091257 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.091473 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.091565 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.091772 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.091857 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.092071 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.092157 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.092372 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.092470 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.092762 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.092876 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.093014 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.093101 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.093317 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.093404 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.093633 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.093763 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.093942 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.094028 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.094250 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.094340 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.094552 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.094635 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.094854 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.094939 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.095167 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.095338 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.095468 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.095551 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.095771 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.095872 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.096075 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.096177 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.096421 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.096538 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.096756 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.096906 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.097064 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.097152 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.097448 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.097542 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.097751 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.097846 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.098058 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.098144 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.098364 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.098449 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.098681 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.098768 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.098997 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.099084 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.099297 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.099383 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.099615 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.099703 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.099930 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.100015 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.100265 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.100350 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.100569 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.100676 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.100926 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.101012 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.101247 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.101333 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.101552 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.101639 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.101853 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.101940 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.102093 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 09:57:14.102189 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:57:14.102368 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 09:57:14.257663 n-d-854663-10 devstack@n-api.service[104851]: INFO dbcounter [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Registered counter for database nova_api Oct 27 09:57:14.258774 n-d-854663-10 devstack@n-api.service[104852]: INFO dbcounter [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Registered counter for database nova_api Oct 27 09:57:14.279889 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_db.sqlalchemy.engines [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:57:14.281731 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_db.sqlalchemy.engines [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:57:14.287685 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writer thread running {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:57:14.289319 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writer thread running {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:57:14.344778 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.context [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) {{(pid=104851) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 09:57:14.345240 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.context [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) {{(pid=104852) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 09:57:14.348716 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_concurrency.lockutils [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:14.349098 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:14.349231 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_concurrency.lockutils [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:14.349561 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:14.350782 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_concurrency.lockutils [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:14.351129 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:14.351501 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_concurrency.lockutils [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:14.351820 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:14.351919 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_concurrency.lockutils [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:14.352251 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:14.353990 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_concurrency.lockutils [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:14.354256 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:14.356051 n-d-854663-10 devstack@n-api.service[104851]: INFO dbcounter [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Registered counter for database nova_cell0 Oct 27 09:57:14.356294 n-d-854663-10 devstack@n-api.service[104852]: INFO dbcounter [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Registered counter for database nova_cell0 Oct 27 09:57:14.360314 n-d-854663-10 devstack@n-api.service[104851]: INFO dbcounter [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Registered counter for database nova_cell1 Oct 27 09:57:14.360533 n-d-854663-10 devstack@n-api.service[104852]: INFO dbcounter [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Registered counter for database nova_cell1 Oct 27 09:57:14.368595 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_db.sqlalchemy.engines [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:57:14.370582 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_db.sqlalchemy.engines [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:57:14.373781 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writer thread running {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:57:14.374511 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_db.sqlalchemy.engines [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:57:14.375101 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_db.sqlalchemy.engines [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:57:14.376966 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writer thread running {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:57:14.518062 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writer thread running {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:57:14.518966 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writer thread running {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:57:14.527817 n-d-854663-10 devstack@n-api.service[104851]: INFO dbcounter [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Registered counter for database nova_cell0 Oct 27 09:57:14.528056 n-d-854663-10 devstack@n-api.service[104852]: INFO dbcounter [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Registered counter for database nova_cell0 Oct 27 09:57:14.536639 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_db.sqlalchemy.engines [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:57:14.540083 n-d-854663-10 devstack@n-api.service[104851]: DEBUG oslo_db.sqlalchemy.engines [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:57:14.541603 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writer thread running {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:57:14.546312 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writer thread running {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:57:14.875345 n-d-854663-10 devstack@n-api.service[104852]: WARNING keystonemiddleware.auth_token [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:57:14.875979 n-d-854663-10 devstack@n-api.service[104851]: WARNING keystonemiddleware.auth_token [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:57:14.882883 n-d-854663-10 devstack@n-api.service[104852]: WARNING keystonemiddleware.auth_token [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:57:14.883376 n-d-854663-10 devstack@n-api.service[104851]: WARNING keystonemiddleware.auth_token [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:57:15.223117 n-d-854663-10 devstack@n-api.service[104851]: WARNING keystonemiddleware.auth_token [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:57:15.223314 n-d-854663-10 devstack@n-api.service[104852]: WARNING keystonemiddleware.auth_token [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:57:15.229051 n-d-854663-10 devstack@n-api.service[104851]: WARNING keystonemiddleware.auth_token [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:57:15.229188 n-d-854663-10 devstack@n-api.service[104852]: WARNING keystonemiddleware.auth_token [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:57:15.234317 n-d-854663-10 devstack@n-api.service[104851]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5609b5c7c9c0 pid: 104851 (default app) Oct 27 09:57:15.234478 n-d-854663-10 devstack@n-api.service[104852]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5609b5c7c9c0 pid: 104852 (default app) Oct 27 09:57:15.236344 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:57:15.237644 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-d6904cfb-bc25-4b1f-b0a0-352aa9c43207 None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001801 Oct 27 09:57:15.238044 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Thu Oct 27 09:57:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:58:37.054360 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:37.056376 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002759 Oct 27 09:58:37.056879 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:58:37.068251 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writing DB stats nova_api:SELECT=3 {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:37.069402 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writing DB stats nova_cell1:SELECT=3 {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:37.071435 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writing DB stats nova_cell0:SELECT=3 {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:37.072465 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:37.952271 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-362e35e3-aaef-4c2b-b5ab-63fd596d8162 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:37.985576 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-362e35e3-aaef-4c2b-b5ab-63fd596d8162 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922527 Oct 27 09:58:37.986490 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 2/3] 10.222.0.76 () {60 vars in 1292 bytes} [Thu Oct 27 09:58:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:58:40.605728 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:40.606876 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-4d489e2c-3a1c-4135-85b7-91fe7e1154fe None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 27 09:58:40.607259 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 2/4] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:58:41.065334 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-b1f91768-9aed-41b4-87c8-dcadfc6a3035 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "disk": 1}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:41.113066 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-b1f91768-9aed-41b4-87c8-dcadfc6a3035 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.499504 Oct 27 09:58:41.113642 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 3/5] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:58:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:58:41.127715 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writing DB stats nova_api:SELECT=3 {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:41.128561 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writing DB stats nova_cell0:SELECT=3 {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:41.131729 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writing DB stats nova_cell1:SELECT=3 {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:41.131729 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:41.335507 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-5f1d4342-97e1-4f4d-96eb-8a0c7739919a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:41.408349 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-5f1d4342-97e1-4f4d-96eb-8a0c7739919a admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285789 Oct 27 09:58:41.409084 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 3/6] 10.222.0.76 () {64 vars in 1336 bytes} [Thu Oct 27 09:58:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:58:44.052218 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-b1f91768-9aed-41b4-87c8-dcadfc6a3035 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:44.053311 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-b1f91768-9aed-41b4-87c8-dcadfc6a3035 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Oct 27 09:58:44.054140 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 4/7] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:58:44.867156 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-5c40eb80-d527-4405-8de1-653aa0e6c34b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "id": "d1", "name": "ds512M", "vcpus": 1}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:44.922655 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-5c40eb80-d527-4405-8de1-653aa0e6c34b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.862710 Oct 27 09:58:44.930361 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 4/8] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:58:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:58:44.935860 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-c5b4ae02-b203-42bd-853b-0bcaeb52622d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:45.009981 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-c5b4ae02-b203-42bd-853b-0bcaeb52622d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078059 Oct 27 09:58:45.014133 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 5/9] 10.222.0.76 () {64 vars in 1336 bytes} [Thu Oct 27 09:58:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:58:47.907331 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-5c40eb80-d527-4405-8de1-653aa0e6c34b admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:47.908442 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-5c40eb80-d527-4405-8de1-653aa0e6c34b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 27 09:58:47.913198 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:58:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:58:48.385439 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-5b3c1b3b-3641-491e-b16a-ceb16967cd3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:48.417900 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-5b3c1b3b-3641-491e-b16a-ceb16967cd3c admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.499139 Oct 27 09:58:48.418869 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 6/11] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:58:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:58:48.431273 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-bf7c890d-aa56-44b0-ba88-8a81d8d90481 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:48.461796 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-bf7c890d-aa56-44b0-ba88-8a81d8d90481 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034244 Oct 27 09:58:48.462731 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 6/12] 10.222.0.76 () {64 vars in 1336 bytes} [Thu Oct 27 09:58:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:58:51.056650 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-5b3c1b3b-3641-491e-b16a-ceb16967cd3c admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:51.057675 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-5b3c1b3b-3641-491e-b16a-ceb16967cd3c admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Oct 27 09:58:51.058308 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 7/13] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:58:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:58:51.518222 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-8e53d86d-140b-457d-b489-f2c2cae55de8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "name": "ds2G", "id": "d3", "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:51.542450 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-8e53d86d-140b-457d-b489-f2c2cae55de8 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477758 Oct 27 09:58:51.543252 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 7/14] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:58:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:58:51.555905 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-1061b625-a5bb-4d86-8e22-bfb415e4f2fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:51.589271 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-1061b625-a5bb-4d86-8e22-bfb415e4f2fe admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037240 Oct 27 09:58:51.593149 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 8/15] 10.222.0.76 () {64 vars in 1336 bytes} [Thu Oct 27 09:58:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:58:54.273455 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-8e53d86d-140b-457d-b489-f2c2cae55de8 admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:54.275184 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-8e53d86d-140b-457d-b489-f2c2cae55de8 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002338 Oct 27 09:58:54.281027 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 8/16] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:58:54 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:58:54.699742 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-218458e0-9831-49fe-b87b-0b485c59eab9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "swap": 0, "id": "d4"}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:54.721720 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-218458e0-9831-49fe-b87b-0b485c59eab9 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439331 Oct 27 09:58:54.723049 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 9/17] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:58:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:58:54.735524 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-b52c20d8-38c1-442f-90e7-892d53b99ad4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:58:54.767094 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-b52c20d8-38c1-442f-90e7-892d53b99ad4 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035296 Oct 27 09:58:54.768440 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 9/18] 10.222.0.76 () {64 vars in 1336 bytes} [Thu Oct 27 09:58:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:58:57.435194 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-218458e0-9831-49fe-b87b-0b485c59eab9 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:57.437635 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-218458e0-9831-49fe-b87b-0b485c59eab9 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002849 Oct 27 09:58:57.438068 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 10/19] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:58:57.889989 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-8523819a-39bb-429b-96a8-6782d48c341f admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:57.915168 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-8523819a-39bb-429b-96a8-6782d48c341f admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470545 Oct 27 09:58:57.915733 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 10/20] 10.222.0.76 () {60 vars in 1292 bytes} [Thu Oct 27 09:58:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:59:00.569397 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-218458e0-9831-49fe-b87b-0b485c59eab9 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:00.570417 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-218458e0-9831-49fe-b87b-0b485c59eab9 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 27 09:59:00.570814 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 11/21] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:01.026374 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-4428e207-8dbe-40a8-b934-4f98c7f08c9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "ram": 512}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:01.047818 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-4428e207-8dbe-40a8-b934-4f98c7f08c9b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.470685 Oct 27 09:59:01.048380 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 11/22] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:59:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:59:01.061319 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-d7239290-9665-49fd-bd70-4c9b169e91b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:01.090713 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-d7239290-9665-49fd-bd70-4c9b169e91b8 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033623 Oct 27 09:59:01.091422 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 12/23] 10.222.0.76 () {64 vars in 1333 bytes} [Thu Oct 27 09:59:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:59:03.726524 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-4428e207-8dbe-40a8-b934-4f98c7f08c9b admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:03.727545 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-4428e207-8dbe-40a8-b934-4f98c7f08c9b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 27 09:59:03.727946 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 12/24] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:04.142179 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-a55ea8f0-487f-4527-ad75-36ae473ff2cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "swap": 0, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:04.162537 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-a55ea8f0-487f-4527-ad75-36ae473ff2cc admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.428023 Oct 27 09:59:04.163125 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 13/25] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:59:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:59:04.175625 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-eb994268-dc0f-4832-83ba-ab6940fc0409 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:04.202122 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-eb994268-dc0f-4832-83ba-ab6940fc0409 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030236 Oct 27 09:59:04.202703 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 13/26] 10.222.0.76 () {64 vars in 1333 bytes} [Thu Oct 27 09:59:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:59:06.783946 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-a55ea8f0-487f-4527-ad75-36ae473ff2cc admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:06.785009 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-a55ea8f0-487f-4527-ad75-36ae473ff2cc admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 27 09:59:06.785377 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 14/27] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:07.206333 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-4eb2e040-1c7f-4212-a59a-82559bb86492 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:07.227900 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-4eb2e040-1c7f-4212-a59a-82559bb86492 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.435751 Oct 27 09:59:07.228814 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 14/28] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:59:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:59:07.242382 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-81930bc0-a6d9-46da-b2c4-d37bba66dcf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:07.247835 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:07.271675 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-81930bc0-a6d9-46da-b2c4-d37bba66dcf3 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033461 Oct 27 09:59:07.272251 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 15/29] 10.222.0.76 () {64 vars in 1333 bytes} [Thu Oct 27 09:59:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:59:09.897826 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-4eb2e040-1c7f-4212-a59a-82559bb86492 admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:09.899495 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-4eb2e040-1c7f-4212-a59a-82559bb86492 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Oct 27 09:59:09.899892 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 15/30] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:10.334247 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-88ea27bf-5001-4376-878d-ce57e0512cc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:10.354547 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-88ea27bf-5001-4376-878d-ce57e0512cc6 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448486 Oct 27 09:59:10.362912 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 16/31] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:59:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:59:10.367925 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-b2f788da-311e-4af4-8225-92f3b4d8390d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:10.393158 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-b2f788da-311e-4af4-8225-92f3b4d8390d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029000 Oct 27 09:59:10.394011 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 16/32] 10.222.0.76 () {64 vars in 1333 bytes} [Thu Oct 27 09:59:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:59:13.003335 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-88ea27bf-5001-4376-878d-ce57e0512cc6 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:13.004276 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-88ea27bf-5001-4376-878d-ce57e0512cc6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 27 09:59:13.004692 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 17/33] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:13.455690 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-b834fc7c-9dfd-4bba-9c5f-81cd6186fc8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5"}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:13.462854 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:13.479299 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-b834fc7c-9dfd-4bba-9c5f-81cd6186fc8b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.468486 Oct 27 09:59:13.480150 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 17/34] 10.222.0.76 () {64 vars in 1283 bytes} [Thu Oct 27 09:59:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:59:13.492503 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-ab3bcebe-e752-448c-92f1-40f9fcaed084 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:13.519718 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-ab3bcebe-e752-448c-92f1-40f9fcaed084 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031186 Oct 27 09:59:13.520427 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 18/35] 10.222.0.76 () {64 vars in 1333 bytes} [Thu Oct 27 09:59:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:59:34.676270 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-b834fc7c-9dfd-4bba-9c5f-81cd6186fc8b admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:34.677330 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-b834fc7c-9dfd-4bba-9c5f-81cd6186fc8b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 27 09:59:34.677759 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 18/36] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 09:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:34.692464 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:35.124349 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-52530310-81ec-4e77-b709-c63bf4ac4cea admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:35.142393 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-52530310-81ec-4e77-b709-c63bf4ac4cea admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.457642 Oct 27 09:59:35.142931 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 19/37] 10.222.0.76 () {60 vars in 1292 bytes} [Thu Oct 27 09:59:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:59:36.457200 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-b834fc7c-9dfd-4bba-9c5f-81cd6186fc8b admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:36.458214 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-b834fc7c-9dfd-4bba-9c5f-81cd6186fc8b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 27 09:59:36.458620 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 19/38] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 09:59:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:37.036043 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-ca5ab7b0-b72c-4098-b0b0-275638ec7b49 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:37.041729 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.wsgi [None req-ca5ab7b0-b72c-4098-b0b0-275638ec7b49 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-ca5ab7b0-b72c-4098-b0b0-275638ec7b49 admin admin] Request method failure captured: Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: Accept: application/json Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: Accept-Encoding: gzip, deflate Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: Connection: keep-alive Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: Content-Length: 0 Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: Host: 10.222.0.76 Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: Openstack-Api-Version: compute 2.92 Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: Openstack-System-Scope: None Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: User-Agent: python-novaclient Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Auth-Token: gAAAAABjWlaItB2URWw6x3uSDU7jVE5kXcMYqVzniwnIxtr4F3mcZ40xTlmKzudAuUCwfgA0haKDTMFPAp-AY7nArHv9yQ5KMav4RV-AbWThGnqUmCCgpqRgNEkvblC23upRNN1lPYH8CT8VyuegXF1owz6qucUgqDX3-UtJDTfkAKaRavBTxx0 Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Domain-Id: None Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Domain-Name: None Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Identity-Status: Confirmed Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Is-Admin-Project: True Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Domain-Id: default Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Domain-Name: Default Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Name: admin Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Role: member,admin,reader Oct 27 09:59:37.044977 n-d-854663-10 devstack@n-api.service[104851]: X-Roles: member,admin,reader Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cea32a4db8c24ea397e127b87ca2442e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: X-Tenant: admin Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: X-Tenant-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: X-Tenant-Name: admin Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: X-User: admin Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: X-User-Domain-Id: default Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: X-User-Domain-Name: Default Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: X-User-Id: d4716ee1854e40859ee11f500ee74d30 Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: X-User-Name: admin Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: method: > Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: exception: Flavor 42 could not be found. Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: action_args: {'id': '42'} Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:59:37.046615 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:37.047777 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.049312 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-ca5ab7b0-b72c-4098-b0b0-275638ec7b49 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:59:37.050614 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-ca5ab7b0-b72c-4098-b0b0-275638ec7b49 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.436037 Oct 27 09:59:37.050614 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 20/39] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 27 09:59:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:37.057081 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-56b03c78-4adb-4c6d-8f74-12b9da39b739 admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:37.079444 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-56b03c78-4adb-4c6d-8f74-12b9da39b739 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026741 Oct 27 09:59:37.079992 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 20/40] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 27 09:59:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:59:37.102026 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-c08cc363-959a-423e-929b-41fb88ae2667 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:37.124127 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-c08cc363-959a-423e-929b-41fb88ae2667 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026819 Oct 27 09:59:37.124689 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 21/41] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 27 09:59:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:59:37.136989 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-6e39307d-8b34-4eaa-bce8-6d796dc48001 admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:37.145305 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.wsgi [None req-6e39307d-8b34-4eaa-bce8-6d796dc48001 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-6e39307d-8b34-4eaa-bce8-6d796dc48001 admin admin] Request method failure captured: Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: Accept: application/json Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: Accept-Encoding: gzip, deflate Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: Connection: keep-alive Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: Content-Length: 0 Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: Host: 10.222.0.76 Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: Openstack-Api-Version: compute 2.92 Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: Openstack-System-Scope: None Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: User-Agent: python-novaclient Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Auth-Token: gAAAAABjWlaItB2URWw6x3uSDU7jVE5kXcMYqVzniwnIxtr4F3mcZ40xTlmKzudAuUCwfgA0haKDTMFPAp-AY7nArHv9yQ5KMav4RV-AbWThGnqUmCCgpqRgNEkvblC23upRNN1lPYH8CT8VyuegXF1owz6qucUgqDX3-UtJDTfkAKaRavBTxx0 Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Domain-Id: None Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Domain-Name: None Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Identity-Status: Confirmed Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Is-Admin-Project: True Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Domain-Id: default Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Domain-Name: Default Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Name: admin Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Role: member,admin,reader Oct 27 09:59:37.150005 n-d-854663-10 devstack@n-api.service[104852]: X-Roles: member,admin,reader Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cea32a4db8c24ea397e127b87ca2442e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: X-Tenant: admin Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: X-Tenant-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: X-Tenant-Name: admin Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: X-User: admin Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: X-User-Domain-Id: default Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: X-User-Domain-Name: Default Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: X-User-Id: d4716ee1854e40859ee11f500ee74d30 Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: X-User-Name: admin Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: method: > Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: exception: Flavor 42 could not be found. Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: action_args: {'id': '42'} Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:59:37.151560 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:37.152573 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:37.153820 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-6e39307d-8b34-4eaa-bce8-6d796dc48001 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:59:37.155068 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-6e39307d-8b34-4eaa-bce8-6d796dc48001 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.020461 Oct 27 09:59:37.155068 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 21/42] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 27 09:59:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:38.366215 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-c08cc363-959a-423e-929b-41fb88ae2667 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:38.367233 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-c08cc363-959a-423e-929b-41fb88ae2667 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 27 09:59:38.367625 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 22/43] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 09:59:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:38.953309 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-b4006bd5-3e9e-4ab0-bcf2-c59a5b93dffb admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:38.958513 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.wsgi [None req-b4006bd5-3e9e-4ab0-bcf2-c59a5b93dffb admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-b4006bd5-3e9e-4ab0-bcf2-c59a5b93dffb admin admin] Request method failure captured: Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: Accept: application/json Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: Accept-Encoding: gzip, deflate Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: Connection: keep-alive Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: Content-Length: 0 Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: Host: 10.222.0.76 Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: Openstack-Api-Version: compute 2.92 Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: Openstack-System-Scope: None Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: User-Agent: python-novaclient Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Auth-Token: gAAAAABjWlaKQupgvhC5KDexKhzIYQ3GBwC5J15bOafOEavrasE7ac_L-XhMJqFgXplRFvbeIreJiPW5BnyxvKg1y8dYSBntulAWrzanHPMJLLjopxbLcSjMGgNc_ArosXQmurvdmGnWn_dall-cu55dEOHoT1yOpI7-TH5TV0A4UTquq0yk2Xs Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Domain-Id: None Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Domain-Name: None Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Identity-Status: Confirmed Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Is-Admin-Project: True Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Domain-Id: default Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Domain-Name: Default Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Name: admin Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Role: member,admin,reader Oct 27 09:59:38.960104 n-d-854663-10 devstack@n-api.service[104852]: X-Roles: member,admin,reader Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cea32a4db8c24ea397e127b87ca2442e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: X-Tenant: admin Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: X-Tenant-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: X-Tenant-Name: admin Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: X-User: admin Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: X-User-Domain-Id: default Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: X-User-Domain-Name: Default Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: X-User-Id: d4716ee1854e40859ee11f500ee74d30 Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: X-User-Name: admin Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: method: > Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: exception: Flavor 84 could not be found. Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: action_args: {'id': '84'} Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:59:38.961445 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:38.962427 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:38.963495 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-b4006bd5-3e9e-4ab0-bcf2-c59a5b93dffb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:59:38.964708 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-b4006bd5-3e9e-4ab0-bcf2-c59a5b93dffb admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.458369 Oct 27 09:59:38.964708 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 22/44] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 27 09:59:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 460 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:38.975768 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-16d0a4a6-796a-4dee-a9ec-27957d9510f2 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:38.992912 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-16d0a4a6-796a-4dee-a9ec-27957d9510f2 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022933 Oct 27 09:59:38.993443 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 23/45] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 27 09:59:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:59:39.003645 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-e2a1936d-0b57-4547-82d3-d5174520238a admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:39.020867 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-e2a1936d-0b57-4547-82d3-d5174520238a admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021297 Oct 27 09:59:39.021397 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 23/46] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 27 09:59:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:59:39.031546 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-de1fdc15-0f57-4dd0-8f9c-7736f838231f admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:39.038480 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.wsgi [None req-de1fdc15-0f57-4dd0-8f9c-7736f838231f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-de1fdc15-0f57-4dd0-8f9c-7736f838231f admin admin] Request method failure captured: Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: Accept: application/json Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: Accept-Encoding: gzip, deflate Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: Connection: keep-alive Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: Content-Length: 0 Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: Host: 10.222.0.76 Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: Openstack-Api-Version: compute 2.92 Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: Openstack-System-Scope: None Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: User-Agent: python-novaclient Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Auth-Token: gAAAAABjWlaKQupgvhC5KDexKhzIYQ3GBwC5J15bOafOEavrasE7ac_L-XhMJqFgXplRFvbeIreJiPW5BnyxvKg1y8dYSBntulAWrzanHPMJLLjopxbLcSjMGgNc_ArosXQmurvdmGnWn_dall-cu55dEOHoT1yOpI7-TH5TV0A4UTquq0yk2Xs Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Domain-Id: None Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Domain-Name: None Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Identity-Status: Confirmed Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Is-Admin-Project: True Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Domain-Id: default Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Domain-Name: Default Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Name: admin Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Role: member,admin,reader Oct 27 09:59:39.040002 n-d-854663-10 devstack@n-api.service[104851]: X-Roles: member,admin,reader Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cea32a4db8c24ea397e127b87ca2442e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: X-Tenant: admin Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: X-Tenant-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: X-Tenant-Name: admin Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: X-User: admin Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: X-User-Domain-Id: default Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: X-User-Domain-Name: Default Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: X-User-Id: d4716ee1854e40859ee11f500ee74d30 Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: X-User-Name: admin Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: method: > Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: exception: Flavor 84 could not be found. Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: action_args: {'id': '84'} Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:59:39.041688 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:39.043730 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:39.044929 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-de1fdc15-0f57-4dd0-8f9c-7736f838231f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:59:39.046016 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-de1fdc15-0f57-4dd0-8f9c-7736f838231f admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013787 Oct 27 09:59:39.046016 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 24/47] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 27 09:59:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 27 09:59:40.275633 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-e2a1936d-0b57-4547-82d3-d5174520238a admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:40.276648 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-e2a1936d-0b57-4547-82d3-d5174520238a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 27 09:59:40.277216 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 24/48] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 09:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:40.834945 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-f46ff47f-eb9f-4af7-abbf-db0c77923a96 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:40.841405 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.wsgi [None req-f46ff47f-eb9f-4af7-abbf-db0c77923a96 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-f46ff47f-eb9f-4af7-abbf-db0c77923a96 admin admin] Request method failure captured: Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: Accept: application/json Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: Accept-Encoding: gzip, deflate Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: Connection: keep-alive Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: Content-Length: 0 Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: Host: 10.222.0.76 Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: Openstack-Api-Version: compute 2.92 Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: Openstack-System-Scope: None Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: User-Agent: python-novaclient Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Auth-Token: gAAAAABjWlaMTRFlWkksO0wF8LRVTAHtdWxsP_IHJkzQ9iXvpOT0qrVT_PuK1M8ktgzHuFRtEevn_c05dJZjQWBcrcgGcQsffz_dHB4yk2g5V1PQ5AawQ5wp0eTnA6jWs_VCMPaf3Lt6kCwiK3vg4OUPzzCmrf1G8WHUUV-DNP1iMnz15ferN40 Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Domain-Id: None Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Domain-Name: None Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Identity-Status: Confirmed Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Is-Admin-Project: True Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Domain-Id: default Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Domain-Name: Default Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Project-Name: admin Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Role: member,admin,reader Oct 27 09:59:40.842871 n-d-854663-10 devstack@n-api.service[104851]: X-Roles: member,admin,reader Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cea32a4db8c24ea397e127b87ca2442e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: X-Tenant: admin Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: X-Tenant-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: X-Tenant-Name: admin Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: X-User: admin Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: X-User-Domain-Id: default Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: X-User-Domain-Name: Default Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: X-User-Id: d4716ee1854e40859ee11f500ee74d30 Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: X-User-Name: admin Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: method: > Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: exception: Flavor 451 could not be found. Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: action_args: {'id': '451'} Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:59:40.844478 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:40.845780 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.847600 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-f46ff47f-eb9f-4af7-abbf-db0c77923a96 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:59:40.849118 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-f46ff47f-eb9f-4af7-abbf-db0c77923a96 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.430388 Oct 27 09:59:40.849118 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 25/49] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 27 09:59:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:40.856718 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-827b1c3a-e226-4696-9b27-2b9db7fdc16d admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:40.871703 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-827b1c3a-e226-4696-9b27-2b9db7fdc16d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018827 Oct 27 09:59:40.872371 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 25/50] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 27 09:59:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:59:40.882753 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:40.898031 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018948 Oct 27 09:59:40.898592 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 26/51] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 27 09:59:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:59:40.908561 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-bb305a00-0aca-47f2-85f1-238525d04c72 admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:40.914466 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.wsgi [None req-bb305a00-0aca-47f2-85f1-238525d04c72 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-bb305a00-0aca-47f2-85f1-238525d04c72 admin admin] Request method failure captured: Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: Accept: application/json Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: Accept-Encoding: gzip, deflate Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: Connection: keep-alive Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: Content-Length: 0 Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: Host: 10.222.0.76 Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: Openstack-Api-Version: compute 2.92 Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: Openstack-System-Scope: None Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: User-Agent: python-novaclient Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Auth-Token: gAAAAABjWlaMTRFlWkksO0wF8LRVTAHtdWxsP_IHJkzQ9iXvpOT0qrVT_PuK1M8ktgzHuFRtEevn_c05dJZjQWBcrcgGcQsffz_dHB4yk2g5V1PQ5AawQ5wp0eTnA6jWs_VCMPaf3Lt6kCwiK3vg4OUPzzCmrf1G8WHUUV-DNP1iMnz15ferN40 Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Domain-Id: None Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Domain-Name: None Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Identity-Status: Confirmed Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Is-Admin-Project: True Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Domain-Id: default Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Domain-Name: Default Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Project-Name: admin Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Role: member,admin,reader Oct 27 09:59:40.916312 n-d-854663-10 devstack@n-api.service[104852]: X-Roles: member,admin,reader Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cea32a4db8c24ea397e127b87ca2442e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cea32a4db8c24ea397e127b87ca2442e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: X-Tenant: admin Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: X-Tenant-Id: cea32a4db8c24ea397e127b87ca2442e Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: X-Tenant-Name: admin Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: X-User: admin Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: X-User-Domain-Id: default Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: X-User-Domain-Name: Default Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: X-User-Id: d4716ee1854e40859ee11f500ee74d30 Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: X-User-Name: admin Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: method: > Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: exception: Flavor 451 could not be found. Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: action_args: {'id': '451'} Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:59:40.917945 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:40.920412 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: ERROR nova.api.openstack.wsgi Oct 27 09:59:40.921901 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-bb305a00-0aca-47f2-85f1-238525d04c72 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:59:40.923167 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-bb305a00-0aca-47f2-85f1-238525d04c72 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013093 Oct 27 09:59:40.923167 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 26/52] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 27 09:59:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:42.136382 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:42.137509 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Oct 27 09:59:42.137926 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 27/53] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 09:59:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:42.719179 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-2973a68a-aec3-41ac-8078-ffb0b7b793e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:42.740195 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-2973a68a-aec3-41ac-8078-ffb0b7b793e6 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.464607 Oct 27 09:59:42.740755 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 27/54] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Oct 27 09:59:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:59:43.949829 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:43.950858 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 27 09:59:43.951252 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 28/55] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 09:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:44.540511 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-19ea4af6-c1fc-4d4c-9b05-4f58ef8f10b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:44.566271 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-19ea4af6-c1fc-4d4c-9b05-4f58ef8f10b5 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.480161 Oct 27 09:59:44.566845 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 28/56] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Oct 27 09:59:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:59:45.773802 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:45.774824 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 27 09:59:45.775232 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 29/57] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 09:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:46.322157 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-f3f5bb25-cc48-4ee3-84eb-cea4c7e1bb47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:46.343637 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-f3f5bb25-cc48-4ee3-84eb-cea4c7e1bb47 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.434092 Oct 27 09:59:46.344172 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 29/58] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Oct 27 09:59:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:59:47.561917 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:47.562940 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 27 09:59:47.563333 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 30/59] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 09:59:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:48.143927 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-695664c9-aa58-4109-b44d-d650f74125e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:48.169984 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-695664c9-aa58-4109-b44d-d650f74125e7 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.463185 Oct 27 09:59:48.170668 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 30/60] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Oct 27 09:59:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:59:49.419343 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:49.420346 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 27 09:59:49.420770 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 31/61] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 09:59:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:59:49.989056 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-2b869d7a-5c53-41b3-9d8c-a11c1724605b admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:50.012078 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-2b869d7a-5c53-41b3-9d8c-a11c1724605b admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.454582 Oct 27 09:59:50.012888 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 31/62] 10.222.0.76 () {60 vars in 1202 bytes} [Thu Oct 27 09:59:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:00:47.268270 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:00:47.269218 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-30b391d2-7a71-4b56-a773-1c386ced5255 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Oct 27 10:00:47.269622 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 32/63] 10.222.0.76 () {54 vars in 931 bytes} [Thu Oct 27 10:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:00:47.284288 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:47.693429 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-50fa6c17-e8b2-4407-9c46-e260d17dc05a admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:00:47.715154 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-50fa6c17-e8b2-4407-9c46-e260d17dc05a admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.438819 Oct 27 10:00:47.715739 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 32/64] 10.222.0.76 () {60 vars in 1292 bytes} [Thu Oct 27 10:00:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:00:47.737342 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writing DB stats nova_api:SELECT=14 {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:47.741145 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-0c334714-1405-46d7-a325-fc8c4226bfc3 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:00:47.749381 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-0c334714-1405-46d7-a325-fc8c4226bfc3 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013491 Oct 27 10:00:47.749907 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 33/65] 10.222.0.76 () {60 vars in 1283 bytes} [Thu Oct 27 10:00:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:00:47.762137 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-a80707cc-a5ec-44e0-a2d9-ef7a0409593e admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:00:47.769808 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-a80707cc-a5ec-44e0-a2d9-ef7a0409593e admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011446 Oct 27 10:00:47.770305 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 33/66] 10.222.0.76 () {60 vars in 1286 bytes} [Thu Oct 27 10:00:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:00:47.785255 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-693e6521-da9f-4f05-bed1-add4775a55f6 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:00:47.793036 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-693e6521-da9f-4f05-bed1-add4775a55f6 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011277 Oct 27 10:00:47.793484 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 34/67] 10.222.0.76 () {60 vars in 1286 bytes} [Thu Oct 27 10:00:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:00:47.805239 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-d8fce6bf-402b-4ba1-93af-2fef21e71e58 admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:00:47.812872 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-d8fce6bf-402b-4ba1-93af-2fef21e71e58 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011273 Oct 27 10:00:47.813389 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 34/68] 10.222.0.76 () {60 vars in 1283 bytes} [Thu Oct 27 10:00:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:06:21.206069 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-693e6521-da9f-4f05-bed1-add4775a55f6 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:21.207085 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-693e6521-da9f-4f05-bed1-add4775a55f6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Oct 27 10:06:21.207473 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 35/69] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 10:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:06:21.348274 n-d-854663-10 devstack@n-api.service[104852]: DEBUG dbcounter [-] [104852] Writing DB stats nova_api:SELECT=6 {{(pid=104852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:21.505156 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-ea08e79f-52bf-4559-bbcd-76a1b20cf54a admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:21.510242 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-52bf-4559-bbcd-76a1b20cf54a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:21.510714 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-52bf-4559-bbcd-76a1b20cf54a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:21.511137 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-52bf-4559-bbcd-76a1b20cf54a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:21.511841 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-52bf-4559-bbcd-76a1b20cf54a admin admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:21.512284 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-52bf-4559-bbcd-76a1b20cf54a admin admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:21.512698 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-52bf-4559-bbcd-76a1b20cf54a admin admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:21.551799 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-ea08e79f-52bf-4559-bbcd-76a1b20cf54a admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.205910 Oct 27 10:06:21.552411 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 35/70] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 27 10:06:21 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:06:22.639714 n-d-854663-10 devstack@n-api.service[104851]: DEBUG nova.api.openstack.wsgi [None req-693e6521-da9f-4f05-bed1-add4775a55f6 admin admin] Calling method '>' {{(pid=104851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:22.640800 n-d-854663-10 devstack@n-api.service[104851]: INFO nova.api.openstack.requestlog [None req-693e6521-da9f-4f05-bed1-add4775a55f6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 27 10:06:22.641199 n-d-854663-10 devstack@n-api.service[104851]: [pid: 104851|app: 0|req: 36/71] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 27 10:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:06:22.846008 n-d-854663-10 devstack@n-api.service[104852]: DEBUG nova.api.openstack.wsgi [None req-be234e68-71db-497c-bf90-22e5523de9bf admin admin] Calling method '>' {{(pid=104852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:22.849542 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-be234e68-71db-497c-bf90-22e5523de9bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:22.850023 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-be234e68-71db-497c-bf90-22e5523de9bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:22.850495 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-be234e68-71db-497c-bf90-22e5523de9bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:22.851224 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-be234e68-71db-497c-bf90-22e5523de9bf admin admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:22.851676 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-be234e68-71db-497c-bf90-22e5523de9bf admin admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:22.852094 n-d-854663-10 devstack@n-api.service[104852]: DEBUG oslo_concurrency.lockutils [None req-be234e68-71db-497c-bf90-22e5523de9bf admin admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:22.875229 n-d-854663-10 devstack@n-api.service[104852]: INFO nova.api.openstack.requestlog [None req-be234e68-71db-497c-bf90-22e5523de9bf admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.091885 Oct 27 10:06:22.875779 n-d-854663-10 devstack@n-api.service[104852]: [pid: 104852|app: 0|req: 36/72] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 27 10:06:22 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:07:08.609786 n-d-854663-10 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 10:07:08.610623 n-d-854663-10 devstack@n-api.service[104850]: Thu Oct 27 10:07:08 2022 - graceful shutdown triggered... Oct 27 10:07:08.611101 n-d-854663-10 devstack@n-api.service[104851]: Gracefully killing worker 1 (pid: 104851)... Oct 27 10:07:08.611468 n-d-854663-10 devstack@n-api.service[104852]: Gracefully killing worker 2 (pid: 104852)... Oct 27 10:07:08.740780 n-d-854663-10 devstack@n-api.service[104851]: DEBUG dbcounter [-] [104851] Writing DB stats nova_api:SELECT=4 {{(pid=104851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:09.611562 n-d-854663-10 devstack@n-api.service[104850]: worker 1 buried after 1 seconds Oct 27 10:07:09.611562 n-d-854663-10 devstack@n-api.service[104850]: worker 2 buried after 1 seconds Oct 27 10:07:09.611562 n-d-854663-10 devstack@n-api.service[104850]: goodbye to uWSGI. Oct 27 10:07:09.614133 n-d-854663-10 systemd[1]: devstack@n-api.service: Succeeded. Oct 27 10:07:09.615048 n-d-854663-10 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 10:07:09.619393 n-d-854663-10 systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 10:07:09.634442 n-d-854663-10 devstack@n-api.service[120704]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 10:07:09 2022] *** Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: nodename: n-d-854663-10 Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: machine: x86_64 Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: clock source: unix Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: pcre jit disabled Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: detected number of CPU cores: 4 Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: current working directory: / Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: detected binary path: /usr/bin/uwsgi-core Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: your processes number limit is 47680 Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: your memory page size is 4096 bytes Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: detected max file descriptor number: 2048 Oct 27 10:07:09.649464 n-d-854663-10 devstack@n-api.service[120704]: lock engine: pthread robust mutexes Oct 27 10:07:09.650664 n-d-854663-10 devstack@n-api.service[120704]: thunder lock: enabled Oct 27 10:07:09.650664 n-d-854663-10 devstack@n-api.service[120704]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 10:07:09.650664 n-d-854663-10 devstack@n-api.service[120704]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 10:07:09.689964 n-d-854663-10 devstack@n-api.service[120704]: Python main interpreter initialized at 0x557462aa59c0 Oct 27 10:07:09.689964 n-d-854663-10 devstack@n-api.service[120704]: python threads support enabled Oct 27 10:07:09.689964 n-d-854663-10 devstack@n-api.service[120704]: your server socket listen backlog is limited to 100 connections Oct 27 10:07:09.689964 n-d-854663-10 devstack@n-api.service[120704]: your mercy for graceful operations on workers is 90 seconds Oct 27 10:07:09.690398 n-d-854663-10 devstack@n-api.service[120704]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 10:07:09.690398 n-d-854663-10 devstack@n-api.service[120704]: *** Operational MODE: preforking *** Oct 27 10:07:09.690689 n-d-854663-10 devstack@n-api.service[120704]: *** uWSGI is running in multiple interpreter mode *** Oct 27 10:07:09.690689 n-d-854663-10 devstack@n-api.service[120704]: spawned uWSGI master process (pid: 120704) Oct 27 10:07:09.690772 n-d-854663-10 systemd[1]: Started Devstack devstack@n-api.service. Oct 27 10:07:09.691879 n-d-854663-10 devstack@n-api.service[120704]: spawned uWSGI worker 1 (pid: 120719, cores: 1) Oct 27 10:07:09.691879 n-d-854663-10 devstack@n-api.service[120704]: spawned uWSGI worker 2 (pid: 120720, cores: 1) Oct 27 10:07:09.691879 n-d-854663-10 devstack@n-api.service[120704]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 10:07:10.345972 n-d-854663-10 devstack@n-api.service[120719]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 10:07:10.347660 n-d-854663-10 devstack@n-api.service[120720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 10:07:11.590009 n-d-854663-10 devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 10:07:11.590009 n-d-854663-10 devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Oct 27 10:07:11.590899 n-d-854663-10 devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 10:07:11.590899 n-d-854663-10 devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Oct 27 10:07:11.594060 n-d-854663-10 devstack@n-api.service[120719]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 10:07:11.594060 n-d-854663-10 devstack@n-api.service[120719]: from cryptography.utils import int_from_bytes Oct 27 10:07:11.594582 n-d-854663-10 devstack@n-api.service[120719]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 10:07:11.594582 n-d-854663-10 devstack@n-api.service[120719]: from cryptography.utils import int_from_bytes Oct 27 10:07:14.021001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 10:07:14.021713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 10:07:14.021817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 10:07:14.022178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 10:07:14.022441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 10:07:14.022858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.023167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.023493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.023838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.024160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.024484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.024843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.025184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.025507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.025768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.026065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.026390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854663-10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.026717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.027024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.027405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.027724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.028029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.028353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.028683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.029177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.029635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.029944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.030258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.030601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.030917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.031226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.031548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.031859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.032182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.032494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.032918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854663-10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.033236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.033550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.033860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.034273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.034904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.035209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.035530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.035878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.036167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.036497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.036842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.037165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.037485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.037790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.038093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.038401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.038720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.039022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.039325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.039574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.039881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.040203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.040524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.040869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.041123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.041373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.041691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.042009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.042316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.042624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.042972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.043286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.043615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.044000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.044308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.044613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.045035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.045358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.045682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.045990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.046314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.046721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.046972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.047281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.047623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.047943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.048283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.048570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.049108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.049419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.049732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.050045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.050367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.050704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.051012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.051262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.051591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.051898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.052215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.052522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.052857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.053162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.053314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 10:07:14.053746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.053858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 10:07:14.053956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.054042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.054138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 10:07:14.054322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.054437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 10:07:14.054658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.054817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 10:07:14.054919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.055070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.055256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.055456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.055565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.055655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.055832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.055944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.056164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.056313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.056444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.056543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.056819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.056974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.057140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.057278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.057422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.057526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.057755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.057897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.058029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.058138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.058450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854663-10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.058612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.058745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.059038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.059364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.059455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.059551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.059642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.059810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.059992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.060149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.060305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.060446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.060647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.060933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.061082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.061231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.061368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.061543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.061728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.061864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.062001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.062140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.062279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.062432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.062580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.062732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.062871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.063008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.063148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.063284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.063447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.063662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.063805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.064033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.064183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.064356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.064578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.064742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.064892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854663-10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.065050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.065217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.065355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.065576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.065742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.065918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.066065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.066224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.066373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.066524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.066675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.066841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.066976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.067131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.067274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.067274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.067544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.067544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.067838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.068008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.068173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.068402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.068544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.068711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.068819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.068916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.069011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.069098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.069183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.069267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.069359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.069462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.069623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.069966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.070108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.070288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.070494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.074192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.074396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.074627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.074802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.074922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.075000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.075119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.075284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.075444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.075683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.075840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.075982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.075982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.076266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.076406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.076563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.076741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.076890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.077059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.077213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.077354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.077506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.077646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.077791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.077939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.078088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.078227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.078403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.078563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.078563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.078957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.079108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.079257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.079408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.079554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.079700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.079837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.079972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.080134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.080274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.080421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.080421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.080723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.080858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.080962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.081093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.081190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.081277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.081368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.081461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.081556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.081642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.081739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.081825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.081916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.082009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.082111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.082197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.082289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.082382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.082468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.082561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.082647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.082737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.082829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.082922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.083015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.083110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.083207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.083300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.083394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.083480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.083564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.083564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.083736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.083817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.083955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.084045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.084128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.084265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.084355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.084449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.084540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.084625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.084763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.084911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.085007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.085106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.085192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.085276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.085374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.085512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.085602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.085704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.085704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.085704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.085704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.086079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.086079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.086309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.086427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.086779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.086988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.087121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.087244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.087357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.087485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.087669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.088445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.088562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.088652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.088652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.088937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.089060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.089207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.089298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.089383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.089468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.089625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.089625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.089847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.089991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.090148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.090304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.090421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.090518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.090712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.090853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.091041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.091249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.091349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.091436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.091640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.091793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.091965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.092120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.092225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.092315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.092553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.092759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.092875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.092983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.093188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.093330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.093499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.093655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.093819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.093975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.094115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.094245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.094381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.094510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.094648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.094747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.094957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.095110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.095213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.095402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.095557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.095730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.095872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.096022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.096115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.096369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.096535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.096632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.096801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.097013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.097154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.097297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.097415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 10:07:14.097610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.097707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.097917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.098017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.098229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.098327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.098534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.098632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.098837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.098942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.099145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.099250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.099447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.099548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.099753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.099857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.100075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.100174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.100386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.100482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.100725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.100837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.101034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.101138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.101340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.101446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.101652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.101758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.101969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.102066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.102281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.102382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.102595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.102698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.102905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.103005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.103220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.103313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.103526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.103632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.103841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.103932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.104154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.104256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.104469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.104612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.104810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.104908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.105125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.105257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.105472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.105574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.105891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.106006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.106145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.106237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.106411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.106506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.106735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.106827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.107043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.107148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.107350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.107451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.107658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.107757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.107975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.108077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.108283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.108375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.108601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.108748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.108937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.109044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.109258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.109350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.109568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.109668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.109877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.109978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.110186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.110279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.110495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.110595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.110808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.110911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.111120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.111220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.111435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.111525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.111745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.111846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.112055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.112147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.112364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.112455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.112694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.112839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.113008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.113124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.113314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.113426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.113620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.113729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.113921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.114026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.114254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.114372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.114588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.114898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.115213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.115390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.115546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.117858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.118942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.119990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.120060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.120129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.120800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.120966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.121043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.121113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.121182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.121259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.121514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.121600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.121673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.121835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.121932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.122154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.122305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.122448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.122551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.122816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.122955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.123132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.123277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.123450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.123623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.123784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.123958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.124118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.124279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.124427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.124531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.124802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.124958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.125183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.125310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.125412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.125573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.125665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.125877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.126008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.126313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.126408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.126504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.126622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.126822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.127001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.127133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.127311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.127445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.127703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.127796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.128012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.128109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.128319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.128416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.128625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.128806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.128982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.129296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.129565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.129706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.130019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.130181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.130181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.130402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.130499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.130595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.130822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.131071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.131172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.131404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.131497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.131746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.131919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.132076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.132403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.132525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.132728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.132844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.133064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.133393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.133711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.133842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.134019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.134232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.134376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.134582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.134677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.134916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.135016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.135232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.135344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.135536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.135659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.135850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.135991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.136155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.136333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.136493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.136822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.137013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.137255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.137349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.137568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.137757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.137879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.138078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.138200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.138398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.138497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.138724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.138817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.139041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.139135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.139369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.139469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.139686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.139798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.140006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.140099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.140314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.140415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.140620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.140754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.140994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.141089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.141304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.141397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.141645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.141746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.141979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.142072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.142291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.142397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.142636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.142745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.142911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.143003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.143225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.143332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.143530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.143622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.143837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.143937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.144143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.144235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.144451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.144552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.144784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.144893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.145095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.145195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.145413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.145559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.145718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.145856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.146034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.146126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.146341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.146485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.146643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.146734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.146948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.147040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.147252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.147352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.147568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.147660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.147879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.147985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.148189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.148305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.148494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.148590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.148832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.148944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.149143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.149233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.149445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.149543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.149755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.149885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.150057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.150168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.150364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.150493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.150665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.150777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.150970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.151251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.151358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.151566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.151681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.151871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.151978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.152246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.152529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.152648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.152829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.153097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.153202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.153582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.153754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.153840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.153934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.154165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.154269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.154422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.154579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.154730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.155004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.155119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.155328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.155433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.155779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.156810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.156933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.157959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.158056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.158207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.158297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.158514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.158620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.158818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.158923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.159122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.159218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.159761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.159866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.160070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.160165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.160375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.160481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.160696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.160812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.161132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.161445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.161781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.162079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.162195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.162384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.162470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.162747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.162903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.163049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.163217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.163385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.163529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.163669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.163815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.163954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.164109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.164248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.164397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.164543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.164703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.164914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.165009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.165225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.165307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.165537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.165795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.165963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.166069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.166353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.166505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.166622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.166739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.166871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.167046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.167183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.167452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.167557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.167800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.167907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.168164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.168274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.168496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.168602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.168895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.168994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.169208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.169301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.169516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.169618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.169825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.169918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.170130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.170223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.170441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.170569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.170754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.170859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.171056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.171179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.171368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.171482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.171673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.171774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.171983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.172099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.172291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.172442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.172597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.172775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.172955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.173078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.173205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.173341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.173520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.173622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.173824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.173931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.174136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.174230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.174448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.174540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.174759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.174859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.175068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.175157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.175376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.175504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.175681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.175807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.175983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.176338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.176428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.176642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.176804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.177004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.177126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.177348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.177450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.177694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.177857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.178008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.178115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.178316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.178412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.178634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.178734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.178935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.179027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.179238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.179366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.179544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.179685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.179855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.180000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.180152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.180320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.180461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.180633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.180802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.180974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.181095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.181286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.181386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.181619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.181710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.181938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.182028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.182249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.182364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.182560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.182742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.182935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.183766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.183995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.184220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.184369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.184513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.184765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.184891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.184993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.185084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.185170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.185254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.185335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.185417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.185504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.185590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.186053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.186155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.186232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.186313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.186394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.186475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.186632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.186940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.188796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.188893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.188969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.189966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.190085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.190187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.190279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.190374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.190468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.190566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.190672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.190854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.190955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.191129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.191219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.191304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.191389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.191473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.191626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.191756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.191956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.192058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.192265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.192359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.192573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.192697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.192911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.193113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.193239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.193556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.193696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.193906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.194024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.194155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.194274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.194420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.194731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.195039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.195227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.195369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.195634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.195766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.195964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.196247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.196392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.196577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.196734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.196942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.197164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.197297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.197544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.197777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.197910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.198054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.198185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.198422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.198562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.198741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.198947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.199179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.199365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.199505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.199709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.200014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.200165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.200333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.200491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.200701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.201020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.201155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.201332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.201535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.201668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.201981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.202122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.202299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.202461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.202609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.202897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.203038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.203226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.203479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.203637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.203882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.204079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.204219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.204397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.204540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.204791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.204938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.205101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.205306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.205455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.205701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.205831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.206010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.206307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.206449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.206622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.206754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.206973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.207130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.207330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.207531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.207775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.207989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.208122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.208268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.208406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.208544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.208762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.209001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.209147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.209385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.209523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.209695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.209898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.210037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.210319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.210449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.210635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.210781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.211017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.211231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.211364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.211560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.211719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.211866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.212147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.212282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.212466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.212605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.212805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.213123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.213261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.213500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.213650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.214010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.214247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.214382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.214511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.214776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.214980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.215309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.215309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.215578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.215716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.215869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.216001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.216221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.216480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.216616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.216769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.216899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.217161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.217331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.217532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.217801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.218125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.218350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.218491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.218764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.218896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.219080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.219258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.219402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.219691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.220049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.220184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.220366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.220599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.220818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.221099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.221250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.221392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.221528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.221671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.221919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.222233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.222405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.222534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.222680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.222839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.223091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.223258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.223453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.223608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.223826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.224072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.224332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.224476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.224611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.224770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.225041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.225176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.225527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.225666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.225801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.225938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.226073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.226352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.226590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.226780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.226928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.227131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.227346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.227523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.227736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.227898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.228130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.228341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.228482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.228622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.228835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.229002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.229135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.229340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.229479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.229651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.229895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.230027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.230286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.230474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.230607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.230900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.231042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.231286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.231419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.231556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.231801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.231933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.232343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.232484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.232718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.232856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.233042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.233265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.233406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.233687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.233851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.234070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.234340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.234545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.234677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.234806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.234942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.235073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.235244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.235642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.235787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.235917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.236045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.236211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.236480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.236899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.237153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.237288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.237511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.237660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.237899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.238150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.238298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.238429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.238618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.238873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.239008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.239304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.239459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.239602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.239808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.239963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.240212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.240347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.240518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.240745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.241001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.241340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.241477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.241624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.241763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.241903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.242071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.242271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.242413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.242703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.242844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.243039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.243223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.243373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.243670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.243807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.243979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.244218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.244476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.244744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.244893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.245024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.245162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.245308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.245448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.245653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.245910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.246114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.246273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.246533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.246682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.246884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.247130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.247272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.247538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.247695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.247826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.248051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.248198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.248403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.248544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.248739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.248988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.249131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.249340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.249480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.249664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.249840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.249970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.250244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.250385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.250612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.250781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.250913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.251146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.251395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.251531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.251665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.251803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.252022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.252164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.252350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.252505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.252650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.252964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.253096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.253277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.253415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.253588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.253831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.253963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.254245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.254395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.254645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.254972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.255119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.255252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.255389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.255526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.255678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.255872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.256020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.256161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.256341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.256512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.256644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.256962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.257103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.257301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.257468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.257619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.257908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.258075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.258272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.258420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.258640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.258786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.258954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.259277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.259597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.259834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.259975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.260214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.260465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.260599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.260778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.260922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.261176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.261315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.261749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.261894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.262026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.262156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.262292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.262479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.262622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.262806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.262978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.263119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.263403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.263535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.263705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.263867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.264000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.264357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.264498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.264654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.264917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.265115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.265256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.265400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.265545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.265683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.265918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.266091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.266231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.266438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.266569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.266744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.267050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.267192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.267343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.267473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.267647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.267874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.268023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.268324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.268475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.268623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.268857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.269000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.269883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.270041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.270187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.270319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.270463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.270594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.270732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.270732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.271071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.271210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.271210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.271470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.271599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.271844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.272093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.272242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.272373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.272373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.272625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.272806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.272806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.273076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.273215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.273352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.273481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.273729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.273859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.274040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.274230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.274363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.274662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.274799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.275034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.275263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.275404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.275662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.275868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.276024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.276238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.276381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.276512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.276798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.276937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.277264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.277430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.277657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.277853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.278092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.278234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.278382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.278606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.278739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.278883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.279095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.279233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.279440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.279587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.279786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.279924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.280279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.280444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.280592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.280754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.280884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.281030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.281244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.281376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.281619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.281864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.282001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.282163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.282296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.282546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.282678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.282873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.283045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.283179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.283485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.283628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.284822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.284986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.285143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.285444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.285591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.285591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.285591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.285980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.286110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.286254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.286469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.286602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.286602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 10:07:14.286855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.287168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.287553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.287932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.288313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.288712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.289137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.289464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.289854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.290235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.290615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.291003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.291406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.291792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.292173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.292551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.293007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.293625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.294006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.294450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.294841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.295249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.295643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.296027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.296499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.296815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.297190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.297569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.297942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.298312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.298762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.299062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.299432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.299827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.300200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.300830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.301248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.302127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.302127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.302412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.302738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.303110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.303496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.303869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.304240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.304622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.305124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.305401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.305779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.306154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.307872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.307872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.307872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.307872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.307872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.308835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.308835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.309259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.309538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.309916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.310297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.310796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.311063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.311446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.311815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.312259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.312554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.312946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.313381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.313760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.314142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.314551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.314943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.315330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.315745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.316591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.316591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.316900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.317196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.317620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.318018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.318695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.319103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.319488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.319913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.320311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.320726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.321105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.321485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.321900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.322512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.322674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.323085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.323476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.323851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.324255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.324732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.325237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.325628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.326076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.326377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.326764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.327138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.327533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.328066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.328913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.329300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.332782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.332782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.332782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.332782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.332782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.332782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.332782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.332782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.333401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.333401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.333401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.333820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.334038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.334380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.334709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.335030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.335368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.335696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.336010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.336344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.336684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.337030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.337381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.337715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.338052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.338368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.338677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.338994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.339307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.339731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.340050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.340362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.340685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.341001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.341308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.341614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.341918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.342226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.342533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.342837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.343141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.343444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.343745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.344047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.344352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.344677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.344998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.345303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.345606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.345909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.346212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.346548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.346882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.347195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.347519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.347831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.348152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.348462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.348813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.349136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.349454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.349629 n-d-854663-10 devstack@n-api.service[120720]: INFO dbcounter [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Registered counter for database nova_api Oct 27 10:07:14.349790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.350095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.350400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.350707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.351019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.351328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.351638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.351946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.352277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.352603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.352950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.353276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.353592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.354180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.354501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.354814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.355142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.355530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.355844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.356153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.356466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.356797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.357114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.357423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.357733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.358048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.358417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.358691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.359007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.359315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.359646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.359980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.360351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.360669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.361058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.361393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.361709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.362025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.362338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 10:07:14.362582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 10:07:14.370906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 10:07:14.378984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 10:07:14.427430 n-d-854663-10 devstack@n-api.service[120719]: INFO dbcounter [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Registered counter for database nova_api Oct 27 10:07:14.437031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.context [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) {{(pid=120720) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 10:07:14.441055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:14.441528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:14.443212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:14.443944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:14.444419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:14.446493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:14.447835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 10:07:14.448534 n-d-854663-10 devstack@n-api.service[120720]: INFO dbcounter [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Registered counter for database nova_cell0 Oct 27 10:07:14.453150 n-d-854663-10 devstack@n-api.service[120720]: INFO dbcounter [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Registered counter for database nova_cell1 Oct 27 10:07:14.457127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 10:07:14.460864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 10:07:14.463286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 10:07:14.471045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 10:07:14.472414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 10:07:14.518230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.context [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) {{(pid=120719) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 10:07:14.522349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:14.522909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:14.524542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:14.525284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:14.525720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:14.527793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:14.529864 n-d-854663-10 devstack@n-api.service[120719]: INFO dbcounter [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Registered counter for database nova_cell0 Oct 27 10:07:14.534010 n-d-854663-10 devstack@n-api.service[120719]: INFO dbcounter [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Registered counter for database nova_cell1 Oct 27 10:07:14.542419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 10:07:14.547356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 10:07:14.550135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 10:07:14.619709 n-d-854663-10 devstack@n-api.service[120720]: INFO dbcounter [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Registered counter for database nova_cell0 Oct 27 10:07:14.626715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 10:07:14.631508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 10:07:14.693335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 10:07:14.704386 n-d-854663-10 devstack@n-api.service[120719]: INFO dbcounter [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Registered counter for database nova_cell0 Oct 27 10:07:14.713602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 10:07:14.718806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 10:07:14.947876 n-d-854663-10 devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 10:07:14.955355 n-d-854663-10 devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 10:07:15.038998 n-d-854663-10 devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 10:07:15.046507 n-d-854663-10 devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 10:07:15.301038 n-d-854663-10 devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 10:07:15.307269 n-d-854663-10 devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-57e759dc-c8c9-4ce2-9dd6-d3f8440e7dd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 10:07:15.313085 n-d-854663-10 devstack@n-api.service[120720]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557462aa59c0 pid: 120720 (default app) Oct 27 10:07:15.392649 n-d-854663-10 devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 10:07:15.399480 n-d-854663-10 devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-c341c611-8f40-434f-a1be-977d49a797e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 10:07:15.404205 n-d-854663-10 devstack@n-api.service[120719]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557462aa59c0 pid: 120719 (default app) Oct 27 10:07:54.541000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:54.542404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:54.543291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:54.544600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:55.297196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:55.298708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:55.299475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:55.300254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:55.886206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Calling method '.version_select at 0x7f6d610590d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:55.896409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) {{(pid=120720) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 27 10:07:55.897153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:55.897600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:55.898183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:55.927718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:55.928405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:55.929009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:55.942995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:55.943469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:55.943896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:55.951100 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-134e0ee1-4897-400a-a6c4-b7483845958e tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.418659 Oct 27 10:07:55.951692 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1208 bytes} [Thu Oct 27 10:07:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:07:55.971854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e201c221-d58a-4476-84ec-d6081ac8e3a6 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-555421128"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:55.992177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.aggregate [None req-e201c221-d58a-4476-84ec-d6081ac8e3a6 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Generated uuid 8a440cd3-c861-47b9-85f2-a7518003f35c for aggregate {{(pid=120720) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:07:56.063666 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e201c221-d58a-4476-84ec-d6081ac8e3a6 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.095768 Oct 27 10:07:56.068806 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2/2] 10.222.0.76 () {62 vars in 1205 bytes} [Thu Oct 27 10:07:55 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:07:56.076413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-464515f3-4086-4365-ba0d-70236eddb83f tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2111806619"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:56.211155 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-464515f3-4086-4365-ba0d-70236eddb83f tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.138627 Oct 27 10:07:56.211946 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3/3] 10.222.0.76 () {62 vars in 1210 bytes} [Thu Oct 27 10:07:56 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:07:56.590018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4bbf61d-a89e-4d3f-ae48-6a9d7c1fde57 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Calling method '.version_select at 0x7f6d60e7eee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:56.593434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4bbf61d-a89e-4d3f-ae48-6a9d7c1fde57 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:56.594084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4bbf61d-a89e-4d3f-ae48-6a9d7c1fde57 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:56.594665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4bbf61d-a89e-4d3f-ae48-6a9d7c1fde57 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:56.596500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4bbf61d-a89e-4d3f-ae48-6a9d7c1fde57 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:56.597152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4bbf61d-a89e-4d3f-ae48-6a9d7c1fde57 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:56.597724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4bbf61d-a89e-4d3f-ae48-6a9d7c1fde57 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:56.640156 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4bbf61d-a89e-4d3f-ae48-6a9d7c1fde57 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.426288 Oct 27 10:07:56.640996 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4/4] 10.222.0.76 () {58 vars in 1128 bytes} [Thu Oct 27 10:07:56 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:56.645718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7582c60c-e6a7-4ca4-9122-a42816b09467 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:56.656766 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7582c60c-e6a7-4ca4-9122-a42816b09467 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.014565 Oct 27 10:07:56.657779 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 5/5] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 27 10:07:56 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:07:56.741237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6091c860-35a2-45eb-a8a2-a1a1ccc30b6d tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:56.742957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6091c860-35a2-45eb-a8a2-a1a1ccc30b6d tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:56.743542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6091c860-35a2-45eb-a8a2-a1a1ccc30b6d tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:56.743859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6091c860-35a2-45eb-a8a2-a1a1ccc30b6d tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:56.744619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6091c860-35a2-45eb-a8a2-a1a1ccc30b6d tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:56.745086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6091c860-35a2-45eb-a8a2-a1a1ccc30b6d tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:56.745506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6091c860-35a2-45eb-a8a2-a1a1ccc30b6d tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:56.781981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a66611-ef05-4449-b273-8010eba35598 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1285726688", "id": 1177413805, "os-flavor-access:is_public": "False"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:56.786812 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6091c860-35a2-45eb-a8a2-a1a1ccc30b6d tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] 10.222.0.76 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.499680 Oct 27 10:07:56.795308 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1/6] 10.222.0.76 () {58 vars in 1164 bytes} [Thu Oct 27 10:07:55 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 10:07:56.821807 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48a66611-ef05-4449-b273-8010eba35598 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.162010 Oct 27 10:07:56.822633 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 6/7] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:07:56 2022] POST /compute/v2.1/flavors => generated 431 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:56.963823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '.version_select at 0x7f6d60ef99d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:56.983670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) {{(pid=120719) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 27 10:07:56.983670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:56.983670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:56.983670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.012165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.013326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.013763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.030808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.031413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.031985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.040479 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f6bb8cc-b80f-4056-8d83-c2fc375931a9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.251610 Oct 27 10:07:57.041188 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2/8] 10.222.0.76 () {58 vars in 1167 bytes} [Thu Oct 27 10:07:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:57.045531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bac868e7-d5f8-4247-a870-d373b8894257 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Calling method '.version_select at 0x7f6d60643e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:57.048625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3afc3cce-9d34-4492-8035-4d40f16090e3 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Calling method '.version_select at 0x7f6d60f19ee0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:57.048923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bac868e7-d5f8-4247-a870-d373b8894257 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b2c33667f1a445e0ac35c6bb1aade786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea7c37b58e74415bd59dff6a732fa11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:57.053612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3afc3cce-9d34-4492-8035-4d40f16090e3 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bac868e7-d5f8-4247-a870-d373b8894257 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Request method failure captured: Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh5pbiRAncZWSApLBiFjg-xLI3LjzeNayBFlT2ja0gqlY1a7QwmOGVnBsXvxpFop-yvSRJDZBHVKw5QUQb715vO4-4TVLuziB1pE5H3qFoF-3hEUjVYZWrLlnGrKjd4sJiHYqM5KCdS_OPp2VFKIFQey30LOBSkSjDaDi-7xVOxC1o Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:07:57.053879 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4ea7c37b58e74415bd59dff6a732fa11", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b2c33667f1a445e0ac35c6bb1aade786 Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: action_args: {} Oct 27 10:07:57.055060 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:07:57.055938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 10:07:57.057167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:57.058231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3afc3cce-9d34-4492-8035-4d40f16090e3 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.058231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3afc3cce-9d34-4492-8035-4d40f16090e3 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.058231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3afc3cce-9d34-4492-8035-4d40f16090e3 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.058231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3afc3cce-9d34-4492-8035-4d40f16090e3 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.058480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3afc3cce-9d34-4492-8035-4d40f16090e3 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.058947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bac868e7-d5f8-4247-a870-d373b8894257 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:07:57.060073 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bac868e7-d5f8-4247-a870-d373b8894257 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.230102 Oct 27 10:07:57.060727 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 7/9] 10.222.0.76 () {58 vars in 1167 bytes} [Thu Oct 27 10:07:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:07:57.085229 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3afc3cce-9d34-4492-8035-4d40f16090e3 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.042969 Oct 27 10:07:57.085969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3/10] 10.222.0.76 () {58 vars in 1139 bytes} [Thu Oct 27 10:07:57 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:57.090618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72262893-4ef7-4c61-884e-3d1fa6d7c922 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:57.122674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72262893-4ef7-4c61-884e-3d1fa6d7c922 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.123292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72262893-4ef7-4c61-884e-3d1fa6d7c922 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.124167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72262893-4ef7-4c61-884e-3d1fa6d7c922 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.257711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1c51670-2f69-4a9a-8b96-4275b4913a88 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:57.265955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c51670-2f69-4a9a-8b96-4275b4913a88 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.266452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c51670-2f69-4a9a-8b96-4275b4913a88 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.266899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c51670-2f69-4a9a-8b96-4275b4913a88 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.267641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c51670-2f69-4a9a-8b96-4275b4913a88 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.268099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c51670-2f69-4a9a-8b96-4275b4913a88 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.268530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c51670-2f69-4a9a-8b96-4275b4913a88 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.301513 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1c51670-2f69-4a9a-8b96-4275b4913a88 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.239615 Oct 27 10:07:57.302107 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 8/11] 10.222.0.76 () {58 vars in 1176 bytes} [Thu Oct 27 10:07:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:57.310437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca8bc922-3d06-4486-9b23-427b3c263a32 tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:57.312599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca8bc922-3d06-4486-9b23-427b3c263a32 tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.313258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca8bc922-3d06-4486-9b23-427b3c263a32 tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.313700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca8bc922-3d06-4486-9b23-427b3c263a32 tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.314431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca8bc922-3d06-4486-9b23-427b3c263a32 tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.314887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca8bc922-3d06-4486-9b23-427b3c263a32 tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.315320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca8bc922-3d06-4486-9b23-427b3c263a32 tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.342588 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca8bc922-3d06-4486-9b23-427b3c263a32 tempest-AZAdminV2TestJSON-1049720419 tempest-AZAdminV2TestJSON-1049720419-project-admin] 10.222.0.76 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.039287 Oct 27 10:07:57.343183 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 9/12] 10.222.0.76 () {58 vars in 1185 bytes} [Thu Oct 27 10:07:57 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:57.347694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7190be8-32d4-4439-943d-dd1ba533adc7 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3e261301ff6441219a8b124a51099826"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:57.629073 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72262893-4ef7-4c61-884e-3d1fa6d7c922 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 0.539858 Oct 27 10:07:57.634969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 4/13] 10.222.0.76 () {62 vars in 1232 bytes} [Thu Oct 27 10:07:57 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:07:57.642897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b53ee3d3-b3f8-40a6-8448-7651c19c25b6 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Calling method '.version_select at 0x7f6d605f85e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:57.644880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b53ee3d3-b3f8-40a6-8448-7651c19c25b6 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b2c33667f1a445e0ac35c6bb1aade786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea7c37b58e74415bd59dff6a732fa11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b53ee3d3-b3f8-40a6-8448-7651c19c25b6 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Request method failure captured: Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh5pbiRAncZWSApLBiFjg-xLI3LjzeNayBFlT2ja0gqlY1a7QwmOGVnBsXvxpFop-yvSRJDZBHVKw5QUQb715vO4-4TVLuziB1pE5H3qFoF-3hEUjVYZWrLlnGrKjd4sJiHYqM5KCdS_OPp2VFKIFQey30LOBSkSjDaDi-7xVOxC1o Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:07:57.648652 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4ea7c37b58e74415bd59dff6a732fa11", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: b2c33667f1a445e0ac35c6bb1aade786 Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: action_args: {} Oct 27 10:07:57.649921 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:07:57.651022 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 10:07:57.652435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:57.653570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b53ee3d3-b3f8-40a6-8448-7651c19c25b6 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:07:57.653570 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b53ee3d3-b3f8-40a6-8448-7651c19c25b6 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014147 Oct 27 10:07:57.653861 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 5/14] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:07:57 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:07:57.661637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15b4e191-37aa-4fb4-aa61-e049e3394b31 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Calling method '.version_select at 0x7f6d605c6e50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:57.665347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15b4e191-37aa-4fb4-aa61-e049e3394b31 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.666528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15b4e191-37aa-4fb4-aa61-e049e3394b31 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.667042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15b4e191-37aa-4fb4-aa61-e049e3394b31 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.667812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15b4e191-37aa-4fb4-aa61-e049e3394b31 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.668271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15b4e191-37aa-4fb4-aa61-e049e3394b31 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.668719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15b4e191-37aa-4fb4-aa61-e049e3394b31 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.692938 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15b4e191-37aa-4fb4-aa61-e049e3394b31 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.037885 Oct 27 10:07:57.693607 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 6/15] 10.222.0.76 () {58 vars in 1145 bytes} [Thu Oct 27 10:07:57 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:07:57.698753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-27d4ffe0-02d1-4e49-b880-c522f0a06090 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:57.710460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27d4ffe0-02d1-4e49-b880-c522f0a06090 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:57.711299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27d4ffe0-02d1-4e49-b880-c522f0a06090 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:57.711746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27d4ffe0-02d1-4e49-b880-c522f0a06090 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:57.847633 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7190be8-32d4-4439-943d-dd1ba533adc7 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/1177413805/action" status: 200 len: 97 microversion: 2.1 time: 0.503218 Oct 27 10:07:57.848250 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 10/16] 10.222.0.76 () {60 vars in 1200 bytes} [Thu Oct 27 10:07:57 2022] POST /compute/v2.1/flavors/1177413805/action => generated 97 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:07:57.852879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9477ac3f-035a-4c56-9b48-8f90f09c179d tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Calling method '.version_select at 0x7f6d605f23a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:57.857134 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-27d4ffe0-02d1-4e49-b880-c522f0a06090 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.162287 Oct 27 10:07:57.858345 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 7/17] 10.222.0.76 () {62 vars in 1232 bytes} [Thu Oct 27 10:07:57 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:07:57.860292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9477ac3f-035a-4c56-9b48-8f90f09c179d tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b2c33667f1a445e0ac35c6bb1aade786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea7c37b58e74415bd59dff6a732fa11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9477ac3f-035a-4c56-9b48-8f90f09c179d tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Request method failure captured: Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh5pbiRAncZWSApLBiFjg-xLI3LjzeNayBFlT2ja0gqlY1a7QwmOGVnBsXvxpFop-yvSRJDZBHVKw5QUQb715vO4-4TVLuziB1pE5H3qFoF-3hEUjVYZWrLlnGrKjd4sJiHYqM5KCdS_OPp2VFKIFQey30LOBSkSjDaDi-7xVOxC1o Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:07:57.862018 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4ea7c37b58e74415bd59dff6a732fa11", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b2c33667f1a445e0ac35c6bb1aade786 Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: action_args: {} Oct 27 10:07:57.863610 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:07:57.864378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 10:07:57.865496 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:57.867375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9477ac3f-035a-4c56-9b48-8f90f09c179d tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:07:57.868312 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9477ac3f-035a-4c56-9b48-8f90f09c179d tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.019112 Oct 27 10:07:57.869335 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 11/18] 10.222.0.76 () {58 vars in 1179 bytes} [Thu Oct 27 10:07:57 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:07:57.875124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1e085ea-12ec-462c-b9ee-1817badd4367 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:57.901212 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1e085ea-12ec-462c-b9ee-1817badd4367 tempest-AggregatesAdminTestV241-1876590797 tempest-AggregatesAdminTestV241-1876590797-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.030141 Oct 27 10:07:57.902400 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 12/19] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 27 10:07:57 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:58.234167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a067f629-a866-4b7a-818f-c9b40d429da1 tempest-FlavorsAccessTestJSON-796942238 tempest-FlavorsAccessTestJSON-796942238-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:58.301087 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a067f629-a866-4b7a-818f-c9b40d429da1 tempest-FlavorsAccessTestJSON-796942238 tempest-FlavorsAccessTestJSON-796942238-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.441470 Oct 27 10:07:58.302663 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 8/20] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:07:57 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:58.318295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54870f51-7ff3-4576-b21c-ba642701979b tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1653299039", "name": "tempest-test_aggregate-1747733245"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:58.350221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Calling method '.version_select at 0x7f6d605f28b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:58.352181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:58.353064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:58.353818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:58.354558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-54870f51-7ff3-4576-b21c-ba642701979b tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Generated uuid 2b93ac1f-db46-423f-8942-47822bec6d57 for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:07:58.371772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:58.372436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:58.373190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:58.386088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:58.386556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:58.387187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:58.389584 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54870f51-7ff3-4576-b21c-ba642701979b tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.085788 Oct 27 10:07:58.390192 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 9/21] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 27 10:07:58 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:58.398706 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2deb058b-0b38-4985-a83e-83260a043cd4 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.495189 Oct 27 10:07:58.399531 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 13/22] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:07:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:58.402300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b5b4319-6b23-4536-bd2a-9633202ad220 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3e261301ff6441219a8b124a51099826"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:58.407320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-110894fc-7c66-432d-9ef1-db58cf99e36a tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:58.424975 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-110894fc-7c66-432d-9ef1-db58cf99e36a tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.021646 Oct 27 10:07:58.425559 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 14/23] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:07:58 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:58.430471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70370274-f160-40b1-891d-c1256ccc0d01 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Calling method '.version_select at 0x7f6d6066aaf0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:58.432821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-70370274-f160-40b1-891d-c1256ccc0d01 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b2c33667f1a445e0ac35c6bb1aade786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea7c37b58e74415bd59dff6a732fa11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70370274-f160-40b1-891d-c1256ccc0d01 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Request method failure captured: Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh5pbiRAncZWSApLBiFjg-xLI3LjzeNayBFlT2ja0gqlY1a7QwmOGVnBsXvxpFop-yvSRJDZBHVKw5QUQb715vO4-4TVLuziB1pE5H3qFoF-3hEUjVYZWrLlnGrKjd4sJiHYqM5KCdS_OPp2VFKIFQey30LOBSkSjDaDi-7xVOxC1o Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:07:58.434413 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4ea7c37b58e74415bd59dff6a732fa11", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b2c33667f1a445e0ac35c6bb1aade786 Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1'} Oct 27 10:07:58.435636 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:07:58.436418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 10:07:58.437584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:58.440049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70370274-f160-40b1-891d-c1256ccc0d01 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:07:58.440049 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70370274-f160-40b1-891d-c1256ccc0d01 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009283 Oct 27 10:07:58.440800 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 15/24] 10.222.0.76 () {58 vars in 1173 bytes} [Thu Oct 27 10:07:58 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:07:58.446512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-195c628f-67b7-4cfe-af60-280d32f461b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:58.459210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-195c628f-67b7-4cfe-af60-280d32f461b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:58.460079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-195c628f-67b7-4cfe-af60-280d32f461b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:58.460622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-195c628f-67b7-4cfe-af60-280d32f461b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:59.056039 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b5b4319-6b23-4536-bd2a-9633202ad220 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/1177413805/action" status: 200 len: 21 microversion: 2.1 time: 0.660841 Oct 27 10:07:59.057327 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 10/25] 10.222.0.76 () {60 vars in 1200 bytes} [Thu Oct 27 10:07:58 2022] POST /compute/v2.1/flavors/1177413805/action => generated 21 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:07:59.069918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4136b5d-4f9c-4d06-b3f6-c27eaf5b5849 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Calling method '.version_select at 0x7f6d605f81f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.073954 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-d4136b5d-4f9c-4d06-b3f6-c27eaf5b5849 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] HTTP exception thrown: Hypervisor with ID 'dea7537d-f9f2-42fa-9dc3-6cd1f65a6752' could not be found. Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4136b5d-4f9c-4d06-b3f6-c27eaf5b5849 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Request method failure captured: Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-hypervisors/dea7537d-f9f2-42fa-9dc3-6cd1f65a6752/uptime HTTP/1.1 Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh8nra8sz1J7RGj4t26h1yyPyKIoF5GtsZWPMZ00q7oaB9p4XODP4zMB1dIN2F6XzcDAJ4aEfR6Ub3e4NiG8HU4GJ8RecLlyEAtpK03QvwyvMdPtuOpfQjVaFvKBwxxnLq-AK7XYN8ZHBn7uyeGTkbleQDZtJAXliAJGvS9N_ZHTDA Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 46059660535949fea3406193802b6dde Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-946370183 Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:07:59.077794 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/46059660535949fea3406193802b6dde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/46059660535949fea3406193802b6dde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_46059660535949fea3406193802b6dde", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/46059660535949fea3406193802b6dde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-946370183 Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 46059660535949fea3406193802b6dde Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-946370183 Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 0a68501a3b5f4f8eb79345cb4a87b8b6 Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: exception: Hypervisor with ID 'dea7537d-f9f2-42fa-9dc3-6cd1f65a6752' could not be found. Oct 27 10:07:59.078806 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'dea7537d-f9f2-42fa-9dc3-6cd1f65a6752'} Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'dea7537d-f9f2-42fa-9dc3-6cd1f65a6752' Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 27 10:07:59.079366 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'dea7537d-f9f2-42fa-9dc3-6cd1f65a6752' could not be found. Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:59.080351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'dea7537d-f9f2-42fa-9dc3-6cd1f65a6752' could not be found. Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4136b5d-4f9c-4d06-b3f6-c27eaf5b5849 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Returning 404 to user: Hypervisor with ID 'dea7537d-f9f2-42fa-9dc3-6cd1f65a6752' could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d4136b5d-4f9c-4d06-b3f6-c27eaf5b5849 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/dea7537d-f9f2-42fa-9dc3-6cd1f65a6752/uptime" status: 404 len: 123 microversion: 2.1 time: 0.020374 Oct 27 10:07:59.081417 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 11/26] 10.222.0.76 () {58 vars in 1278 bytes} [Thu Oct 27 10:07:59 2022] GET /compute/v2.1/os-hypervisors/dea7537d-f9f2-42fa-9dc3-6cd1f65a6752/uptime => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:07:59.092478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd62d668-6a39-47ff-8b75-9430d0e35457 tempest-FlavorsAccessTestJSON-796942238 tempest-FlavorsAccessTestJSON-796942238-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.130838 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd62d668-6a39-47ff-8b75-9430d0e35457 tempest-FlavorsAccessTestJSON-796942238 tempest-FlavorsAccessTestJSON-796942238-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042601 Oct 27 10:07:59.131432 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 12/27] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:07:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:59.242065 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-195c628f-67b7-4cfe-af60-280d32f461b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 316 microversion: 2.1 time: 0.799678 Oct 27 10:07:59.243239 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 16/28] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:07:58 2022] POST /compute/v2.1/os-aggregates/2/action => generated 316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:59.250081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Calling method '.version_select at 0x7f6d605984c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.252161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:59.252848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:59.253605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:59.278073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:59.278962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:59.279537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:59.293053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:59.293829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:59.294584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:59.303531 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2452cf20-ef1b-40c1-b564-a4db6a206657 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.058705 Oct 27 10:07:59.304514 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 17/29] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:07:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:59.304514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14f73e37-3a8b-4008-b2d1-226f7fd51794 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.312983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1763696068", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:59.344413 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14f73e37-3a8b-4008-b2d1-226f7fd51794 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1177413805" status: 202 len: 0 microversion: 2.1 time: 0.037760 Oct 27 10:07:59.349299 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 18/30] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:07:59 2022] DELETE /compute/v2.1/flavors/1177413805 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:07:59.354816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5a90d2a-5257-4455-a9a8-a174013a56e8 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Calling method '.version_select at 0x7f6d605989d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.356643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5a90d2a-5257-4455-a9a8-a174013a56e8 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b2c33667f1a445e0ac35c6bb1aade786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea7c37b58e74415bd59dff6a732fa11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5a90d2a-5257-4455-a9a8-a174013a56e8 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Request method failure captured: Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh5pbiRAncZWSApLBiFjg-xLI3LjzeNayBFlT2ja0gqlY1a7QwmOGVnBsXvxpFop-yvSRJDZBHVKw5QUQb715vO4-4TVLuziB1pE5H3qFoF-3hEUjVYZWrLlnGrKjd4sJiHYqM5KCdS_OPp2VFKIFQey30LOBSkSjDaDi-7xVOxC1o Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:07:59.358503 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4ea7c37b58e74415bd59dff6a732fa11", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4ea7c37b58e74415bd59dff6a732fa11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 4ea7c37b58e74415bd59dff6a732fa11 Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554 Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b2c33667f1a445e0ac35c6bb1aade786 Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1918493554-project Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1'} Oct 27 10:07:59.359781 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:07:59.360647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 10:07:59.366743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.368116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5a90d2a-5257-4455-a9a8-a174013a56e8 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:07:59.368116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5a90d2a-5257-4455-a9a8-a174013a56e8 tempest-HypervisorAdminNegativeTestJSON-1918493554 tempest-HypervisorAdminNegativeTestJSON-1918493554-project] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009542 Oct 27 10:07:59.368116 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 19/31] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:07:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:07:59.368116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-85d5229e-ef4c-4389-b9a3-963fa0ea9a5e tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.399292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-85d5229e-ef4c-4389-b9a3-963fa0ea9a5e tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036930 Oct 27 10:07:59.404806 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 20/32] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:07:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:59.410348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4050118d-7322-4e07-a7c3-e624719d6d19 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Calling method '.version_select at 0x7f6d604f6670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.412211 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4050118d-7322-4e07-a7c3-e624719d6d19 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] HTTP exception thrown: Hypervisor with ID '893633b2-248c-4e7c-9ae8-d4695bba1307' could not be found. Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4050118d-7322-4e07-a7c3-e624719d6d19 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Request method failure captured: Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hypervisors/893633b2-248c-4e7c-9ae8-d4695bba1307 HTTP/1.1 Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh8nra8sz1J7RGj4t26h1yyPyKIoF5GtsZWPMZ00q7oaB9p4XODP4zMB1dIN2F6XzcDAJ4aEfR6Ub3e4NiG8HU4GJ8RecLlyEAtpK03QvwyvMdPtuOpfQjVaFvKBwxxnLq-AK7XYN8ZHBn7uyeGTkbleQDZtJAXliAJGvS9N_ZHTDA Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 46059660535949fea3406193802b6dde Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-946370183 Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:07:59.417187 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/46059660535949fea3406193802b6dde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/46059660535949fea3406193802b6dde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_46059660535949fea3406193802b6dde", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/46059660535949fea3406193802b6dde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-946370183 Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 46059660535949fea3406193802b6dde Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-946370183 Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 0a68501a3b5f4f8eb79345cb4a87b8b6 Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: exception: Hypervisor with ID '893633b2-248c-4e7c-9ae8-d4695bba1307' could not be found. Oct 27 10:07:59.418171 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '893633b2-248c-4e7c-9ae8-d4695bba1307'} Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '893633b2-248c-4e7c-9ae8-d4695bba1307' Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 27 10:07:59.418775 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:07:59.419799 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '893633b2-248c-4e7c-9ae8-d4695bba1307' could not be found. Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '893633b2-248c-4e7c-9ae8-d4695bba1307' could not be found. Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4050118d-7322-4e07-a7c3-e624719d6d19 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] Returning 404 to user: Hypervisor with ID '893633b2-248c-4e7c-9ae8-d4695bba1307' could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4050118d-7322-4e07-a7c3-e624719d6d19 tempest-HypervisorAdminNegativeTestJSON-946370183 tempest-HypervisorAdminNegativeTestJSON-946370183-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/893633b2-248c-4e7c-9ae8-d4695bba1307" status: 404 len: 123 microversion: 2.1 time: 0.012815 Oct 27 10:07:59.422166 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 21/33] 10.222.0.76 () {58 vars in 1257 bytes} [Thu Oct 27 10:07:59 2022] GET /compute/v2.1/os-hypervisors/893633b2-248c-4e7c-9ae8-d4695bba1307 => generated 123 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:07:59.426054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b268d95b-13f6-49d9-941a-dce400f2acf5 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1765519439", "id": 280410895, "os-flavor-access:is_public": "False"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:59.451304 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b268d95b-13f6-49d9-941a-dce400f2acf5 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.031116 Oct 27 10:07:59.452058 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 22/34] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:07:59 2022] POST /compute/v2.1/flavors => generated 428 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:59.464521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70ebc9b7-9390-4379-ae58-7869b7e79519 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.479327 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70ebc9b7-9390-4379-ae58-7869b7e79519 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/280410895/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.018678 Oct 27 10:07:59.479897 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 23/35] 10.222.0.76 () {58 vars in 1206 bytes} [Thu Oct 27 10:07:59 2022] GET /compute/v2.1/flavors/280410895/os-flavor-access => generated 21 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:07:59.489449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5234b40a-aea4-4e3e-a259-73bea87613a6 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.508437 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5234b40a-aea4-4e3e-a259-73bea87613a6 tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/280410895" status: 202 len: 0 microversion: 2.1 time: 0.022388 Oct 27 10:07:59.509513 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 24/36] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:07:59 2022] DELETE /compute/v2.1/flavors/280410895 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:07:59.517196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-816b3d97-8700-43d4-9f2b-9dd250d3ab8d tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:59.540944 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-816b3d97-8700-43d4-9f2b-9dd250d3ab8d tempest-FlavorsAccessTestJSON-1672952296 tempest-FlavorsAccessTestJSON-1672952296-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027136 Oct 27 10:07:59.541647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 25/37] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:07:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:07:59.934676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-727139159", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "availability_zone": "tempest-test_az-1653299039"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:59.961382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:59.962474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:59.963121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:59.964450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:59.965305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:59.965880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:00.286323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:08:00.786928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:08:00.786928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:08:00.787168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:08:00.787394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:08:00.787800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:08:00.813494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:00.816853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:00.817314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:00.818075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:00.823470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:00.823991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:00.833170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:08:00.880527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Getting quotas for project 1f8e5cdaf2e749069986ccb0b5a971a1. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:08:00.891168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Getting quotas for user 4443955683da4a3cb1936b26f8daea67 and project 1f8e5cdaf2e749069986ccb0b5a971a1. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:08:00.905780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:08:00.910803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:08:00.986017 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e05c0b41-aeb9-4925-8b17-c7eb723c6db1 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.852980 Oct 27 10:08:00.986823 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 13/38] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:08:01.000947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-97df2b59-a0c7-42d0-895a-1f767ed4166f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:01.001938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-97df2b59-a0c7-42d0-895a-1f767ed4166f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:01.122230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-97df2b59-a0c7-42d0-895a-1f767ed4166f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:01.140173 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-97df2b59-a0c7-42d0-895a-1f767ed4166f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1220 microversion: 2.1 time: 0.144323 Oct 27 10:08:01.140914 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 14/39] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:00 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:01.203256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:08:01.204075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:08:01.204718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:08:01.205284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:08:01.205728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:08:01.208883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:01.241805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:01.242284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:01.242714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:01.243420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:01.243860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:01.244829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:01.276157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Getting quotas for project 7ff65e0901dc4084bca6423c66002967. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:08:01.282836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Getting quotas for user 8a658de6fc314b07938ad013f78dfe69 and project 7ff65e0901dc4084bca6423c66002967. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:08:01.295221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:08:01.298061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:08:01.353993 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9f47e5d-e195-4866-a665-fb436ea8d617 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.773704 Oct 27 10:08:01.355139 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 26/40] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:08:01.376766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f4e9e3e-44d4-4d5d-890c-cf9a8bf47317 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:01.378061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f4e9e3e-44d4-4d5d-890c-cf9a8bf47317 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:01.505964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f4e9e3e-44d4-4d5d-890c-cf9a8bf47317 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:01.514324 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f4e9e3e-44d4-4d5d-890c-cf9a8bf47317 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1242 microversion: 2.1 time: 0.151591 Oct 27 10:08:01.514860 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 15/41] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:01 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1242 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:02.175757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-007d9253-5bae-4ae6-9e40-c323de1b6af3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:02.177020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-007d9253-5bae-4ae6-9e40-c323de1b6af3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:02.320831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-007d9253-5bae-4ae6-9e40-c323de1b6af3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:02.361554 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-007d9253-5bae-4ae6-9e40-c323de1b6af3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1220 microversion: 2.1 time: 0.199865 Oct 27 10:08:02.365669 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 27/42] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:02 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1220 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:02.541435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:02.542267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:02.556029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:02.556978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:02.558030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:02.558988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:02.559457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:02.560772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:02.738629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:02.751553 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c3a744ce-da84-4114-aea6-cc21fc78141a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1242 microversion: 2.1 time: 0.214361 Oct 27 10:08:02.752501 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 16/43] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:02 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:03.392952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:03.394524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:03.425001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:03.426330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:03.426963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:03.428162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:03.428900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:03.430495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:03.609404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:03.625539 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba3bb018-7921-4c64-9af3-b5dc5a3b41df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1272 microversion: 2.1 time: 0.240664 Oct 27 10:08:03.626872 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 28/44] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:03 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:03.775447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:03.776190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:03.793256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:03.793931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:03.794372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:03.795237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:03.795685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:03.796107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:03.899389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:03.907893 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3543ee6c-57c2-4007-b68d-dd83d2146f0f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1296 microversion: 2.1 time: 0.136471 Oct 27 10:08:03.908881 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 17/45] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:03 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1296 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:04.441671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Calling method '.version_select at 0x7f6d604695e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.444584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.445342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.445817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.467419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.468113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.468804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.482299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.482949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.483349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.493570 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f7e2563-b967-488b-a78f-af6a95cd0fd3 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.407884 Oct 27 10:08:04.494472 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 29/46] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:04.506204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Calling method '.version_select at 0x7f6d603bd700>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.508243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.508871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.509492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.526691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.527672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.528252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.541569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.542391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.543028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.553350 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eda82ee6-7f0b-443f-81e9-f2da0ce2a211 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.050772 Oct 27 10:08:04.554358 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 18/47] 10.222.0.76 () {58 vars in 1167 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:04.571072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Calling method '.version_select at 0x7f6d60437d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.573001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.573565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.574088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.597038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.597519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.598091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.610324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.611034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.611720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.620729 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5fab619a-f05c-4f40-a633-bada5fa32e2f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.053170 Oct 27 10:08:04.621960 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 30/48] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:04.633447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-798fc1b6-35bb-4aec-ba23-84b080aaab10 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Calling method '.version_select at 0x7f6d603bd790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.635601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-798fc1b6-35bb-4aec-ba23-84b080aaab10 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.636115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-798fc1b6-35bb-4aec-ba23-84b080aaab10 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.636561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-798fc1b6-35bb-4aec-ba23-84b080aaab10 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.651384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.652010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:04.666883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.667369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.669352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.671768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.672723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.674264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.675054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-798fc1b6-35bb-4aec-ba23-84b080aaab10 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.677229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-798fc1b6-35bb-4aec-ba23-84b080aaab10 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.680364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-798fc1b6-35bb-4aec-ba23-84b080aaab10 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.694851 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-798fc1b6-35bb-4aec-ba23-84b080aaab10 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.065884 Oct 27 10:08:04.698425 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 19/49] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:04.717474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f46c591b-071c-4570-b167-8da8305b9cae tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Calling method '.version_select at 0x7f6d603bd670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.719440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f46c591b-071c-4570-b167-8da8305b9cae tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.720107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f46c591b-071c-4570-b167-8da8305b9cae tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.720654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f46c591b-071c-4570-b167-8da8305b9cae tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.741565 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f46c591b-071c-4570-b167-8da8305b9cae tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.030192 Oct 27 10:08:04.745243 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 20/50] 10.222.0.76 () {58 vars in 1179 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:04.756087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Calling method '.version_select at 0x7f6d603bd0d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.758737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.759403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.760141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.779334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.779994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.780294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.794911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.795675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.796249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.802924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:04.804956 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3455f896-c8b9-4878-88f1-eb4fa55ac043 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.053509 Oct 27 10:08:04.805811 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 21/51] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:04.813887 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-afcdded5-5858-46aa-9451-eb2e42853a8e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1278 microversion: 2.1 time: 0.167607 Oct 27 10:08:04.814983 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 31/52] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:04.822512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f91bcfc9-cbca-4a36-9baf-bf8a3b0ce274 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Calling method '.version_select at 0x7f6d60426a60>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.825726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f91bcfc9-cbca-4a36-9baf-bf8a3b0ce274 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.826937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f91bcfc9-cbca-4a36-9baf-bf8a3b0ce274 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.827718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f91bcfc9-cbca-4a36-9baf-bf8a3b0ce274 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.849728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f91bcfc9-cbca-4a36-9baf-bf8a3b0ce274 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.850470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f91bcfc9-cbca-4a36-9baf-bf8a3b0ce274 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.850971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f91bcfc9-cbca-4a36-9baf-bf8a3b0ce274 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.860870 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f91bcfc9-cbca-4a36-9baf-bf8a3b0ce274 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.047470 Oct 27 10:08:04.873561 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 22/53] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:04.879355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33f16f5e-628b-4aa1-8fa3-63b02a299508 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Calling method '.version_select at 0x7f6d60349280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.885106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33f16f5e-628b-4aa1-8fa3-63b02a299508 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.889825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33f16f5e-628b-4aa1-8fa3-63b02a299508 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.890457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33f16f5e-628b-4aa1-8fa3-63b02a299508 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.933676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:04.934054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33f16f5e-628b-4aa1-8fa3-63b02a299508 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.935089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:04.936956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33f16f5e-628b-4aa1-8fa3-63b02a299508 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.940413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33f16f5e-628b-4aa1-8fa3-63b02a299508 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.956306 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33f16f5e-628b-4aa1-8fa3-63b02a299508 tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.082518 Oct 27 10:08:04.957389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.957883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.958322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:04.958624 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 32/54] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:04.959113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:04.959572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:04.959996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:05.002601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Calling method '.version_select at 0x7f6d60339550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:05.012386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:05.015942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:05.016458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:05.058467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:05.060743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:05.061340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:05.096192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:05.097796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:05.098388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:05.121094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:08:05.122530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2eaf39ad-79b6-48fc-a9f1-ae5379a6582f tempest-HypervisorAdminTestJSON-397113732 tempest-HypervisorAdminTestJSON-397113732-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:08:05.132051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49b9bea9-7987-4d7e-8de4-d40a5858fd0c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:05.133649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49b9bea9-7987-4d7e-8de4-d40a5858fd0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:05.137855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49b9bea9-7987-4d7e-8de4-d40a5858fd0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:05.140775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49b9bea9-7987-4d7e-8de4-d40a5858fd0c None None] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:05.145368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49b9bea9-7987-4d7e-8de4-d40a5858fd0c None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:05.147343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49b9bea9-7987-4d7e-8de4-d40a5858fd0c None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:05.194394 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.rpcapi [None req-49b9bea9-7987-4d7e-8de4-d40a5858fd0c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 10:08:05.195510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49b9bea9-7987-4d7e-8de4-d40a5858fd0c None None] Releasing lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:08:05.272783 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-49b9bea9-7987-4d7e-8de4-d40a5858fd0c None None] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.300058 Oct 27 10:08:05.283769 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 33/55] 10.222.0.76 () {58 vars in 1173 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:05.488618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:05.499521 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1dcc6f3-aabe-4409-80e6-ef3177c1aea1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.571732 Oct 27 10:08:05.500149 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 23/56] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:04 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:05.840476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:05.842308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:05.862635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:05.863299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:05.867898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:05.869007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:05.869881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:05.870510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:06.011377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:06.028021 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed44dcb7-d183-4277-81c6-f24909f99e6b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1278 microversion: 2.1 time: 0.193366 Oct 27 10:08:06.034329 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 24/57] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:05 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:06.159705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a4c06f6-5f17-45c1-9d8a-8975569e7f90 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-651423000", "id": 1000227660, "os-flavor-access:is_public": "False"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:06.217776 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a4c06f6-5f17-45c1-9d8a-8975569e7f90 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.932301 Oct 27 10:08:06.223309 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 34/58] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:05 2022] POST /compute/v2.1/flavors => generated 438 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:06.237311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-74dbf8db-515f-4ace-b423-9f0a1013178d tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:06.524910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:06.526182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:06.563674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:06.564341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:06.564761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:06.573546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:06.574033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:06.575302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:06.866864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:06.881987 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d55773f8-659a-4ece-b9c7-4a9d06912c2e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.361219 Oct 27 10:08:06.883604 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 35/59] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:06 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:07.060887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:07.061828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:07.090686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:07.091236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:07.091929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:07.092680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:07.093140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:07.101679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:07.265507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:07.293038 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-74dbf8db-515f-4ace-b423-9f0a1013178d tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/1000227660/action" status: 200 len: 97 microversion: 2.1 time: 1.053774 Oct 27 10:08:07.295384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 25/60] 10.222.0.76 () {60 vars in 1200 bytes} [Thu Oct 27 10:08:06 2022] POST /compute/v2.1/flavors/1000227660/action => generated 97 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:07.316524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4e7da8d-7f5a-433a-9684-3fe18ddced84 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:07.409728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:07.422231 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31eb521d-9036-470b-8d5c-624da7eeb76d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.366157 Oct 27 10:08:07.423226 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 36/61] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:07 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:08.010957 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e4e7da8d-7f5a-433a-9684-3fe18ddced84 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 34136276903840af92cea0a1eaf3eb91 combination. Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4e7da8d-7f5a-433a-9684-3fe18ddced84 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Request method failure captured: Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/flavors/1000227660/action HTTP/1.1 Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 67 Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliDfq7rbr6B7Q9oXEISf1v0alR2CROMBrX-9A1pKoh41YsPyP2uA691TrMyIOmnwqnJMsz4xXdMvF9ABFAOCDN17a34AY_hwc0WoGyzCKpRICfwQRT4T1AiqTthmMNWe20GLPKl-Zl02NX6Arr30VX_H5Era8x7tW_w8bsD5x1lS64 Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a171e975fdc543699ff78ace7e690e94 Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-239505021 Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:08.087756 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a171e975fdc543699ff78ace7e690e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a171e975fdc543699ff78ace7e690e94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a171e975fdc543699ff78ace7e690e94", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a171e975fdc543699ff78ace7e690e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-239505021 Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a171e975fdc543699ff78ace7e690e94 Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-239505021 Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9fe17833c60b4addb36489cbf28c836a Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: {"addTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} Oct 27 10:08:08.089378 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: exception: Flavor access already exists for flavor 17 and project 34136276903840af92cea0a1eaf3eb91 combination. Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '1000227660', 'body': {'addTenantAccess': {'tenant': '34136276903840af92cea0a1eaf3eb91'}}} Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result.read() Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 10:08:08.090159 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-34136276903840af92cea0a1eaf3eb91' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 10:08:08.091317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 10:08:08.092485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 10:08:08.094242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result.read() Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-34136276903840af92cea0a1eaf3eb91' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 10, 8, 7, 998414), 'updated_at': None, 'flavor_id': 17, 'project_id': '34136276903840af92cea0a1eaf3eb91'}] Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:08.096171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project 34136276903840af92cea0a1eaf3eb91 combination. Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:08.098066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project 34136276903840af92cea0a1eaf3eb91 combination. Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:08.102831 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:08.105104 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project 34136276903840af92cea0a1eaf3eb91 combination. Oct 27 10:08:08.105104 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:08.105104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4e7da8d-7f5a-433a-9684-3fe18ddced84 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 34136276903840af92cea0a1eaf3eb91 combination. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:08.105104 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4e7da8d-7f5a-433a-9684-3fe18ddced84 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/1000227660/action" status: 409 len: 152 microversion: 2.1 time: 0.799572 Oct 27 10:08:08.105104 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 26/62] 10.222.0.76 () {60 vars in 1200 bytes} [Thu Oct 27 10:08:07 2022] POST /compute/v2.1/flavors/1000227660/action => generated 152 bytes in 801 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:08.112417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:08.115447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:08.141667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:08.142172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:08.142603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:08.143317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:08.145772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:08.146892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:08.523782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19333512-c2e7-4094-b024-3e977f9603ca tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-308876487", "ram": 512, "vcpus": 1, "disk": 10, "id": 738393492, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:08.579773 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19333512-c2e7-4094-b024-3e977f9603ca tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.697471 Oct 27 10:08:08.592281 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 37/63] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:07 2022] POST /compute/v2.1/flavors => generated 412 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:08.601277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c93b3cb0-bb7f-4270-9642-4ffed631c13b tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:08.699050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:08.714214 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b09ef604-e9f0-44b4-9a5c-188f2f589a2b tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.606429 Oct 27 10:08:08.715964 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 27/64] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:08 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:08.894440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Calling method '.version_select at 0x7f6d60124ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:08.896876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:08.897681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:08.898515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:08.953308 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c93b3cb0-bb7f-4270-9642-4ffed631c13b tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/1000227660/action" status: 200 len: 21 microversion: 2.1 time: 0.358902 Oct 27 10:08:08.959382 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 38/65] 10.222.0.76 () {60 vars in 1200 bytes} [Thu Oct 27 10:08:08 2022] POST /compute/v2.1/flavors/1000227660/action => generated 21 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:08.969002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:08.969930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:08.972887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:08.977281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:08.978408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:08.999174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:09.000146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:09.000933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:09.002184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:09.005754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:09.006543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:09.008534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:09.009488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:09.010189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:09.027229 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ad698d64-c189-41f4-a7a3-c970f6482a57 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.309512 Oct 27 10:08:09.028148 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 28/66] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:09.042739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5a72829-0b85-449b-ab64-7add20312950 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:09.110795 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5a72829-0b85-449b-ab64-7add20312950 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/738393492/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.072965 Oct 27 10:08:09.116979 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 29/67] 10.222.0.76 () {60 vars in 1221 bytes} [Thu Oct 27 10:08:09 2022] POST /compute/v2.1/flavors/738393492/os-extra_specs => generated 66 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:09.148876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7231fdbe-a8a2-4fe1-b4f3-b8a7b5629555 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:09.229332 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7231fdbe-a8a2-4fe1-b4f3-b8a7b5629555 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1000227660" status: 202 len: 0 microversion: 2.1 time: 0.107758 Oct 27 10:08:09.235168 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 30/68] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:08:09 2022] DELETE /compute/v2.1/flavors/1000227660 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:08:09.347572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:09.358781 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8863ee65-87d5-4658-a8c0-701a4ae3ef21 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.396866 Oct 27 10:08:09.360654 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 39/69] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:08 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:09.525685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d970e8d2-673c-4bd2-a38a-ec27a5c82ae6 tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] Calling method '.version_select at 0x7f6d60124550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:09.542339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d970e8d2-673c-4bd2-a38a-ec27a5c82ae6 tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd0bae493cb6a4fd6a0ac6de17a4233a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71d807fb2084759932e66caaa1f64b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d970e8d2-673c-4bd2-a38a-ec27a5c82ae6 tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] Request method failure captured: Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-hypervisors/n-h2-854663-10/search HTTP/1.1 Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliFqTFJPxu6Gxk4sqXvJdSPamHt2AESBGJzbV5PMmlkjQjqSQsd20hdeVHwkKaP3QrGJYPC9_VD1iobZuYTKm24rwV14VOTNCumf1REiwjGBngpB7mGy0zlfr3FJo0B7hVVQTz1zLeXc9F_l150yL_Qczzn7qCeM46dIf4IeIHUA3w Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: e71d807fb2084759932e66caaa1f64b2 Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-160808392 Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:09.544864 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e71d807fb2084759932e66caaa1f64b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e71d807fb2084759932e66caaa1f64b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e71d807fb2084759932e66caaa1f64b2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e71d807fb2084759932e66caaa1f64b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-160808392 Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: e71d807fb2084759932e66caaa1f64b2 Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-160808392 Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-160808392-project Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d0bae493cb6a4fd6a0ac6de17a4233a4 Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-160808392-project Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 10:08:09.546233 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'n-h2-854663-10'} Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:09.547106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 10:08:09.549646 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:09.553464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d970e8d2-673c-4bd2-a38a-ec27a5c82ae6 tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:09.554767 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d970e8d2-673c-4bd2-a38a-ec27a5c82ae6 tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/n-h2-854663-10/search" status: 403 len: 117 microversion: 2.1 time: 0.318506 Oct 27 10:08:09.555686 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 31/70] 10.222.0.76 () {58 vars in 1212 bytes} [Thu Oct 27 10:08:09 2022] GET /compute/v2.1/os-hypervisors/n-h2-854663-10/search => generated 117 bytes in 320 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:09.568613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-385c3324-3d63-4f44-b307-094ec1064424 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:09.621393 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-385c3324-3d63-4f44-b307-094ec1064424 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.054857 Oct 27 10:08:09.622311 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 32/71] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:09 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:09.630109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10ae48cd-b9c1-4cf7-adc9-778ed0445d04 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Calling method '.version_select at 0x7f6d600c6b80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:09.635057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10ae48cd-b9c1-4cf7-adc9-778ed0445d04 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:09.636336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10ae48cd-b9c1-4cf7-adc9-778ed0445d04 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:09.637142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10ae48cd-b9c1-4cf7-adc9-778ed0445d04 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:09.654676 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-10ae48cd-b9c1-4cf7-adc9-778ed0445d04 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10ae48cd-b9c1-4cf7-adc9-778ed0445d04 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Request method failure captured: Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliIkRicMM-RzwX-hCBy0l7R_3H5NGXJBGDuzHGIT_2bGresvw20E6c6b-88xZouL12YdCAOiZYhkSfV1zIKotTdUMII09FyXuELYbqBkyQZvN2dwDGocX9GrIKSGwB7u88PYfLCsepAoUyYw6ZQy1L6EoCTz4np3KsTwwtCYM9_GCs Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: adc65445895840eb8cb273cc69ce391b Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1866968329 Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:09.658916 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/adc65445895840eb8cb273cc69ce391b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/adc65445895840eb8cb273cc69ce391b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_adc65445895840eb8cb273cc69ce391b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/adc65445895840eb8cb273cc69ce391b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1866968329 Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: adc65445895840eb8cb273cc69ce391b Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1866968329 Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3be3b8d70ab0492bbeab31235532dcab Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 10:08:09.660480 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:09.661376 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:09.663394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:09.663394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:09.663394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:09.663394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 10:08:09.663394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:09.665012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10ae48cd-b9c1-4cf7-adc9-778ed0445d04 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:09.666870 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10ae48cd-b9c1-4cf7-adc9-778ed0445d04 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.042752 Oct 27 10:08:09.674114 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 33/72] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:08:09 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:09.681930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6240ad7c-84ca-45f9-aa3c-c8b2a8320442 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1212543816", "id": 518859354, "os-flavor-access:is_public": "True"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:09.718995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6240ad7c-84ca-45f9-aa3c-c8b2a8320442 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.041965 Oct 27 10:08:09.721168 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 34/73] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:09 2022] POST /compute/v2.1/flavors => generated 435 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:09.728296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Calling method '.version_select at 0x7f6d600898b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:09.740894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:09.741788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:09.742528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:09.786939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:09.787504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:09.788400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:09.804150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eae068f9-2438-4361-8fe7-7f8ebbf16c48 tempest-FlavorsExtraSpecsTestJSON-1550749533 tempest-FlavorsExtraSpecsTestJSON-1550749533-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:09.814806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:09.816183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:09.817109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:09.824159 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eae068f9-2438-4361-8fe7-7f8ebbf16c48 tempest-FlavorsExtraSpecsTestJSON-1550749533 tempest-FlavorsExtraSpecsTestJSON-1550749533-project] 10.222.0.76 "GET /compute/v2.1/flavors/738393492/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.455092 Oct 27 10:08:09.826382 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 40/74] 10.222.0.76 () {58 vars in 1200 bytes} [Thu Oct 27 10:08:09 2022] GET /compute/v2.1/flavors/738393492/os-extra_specs => generated 66 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:09.832846 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c4d84c1-753f-4d07-837e-c15bec9536f6 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.102545 Oct 27 10:08:09.835624 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 35/75] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:09.854244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:09.855079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:09.860216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d16744eb-5719-428e-ad52-88e3972aadc2 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:09.865472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:09.865967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:09.866562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:09.867292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:09.867746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:09.868173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:09.881125 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-d16744eb-5719-428e-ad52-88e3972aadc2 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d16744eb-5719-428e-ad52-88e3972aadc2 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Request method failure captured: Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/flavors/518859354/os-flavor-access HTTP/1.1 Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliDfq7rbr6B7Q9oXEISf1v0alR2CROMBrX-9A1pKoh41YsPyP2uA691TrMyIOmnwqnJMsz4xXdMvF9ABFAOCDN17a34AY_hwc0WoGyzCKpRICfwQRT4T1AiqTthmMNWe20GLPKl-Zl02NX6Arr30VX_H5Era8x7tW_w8bsD5x1lS64 Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a171e975fdc543699ff78ace7e690e94 Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-239505021 Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:09.886709 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a171e975fdc543699ff78ace7e690e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a171e975fdc543699ff78ace7e690e94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a171e975fdc543699ff78ace7e690e94", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a171e975fdc543699ff78ace7e690e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-239505021 Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a171e975fdc543699ff78ace7e690e94 Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-239505021 Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9fe17833c60b4addb36489cbf28c836a Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: exception: Access list not available for public flavors. Oct 27 10:08:09.888198 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'flavor_id': '518859354'} Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 27 10:08:09.889237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:09.894157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d16744eb-5719-428e-ad52-88e3972aadc2 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:09.898054 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d16744eb-5719-428e-ad52-88e3972aadc2 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/518859354/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.070106 Oct 27 10:08:09.899055 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 41/76] 10.222.0.76 () {58 vars in 1206 bytes} [Thu Oct 27 10:08:09 2022] GET /compute/v2.1/flavors/518859354/os-flavor-access => generated 91 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:09.923847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67a683a7-2529-40ad-a8bc-4e55751bbe47 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:10.000889 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67a683a7-2529-40ad-a8bc-4e55751bbe47 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/738393492/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.098756 Oct 27 10:08:10.001753 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 42/77] 10.222.0.76 () {60 vars in 1221 bytes} [Thu Oct 27 10:08:09 2022] POST /compute/v2.1/flavors/738393492/os-extra_specs => generated 66 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:10.011490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-503e05a7-1722-4ba6-9c91-e82716a880bf tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] Calling method '.version_select at 0x7f6d603099d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:10.013418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-503e05a7-1722-4ba6-9c91-e82716a880bf tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd0bae493cb6a4fd6a0ac6de17a4233a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71d807fb2084759932e66caaa1f64b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-503e05a7-1722-4ba6-9c91-e82716a880bf tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] Request method failure captured: Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliFqTFJPxu6Gxk4sqXvJdSPamHt2AESBGJzbV5PMmlkjQjqSQsd20hdeVHwkKaP3QrGJYPC9_VD1iobZuYTKm24rwV14VOTNCumf1REiwjGBngpB7mGy0zlfr3FJo0B7hVVQTz1zLeXc9F_l150yL_Qczzn7qCeM46dIf4IeIHUA3w Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: e71d807fb2084759932e66caaa1f64b2 Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-160808392 Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:10.027578 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e71d807fb2084759932e66caaa1f64b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e71d807fb2084759932e66caaa1f64b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e71d807fb2084759932e66caaa1f64b2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e71d807fb2084759932e66caaa1f64b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-160808392 Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: e71d807fb2084759932e66caaa1f64b2 Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-160808392 Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-160808392-project Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: d0bae493cb6a4fd6a0ac6de17a4233a4 Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-160808392-project Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 10:08:10.029016 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1'} Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:10.030348 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 10:08:10.032040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:10.034010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-503e05a7-1722-4ba6-9c91-e82716a880bf tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:10.034010 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-503e05a7-1722-4ba6-9c91-e82716a880bf tempest-HypervisorAdminNegativeUnderV252Test-160808392 tempest-HypervisorAdminNegativeUnderV252Test-160808392-project] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.025305 Oct 27 10:08:10.039352 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 43/78] 10.222.0.76 () {58 vars in 1176 bytes} [Thu Oct 27 10:08:10 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:10.044593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c97face9-3999-4bb6-ba78-3356223dd1e0 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:10.089470 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c97face9-3999-4bb6-ba78-3356223dd1e0 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/518859354" status: 202 len: 0 microversion: 2.1 time: 0.048486 Oct 27 10:08:10.090361 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 44/79] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:08:10 2022] DELETE /compute/v2.1/flavors/518859354 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:08:10.095841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d93430a6-5495-48c1-9794-d23c9b6021fb tempest-FlavorsExtraSpecsTestJSON-1550749533 tempest-FlavorsExtraSpecsTestJSON-1550749533-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:10.114610 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d93430a6-5495-48c1-9794-d23c9b6021fb tempest-FlavorsExtraSpecsTestJSON-1550749533 tempest-FlavorsExtraSpecsTestJSON-1550749533-project] 10.222.0.76 "GET /compute/v2.1/flavors/738393492/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.022787 Oct 27 10:08:10.128984 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 45/80] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 10:08:10 2022] GET /compute/v2.1/flavors/738393492/os-extra_specs/hw:numa_nodes => generated 22 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:10.141087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9375f953-2f93-4c9d-bb8d-58ad49c4b4a0 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Calling method '.version_select at 0x7f6d60566f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:10.143821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9375f953-2f93-4c9d-bb8d-58ad49c4b4a0 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:10.144312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9375f953-2f93-4c9d-bb8d-58ad49c4b4a0 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:10.144800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9375f953-2f93-4c9d-bb8d-58ad49c4b4a0 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:10.186151 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9375f953-2f93-4c9d-bb8d-58ad49c4b4a0 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] HTTP exception thrown: No hypervisor matching 'd9d50ae6-7a6a-4369-a641-61afcbf2cf9f' could be found. Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9375f953-2f93-4c9d-bb8d-58ad49c4b4a0 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Request method failure captured: Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hypervisors/d9d50ae6-7a6a-4369-a641-61afcbf2cf9f/servers HTTP/1.1 Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliIkRicMM-RzwX-hCBy0l7R_3H5NGXJBGDuzHGIT_2bGresvw20E6c6b-88xZouL12YdCAOiZYhkSfV1zIKotTdUMII09FyXuELYbqBkyQZvN2dwDGocX9GrIKSGwB7u88PYfLCsepAoUyYw6ZQy1L6EoCTz4np3KsTwwtCYM9_GCs Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: adc65445895840eb8cb273cc69ce391b Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1866968329 Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:10.203656 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/adc65445895840eb8cb273cc69ce391b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/adc65445895840eb8cb273cc69ce391b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_adc65445895840eb8cb273cc69ce391b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/adc65445895840eb8cb273cc69ce391b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1866968329 Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: adc65445895840eb8cb273cc69ce391b Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1866968329 Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3be3b8d70ab0492bbeab31235532dcab Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: exception: No hypervisor matching 'd9d50ae6-7a6a-4369-a641-61afcbf2cf9f' could be found. Oct 27 10:08:10.204945 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'd9d50ae6-7a6a-4369-a641-61afcbf2cf9f'} Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'd9d50ae6-7a6a-4369-a641-61afcbf2cf9f' could be found. Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:10.205938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:10.207277 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:10.207277 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:10.207277 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:10.207277 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:10.207277 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'd9d50ae6-7a6a-4369-a641-61afcbf2cf9f' could be found. Oct 27 10:08:10.207277 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:10.209345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9375f953-2f93-4c9d-bb8d-58ad49c4b4a0 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] Returning 404 to user: No hypervisor matching 'd9d50ae6-7a6a-4369-a641-61afcbf2cf9f' could be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:10.211712 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9375f953-2f93-4c9d-bb8d-58ad49c4b4a0 tempest-HypervisorAdminNegativeUnderV252Test-1866968329 tempest-HypervisorAdminNegativeUnderV252Test-1866968329-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/d9d50ae6-7a6a-4369-a641-61afcbf2cf9f/servers" status: 404 len: 123 microversion: 2.1 time: 0.080976 Oct 27 10:08:10.214638 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 46/81] 10.222.0.76 () {58 vars in 1281 bytes} [Thu Oct 27 10:08:10 2022] GET /compute/v2.1/os-hypervisors/d9d50ae6-7a6a-4369-a641-61afcbf2cf9f/servers => generated 123 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:10.247915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d2b161e-4871-4854-aeed-b5a9ca4dc442 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:10.339763 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d2b161e-4871-4854-aeed-b5a9ca4dc442 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.123029 Oct 27 10:08:10.343004 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 47/82] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:10 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:10.351474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21d55dcd-eefc-4631-b881-d9919bfb75b0 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:10.465217 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21d55dcd-eefc-4631-b881-d9919bfb75b0 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/738393492/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.115353 Oct 27 10:08:10.472798 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 48/83] 10.222.0.76 () {60 vars in 1221 bytes} [Thu Oct 27 10:08:10 2022] POST /compute/v2.1/flavors/738393492/os-extra_specs => generated 66 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:10.504179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30739fe9-bb5f-4fac-aa49-692e1f3bc8d0 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1999653058", "id": 992774835, "os-flavor-access:is_public": "False"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:10.552322 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30739fe9-bb5f-4fac-aa49-692e1f3bc8d0 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.071598 Oct 27 10:08:10.557129 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 49/84] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:10 2022] POST /compute/v2.1/flavors => generated 436 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:10.592006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:10.597958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:10.622406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:10.624987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:10.627814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:10.635950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:10.638529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:10.639234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:10.826832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:10.840635 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67dd6000-1a0d-4397-a3c9-6578c5cacca2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 1.003644 Oct 27 10:08:10.841492 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 36/85] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:09 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:10.871693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afd6dc43-f8fb-426f-8d05-e939d66385ee tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:10.913979 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afd6dc43-f8fb-426f-8d05-e939d66385ee tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/738393492/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067683 Oct 27 10:08:10.923641 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 37/86] 10.222.0.76 () {58 vars in 1200 bytes} [Thu Oct 27 10:08:10 2022] GET /compute/v2.1/flavors/738393492/os-extra_specs => generated 66 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:10.930463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:11.510942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:11.546830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1441c3dc-32b5-4148-bb19-f90579ec9f1c tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:11.550619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1441c3dc-32b5-4148-bb19-f90579ec9f1c tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '232efd614ed84b6ca2526c04b07c0d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34136276903840af92cea0a1eaf3eb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1441c3dc-32b5-4148-bb19-f90579ec9f1c tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] Request method failure captured: Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/flavors/992774835/action HTTP/1.1 Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 67 Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliBdSeouGhK75Ne_22LplZCAQsoNCbg5jRojFpWKyURKvpYdvH8foKC6IoYu1WmNnp0OzPEdt7Nz_sdP1EM6vdWdKaatZMjf48HvpUhdlVgOg12XeX2ro0XGPGsWGywzOYXOTUIisZMasqkx_RLIA1h2Q18GUOlTQa7ds3daGQAFsw Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 34136276903840af92cea0a1eaf3eb91 Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1891965191 Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:11.552542 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/34136276903840af92cea0a1eaf3eb91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/34136276903840af92cea0a1eaf3eb91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_34136276903840af92cea0a1eaf3eb91", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/34136276903840af92cea0a1eaf3eb91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1891965191 Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 34136276903840af92cea0a1eaf3eb91 Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1891965191 Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FlavorsAccessNegativeTestJSON-1891965191-project Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 232efd614ed84b6ca2526c04b07c0d14 Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1891965191-project Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: {"addTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} Oct 27 10:08:11.553782 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '992774835', 'body': {'addTenantAccess': {'tenant': '34136276903840af92cea0a1eaf3eb91'}}} Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:11.554419 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 10:08:11.555400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:11.557893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1441c3dc-32b5-4148-bb19-f90579ec9f1c tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:11.558761 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1441c3dc-32b5-4148-bb19-f90579ec9f1c tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] 10.222.0.76 "POST /compute/v2.1/flavors/992774835/action" status: 403 len: 130 microversion: 2.1 time: 0.633785 Oct 27 10:08:11.567605 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 38/87] 10.222.0.76 () {60 vars in 1197 bytes} [Thu Oct 27 10:08:10 2022] POST /compute/v2.1/flavors/992774835/action => generated 130 bytes in 643 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:11.582943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60a52ea6-ebb3-47b0-8444-3332a962e683 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:11.636721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:11.652342 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-361f2343-2a56-4d68-87e2-6a094ee6babf tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 1.089264 Oct 27 10:08:11.655318 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 50/88] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:10 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:11.678484 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60a52ea6-ebb3-47b0-8444-3332a962e683 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "PUT /compute/v2.1/flavors/738393492/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.108516 Oct 27 10:08:11.683128 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 39/89] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:11 2022] PUT /compute/v2.1/flavors/738393492/os-extra_specs/hw:numa_nodes => generated 22 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:11.690050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-685d36af-89b8-4536-8983-cb6011f5f383 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:11.757855 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-685d36af-89b8-4536-8983-cb6011f5f383 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/992774835" status: 202 len: 0 microversion: 2.1 time: 0.071917 Oct 27 10:08:11.765889 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 40/90] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:08:11 2022] DELETE /compute/v2.1/flavors/992774835 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:08:11.781865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4bd2f881-c669-447f-96a1-efb506c8a32c tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:11.813084 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4bd2f881-c669-447f-96a1-efb506c8a32c tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/738393492/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046436 Oct 27 10:08:11.821119 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 41/91] 10.222.0.76 () {58 vars in 1200 bytes} [Thu Oct 27 10:08:11 2022] GET /compute/v2.1/flavors/738393492/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:11.837068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4891d88-d231-468c-93c1-6834e202a4ad tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:11.864748 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4891d88-d231-468c-93c1-6834e202a4ad tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.042130 Oct 27 10:08:11.865762 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 42/92] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:11 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:11.883019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4a3ca79-cc45-4ea2-90f2-6dc3ec1dd0aa tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:11.951843 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4a3ca79-cc45-4ea2-90f2-6dc3ec1dd0aa tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/738393492/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.084291 Oct 27 10:08:11.955655 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 43/93] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:08:11 2022] DELETE /compute/v2.1/flavors/738393492/os-extra_specs/hw:numa_nodes => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:11.969792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:11.970441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:11.988924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:11.989419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:11.989882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:11.990580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:11.991040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:11.991491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:12.069038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5c1d8cf8-eae8-44c0-b3f3-278f5152a88a req-bec8426e-f374-48e8-a15a-d0a666a72a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc51aea-cbe7-435e-9b95-5ba843803540", "tag": "7f8a675a-9094-4b26-bfe4-896dc88edb90"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:12.124091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5c1d8cf8-eae8-44c0-b3f3-278f5152a88a req-bec8426e-f374-48e8-a15a-d0a666a72a5b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:12.127979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5c1d8cf8-eae8-44c0-b3f3-278f5152a88a req-bec8426e-f374-48e8-a15a-d0a666a72a5b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:12.129089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5c1d8cf8-eae8-44c0-b3f3-278f5152a88a req-bec8426e-f374-48e8-a15a-d0a666a72a5b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:12.216195 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5c1d8cf8-eae8-44c0-b3f3-278f5152a88a req-bec8426e-f374-48e8-a15a-d0a666a72a5b service nova] Creating event network-changed:7f8a675a-9094-4b26-bfe4-896dc88edb90 for instance 3fc51aea-cbe7-435e-9b95-5ba843803540 on n-h2-854663-10 Oct 27 10:08:12.231655 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5c1d8cf8-eae8-44c0-b3f3-278f5152a88a req-bec8426e-f374-48e8-a15a-d0a666a72a5b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.572997 Oct 27 10:08:12.235037 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 51/94] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:12.249784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-794930c7-ba15-497e-8b38-a88f44e7805b tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1899172622", "id": 2120760267, "os-flavor-access:is_public": "False"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:12.269231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:12.324276 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-794930c7-ba15-497e-8b38-a88f44e7805b tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.086881 Oct 27 10:08:12.327760 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 52/95] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:12 2022] POST /compute/v2.1/flavors => generated 439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:12.353772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db862cd2-f2ee-4d9f-b8a9-19425647974d tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:12.360810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:12.388138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:12.391726 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db862cd2-f2ee-4d9f-b8a9-19425647974d tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/738393492/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.062586 Oct 27 10:08:12.393041 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 53/96] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:08:12 2022] DELETE /compute/v2.1/flavors/738393492/os-extra_specs/hw:cpu_policy => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:12.398638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9665f04c-dec5-45ff-8deb-c743d4b32d84 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:12.417660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:12.420213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9bc0b3d3-fc51-4642-b667-a0dabf296d84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.463494 Oct 27 10:08:12.433106 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 44/97] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:11 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:12.451875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7fc3d4dd-7231-49c9-a8f3-2f15557bd6f4 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:12.468622 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7fc3d4dd-7231-49c9-a8f3-2f15557bd6f4 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/738393492/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034306 Oct 27 10:08:12.469233 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 45/98] 10.222.0.76 () {58 vars in 1200 bytes} [Thu Oct 27 10:08:12 2022] GET /compute/v2.1/flavors/738393492/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:12.507771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf1d3943-a02f-40a0-8705-358852b3e055 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:12.581174 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf1d3943-a02f-40a0-8705-358852b3e055 tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/738393492" status: 202 len: 0 microversion: 2.1 time: 0.092424 Oct 27 10:08:12.581690 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 46/99] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:08:12 2022] DELETE /compute/v2.1/flavors/738393492 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:08:12.601144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ecd12da2-a8e8-4ee4-982d-d69453373f1a tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:12.647410 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ecd12da2-a8e8-4ee4-982d-d69453373f1a tempest-FlavorsExtraSpecsTestJSON-1008742583 tempest-FlavorsExtraSpecsTestJSON-1008742583-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058275 Oct 27 10:08:12.667426 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 47/100] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:12.676982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:12.677597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:12.685168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:12.685655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:12.686085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:12.686773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:12.687214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:12.687639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:12.902573 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9665f04c-dec5-45ff-8deb-c743d4b32d84 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/2120760267/action" status: 200 len: 97 microversion: 2.1 time: 0.508000 Oct 27 10:08:12.903111 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 54/101] 10.222.0.76 () {60 vars in 1200 bytes} [Thu Oct 27 10:08:12 2022] POST /compute/v2.1/flavors/2120760267/action => generated 97 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:12.924346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9209272-0a34-4072-843a-1ba100f75e5a tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:12.927844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f9209272-0a34-4072-843a-1ba100f75e5a tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '232efd614ed84b6ca2526c04b07c0d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34136276903840af92cea0a1eaf3eb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9209272-0a34-4072-843a-1ba100f75e5a tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] Request method failure captured: Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/flavors/2120760267/action HTTP/1.1 Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 70 Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliBdSeouGhK75Ne_22LplZCAQsoNCbg5jRojFpWKyURKvpYdvH8foKC6IoYu1WmNnp0OzPEdt7Nz_sdP1EM6vdWdKaatZMjf48HvpUhdlVgOg12XeX2ro0XGPGsWGywzOYXOTUIisZMasqkx_RLIA1h2Q18GUOlTQa7ds3daGQAFsw Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 34136276903840af92cea0a1eaf3eb91 Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1891965191 Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:12.936600 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/34136276903840af92cea0a1eaf3eb91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/34136276903840af92cea0a1eaf3eb91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_34136276903840af92cea0a1eaf3eb91", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/34136276903840af92cea0a1eaf3eb91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1891965191 Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 34136276903840af92cea0a1eaf3eb91 Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1891965191 Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FlavorsAccessNegativeTestJSON-1891965191-project Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 232efd614ed84b6ca2526c04b07c0d14 Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1891965191-project Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: {"removeTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} Oct 27 10:08:12.937891 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '2120760267', 'body': {'removeTenantAccess': {'tenant': '34136276903840af92cea0a1eaf3eb91'}}} Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can( Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:12.938552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 10:08:12.939627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:12.941877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9209272-0a34-4072-843a-1ba100f75e5a tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:12.942097 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9209272-0a34-4072-843a-1ba100f75e5a tempest-FlavorsAccessNegativeTestJSON-1891965191 tempest-FlavorsAccessNegativeTestJSON-1891965191-project] 10.222.0.76 "POST /compute/v2.1/flavors/2120760267/action" status: 403 len: 133 microversion: 2.1 time: 0.030526 Oct 27 10:08:12.947446 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 55/102] 10.222.0.76 () {60 vars in 1200 bytes} [Thu Oct 27 10:08:12 2022] POST /compute/v2.1/flavors/2120760267/action => generated 133 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:12.959549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44f5bc3c-72d3-4ed0-95f1-047c74aa1008 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "34136276903840af92cea0a1eaf3eb91"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:13.119695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:13.128805 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e92852ff-b6e3-46b0-8be2-d170264dfa24 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.455580 Oct 27 10:08:13.134408 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 48/103] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:12 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:13.444579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:13.445989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:13.468510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:13.476168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:13.476966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:13.477986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:13.478910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:13.479653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:13.849064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:13.863801 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-75b5e2d7-9e87-4599-85a4-2f41131c5f60 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.423827 Oct 27 10:08:13.864912 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 49/104] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:13 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:13.899166 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44f5bc3c-72d3-4ed0-95f1-047c74aa1008 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/2120760267/action" status: 200 len: 21 microversion: 2.1 time: 0.945269 Oct 27 10:08:13.905993 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 56/105] 10.222.0.76 () {60 vars in 1200 bytes} [Thu Oct 27 10:08:12 2022] POST /compute/v2.1/flavors/2120760267/action => generated 21 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:13.911968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb29a4ef-01c9-44a0-ba2d-54782f7d6346 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:13.962581 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb29a4ef-01c9-44a0-ba2d-54782f7d6346 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/2120760267" status: 202 len: 0 microversion: 2.1 time: 0.055346 Oct 27 10:08:13.963653 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 50/106] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:08:13 2022] DELETE /compute/v2.1/flavors/2120760267 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:08:13.972258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90bfa75f-8936-4456-b337-fb2fa8913861 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:14.015470 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90bfa75f-8936-4456-b337-fb2fa8913861 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047218 Oct 27 10:08:14.035464 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 57/107] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:14.043865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05ecca16-c563-4d1e-aac7-7589df1798cd tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-92701578", "id": 2142143326, "os-flavor-access:is_public": "False"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:14.052569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:DELETE=13,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:14.088903 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05ecca16-c563-4d1e-aac7-7589df1798cd tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.048611 Oct 27 10:08:14.092303 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 51/108] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:14 2022] POST /compute/v2.1/flavors => generated 437 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:08:14.106408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf3a9bc3-fb15-47c8-afc7-423a6ec78755 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1e85d95eb90145baafe23391cf7eea31"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:14.161562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:14.162227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:14.182193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:14.182687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:14.183128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:14.183848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:14.194122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:14.194588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:14.613010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:14.625195 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-627343e6-e348-42fd-9509-76441fb52789 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.468006 Oct 27 10:08:14.635314 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 52/109] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:14 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:14.649347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-828d15c5-06f1-471c-b7df-e10fddc1b3c3 req-54016572-0eeb-4456-bfde-ff962c51f0db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e77d7f7-01d9-4f67-b567-d759d30cfe3d", "tag": "58c7f30f-27e0-4d35-8a83-7b93cd2c56a5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:14.695950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-828d15c5-06f1-471c-b7df-e10fddc1b3c3 req-54016572-0eeb-4456-bfde-ff962c51f0db service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:14.707652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-828d15c5-06f1-471c-b7df-e10fddc1b3c3 req-54016572-0eeb-4456-bfde-ff962c51f0db service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:14.708383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-828d15c5-06f1-471c-b7df-e10fddc1b3c3 req-54016572-0eeb-4456-bfde-ff962c51f0db service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:14.762547 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-828d15c5-06f1-471c-b7df-e10fddc1b3c3 req-54016572-0eeb-4456-bfde-ff962c51f0db service nova] Creating event network-changed:58c7f30f-27e0-4d35-8a83-7b93cd2c56a5 for instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d on n-h1-854663-10 Oct 27 10:08:14.781517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-828d15c5-06f1-471c-b7df-e10fddc1b3c3 req-54016572-0eeb-4456-bfde-ff962c51f0db service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:08:14.784779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-828d15c5-06f1-471c-b7df-e10fddc1b3c3 req-54016572-0eeb-4456-bfde-ff962c51f0db service nova] Acquired lock "compute-rpcapi-router" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:08:14.786192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c54eae-af12-4168-8eeb-8fbee4a1c8cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:14.787081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c54eae-af12-4168-8eeb-8fbee4a1c8cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:14.789796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c54eae-af12-4168-8eeb-8fbee4a1c8cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:14.790880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c54eae-af12-4168-8eeb-8fbee4a1c8cd None None] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:14.792951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c54eae-af12-4168-8eeb-8fbee4a1c8cd None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:14.797009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c54eae-af12-4168-8eeb-8fbee4a1c8cd None None] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:14.815209 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.compute.rpcapi [None req-39c54eae-af12-4168-8eeb-8fbee4a1c8cd None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 10:08:14.822520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c54eae-af12-4168-8eeb-8fbee4a1c8cd None None] Releasing lock "compute-rpcapi-router" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:08:14.849022 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39c54eae-af12-4168-8eeb-8fbee4a1c8cd None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210764 Oct 27 10:08:14.850124 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 53/110] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:14.889074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:14.890057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:14.906537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:14.907063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:14.907560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:14.908815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:14.909340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:14.913133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:15.024780 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-cf3a9bc3-fb15-47c8-afc7-423a6ec78755 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] HTTP exception thrown: Flavor access not found for 22 / 1e85d95eb90145baafe23391cf7eea31 combination. Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf3a9bc3-fb15-47c8-afc7-423a6ec78755 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Request method failure captured: Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/flavors/2142143326/action HTTP/1.1 Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 70 Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliDfq7rbr6B7Q9oXEISf1v0alR2CROMBrX-9A1pKoh41YsPyP2uA691TrMyIOmnwqnJMsz4xXdMvF9ABFAOCDN17a34AY_hwc0WoGyzCKpRICfwQRT4T1AiqTthmMNWe20GLPKl-Zl02NX6Arr30VX_H5Era8x7tW_w8bsD5x1lS64 Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a171e975fdc543699ff78ace7e690e94 Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-239505021 Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:15.028060 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a171e975fdc543699ff78ace7e690e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a171e975fdc543699ff78ace7e690e94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a171e975fdc543699ff78ace7e690e94", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a171e975fdc543699ff78ace7e690e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-239505021 Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a171e975fdc543699ff78ace7e690e94 Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-239505021 Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9fe17833c60b4addb36489cbf28c836a Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: {"removeTenantAccess": {"tenant": "1e85d95eb90145baafe23391cf7eea31"}} Oct 27 10:08:15.029482 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: exception: Flavor access not found for 22 / 1e85d95eb90145baafe23391cf7eea31 combination. Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '2142143326', 'body': {'removeTenantAccess': {'tenant': '1e85d95eb90145baafe23391cf7eea31'}}} Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 27 10:08:15.030076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / 1e85d95eb90145baafe23391cf7eea31 combination. Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / 1e85d95eb90145baafe23391cf7eea31 combination. Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:15.030955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:15.031994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:15.031994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:15.031994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:15.031994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:15.031994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / 1e85d95eb90145baafe23391cf7eea31 combination. Oct 27 10:08:15.031994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:15.031994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf3a9bc3-fb15-47c8-afc7-423a6ec78755 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Returning 404 to user: Flavor access not found for 22 / 1e85d95eb90145baafe23391cf7eea31 combination. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:15.031994 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf3a9bc3-fb15-47c8-afc7-423a6ec78755 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/2142143326/action" status: 404 len: 124 microversion: 2.1 time: 0.930911 Oct 27 10:08:15.040603 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 58/111] 10.222.0.76 () {60 vars in 1200 bytes} [Thu Oct 27 10:08:14 2022] POST /compute/v2.1/flavors/2142143326/action => generated 124 bytes in 941 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:15.045729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b8fbecb0-e92f-4031-972b-b8e6bc8cbe26 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:15.092167 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b8fbecb0-e92f-4031-972b-b8e6bc8cbe26 tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/2142143326" status: 202 len: 0 microversion: 2.1 time: 0.049951 Oct 27 10:08:15.097790 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 59/112] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:08:15 2022] DELETE /compute/v2.1/flavors/2142143326 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:08:15.108449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-142525d3-5b38-435f-94a6-724c2cb5e4eb tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:15.132116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-142525d3-5b38-435f-94a6-724c2cb5e4eb tempest-FlavorsAccessNegativeTestJSON-239505021 tempest-FlavorsAccessNegativeTestJSON-239505021-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032912 Oct 27 10:08:15.133697 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 60/113] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:15.295063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:15.308381 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73c68d14-a34f-45a8-8d76-a3123f39e91a tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.424722 Oct 27 10:08:15.325539 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 54/114] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:14 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:15.654919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:15.655999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:15.658505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:15.678770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:15.679281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:15.679743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:15.680509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:15.681082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:15.697946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:15.705940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:15.906763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:15.920261 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f0d7618-c549-4a14-a79e-aeb5f537e241 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.269656 Oct 27 10:08:15.922182 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 61/115] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:15 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:16.339141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:16.339772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:16.348512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:16.349034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:16.349472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:16.350175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:16.365377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:16.365891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:16.592378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:16.601299 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62e3afa3-c9ed-4483-959c-15fa45807ed0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.273597 Oct 27 10:08:16.605544 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 55/116] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:16 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:16.949059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:16.949663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:16.966275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:16.967393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:16.971640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:16.972595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:16.977513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:16.981672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:17.334704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-441047849", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:17.419272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:17.437346 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d389db88-1933-4760-8cfb-f0b64d0a15c0 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.494011 Oct 27 10:08:17.440731 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 56/117] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:16 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:17.630787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:17.631584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:17.651659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:17.653944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:17.656979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:17.659747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:17.661574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:17.662758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:18.081073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:18.097213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-baa46648-2b49-48cd-90ec-a8d80d2667b1 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.470016 Oct 27 10:08:18.102213 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 57/118] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:17 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:18.463030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:18.463818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:18.480692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:18.492296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:18.493350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:18.494911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:18.498844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:18.501415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:18.717627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:08:19.111066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:19.121880 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a3644da-01a6-436b-be29-daf78db66a9e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.662410 Oct 27 10:08:19.124384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 58/119] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:18 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:19.133273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:19.134481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:19.153875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:19.154814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:19.155666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:19.157329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:19.158321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:19.159229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:19.311394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:08:19.312140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:08:19.312949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:08:19.313819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:08:19.314402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:08:19.333511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:19.334370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:19.335016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:19.336011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:19.338316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:19.339359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:19.373241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Getting quotas for project 12700bbe431149d18786ca6a80f99a10. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:08:19.377766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Getting quotas for user 086f3e5cbee145128f98a1cbe6133280 and project 12700bbe431149d18786ca6a80f99a10. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:08:19.379677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:19.390077 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9cf4818e-4ed6-45c3-a715-8f93ce28f7c0 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.261440 Oct 27 10:08:19.390727 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 59/120] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:19 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:19.419694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:08:19.423009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:08:19.502239 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f04f6cfc-59c0-4deb-86ed-7307342514ee tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.008858 Oct 27 10:08:19.511346 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 62/121] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:08:19.515941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-32cdeab0-a5f3-445d-842f-150014ccfa6d tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:19.517512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-32cdeab0-a5f3-445d-842f-150014ccfa6d tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:19.615629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-32cdeab0-a5f3-445d-842f-150014ccfa6d tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:19.628358 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-32cdeab0-a5f3-445d-842f-150014ccfa6d tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1218 microversion: 2.1 time: 0.112070 Oct 27 10:08:19.631353 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 60/122] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:19 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:20.152132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:20.153450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:20.163538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:20.165651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:20.166360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:20.167329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:20.168261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:20.168900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:20.328437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:20.338907 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa95ef20-c7ca-40b5-8309-dafa5eda712d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.192405 Oct 27 10:08:20.339495 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 63/123] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:20 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:20.417446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:20.418618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:20.424777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:20.425390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:20.425904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:20.426880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:20.427924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:20.428381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:20.573577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:20.582006 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-14216736-1b1b-426e-93af-54279c23ecc7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.169023 Oct 27 10:08:20.582662 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 61/124] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:20 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:20.654568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:20.655413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:20.663878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:20.664689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:20.666028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:20.666950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:20.667403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:20.667834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:20.740758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:20.752355 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d862bb83-b0b2-485f-b275-08dc105174f1 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1222 microversion: 2.1 time: 0.102084 Oct 27 10:08:20.753261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 62/125] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:20 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:20.822746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1187141846", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:20.879616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:08:21.089782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:08:21.090195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:08:21.090652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:08:21.091229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:08:21.091944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:08:21.105177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:21.105655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:21.106077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:21.107017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:21.107625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:21.108260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:21.127635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for project 895a8ef842a242469ffa508e1cf9f378. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:08:21.131883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for user ae3b45c026064d6c946f50a4d9d32c2f and project 895a8ef842a242469ffa508e1cf9f378. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:08:21.145989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:08:21.148398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:08:21.196705 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a013d470-ea7d-4c84-b983-c93ec642f44a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649664 Oct 27 10:08:21.197666 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 64/126] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:08:21.209575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c11214f-7de3-45f6-aa23-c51119ece200 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:21.210192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c11214f-7de3-45f6-aa23-c51119ece200 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:21.269367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c11214f-7de3-45f6-aa23-c51119ece200 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:21.278547 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c11214f-7de3-45f6-aa23-c51119ece200 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1213 microversion: 2.1 time: 0.072885 Oct 27 10:08:21.279124 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 65/127] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:21 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:21.363076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:21.363798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:21.373268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:21.373938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:21.375012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:21.375912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:21.376436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:21.376981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:21.418373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d11d0c88-162e-4265-bd50-f327b3395c1d tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-563391905", "ram": 512, "vcpus": 1, "disk": 10, "id": 397815588, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:21.449651 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d11d0c88-162e-4265-bd50-f327b3395c1d tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.431181 Oct 27 10:08:21.459389 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 63/128] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:21 2022] POST /compute/v2.1/flavors => generated 412 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:08:21.559081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:21.568560 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50b9159c-dec7-46d2-b44b-06c7fecc7473 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.210420 Oct 27 10:08:21.569552 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 66/129] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:21 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:21.606383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:21.607020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:21.613793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:21.614396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:21.614884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:21.615581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:21.616022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:21.616436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:21.727738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f59256b-41f5-41d1-9e34-05af4d545552 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:21.744062 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0f59256b-41f5-41d1-9e34-05af4d545552 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] HTTP exception thrown: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f59256b-41f5-41d1-9e34-05af4d545552 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Request method failure captured: Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/flavors/397815588/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliTHCgLqELZtJJH25F4NFatlQNJx57R2P1AI3RofMpCCFOjNRl07upClrOCXF-kFn5kM1RIeXxetfj85vWv6TcMZzr6gg3lObaG5_SoiTZx7XtlUl6NFxsT3rYchpBPi7oU3Y1HbSuOU7wBe1LF0EQUgtp4T9auBkPkWK1pe5SZi94 Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f3182ebf49694cebacb9e2dc217b5307 Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:21.747557 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f3182ebf49694cebacb9e2dc217b5307", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f3182ebf49694cebacb9e2dc217b5307 Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: eadf6bd1ef5445a7903e7ad7a5a8e032 Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:21.748770 n-d-854663-10 devstack@n-api.service[120719]: exception: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'flavor_id': '397815588', 'id': 'hw:cpu_thread_policy'} Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:21.749399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:21.750511 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:21.750511 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:21.750511 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:21.750511 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:21.750511 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:21.750511 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. Oct 27 10:08:21.750511 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:21.754595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f59256b-41f5-41d1-9e34-05af4d545552 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Returning 404 to user: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:21.757765 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f59256b-41f5-41d1-9e34-05af4d545552 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] 10.222.0.76 "GET /compute/v2.1/flavors/397815588/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.295740 Oct 27 10:08:21.758674 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 64/130] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:08:21 2022] GET /compute/v2.1/flavors/397815588/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:21.800951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:21.812599 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5653582-b42e-4642-8d68-d234b0e165a7 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.209967 Oct 27 10:08:21.813597 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 67/131] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:21 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:21.833250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:21.834269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:21.842722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:21.843605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:21.844140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:21.844987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:21.845545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:21.846096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:21.954523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:21.963904 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a83fb97f-3d4c-428d-aa47-7d03a227c4e7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1278 microversion: 2.1 time: 0.138696 Oct 27 10:08:21.964991 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 68/132] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:21 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1278 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:21.969178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9c2c3fd-dda0-4e1e-a651-df10bc670f68 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:21.972789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d9c2c3fd-dda0-4e1e-a651-df10bc670f68 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'eadf6bd1ef5445a7903e7ad7a5a8e032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3182ebf49694cebacb9e2dc217b5307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9c2c3fd-dda0-4e1e-a651-df10bc670f68 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Request method failure captured: Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/flavors/397815588/os-extra_specs HTTP/1.1 Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 66 Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliTHCgLqELZtJJH25F4NFatlQNJx57R2P1AI3RofMpCCFOjNRl07upClrOCXF-kFn5kM1RIeXxetfj85vWv6TcMZzr6gg3lObaG5_SoiTZx7XtlUl6NFxsT3rYchpBPi7oU3Y1HbSuOU7wBe1LF0EQUgtp4T9auBkPkWK1pe5SZi94 Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f3182ebf49694cebacb9e2dc217b5307 Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:21.974605 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f3182ebf49694cebacb9e2dc217b5307", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f3182ebf49694cebacb9e2dc217b5307 Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: eadf6bd1ef5445a7903e7ad7a5a8e032 Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 27 10:08:21.975932 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'flavor_id': '397815588', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:21.976743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 10:08:21.978057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:21.979612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9c2c3fd-dda0-4e1e-a651-df10bc670f68 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:21.980393 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d9c2c3fd-dda0-4e1e-a651-df10bc670f68 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] 10.222.0.76 "POST /compute/v2.1/flavors/397815588/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.214077 Oct 27 10:08:21.981024 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 65/133] 10.222.0.76 () {60 vars in 1221 bytes} [Thu Oct 27 10:08:21 2022] POST /compute/v2.1/flavors/397815588/os-extra_specs => generated 124 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:21.990328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86202c7f-600a-4bd2-ade2-dd6cf84ac790 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.031028 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-86202c7f-600a-4bd2-ade2-dd6cf84ac790 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/397815588/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044753 Oct 27 10:08:22.032123 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 69/134] 10.222.0.76 () {60 vars in 1221 bytes} [Thu Oct 27 10:08:21 2022] POST /compute/v2.1/flavors/397815588/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 10:08:22.042729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-144dc99b-76a0-44ee-a057-519cbebb70e2 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.044838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-144dc99b-76a0-44ee-a057-519cbebb70e2 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'eadf6bd1ef5445a7903e7ad7a5a8e032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3182ebf49694cebacb9e2dc217b5307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-144dc99b-76a0-44ee-a057-519cbebb70e2 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Request method failure captured: Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliTHCgLqELZtJJH25F4NFatlQNJx57R2P1AI3RofMpCCFOjNRl07upClrOCXF-kFn5kM1RIeXxetfj85vWv6TcMZzr6gg3lObaG5_SoiTZx7XtlUl6NFxsT3rYchpBPi7oU3Y1HbSuOU7wBe1LF0EQUgtp4T9auBkPkWK1pe5SZi94 Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f3182ebf49694cebacb9e2dc217b5307 Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:22.047123 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f3182ebf49694cebacb9e2dc217b5307", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f3182ebf49694cebacb9e2dc217b5307 Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: eadf6bd1ef5445a7903e7ad7a5a8e032 Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:22.048357 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'flavor_id': '397815588', 'id': 'hw:numa_nodes'} Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.048964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 10:08:22.049951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.050777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-144dc99b-76a0-44ee-a057-519cbebb70e2 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.051933 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-144dc99b-76a0-44ee-a057-519cbebb70e2 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] 10.222.0.76 "DELETE /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013224 Oct 27 10:08:22.052689 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 66/135] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:08:22 2022] DELETE /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:22.063627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff330763-e83e-48a7-a81e-c1891773810b tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.083464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=6,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:22.092753 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff330763-e83e-48a7-a81e-c1891773810b tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/397815588/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033801 Oct 27 10:08:22.093514 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 70/136] 10.222.0.76 () {60 vars in 1221 bytes} [Thu Oct 27 10:08:22 2022] POST /compute/v2.1/flavors/397815588/os-extra_specs => generated 66 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:08:22.106993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0068fb1-c064-4651-b98b-7def2d574d42 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.110209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a0068fb1-c064-4651-b98b-7def2d574d42 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'eadf6bd1ef5445a7903e7ad7a5a8e032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3182ebf49694cebacb9e2dc217b5307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0068fb1-c064-4651-b98b-7def2d574d42 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Request method failure captured: Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 22 Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliTHCgLqELZtJJH25F4NFatlQNJx57R2P1AI3RofMpCCFOjNRl07upClrOCXF-kFn5kM1RIeXxetfj85vWv6TcMZzr6gg3lObaG5_SoiTZx7XtlUl6NFxsT3rYchpBPi7oU3Y1HbSuOU7wBe1LF0EQUgtp4T9auBkPkWK1pe5SZi94 Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f3182ebf49694cebacb9e2dc217b5307 Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:22.112010 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f3182ebf49694cebacb9e2dc217b5307", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f3182ebf49694cebacb9e2dc217b5307"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f3182ebf49694cebacb9e2dc217b5307 Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: eadf6bd1ef5445a7903e7ad7a5a8e032 Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: {"hw:numa_nodes": "1"} Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:22.113114 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'flavor_id': '397815588', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.113738 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 10:08:22.114651 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.117267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0068fb1-c064-4651-b98b-7def2d574d42 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.118836 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a0068fb1-c064-4651-b98b-7def2d574d42 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984 tempest-FlavorsExtraSpecsNegativeTestJSON-1462461984-project] 10.222.0.76 "PUT /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018258 Oct 27 10:08:22.119576 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 71/137] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:22 2022] PUT /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:22.131779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6eb8f696-981a-41a6-8c59-b581d3e6277d tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.138964 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6eb8f696-981a-41a6-8c59-b581d3e6277d tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] HTTP exception thrown: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6eb8f696-981a-41a6-8c59-b581d3e6277d tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Request method failure captured: Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/flavors/397815588/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliUJt5uCBB2KAnGg-3jXupwSww5U-oze_7iPea6RaS_s6lnXlWI0HZmZwRgkUgS97EdG_fXmqU18MHD-Fn-m143B9lFOHJrjgbyBPQ6pjeJ_sdppzhmppW5M2a1IkjD-Rh2gaO8Jdh6_1-I70AgLn3N2qW_VckZxiZI2oSWeaUHWrs Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: b4432b8964e24d4599eb802f571d4dc9 Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:22.140339 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b4432b8964e24d4599eb802f571d4dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b4432b8964e24d4599eb802f571d4dc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b4432b8964e24d4599eb802f571d4dc9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b4432b8964e24d4599eb802f571d4dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: b4432b8964e24d4599eb802f571d4dc9 Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b96cf0d27fa14ce593a69e9f49d169d8 Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:22.141588 n-d-854663-10 devstack@n-api.service[120720]: exception: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'flavor_id': '397815588', 'id': 'hw:cpu_thread_policy'} Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.142150 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6eb8f696-981a-41a6-8c59-b581d3e6277d tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Returning 404 to user: Flavor 397815588 has no extra specs with key hw:cpu_thread_policy. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6eb8f696-981a-41a6-8c59-b581d3e6277d tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/397815588/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.015374 Oct 27 10:08:22.145728 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 72/138] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:08:22 2022] DELETE /compute/v2.1/flavors/397815588/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:22.153582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64142579-ca01-4175-a647-19260b96cdaf tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.157980 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-64142579-ca01-4175-a647-19260b96cdaf tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64142579-ca01-4175-a647-19260b96cdaf tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Request method failure captured: Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 27 Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliUJt5uCBB2KAnGg-3jXupwSww5U-oze_7iPea6RaS_s6lnXlWI0HZmZwRgkUgS97EdG_fXmqU18MHD-Fn-m143B9lFOHJrjgbyBPQ6pjeJ_sdppzhmppW5M2a1IkjD-Rh2gaO8Jdh6_1-I70AgLn3N2qW_VckZxiZI2oSWeaUHWrs Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: b4432b8964e24d4599eb802f571d4dc9 Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:22.159405 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b4432b8964e24d4599eb802f571d4dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b4432b8964e24d4599eb802f571d4dc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b4432b8964e24d4599eb802f571d4dc9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b4432b8964e24d4599eb802f571d4dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: b4432b8964e24d4599eb802f571d4dc9 Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b96cf0d27fa14ce593a69e9f49d169d8 Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: {"hw:cpu_policy": "shared"} Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:22.160547 n-d-854663-10 devstack@n-api.service[120720]: exception: Request body and URI mismatch Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'flavor_id': '397815588', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.161249 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.165796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:22.165796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:22.165796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 27 10:08:22.165796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.165796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64142579-ca01-4175-a647-19260b96cdaf tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.165796 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-64142579-ca01-4175-a647-19260b96cdaf tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] 10.222.0.76 "PUT /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.012021 Oct 27 10:08:22.165796 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 73/139] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:22 2022] PUT /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes => generated 73 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:08:22.175871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-507a97a6-83fa-4103-b532-ae611b672c13 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-507a97a6-83fa-4103-b532-ae611b672c13 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Request method failure captured: Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 49 Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliUJt5uCBB2KAnGg-3jXupwSww5U-oze_7iPea6RaS_s6lnXlWI0HZmZwRgkUgS97EdG_fXmqU18MHD-Fn-m143B9lFOHJrjgbyBPQ6pjeJ_sdppzhmppW5M2a1IkjD-Rh2gaO8Jdh6_1-I70AgLn3N2qW_VckZxiZI2oSWeaUHWrs Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: b4432b8964e24d4599eb802f571d4dc9 Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:22.187904 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b4432b8964e24d4599eb802f571d4dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b4432b8964e24d4599eb802f571d4dc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b4432b8964e24d4599eb802f571d4dc9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b4432b8964e24d4599eb802f571d4dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: b4432b8964e24d4599eb802f571d4dc9 Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b96cf0d27fa14ce593a69e9f49d169d8 Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 27 10:08:22.189217 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'flavor_id': '397815588', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance: Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 27 10:08:22.189858 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.191909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.193244 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.193244 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.193244 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:08:22.193244 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:08:22.193244 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 10:08:22.193244 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.193244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-507a97a6-83fa-4103-b532-ae611b672c13 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.193244 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-507a97a6-83fa-4103-b532-ae611b672c13 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] 10.222.0.76 "PUT /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.023235 Oct 27 10:08:22.193244 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 74/140] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:22 2022] PUT /compute/v2.1/flavors/397815588/os-extra_specs/hw:numa_nodes => generated 117 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:22.204151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77d788a4-079e-4b11-bd98-019c96c971a6 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.224435 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77d788a4-079e-4b11-bd98-019c96c971a6 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/397815588" status: 202 len: 0 microversion: 2.1 time: 0.026637 Oct 27 10:08:22.225056 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 75/141] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:08:22 2022] DELETE /compute/v2.1/flavors/397815588 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:08:22.236482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b97f07d8-3448-4b3f-bf16-ed88aa1c419f tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.259427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12ffb73d-e4ae-4005-bb78-2d9748c3cfda tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Calling method '.version_select at 0x7f6d600a6790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.263619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ffb73d-e4ae-4005-bb78-2d9748c3cfda tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:22.264089 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b97f07d8-3448-4b3f-bf16-ed88aa1c419f tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865 tempest-FlavorsExtraSpecsNegativeTestJSON-1713506865-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031261 Oct 27 10:08:22.264509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ffb73d-e4ae-4005-bb78-2d9748c3cfda tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:22.277958 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 76/142] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:22.278834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ffb73d-e4ae-4005-bb78-2d9748c3cfda tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:22.280036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ffb73d-e4ae-4005-bb78-2d9748c3cfda tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:22.280572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ffb73d-e4ae-4005-bb78-2d9748c3cfda tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:22.281291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ffb73d-e4ae-4005-bb78-2d9748c3cfda tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:22.309150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.309767 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12ffb73d-e4ae-4005-bb78-2d9748c3cfda tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.226114 Oct 27 10:08:22.310430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:22.317782 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 67/143] 10.222.0.76 () {58 vars in 1128 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:22.322693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:22.323383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:22.323955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:22.324852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:22.325459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:22.326017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:22.400094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.412070 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de4ea733-c49c-4f1b-98e0-7c61dd11392c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1287 microversion: 2.1 time: 0.112602 Oct 27 10:08:22.413302 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 77/144] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:22.459791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe4d04b7-c20f-43de-941a-9c16ca0f2bf2 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Calling method '.version_select at 0x7f6d60124ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.464314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fe4d04b7-c20f-43de-941a-9c16ca0f2bf2 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '507c8c148374402b9b052857a07d3fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09556f92527a4b22a428e47ca5301bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe4d04b7-c20f-43de-941a-9c16ca0f2bf2 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Request method failure captured: Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliVMMgU-FLkjh9fFQ9FKLxqNtQP8o4DuCteLfVw2YIEhrI_eHyEDlfKhfyfqZe1Nhhur_C3tLJNHkoN_VG5MSNfS_rSEbaJfEd3UXvvnE2h5kc_qdxuqrWtE_3WLLDFmPeklKuRkdvwqUGS8siAzGF6LuXJq7W9uqMjrdGTRlUwoJQ Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:22.466484 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_09556f92527a4b22a428e47ca5301bcd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 507c8c148374402b9b052857a07d3fca Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: action_args: {} Oct 27 10:08:22.467624 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.468304 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 10:08:22.469819 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.470966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe4d04b7-c20f-43de-941a-9c16ca0f2bf2 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.470966 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe4d04b7-c20f-43de-941a-9c16ca0f2bf2 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] 10.222.0.76 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.149155 Oct 27 10:08:22.470966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 68/145] 10.222.0.76 () {58 vars in 1128 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 151 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:22.478968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0dce65c9-9f79-4e05-96f9-b43347fd3e7f tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Calling method '.version_select at 0x7f6d60260310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.481215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0dce65c9-9f79-4e05-96f9-b43347fd3e7f tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '507c8c148374402b9b052857a07d3fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09556f92527a4b22a428e47ca5301bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0dce65c9-9f79-4e05-96f9-b43347fd3e7f tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Request method failure captured: Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hosts/n-d-854663-10/reboot HTTP/1.1 Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVMMgU-FLkjh9fFQ9FKLxqNtQP8o4DuCteLfVw2YIEhrI_eHyEDlfKhfyfqZe1Nhhur_C3tLJNHkoN_VG5MSNfS_rSEbaJfEd3UXvvnE2h5kc_qdxuqrWtE_3WLLDFmPeklKuRkdvwqUGS8siAzGF6LuXJq7W9uqMjrdGTRlUwoJQ Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:22.483928 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_09556f92527a4b22a428e47ca5301bcd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 507c8c148374402b9b052857a07d3fca Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'n-d-854663-10'} Oct 27 10:08:22.485234 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.485902 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 10:08:22.486919 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.488362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0dce65c9-9f79-4e05-96f9-b43347fd3e7f tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.488362 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0dce65c9-9f79-4e05-96f9-b43347fd3e7f tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] 10.222.0.76 "GET /compute/v2.1/os-hosts/n-d-854663-10/reboot" status: 403 len: 111 microversion: 2.1 time: 0.012275 Oct 27 10:08:22.489033 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 78/146] 10.222.0.76 () {58 vars in 1191 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts/n-d-854663-10/reboot => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:22.506407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-badd709a-8be1-48b4-a6f3-43b1b04aa0ef tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Calling method '.version_select at 0x7f6d6004c9d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.529770 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-badd709a-8be1-48b4-a6f3-43b1b04aa0ef tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-badd709a-8be1-48b4-a6f3-43b1b04aa0ef tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Request method failure captured: Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliVfRMhf6BQ_IcoS-Egsf6vVD_o7PkWM11zLYHGYa7JzuFVkR3uaC7zHMSnRY2eSAc1zO2j38zmw8e4a49nthYg4IQiHV1EomIgFHTV_n5hVerp3DYzBSRQM9gKCMUqdItNB5-q2FHc2IlyR6ffK3u6PI8IqyoPkyEusmcjEuiTO4Q Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:22.537090 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d61fdbae0bc04bf3b2aa7676eb19f4cb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 7b7bbd634335421eb6995dd6f911b303 Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'nonexistent_hostname'} Oct 27 10:08:22.538259 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:22.538951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 10:08:22.539994 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-badd709a-8be1-48b4-a6f3-43b1b04aa0ef tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-badd709a-8be1-48b4-a6f3-43b1b04aa0ef tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.042656 Oct 27 10:08:22.542458 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 69/147] 10.222.0.76 () {58 vars in 1212 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:22.550010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c64ddc53-7b82-48a0-b8b9-9b76b3c7a126 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Calling method '.version_select at 0x7f6d60309670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.552221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c64ddc53-7b82-48a0-b8b9-9b76b3c7a126 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '507c8c148374402b9b052857a07d3fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09556f92527a4b22a428e47ca5301bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c64ddc53-7b82-48a0-b8b9-9b76b3c7a126 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Request method failure captured: Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hosts/n-d-854663-10 HTTP/1.1 Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVMMgU-FLkjh9fFQ9FKLxqNtQP8o4DuCteLfVw2YIEhrI_eHyEDlfKhfyfqZe1Nhhur_C3tLJNHkoN_VG5MSNfS_rSEbaJfEd3UXvvnE2h5kc_qdxuqrWtE_3WLLDFmPeklKuRkdvwqUGS8siAzGF6LuXJq7W9uqMjrdGTRlUwoJQ Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:22.554241 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_09556f92527a4b22a428e47ca5301bcd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 507c8c148374402b9b052857a07d3fca Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'n-d-854663-10'} Oct 27 10:08:22.555504 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.556194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 10:08:22.557158 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.557988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c64ddc53-7b82-48a0-b8b9-9b76b3c7a126 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.557988 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c64ddc53-7b82-48a0-b8b9-9b76b3c7a126 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] 10.222.0.76 "GET /compute/v2.1/os-hosts/n-d-854663-10" status: 403 len: 109 microversion: 2.1 time: 0.009499 Oct 27 10:08:22.557988 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 79/148] 10.222.0.76 () {58 vars in 1170 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts/n-d-854663-10 => generated 109 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:22.566548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e79041ff-ae9a-43ba-b7bb-e366dcb62642 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Calling method '.version_select at 0x7f6d600a5700>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.574587 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e79041ff-ae9a-43ba-b7bb-e366dcb62642 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e79041ff-ae9a-43ba-b7bb-e366dcb62642 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Request method failure captured: Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliVfRMhf6BQ_IcoS-Egsf6vVD_o7PkWM11zLYHGYa7JzuFVkR3uaC7zHMSnRY2eSAc1zO2j38zmw8e4a49nthYg4IQiHV1EomIgFHTV_n5hVerp3DYzBSRQM9gKCMUqdItNB5-q2FHc2IlyR6ffK3u6PI8IqyoPkyEusmcjEuiTO4Q Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:22.576092 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d61fdbae0bc04bf3b2aa7676eb19f4cb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 7b7bbd634335421eb6995dd6f911b303 Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'nonexistent_hostname'} Oct 27 10:08:22.577202 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.577936 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.578998 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.580048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e79041ff-ae9a-43ba-b7bb-e366dcb62642 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.580048 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e79041ff-ae9a-43ba-b7bb-e366dcb62642 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016575 Oct 27 10:08:22.580048 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 70/149] 10.222.0.76 () {58 vars in 1191 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:22.590405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-676fdbd1-55cd-4d10-92d8-7b7133693d5d tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Calling method '.version_select at 0x7f6d60309f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.597014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-676fdbd1-55cd-4d10-92d8-7b7133693d5d tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '507c8c148374402b9b052857a07d3fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09556f92527a4b22a428e47ca5301bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-676fdbd1-55cd-4d10-92d8-7b7133693d5d tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Request method failure captured: Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hosts/n-d-854663-10/shutdown HTTP/1.1 Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVMMgU-FLkjh9fFQ9FKLxqNtQP8o4DuCteLfVw2YIEhrI_eHyEDlfKhfyfqZe1Nhhur_C3tLJNHkoN_VG5MSNfS_rSEbaJfEd3UXvvnE2h5kc_qdxuqrWtE_3WLLDFmPeklKuRkdvwqUGS8siAzGF6LuXJq7W9uqMjrdGTRlUwoJQ Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:22.599486 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_09556f92527a4b22a428e47ca5301bcd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 507c8c148374402b9b052857a07d3fca Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'n-d-854663-10'} Oct 27 10:08:22.600611 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.601300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 10:08:22.602240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.603121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-676fdbd1-55cd-4d10-92d8-7b7133693d5d tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.603925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.604539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:22.608345 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-676fdbd1-55cd-4d10-92d8-7b7133693d5d tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] 10.222.0.76 "GET /compute/v2.1/os-hosts/n-d-854663-10/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016576 Oct 27 10:08:22.609257 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 80/150] 10.222.0.76 () {58 vars in 1197 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts/n-d-854663-10/shutdown => generated 113 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:22.618679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fe358e3-974f-4c74-ae32-3890c7fc6b2b tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Calling method '.version_select at 0x7f6d60319c10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.622182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:22.625112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:22.626505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:22.631026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:22.631923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:22.633434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:22.633852 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-5fe358e3-974f-4c74-ae32-3890c7fc6b2b tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fe358e3-974f-4c74-ae32-3890c7fc6b2b tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Request method failure captured: Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVfRMhf6BQ_IcoS-Egsf6vVD_o7PkWM11zLYHGYa7JzuFVkR3uaC7zHMSnRY2eSAc1zO2j38zmw8e4a49nthYg4IQiHV1EomIgFHTV_n5hVerp3DYzBSRQM9gKCMUqdItNB5-q2FHc2IlyR6ffK3u6PI8IqyoPkyEusmcjEuiTO4Q Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:22.638133 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d61fdbae0bc04bf3b2aa7676eb19f4cb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7b7bbd634335421eb6995dd6f911b303 Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'nonexistent_hostname'} Oct 27 10:08:22.639344 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:22.639975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 10:08:22.641626 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fe358e3-974f-4c74-ae32-3890c7fc6b2b tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5fe358e3-974f-4c74-ae32-3890c7fc6b2b tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.024697 Oct 27 10:08:22.642565 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 81/151] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:22.653083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b9606f1-7d94-49f8-907b-4322c486cc43 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Calling method '.version_select at 0x7f6d60139700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.655863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b9606f1-7d94-49f8-907b-4322c486cc43 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '507c8c148374402b9b052857a07d3fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09556f92527a4b22a428e47ca5301bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b9606f1-7d94-49f8-907b-4322c486cc43 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Request method failure captured: Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hosts/n-d-854663-10/startup HTTP/1.1 Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVMMgU-FLkjh9fFQ9FKLxqNtQP8o4DuCteLfVw2YIEhrI_eHyEDlfKhfyfqZe1Nhhur_C3tLJNHkoN_VG5MSNfS_rSEbaJfEd3UXvvnE2h5kc_qdxuqrWtE_3WLLDFmPeklKuRkdvwqUGS8siAzGF6LuXJq7W9uqMjrdGTRlUwoJQ Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:22.658084 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_09556f92527a4b22a428e47ca5301bcd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 507c8c148374402b9b052857a07d3fca Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'n-d-854663-10'} Oct 27 10:08:22.659253 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.659983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 10:08:22.660921 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.663821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b9606f1-7d94-49f8-907b-4322c486cc43 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.665766 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b9606f1-7d94-49f8-907b-4322c486cc43 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] 10.222.0.76 "GET /compute/v2.1/os-hosts/n-d-854663-10/startup" status: 403 len: 110 microversion: 2.1 time: 0.019326 Oct 27 10:08:22.666901 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 82/152] 10.222.0.76 () {58 vars in 1194 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts/n-d-854663-10/startup => generated 110 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:22.677733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-265e6669-c8c5-4c0d-93b0-0454314a82dc tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Calling method '.version_select at 0x7f6d603a33a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.697132 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-265e6669-c8c5-4c0d-93b0-0454314a82dc tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-265e6669-c8c5-4c0d-93b0-0454314a82dc tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Request method failure captured: Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVfRMhf6BQ_IcoS-Egsf6vVD_o7PkWM11zLYHGYa7JzuFVkR3uaC7zHMSnRY2eSAc1zO2j38zmw8e4a49nthYg4IQiHV1EomIgFHTV_n5hVerp3DYzBSRQM9gKCMUqdItNB5-q2FHc2IlyR6ffK3u6PI8IqyoPkyEusmcjEuiTO4Q Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:22.699079 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d61fdbae0bc04bf3b2aa7676eb19f4cb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7b7bbd634335421eb6995dd6f911b303 Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'nonexistent_hostname'} Oct 27 10:08:22.700417 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:22.701347 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 10:08:22.702430 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.704536 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.706356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-265e6669-c8c5-4c0d-93b0-0454314a82dc tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.707973 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-265e6669-c8c5-4c0d-93b0-0454314a82dc tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.034661 Oct 27 10:08:22.713605 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 83/153] 10.222.0.76 () {58 vars in 1215 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:22.719109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bc6067f-eeb0-49fa-886e-d80846282817 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Action: 'update', calling method: .version_select at 0x7f6d60245ca0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bc6067f-eeb0-49fa-886e-d80846282817 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Request method failure captured: Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/os-hosts/n-d-854663-10 HTTP/1.1 Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 51 Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVfRMhf6BQ_IcoS-Egsf6vVD_o7PkWM11zLYHGYa7JzuFVkR3uaC7zHMSnRY2eSAc1zO2j38zmw8e4a49nthYg4IQiHV1EomIgFHTV_n5hVerp3DYzBSRQM9gKCMUqdItNB5-q2FHc2IlyR6ffK3u6PI8IqyoPkyEusmcjEuiTO4Q Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:22.723091 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d61fdbae0bc04bf3b2aa7676eb19f4cb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7b7bbd634335421eb6995dd6f911b303 Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: {"status": "enable", "maintenance_mode": "invalid"} Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.724267 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'n-d-854663-10', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance: Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.725373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.727202 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.730358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.730358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:08:22.730358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:08:22.730358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 10:08:22.730358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.730358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bc6067f-eeb0-49fa-886e-d80846282817 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.730358 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bc6067f-eeb0-49fa-886e-d80846282817 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-hosts/n-d-854663-10" status: 400 len: 199 microversion: 2.1 time: 0.013486 Oct 27 10:08:22.733761 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 84/154] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 27 10:08:22 2022] PUT /compute/v2.1/os-hosts/n-d-854663-10 => generated 199 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:22.740853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4cc45899-19bd-4fd4-9868-8896ff5c076d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Action: 'update', calling method: .version_select at 0x7f6d60139670>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4cc45899-19bd-4fd4-9868-8896ff5c076d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Request method failure captured: Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/os-hosts/n-d-854663-10 HTTP/1.1 Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 51 Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVfRMhf6BQ_IcoS-Egsf6vVD_o7PkWM11zLYHGYa7JzuFVkR3uaC7zHMSnRY2eSAc1zO2j38zmw8e4a49nthYg4IQiHV1EomIgFHTV_n5hVerp3DYzBSRQM9gKCMUqdItNB5-q2FHc2IlyR6ffK3u6PI8IqyoPkyEusmcjEuiTO4Q Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:22.745298 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d61fdbae0bc04bf3b2aa7676eb19f4cb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7b7bbd634335421eb6995dd6f911b303 Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: {"status": "invalid", "maintenance_mode": "enable"} Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.746728 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'n-d-854663-10', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance: Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.747547 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.750087 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.751293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.751293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:08:22.751293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:08:22.751293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 10:08:22.751293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.751293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4cc45899-19bd-4fd4-9868-8896ff5c076d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.751293 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4cc45899-19bd-4fd4-9868-8896ff5c076d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-hosts/n-d-854663-10" status: 400 len: 189 microversion: 2.1 time: 0.011883 Oct 27 10:08:22.752613 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 85/155] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 27 10:08:22 2022] PUT /compute/v2.1/os-hosts/n-d-854663-10 => generated 189 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:22.758449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c808262-30eb-47cf-a1b0-4a254ab2f1b7 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Action: 'update', calling method: .version_select at 0x7f6d603a31f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.762378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c808262-30eb-47cf-a1b0-4a254ab2f1b7 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '507c8c148374402b9b052857a07d3fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09556f92527a4b22a428e47ca5301bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c808262-30eb-47cf-a1b0-4a254ab2f1b7 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Request method failure captured: Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/os-hosts/n-d-854663-10 HTTP/1.1 Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 50 Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVMMgU-FLkjh9fFQ9FKLxqNtQP8o4DuCteLfVw2YIEhrI_eHyEDlfKhfyfqZe1Nhhur_C3tLJNHkoN_VG5MSNfS_rSEbaJfEd3UXvvnE2h5kc_qdxuqrWtE_3WLLDFmPeklKuRkdvwqUGS8siAzGF6LuXJq7W9uqMjrdGTRlUwoJQ Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:22.763990 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_09556f92527a4b22a428e47ca5301bcd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/09556f92527a4b22a428e47ca5301bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 09556f92527a4b22a428e47ca5301bcd Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1982957112 Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 507c8c148374402b9b052857a07d3fca Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1982957112-project Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: {"status": "enable", "maintenance_mode": "enable"} Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 10:08:22.765423 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'n-d-854663-10', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.766349 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 10:08:22.767576 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.768949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c808262-30eb-47cf-a1b0-4a254ab2f1b7 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.768949 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c808262-30eb-47cf-a1b0-4a254ab2f1b7 tempest-HostsAdminNegativeTestJSON-1982957112 tempest-HostsAdminNegativeTestJSON-1982957112-project] 10.222.0.76 "PUT /compute/v2.1/os-hosts/n-d-854663-10" status: 403 len: 111 microversion: 2.1 time: 0.012334 Oct 27 10:08:22.771009 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 86/156] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 27 10:08:22 2022] PUT /compute/v2.1/os-hosts/n-d-854663-10 => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:22.776726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43a5609f-71ec-4f5e-8804-76f0155f21a8 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Action: 'update', calling method: .version_select at 0x7f6d6013d9d0>, body: {"status": null, "maintenance_mode": null} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43a5609f-71ec-4f5e-8804-76f0155f21a8 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Request method failure captured: Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/os-hosts/n-d-854663-10 HTTP/1.1 Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 42 Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVfRMhf6BQ_IcoS-Egsf6vVD_o7PkWM11zLYHGYa7JzuFVkR3uaC7zHMSnRY2eSAc1zO2j38zmw8e4a49nthYg4IQiHV1EomIgFHTV_n5hVerp3DYzBSRQM9gKCMUqdItNB5-q2FHc2IlyR6ffK3u6PI8IqyoPkyEusmcjEuiTO4Q Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:22.781109 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d61fdbae0bc04bf3b2aa7676eb19f4cb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7b7bbd634335421eb6995dd6f911b303 Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: {"status": null, "maintenance_mode": null} Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 10:08:22.782900 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'n-d-854663-10', 'body': {'status': None, 'maintenance_mode': None}} Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance: Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi None Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.783773 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.785384 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.787271 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:08:22.787271 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:08:22.787271 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 10:08:22.787271 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.788499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43a5609f-71ec-4f5e-8804-76f0155f21a8 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.789624 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43a5609f-71ec-4f5e-8804-76f0155f21a8 tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-hosts/n-d-854663-10" status: 400 len: 127 microversion: 2.1 time: 0.017631 Oct 27 10:08:22.790481 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 87/157] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 27 10:08:22 2022] PUT /compute/v2.1/os-hosts/n-d-854663-10 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:22.801357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a28c608c-99bc-44d6-8fcf-a805b28fdf2d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Action: 'update', calling method: .version_select at 0x7f6d60260c10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:22.806627 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.hosts [None req-a28c608c-99bc-44d6-8fcf-a805b28fdf2d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Enabling host nonexistent_hostname. Oct 27 10:08:22.815702 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a28c608c-99bc-44d6-8fcf-a805b28fdf2d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a28c608c-99bc-44d6-8fcf-a805b28fdf2d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Request method failure captured: Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 50 Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliVfRMhf6BQ_IcoS-Egsf6vVD_o7PkWM11zLYHGYa7JzuFVkR3uaC7zHMSnRY2eSAc1zO2j38zmw8e4a49nthYg4IQiHV1EomIgFHTV_n5hVerp3DYzBSRQM9gKCMUqdItNB5-q2FHc2IlyR6ffK3u6PI8IqyoPkyEusmcjEuiTO4Q Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:22.817928 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d61fdbae0bc04bf3b2aa7676eb19f4cb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d61fdbae0bc04bf3b2aa7676eb19f4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d61fdbae0bc04bf3b2aa7676eb19f4cb Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1502368915 Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7b7bbd634335421eb6995dd6f911b303 Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1502368915-project-admin Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: {"status": "enable", "maintenance_mode": "enable"} Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.819025 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 10:08:22.819748 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:22.820732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:22.821976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a28c608c-99bc-44d6-8fcf-a805b28fdf2d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:22.822823 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a28c608c-99bc-44d6-8fcf-a805b28fdf2d tempest-HostsAdminNegativeTestJSON-1502368915 tempest-HostsAdminNegativeTestJSON-1502368915-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022119 Oct 27 10:08:22.824530 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 88/158] 10.222.0.76 () {60 vars in 1211 bytes} [Thu Oct 27 10:08:22 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:22.835892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.836614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:22.841973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:22.852982 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4632e57e-3902-479a-bb27-9d06a4b3a79d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.260798 Oct 27 10:08:22.855540 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 71/159] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:22.859438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:22.860398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:22.861265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:22.862353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:22.862859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:22.863349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:22.989000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:22.989618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:22.998464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:22.999565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:23.000204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:23.002221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:23.002905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:23.003832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:23.086092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:23.094535 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3b798cd-812a-4ee7-a52b-451c5d5a2c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1276 microversion: 2.1 time: 0.109225 Oct 27 10:08:23.095223 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 72/160] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:23.192617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:23.201524 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-125935a2-94db-4d07-8d71-436af4347f9f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.370227 Oct 27 10:08:23.202418 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 89/161] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:22 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:23.440063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:23.440702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:23.447924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:23.448463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:23.448862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:23.449569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:23.450019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:23.450436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:23.568828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:23.584024 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f65c3d9c-d5a5-4069-8bec-5153a1f4dfb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1293 microversion: 2.1 time: 0.147744 Oct 27 10:08:23.584841 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 73/162] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:23 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1293 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:23.879197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:23.880427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:23.887662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:23.888142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:23.888552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:23.889443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:23.889865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:23.890446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:24.081282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:24.090837 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-321bfb74-93d6-41db-b724-2371b301e11c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.215448 Oct 27 10:08:24.105145 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 90/163] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:23 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:24.122310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:24.122310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:24.127476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:24.129945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:24.130385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:24.131796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:24.132568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:24.133150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:24.228382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:24.230319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:24.259368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:24.260063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:24.262300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:24.265254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:24.266950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:24.269522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:24.442387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:24.456520 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-97ee1cee-aa29-487d-9976-51436a78ab7a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1318 microversion: 2.1 time: 0.337868 Oct 27 10:08:24.457222 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 74/164] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:24 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:24.573116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:24.582763 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41ff8551-dbab-4fc6-a5ba-675eac7702e9 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.361848 Oct 27 10:08:24.583341 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 91/165] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:24 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:24.609467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:24.610078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:24.616001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:24.616540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:24.616941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:24.617656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:24.618457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:24.618874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:24.639551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:24.704195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:24.712997 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-832b298b-73f0-4669-a2ae-e7e9d1c0fe40 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1293 microversion: 2.1 time: 0.107224 Oct 27 10:08:24.724712 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 75/166] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:24 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:24.974319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6b00c6dd-3231-498e-852f-96047ca38590 req-82c7df42-c11d-4ed9-a3b0-fa447cdf8132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05477c33-3427-45c5-88ce-1f0dcfc68874", "tag": "1668331e-2153-46cb-8660-beb90803f0a6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:24.992914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6b00c6dd-3231-498e-852f-96047ca38590 req-82c7df42-c11d-4ed9-a3b0-fa447cdf8132 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:24.995693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6b00c6dd-3231-498e-852f-96047ca38590 req-82c7df42-c11d-4ed9-a3b0-fa447cdf8132 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:24.996762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6b00c6dd-3231-498e-852f-96047ca38590 req-82c7df42-c11d-4ed9-a3b0-fa447cdf8132 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:25.030518 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6b00c6dd-3231-498e-852f-96047ca38590 req-82c7df42-c11d-4ed9-a3b0-fa447cdf8132 service nova] Creating event network-changed:1668331e-2153-46cb-8660-beb90803f0a6 for instance 05477c33-3427-45c5-88ce-1f0dcfc68874 on n-h1-854663-10 Oct 27 10:08:25.038937 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6b00c6dd-3231-498e-852f-96047ca38590 req-82c7df42-c11d-4ed9-a3b0-fa447cdf8132 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073294 Oct 27 10:08:25.064811 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 92/167] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:25.116705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:25.117523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:25.127364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:25.129461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:25.130031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:25.130883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:25.131378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:25.131846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:25.372030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:25.385131 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-04df74aa-ad37-4680-81b0-ade4ee951707 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.273152 Oct 27 10:08:25.387293 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 76/168] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:25 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:25.486106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:25.486879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:25.499509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:25.500155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:25.501430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:25.502336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:25.503529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:25.504085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:25.608265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:25.609504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:25.617769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:25.619199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:25.620090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:25.621017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:25.621612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:25.622179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:25.732907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:25.747413 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f076675-75b9-43fc-bd9e-b754bee0c410 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1318 microversion: 2.1 time: 0.268440 Oct 27 10:08:25.749484 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 93/169] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:25 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:25.756958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:25.763939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:25.790125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:25.790955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:25.794175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:25.795701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:25.796302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:25.797983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:25.988435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:26.005627 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71d070b6-a9bc-46ec-a224-32e30b465fe2 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.401785 Oct 27 10:08:26.022153 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 77/170] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:25 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:26.091279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:26.102887 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e786dbc3-40f5-465c-b071-241d31f6b8ee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1335 microversion: 2.1 time: 0.352134 Oct 27 10:08:26.105114 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 94/171] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:25 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1335 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:26.123790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-75160407-72df-49ed-bb9c-a5a2d50ac168 req-b9f96b62-81b3-4d68-a690-ad64733d3942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc51aea-cbe7-435e-9b95-5ba843803540", "name": "network-vif-plugged", "status": "completed", "tag": "7f8a675a-9094-4b26-bfe4-896dc88edb90"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:26.139265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-75160407-72df-49ed-bb9c-a5a2d50ac168 req-b9f96b62-81b3-4d68-a690-ad64733d3942 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:26.143000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-75160407-72df-49ed-bb9c-a5a2d50ac168 req-b9f96b62-81b3-4d68-a690-ad64733d3942 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:26.143788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-75160407-72df-49ed-bb9c-a5a2d50ac168 req-b9f96b62-81b3-4d68-a690-ad64733d3942 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:26.161156 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-75160407-72df-49ed-bb9c-a5a2d50ac168 req-b9f96b62-81b3-4d68-a690-ad64733d3942 service nova] Creating event network-vif-plugged:7f8a675a-9094-4b26-bfe4-896dc88edb90 for instance 3fc51aea-cbe7-435e-9b95-5ba843803540 on n-h2-854663-10 Oct 27 10:08:26.167111 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-75160407-72df-49ed-bb9c-a5a2d50ac168 req-b9f96b62-81b3-4d68-a690-ad64733d3942 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143506 Oct 27 10:08:26.168177 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 78/172] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:26.412048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:26.412687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:26.427912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:26.428400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:26.429038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:26.429865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:26.430471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:26.431034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:26.705155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:26.715007 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e933f301-4347-444e-b939-5b430cf2f18e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.307627 Oct 27 10:08:26.716418 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 95/173] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:26 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:26.773086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:26.774436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:26.794646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:26.795492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:26.796042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:26.797422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:26.798001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:26.798518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.038105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.043192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:27.045536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:27.051072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.052343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.053052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.054231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.055250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.056245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.056388 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52db4479-8c5b-4104-9fd0-371ea8e34361 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1318 microversion: 2.1 time: 0.289717 Oct 27 10:08:27.057203 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 79/174] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:26 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:27.130493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.131134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:27.142723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.143388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.143630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.149427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.150404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.150976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.380367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:27.389300 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-91b68c22-32ac-42b8-849b-22728d27f12d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.360500 Oct 27 10:08:27.389906 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 96/175] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:27 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:27.399839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-eba4713f-cfbb-41f8-8330-2fb810e559a2 req-bb38a1ef-192c-4e75-b7c1-6014e7e1a38d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb77378-15a7-4ccf-ac15-96574a205e0a", "tag": "ba2f9293-c098-436c-8a1a-23b264e8b733"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:27.419200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eba4713f-cfbb-41f8-8330-2fb810e559a2 req-bb38a1ef-192c-4e75-b7c1-6014e7e1a38d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.419930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eba4713f-cfbb-41f8-8330-2fb810e559a2 req-bb38a1ef-192c-4e75-b7c1-6014e7e1a38d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.420366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eba4713f-cfbb-41f8-8330-2fb810e559a2 req-bb38a1ef-192c-4e75-b7c1-6014e7e1a38d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.429681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:27.432617 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-eba4713f-cfbb-41f8-8330-2fb810e559a2 req-bb38a1ef-192c-4e75-b7c1-6014e7e1a38d service nova] Creating event network-changed:ba2f9293-c098-436c-8a1a-23b264e8b733 for instance 3eb77378-15a7-4ccf-ac15-96574a205e0a on n-h2-854663-10 Oct 27 10:08:27.437704 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-eba4713f-cfbb-41f8-8330-2fb810e559a2 req-bb38a1ef-192c-4e75-b7c1-6014e7e1a38d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046683 Oct 27 10:08:27.438583 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 97/176] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:27.440668 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-526d2472-d536-4772-bd8b-350c7b0339a9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1335 microversion: 2.1 time: 0.313294 Oct 27 10:08:27.442606 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 80/177] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:27 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1335 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:27.579630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35935a2a-18c7-4b80-9701-7c794275b76e tempest-FlavorsV255TestJSON-1546627950 tempest-FlavorsV255TestJSON-1546627950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-429329741", "id": 688454719, "os-flavor-access:is_public": "True"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:27.598415 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35935a2a-18c7-4b80-9701-7c794275b76e tempest-FlavorsV255TestJSON-1546627950 tempest-FlavorsV255TestJSON-1546627950-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.074726 Oct 27 10:08:27.599734 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 81/178] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:08:27 2022] POST /compute/v2.1/flavors => generated 445 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:08:27.636595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Calling method '.version_select at 0x7f6d60e944c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.638466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.638950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.639381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.654465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.654942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.655380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.665779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.666259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.666703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.672955 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4584d430-4e09-4c38-bce6-201325ea7e55 tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.233206 Oct 27 10:08:27.673554 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 98/179] 10.222.0.76 () {60 vars in 1187 bytes} [Thu Oct 27 10:08:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:08:27.686983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-000442a2-c858-448f-9150-933aa8e8450a tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Calling method '.version_select at 0x7f6d602cf3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.688842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000442a2-c858-448f-9150-933aa8e8450a tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.689319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000442a2-c858-448f-9150-933aa8e8450a tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.689750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000442a2-c858-448f-9150-933aa8e8450a tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.703956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000442a2-c858-448f-9150-933aa8e8450a tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.704466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000442a2-c858-448f-9150-933aa8e8450a tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.704932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000442a2-c858-448f-9150-933aa8e8450a tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.711737 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-000442a2-c858-448f-9150-933aa8e8450a tempest-HypervisorAdminV228Test-576298551 tempest-HypervisorAdminV228Test-576298551-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.031079 Oct 27 10:08:27.712649 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 99/180] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 27 10:08:27 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:08:27.715180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d16211f-cc04-44f3-9c60-690a55aa81b5 tempest-FlavorsV255TestJSON-489097436 tempest-FlavorsV255TestJSON-489097436-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.723343 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d16211f-cc04-44f3-9c60-690a55aa81b5 tempest-FlavorsV255TestJSON-489097436 tempest-FlavorsV255TestJSON-489097436-project] 10.222.0.76 "GET /compute/v2.1/flavors/688454719" status: 200 len: 445 microversion: 2.55 time: 0.113923 Oct 27 10:08:27.724037 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 82/181] 10.222.0.76 () {60 vars in 1196 bytes} [Thu Oct 27 10:08:27 2022] GET /compute/v2.1/flavors/688454719 => generated 445 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:08:27.737042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ebb637b-e5e1-4c08-988c-f58a3dd93019 tempest-FlavorsV255TestJSON-1546627950 tempest-FlavorsV255TestJSON-1546627950-project-admin] Action: 'update', calling method: .version_select at 0x7f6d61418f70>, body: {"flavor": {"description": "new"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:27.738141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.738729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:27.746445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.746942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.747366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.748051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:27.748467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:27.748956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:27.780643 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ebb637b-e5e1-4c08-988c-f58a3dd93019 tempest-FlavorsV255TestJSON-1546627950 tempest-FlavorsV255TestJSON-1546627950-project-admin] 10.222.0.76 "PUT /compute/v2.1/flavors/688454719" status: 200 len: 446 microversion: 2.55 time: 0.047459 Oct 27 10:08:27.789980 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 100/182] 10.222.0.76 () {62 vars in 1216 bytes} [Thu Oct 27 10:08:27 2022] PUT /compute/v2.1/flavors/688454719 => generated 446 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:08:27.798361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01d1912b-165d-4af7-a287-4e20589dd486 tempest-FlavorsV255TestJSON-489097436 tempest-FlavorsV255TestJSON-489097436-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.830211 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01d1912b-165d-4af7-a287-4e20589dd486 tempest-FlavorsV255TestJSON-489097436 tempest-FlavorsV255TestJSON-489097436-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.035493 Oct 27 10:08:27.830816 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 101/183] 10.222.0.76 () {60 vars in 1187 bytes} [Thu Oct 27 10:08:27 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:08:27.852122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e361187-46e0-4679-a52e-f64ff97727ae tempest-FlavorsV255TestJSON-489097436 tempest-FlavorsV255TestJSON-489097436-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.875312 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e361187-46e0-4679-a52e-f64ff97727ae tempest-FlavorsV255TestJSON-489097436 tempest-FlavorsV255TestJSON-489097436-project] 10.222.0.76 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.026926 Oct 27 10:08:27.876277 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 102/184] 10.222.0.76 () {60 vars in 1166 bytes} [Thu Oct 27 10:08:27 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:08:27.892593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c71d6de-d9d4-49e0-8f92-d075334097db tempest-FlavorsV255TestJSON-1546627950 tempest-FlavorsV255TestJSON-1546627950-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.895480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:27.904479 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5fbd467f-d84b-4c5b-b9fa-475f47afc38b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.169984 Oct 27 10:08:27.905200 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 83/185] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:27 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:27.914110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c71d6de-d9d4-49e0-8f92-d075334097db tempest-FlavorsV255TestJSON-1546627950 tempest-FlavorsV255TestJSON-1546627950-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/688454719" status: 202 len: 0 microversion: 2.55 time: 0.025019 Oct 27 10:08:27.914730 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 103/186] 10.222.0.76 () {60 vars in 1199 bytes} [Thu Oct 27 10:08:27 2022] DELETE /compute/v2.1/flavors/688454719 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:08:27.922688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d8882c2-e5b6-4834-8fda-bd727e0323d2 tempest-FlavorsV255TestJSON-1546627950 tempest-FlavorsV255TestJSON-1546627950-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:27.943236 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d8882c2-e5b6-4834-8fda-bd727e0323d2 tempest-FlavorsV255TestJSON-1546627950 tempest-FlavorsV255TestJSON-1546627950-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.024155 Oct 27 10:08:27.943784 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 84/187] 10.222.0.76 () {60 vars in 1187 bytes} [Thu Oct 27 10:08:27 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:08:28.082899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:28.083819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:28.091377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:28.091859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:28.092284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:28.092996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:28.093783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:28.094344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:28.184431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-de4cc7f7-a1e1-4b66-b92a-cd85122845e6 req-1ac62193-bfbb-45c9-929f-a9a7e8f8ea67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e77d7f7-01d9-4f67-b567-d759d30cfe3d", "name": "network-vif-plugged", "status": "completed", "tag": "58c7f30f-27e0-4d35-8a83-7b93cd2c56a5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:28.204786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-de4cc7f7-a1e1-4b66-b92a-cd85122845e6 req-1ac62193-bfbb-45c9-929f-a9a7e8f8ea67 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:28.206466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-de4cc7f7-a1e1-4b66-b92a-cd85122845e6 req-1ac62193-bfbb-45c9-929f-a9a7e8f8ea67 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:28.208626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-de4cc7f7-a1e1-4b66-b92a-cd85122845e6 req-1ac62193-bfbb-45c9-929f-a9a7e8f8ea67 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:28.224481 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-de4cc7f7-a1e1-4b66-b92a-cd85122845e6 req-1ac62193-bfbb-45c9-929f-a9a7e8f8ea67 service nova] Creating event network-vif-plugged:58c7f30f-27e0-4d35-8a83-7b93cd2c56a5 for instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d on n-h1-854663-10 Oct 27 10:08:28.233298 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-de4cc7f7-a1e1-4b66-b92a-cd85122845e6 req-1ac62193-bfbb-45c9-929f-a9a7e8f8ea67 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052073 Oct 27 10:08:28.234294 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 85/188] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:08:28.275945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:28.288294 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f8c1270-49f8-463f-bd4a-4f7d99f4130f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1318 microversion: 2.1 time: 0.209020 Oct 27 10:08:28.289688 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 104/189] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:28 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:28.415468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:28.416204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:28.422509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:28.422981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:28.423379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:28.424094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:28.424539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:28.425011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:28.464017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:28.464724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:28.473319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:28.473809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:28.474237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:28.474937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:28.475389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:28.475925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:28.495874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:28.622673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:28.632605 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73840b8d-bcc5-4b9f-a0c4-e841e0da0f1e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1338 microversion: 2.1 time: 0.221372 Oct 27 10:08:28.645963 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 86/190] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:28 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1338 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:28.657811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:28.666054 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a9b2b1b-2695-46e3-9fd0-05fb1c41db04 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1335 microversion: 2.1 time: 0.205895 Oct 27 10:08:28.666622 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 105/191] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:28 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1335 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:28.929231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:28.931021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:28.938549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:28.939305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:28.939975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:28.942239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:28.943254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:28.943865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:29.118797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:29.131860 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1fd89716-8200-4b9f-a787-3a82867e52df tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.207640 Oct 27 10:08:29.133089 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 87/192] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:28 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:29.311708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:29.312322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:29.324103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:29.324884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:29.325462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:29.329507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:29.330116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:29.330757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:29.551074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:29.563809 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a5f0737-537c-42af-a30b-1c82ca2d17c3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1318 microversion: 2.1 time: 0.255915 Oct 27 10:08:29.572863 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 106/193] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:29 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:29.659038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:29.659742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:29.665112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:29.667984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:29.668566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:29.669227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:29.670047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:29.670614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:29.671111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:29.689208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:29.690001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:29.697888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:29.698503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:29.699142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:29.700134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:29.700651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:29.701210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:29.949448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:29.959657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:29.970303 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f83b9d36-112c-49b6-b534-4835e56590eb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1335 microversion: 2.1 time: 0.284898 Oct 27 10:08:29.970740 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4252a3ea-200e-4c34-bc4f-96b37e3f27da tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1488 microversion: 2.1 time: 0.317767 Oct 27 10:08:29.971707 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 88/194] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:29 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1488 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:29.973739 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 107/195] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:29 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1335 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:30.008141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3e32128-b655-4402-98fb-32454dfb6d05 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:30.009583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f3e32128-b655-4402-98fb-32454dfb6d05 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:30.018385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3e32128-b655-4402-98fb-32454dfb6d05 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.018920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3e32128-b655-4402-98fb-32454dfb6d05 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.019378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3e32128-b655-4402-98fb-32454dfb6d05 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.020171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3e32128-b655-4402-98fb-32454dfb6d05 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.020651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3e32128-b655-4402-98fb-32454dfb6d05 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.021156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3e32128-b655-4402-98fb-32454dfb6d05 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.155443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:30.156074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:30.165094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.165572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.165996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.166689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.167149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.172853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.362454 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f3e32128-b655-4402-98fb-32454dfb6d05 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1641 microversion: 2.1 time: 0.359086 Oct 27 10:08:30.363063 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 89/196] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:30 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1641 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:30.386846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:30.387488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:30.396196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.398058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.401398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.402417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.403899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.405747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.444993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:08:30.491227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:30.512010 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f336fad-ba80-4a95-bc74-c87cece6ef25 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1320 microversion: 2.1 time: 0.361416 Oct 27 10:08:30.531710 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 108/197] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:30 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1320 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:30.588189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:30.589996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:30.602487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.604533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.606022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.608101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.609180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.611969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.625061 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fec10ee-3846-492a-b565-24049ffd2d34 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 204 len: 0 microversion: 2.1 time: 0.241925 Oct 27 10:08:30.629498 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 90/198] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:08:30 2022] DELETE /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:08:30.636924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:30.638024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:30.645937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.646915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.649611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.653341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:30.654075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:30.655026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:30.907089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:30.923599 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f44c581-35c9-4438-bc87-a17d6236abde tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1318 microversion: 2.1 time: 0.339638 Oct 27 10:08:30.924935 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 109/199] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:30 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:30.944774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:30.951354 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-989bbf11-4e32-47e9-a40c-8cb00a9bbb84 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1494 microversion: 2.1 time: 0.320036 Oct 27 10:08:30.951940 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 91/200] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:30 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1494 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:31.014700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:31.015477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:31.022202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.022734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.023237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.024244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.024755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.025328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.119019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:31.167383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:31.176367 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a12ce7a-2e25-4682-b134-41c44053ffca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1335 microversion: 2.1 time: 0.165753 Oct 27 10:08:31.202173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 110/201] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:31 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1335 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:31.534970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:31.535580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:31.537682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:31.543799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.544282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.544890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.545739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.546189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.546601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.569301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Calling method '.version_select at 0x7f6d5bf6fa60>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:31.573224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.573761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.574240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.598255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.598923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.599633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.640014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.640498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.640966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.651732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.652215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.652642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.675486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.676220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.676828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.683784 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1919 microversion: 2.53 time: 0.378464 Oct 27 10:08:31.684376 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 92/202] 10.222.0.76 () {60 vars in 1243 bytes} [Thu Oct 27 10:08:31 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1919 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:08:31.693946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:31.694962 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7848391c-3b36-4713-82d1-ce6785541eda tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] 10.222.0.76 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001297 Oct 27 10:08:31.695500 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 93/203] 10.222.0.76 () {56 vars in 886 bytes} [Thu Oct 27 10:08:31 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 10:08:31.701900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Calling method '.version_select at 0x7f6d600a5d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:31.704277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:31.705467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.705946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.706375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.718070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:31.720292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d95bae5d-70d2-4430-a0f7-ee5c870f481a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1470 microversion: 2.1 time: 0.189509 Oct 27 10:08:31.720916 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 111/204] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:31 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:31.723685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.724168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.724599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.727730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:31.753214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.753806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.754248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.764864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.765342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.765774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.787754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.788240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.788699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.797859 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-06482f5c-b12b-4c07-a6b3-9a64796f42ef tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 609 microversion: 2.53 time: 0.099591 Oct 27 10:08:31.798966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 94/205] 10.222.0.76 () {60 vars in 1222 bytes} [Thu Oct 27 10:08:31 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 609 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:08:31.812996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09cef2d2-501e-4403-8064-750e2d3fdc7e tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Calling method '.version_select at 0x7f6d5bf634c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:31.819371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09cef2d2-501e-4403-8064-750e2d3fdc7e tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.820765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09cef2d2-501e-4403-8064-750e2d3fdc7e tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.821365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09cef2d2-501e-4403-8064-750e2d3fdc7e tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.842611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09cef2d2-501e-4403-8064-750e2d3fdc7e tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.843377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09cef2d2-501e-4403-8064-750e2d3fdc7e tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.844007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09cef2d2-501e-4403-8064-750e2d3fdc7e tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.853117 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-09cef2d2-501e-4403-8064-750e2d3fdc7e tempest-HypervisorAdminV253TestBase-876534236 tempest-HypervisorAdminV253TestBase-876534236-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/239ae669-0612-4271-9cd6-9eea1a3d18bc" status: 200 len: 794 microversion: 2.53 time: 0.044664 Oct 27 10:08:31.854286 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 95/206] 10.222.0.76 () {60 vars in 1298 bytes} [Thu Oct 27 10:08:31 2022] GET /compute/v2.1/os-hypervisors/239ae669-0612-4271-9cd6-9eea1a3d18bc => generated 794 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:08:31.948465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:31.949300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:31.960196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.960698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.961392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.962643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.970548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:31.971171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:31.974663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.977674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.979891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.984332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.985494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:31.986781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:31.988804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:31.989383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:32.079670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:08:32.152998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:32.167335 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-943f9fcc-9139-4fd3-b2ec-a87c6238ad82 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1318 microversion: 2.1 time: 0.224408 Oct 27 10:08:32.189582 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 96/207] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:31 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:32.206461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:32.207080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:32.236562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:32.237457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:32.238122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:32.239022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:32.239671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:32.240277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:32.266093 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f826f218-be6f-430c-b838-3267d50dfe18 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] 10.222.0.76 "DELETE /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 204 len: 0 microversion: 2.1 time: 0.522747 Oct 27 10:08:32.267551 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 112/208] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:08:31 2022] DELETE /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:08:32.286956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:32.289695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:32.289952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:32.302321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:32.302803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:32.304065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:32.304065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:32.304409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:32.304782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:32.539993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:32.549363 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-576d15d0-2d6a-4087-853b-a9aacfa58836 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1494 microversion: 2.1 time: 0.353016 Oct 27 10:08:32.550026 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 97/209] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:32 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1494 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:32.555762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:32.556730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:32.560426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:32.563426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:32.564306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:32.564955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:32.565986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:32.566598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:32.567104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:32.574593 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39c79b13-59ad-4e94-a077-7a8e4ab95139 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1335 microversion: 2.1 time: 0.299634 Oct 27 10:08:32.575193 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 113/210] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:32 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1335 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:32.593029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6f461008-f011-41c5-88af-b0c810c27828 req-e9437125-03d9-4230-b63b-2f3cbd7d71f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05477c33-3427-45c5-88ce-1f0dcfc68874", "name": "network-vif-plugged", "status": "completed", "tag": "1668331e-2153-46cb-8660-beb90803f0a6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:32.609373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6f461008-f011-41c5-88af-b0c810c27828 req-e9437125-03d9-4230-b63b-2f3cbd7d71f2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:32.610338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6f461008-f011-41c5-88af-b0c810c27828 req-e9437125-03d9-4230-b63b-2f3cbd7d71f2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:32.611717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6f461008-f011-41c5-88af-b0c810c27828 req-e9437125-03d9-4230-b63b-2f3cbd7d71f2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:32.627547 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6f461008-f011-41c5-88af-b0c810c27828 req-e9437125-03d9-4230-b63b-2f3cbd7d71f2 service nova] Creating event network-vif-plugged:1668331e-2153-46cb-8660-beb90803f0a6 for instance 05477c33-3427-45c5-88ce-1f0dcfc68874 on n-h1-854663-10 Oct 27 10:08:32.632830 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6f461008-f011-41c5-88af-b0c810c27828 req-e9437125-03d9-4230-b63b-2f3cbd7d71f2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056305 Oct 27 10:08:32.633812 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 114/211] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:32.827908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:32.836458 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17f4cae5-fb03-42de-a570-7ad48c934f01 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1476 microversion: 2.1 time: 0.284781 Oct 27 10:08:32.841261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 98/212] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:32 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:33.204179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:33.205109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:33.215705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.216198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.216697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.217388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.217834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.218262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.279163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-53009207-6864-477b-ac08-4fe75b38c1e7 req-235ac061-3c41-4805-b666-27c43cf098db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc51aea-cbe7-435e-9b95-5ba843803540", "name": "network-vif-deleted", "tag": "7f8a675a-9094-4b26-bfe4-896dc88edb90"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:33.293481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-53009207-6864-477b-ac08-4fe75b38c1e7 req-235ac061-3c41-4805-b666-27c43cf098db service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.294273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-53009207-6864-477b-ac08-4fe75b38c1e7 req-235ac061-3c41-4805-b666-27c43cf098db service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.294847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-53009207-6864-477b-ac08-4fe75b38c1e7 req-235ac061-3c41-4805-b666-27c43cf098db service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.312603 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-53009207-6864-477b-ac08-4fe75b38c1e7 req-235ac061-3c41-4805-b666-27c43cf098db service nova] Creating event network-vif-deleted:7f8a675a-9094-4b26-bfe4-896dc88edb90 for instance 3fc51aea-cbe7-435e-9b95-5ba843803540 on n-h2-854663-10 Oct 27 10:08:33.320474 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-53009207-6864-477b-ac08-4fe75b38c1e7 req-235ac061-3c41-4805-b666-27c43cf098db service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047187 Oct 27 10:08:33.333346 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 99/213] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:33.387113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:33.397684 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed537735-6431-4731-bb85-0fa3469d273e tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1318 microversion: 2.1 time: 0.197995 Oct 27 10:08:33.399020 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 115/214] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:33 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:33.577411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:33.578798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:33.590228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.590721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.591160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.596931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.597611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.600621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:33.601079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.601855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:33.621679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.622414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.623354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.625021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.626475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.627059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.678265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.678774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.679203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.687328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lazy-loading 'fault' on Instance uuid 3fc51aea-cbe7-435e-9b95-5ba843803540 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:08:33.789268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a658de6fc314b07938ad013f78dfe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff65e0901dc4084bca6423c66002967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:33.803674 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da6eb38e-8735-4ac6-866c-49349313a19e tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 200 len: 1328 microversion: 2.1 time: 0.232508 Oct 27 10:08:33.812698 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 100/215] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:33 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 1328 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:33.863506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:33.865629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:33.874618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.875407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.876149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.877133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:33.877536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:33.877987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:33.909957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:33.923422 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2608971b-67f8-418c-8711-c7aa656a576b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1335 microversion: 2.1 time: 0.327665 Oct 27 10:08:33.924182 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 116/216] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:33 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1335 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:34.149070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:34.157871 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-631a8c7e-4215-496d-a93a-dbc2ae0b1864 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1476 microversion: 2.1 time: 0.299693 Oct 27 10:08:34.158681 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 101/217] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:33 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:34.426811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:34.428063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:34.436866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:34.437499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:34.437936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:34.438775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:34.439467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:34.439864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:34.645219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:34.656536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-64053b01-ad74-4748-a369-d527203bf485 req-0d906c96-80ac-4733-a6cf-a1d7bf74cb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb77378-15a7-4ccf-ac15-96574a205e0a", "name": "network-vif-plugged", "status": "completed", "tag": "ba2f9293-c098-436c-8a1a-23b264e8b733"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:34.676089 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1ab05ee-4282-4b62-869a-2abb58bb1e18 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1318 microversion: 2.1 time: 0.251593 Oct 27 10:08:34.689726 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 117/218] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:34 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:34.696741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-64053b01-ad74-4748-a369-d527203bf485 req-0d906c96-80ac-4733-a6cf-a1d7bf74cb62 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:34.697295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-64053b01-ad74-4748-a369-d527203bf485 req-0d906c96-80ac-4733-a6cf-a1d7bf74cb62 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:34.697729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-64053b01-ad74-4748-a369-d527203bf485 req-0d906c96-80ac-4733-a6cf-a1d7bf74cb62 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:34.710510 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-64053b01-ad74-4748-a369-d527203bf485 req-0d906c96-80ac-4733-a6cf-a1d7bf74cb62 service nova] Creating event network-vif-plugged:ba2f9293-c098-436c-8a1a-23b264e8b733 for instance 3eb77378-15a7-4ccf-ac15-96574a205e0a on n-h2-854663-10 Oct 27 10:08:34.716583 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-64053b01-ad74-4748-a369-d527203bf485 req-0d906c96-80ac-4733-a6cf-a1d7bf74cb62 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066157 Oct 27 10:08:34.718181 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 102/219] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:34.830434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:34.842837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:34.846124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:RELEASE=1,nova_api:SELECT=91,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:34.853573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:34.854320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:34.854939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:34.855813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:34.856263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:34.856695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:34.872604 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] HTTP exception thrown: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Request method failure captured: Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 HTTP/1.1 Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh58SZJjAs697BoMKgU7XbSW_a9akOMkaPC5_Hjmnfox9Z7cgv6eAC06-j6rOycxkwhIJebTg3ixYe4nmWXtHHBwHzBT2hgh7TEB81hsa-4GCkVpNIaou_7o722pm2dz_tR_lxn7cW1paqEdSAFDyRsu-f5t0U2sNKwCNa8fWqGdvc Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7ff65e0901dc4084bca6423c66002967 Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminTestJSON-262221765 Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:34.875120 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7ff65e0901dc4084bca6423c66002967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7ff65e0901dc4084bca6423c66002967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7ff65e0901dc4084bca6423c66002967", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7ff65e0901dc4084bca6423c66002967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminTestJSON-262221765 Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7ff65e0901dc4084bca6423c66002967 Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-262221765 Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminTestJSON-262221765-project Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8a658de6fc314b07938ad013f78dfe69 Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminTestJSON-262221765-project Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:34.876307 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '3fc51aea-cbe7-435e-9b95-5ba843803540'} Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:34.876989 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:34.878804 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:34.880432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Returning 404 to user: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:34.880432 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-644af6fe-bb60-4b16-8e5b-6cd859ecfcb5 tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 404 len: 111 microversion: 2.1 time: 0.050907 Oct 27 10:08:34.884461 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 118/220] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:34 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:34.890679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1845feee-8cdd-4a72-85f5-50a2810192b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:34.915154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1845feee-8cdd-4a72-85f5-50a2810192b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:34.915643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1845feee-8cdd-4a72-85f5-50a2810192b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:34.916151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1845feee-8cdd-4a72-85f5-50a2810192b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:34.948933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:34.949583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:34.960785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:34.961804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:34.961804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:34.962411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:34.965368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:34.965796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:35.132527 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1845feee-8cdd-4a72-85f5-50a2810192b7 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.246434 Oct 27 10:08:35.133323 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 103/221] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:35.146200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7eaa5f8b-2ba9-44a0-aa58-219e4ca83d85 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:35.202367 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7eaa5f8b-2ba9-44a0-aa58-219e4ca83d85 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.060904 Oct 27 10:08:35.203673 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 104/222] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:35 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:35.215750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:35.216489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:35.233586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:35.234075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:35.234503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:35.235209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:35.235646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:35.236053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:35.285510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:35.286093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:35.286596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:35.287159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lazy-loading 'fault' on Instance uuid 3e77d7f7-01d9-4f67-b567-d759d30cfe3d {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:08:35.350918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:35.362238 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cfe1d7a4-3019-4b01-99d9-ecdd8ed5775d tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 200 len: 1310 microversion: 2.1 time: 0.156515 Oct 27 10:08:35.377538 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 105/223] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:35 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 1310 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:35.377538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1640041-4345-445d-a5c7-1fb112e67f1d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-716314623"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:35.377538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-b1640041-4345-445d-a5c7-1fb112e67f1d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Generated uuid 16ca7860-596b-4c76-847e-3ee3cf3c20d8 for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:35.383517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:35.393303 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-122b864e-629e-4283-a6ef-66732d6f9a4e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1335 microversion: 2.1 time: 0.449248 Oct 27 10:08:35.394207 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 119/224] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:34 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1335 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:35.400044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-64b8d008-9d8d-49af-b3d7-4227dcb4720e req-cc7dd09f-9d02-4082-b974-f28bb86ba416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e77d7f7-01d9-4f67-b567-d759d30cfe3d", "name": "network-vif-deleted", "tag": "58c7f30f-27e0-4d35-8a83-7b93cd2c56a5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:35.427286 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1640041-4345-445d-a5c7-1fb112e67f1d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.060980 Oct 27 10:08:35.427553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64b8d008-9d8d-49af-b3d7-4227dcb4720e req-cc7dd09f-9d02-4082-b974-f28bb86ba416 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:35.428019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64b8d008-9d8d-49af-b3d7-4227dcb4720e req-cc7dd09f-9d02-4082-b974-f28bb86ba416 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:35.428430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64b8d008-9d8d-49af-b3d7-4227dcb4720e req-cc7dd09f-9d02-4082-b974-f28bb86ba416 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:35.429514 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 106/225] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:35 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:35.442542 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-64b8d008-9d8d-49af-b3d7-4227dcb4720e req-cc7dd09f-9d02-4082-b974-f28bb86ba416 service nova] Creating event network-vif-deleted:58c7f30f-27e0-4d35-8a83-7b93cd2c56a5 for instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d on n-h1-854663-10 Oct 27 10:08:35.444263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9b53639-7501-46a3-ad0f-4abbffc822bd tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:35.449883 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-64b8d008-9d8d-49af-b3d7-4227dcb4720e req-cc7dd09f-9d02-4082-b974-f28bb86ba416 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053402 Oct 27 10:08:35.450708 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 120/226] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:35.465937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9b53639-7501-46a3-ad0f-4abbffc822bd tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:35.466720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9b53639-7501-46a3-ad0f-4abbffc822bd tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:35.467362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9b53639-7501-46a3-ad0f-4abbffc822bd tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:35.630752 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9b53639-7501-46a3-ad0f-4abbffc822bd tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.193193 Oct 27 10:08:35.631583 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 107/227] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:35.643947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-897b9044-37c0-4d4f-952f-009cbef9ed1d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:35.663078 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-897b9044-37c0-4d4f-952f-009cbef9ed1d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.023287 Oct 27 10:08:35.663937 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 121/228] 10.222.0.76 () {58 vars in 1149 bytes} [Thu Oct 27 10:08:35 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:35.676743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9940910c-7272-465e-a72a-da297d4dbff6 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:35.688462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9940910c-7272-465e-a72a-da297d4dbff6 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:35.689319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9940910c-7272-465e-a72a-da297d4dbff6 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:35.689744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9940910c-7272-465e-a72a-da297d4dbff6 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:35.704271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:35.705327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:35.713988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:35.714470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:35.715069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:35.715925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:35.716368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:35.716819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:35.886320 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9940910c-7272-465e-a72a-da297d4dbff6 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.213746 Oct 27 10:08:35.886923 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 108/229] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:35.903407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b8db1417-5013-43a1-903e-0d4a22d09312 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:35.906522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:35.916785 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-785214db-a2f9-42f9-bddc-f84327369fd9 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1468 microversion: 2.1 time: 0.217173 Oct 27 10:08:35.917613 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 122/230] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:35 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1468 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:35.938548 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b8db1417-5013-43a1-903e-0d4a22d09312 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.043604 Oct 27 10:08:35.939422 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 109/231] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:35 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:35.951661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfabcda1-3416-4d7c-98d3-3c75a5014134 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1147603135"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:35.956189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-dfabcda1-3416-4d7c-98d3-3c75a5014134 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Generated uuid 961b8014-24cf-487e-809c-1e58d886894c for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:35.982418 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dfabcda1-3416-4d7c-98d3-3c75a5014134 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034255 Oct 27 10:08:35.983926 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 110/232] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:35.998286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6d13e72e-35ed-41ab-9435-e7449e7e105c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:36.010678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d13e72e-35ed-41ab-9435-e7449e7e105c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.011162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d13e72e-35ed-41ab-9435-e7449e7e105c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.011908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d13e72e-35ed-41ab-9435-e7449e7e105c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.161688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6d13e72e-35ed-41ab-9435-e7449e7e105c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.168196 Oct 27 10:08:36.169454 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 111/233] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:35 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:36.175889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a055938-df94-4bf9-92dc-ec56c4db5ca6 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:36.191812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a055938-df94-4bf9-92dc-ec56c4db5ca6 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.192376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a055938-df94-4bf9-92dc-ec56c4db5ca6 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.192838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a055938-df94-4bf9-92dc-ec56c4db5ca6 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.215980 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2a055938-df94-4bf9-92dc-ec56c4db5ca6 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] HTTP exception thrown: Aggregate 4 already has host n-h2-854663-10. Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a055938-df94-4bf9-92dc-ec56c4db5ca6 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Request method failure captured: Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 40 Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh8sjmPgPINVi86oHkut8Ucs4kqErs4sBtyZi42Pph0JoV-qnrOYgyvMc8VSkW_pgwA62jtuUTN926pvWW_-z8KQSHEk5GlCDQzzjeb8URGzECybc8AGFy8RFJ-rU7UepmiTZI3wnausniNcg0mxhH_QWG0epfaolTMKuXbl2vY0EE Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:36.219710 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a0de98870014b0fbb549b8201a0ff49", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d1915adb5757414db446dac9b093aa92 Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: {"add_host": {"host": "n-h2-854663-10"}} Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:36.221288 n-d-854663-10 devstack@n-api.service[120719]: exception: Aggregate 4 already has host n-h2-854663-10. Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h2-854663-10'}}} Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result.read() Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 10:08:36.226105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-854663-10-4' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 10:08:36.227418 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 10:08:36.229736 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 10:08:36.232097 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result.read() Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-854663-10-4' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 10, 8, 36, 208265), 'updated_at': None, 'host': 'n-h2-854663-10', 'aggregate_id': 4}] Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.234057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 4 already has host n-h2-854663-10. Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.236191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 4 already has host n-h2-854663-10. Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:36.238970 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:36.242551 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 4 already has host n-h2-854663-10. Oct 27 10:08:36.242551 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.242551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a055938-df94-4bf9-92dc-ec56c4db5ca6 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Returning 409 to user: Aggregate 4 already has host n-h2-854663-10. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:36.242551 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a055938-df94-4bf9-92dc-ec56c4db5ca6 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/4/action" status: 409 len: 96 microversion: 2.1 time: 0.051046 Oct 27 10:08:36.242551 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 112/234] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 96 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 27 10:08:36.242551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e7c273cd-7c78-424c-b991-4521e038215a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:36.243903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7c273cd-7c78-424c-b991-4521e038215a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.244125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7c273cd-7c78-424c-b991-4521e038215a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.244473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7c273cd-7c78-424c-b991-4521e038215a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.316445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1798547482", "block_migration": true, "disk_over_commit": false}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:36.319361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:36.326096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.326978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.327575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.329874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.330521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.331127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.364218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:36.371071 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e7c273cd-7c78-424c-b991-4521e038215a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.143650 Oct 27 10:08:36.371761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 113/235] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:08:36.519465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fad5a0ff-678e-4b02-bde1-b0e2e09f7392 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:36.523053 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fad5a0ff-678e-4b02-bde1-b0e2e09f7392 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fad5a0ff-678e-4b02-bde1-b0e2e09f7392 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142-project-admin] Request method failure captured: Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlikJarNVEzSjIqSHWB7rIo7jO3o18jori959UNnH8yMeAdawpDLCgsAUvuWdP6gNLcHVeDs_HbaFPalQbI4pgpP9f61D7WbrVgCj1gEknQPZgsE3379mxjXxWJTbsHAy6kylSaIGrLD0jahEyUiSy4KQGWzXcHnOhb6DG_jEpod4eg Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d22c82f39c374318ad5fec23180a20fe Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142 Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:36.533677 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d22c82f39c374318ad5fec23180a20fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d22c82f39c374318ad5fec23180a20fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d22c82f39c374318ad5fec23180a20fe", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d22c82f39c374318ad5fec23180a20fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142 Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d22c82f39c374318ad5fec23180a20fe Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142 Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142-project-admin Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3293edd6ef254e76b8eb7caa3d92acc3 Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142-project-admin Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:36.535153 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid timestamp for date invalid_time Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'invalid_time'} Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:36.535840 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fad5a0ff-678e-4b02-bde1-b0e2e09f7392 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:36.536932 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fad5a0ff-678e-4b02-bde1-b0e2e09f7392 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142 tempest-InstanceUsageAuditLogNegativeTestJSON-1972756142-project-admin] 10.222.0.76 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.157260 Oct 27 10:08:36.537759 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 114/236] 10.222.0.76 () {58 vars in 1224 bytes} [Thu Oct 27 10:08:36 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:08:36.546135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f732e9bf-3b07-4f2f-9594-b62420a630c8 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:36.572640 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f732e9bf-3b07-4f2f-9594-b62420a630c8 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.030556 Oct 27 10:08:36.573270 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 115/237] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:36 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:36.578771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:36.579416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:36.582443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:36.586896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.587372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.587814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.588479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.588942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.589355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.591609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lazy-loading 'flavor' on Instance uuid 05477c33-3427-45c5-88ce-1f0dcfc68874 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:08:36.606002 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] HTTP exception thrown: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Request method failure captured: Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d HTTP/1.1 Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh9dWBneWs2_8qSZQpjA-3AHsoAlGM7L9amsMkIou0kugFX0fypEpWJhbbWyVzJCCsWRUvzjRvq8IL1z_Dwe9_sMoNAl3fbh9tMNA8sq74lInl_hdYx76sbST162hzOMtT2y5_Gic2z088ufdpG3XQnVP9x6G3pgak5C1d2Utg0uF4 Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:36.608490 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1f8e5cdaf2e749069986ccb0b5a971a1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 4443955683da4a3cb1936b26f8daea67 Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:08:36.609703 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '3e77d7f7-01d9-4f67-b567-d759d30cfe3d'} Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:36.610348 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:08:36.611421 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.613734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Returning 404 to user: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:36.613734 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e854143-5923-48db-8c3b-26013afb2147 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 404 len: 111 microversion: 2.1 time: 0.035710 Oct 27 10:08:36.613734 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 116/238] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:36 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:36.618385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:36.619210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:36.625955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.627518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.627518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.627518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.628004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.628387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.644900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Going to try to live migrate instance to tempest-host-1798547482 {{(pid=120720) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:08:36.652061 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] HTTP exception thrown: Compute host tempest-host-1798547482 could not be found. Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Request method failure captured: Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874/action HTTP/1.1 Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 107 Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliP2ttrI66ntL1T0hT_E7Rlh9rN9rQV3O4tryyjnEbNK2iKqEaqpJBo5rK8PsSeHXWuWYEtdougx0JhO60DUQXel_HGLZLHmo9fSD_0fZj7FR26FoPaMk77SPx5bdVpExeQImLMAQnYkUXgGxk20ISSdcIIiSf4g9qBMJWDnqREInU Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 91effd0ede8847519c5354eb43877366 Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-LiveMigrationNegativeTest-44868247 Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:36.655952 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/91effd0ede8847519c5354eb43877366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/91effd0ede8847519c5354eb43877366"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_91effd0ede8847519c5354eb43877366", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/91effd0ede8847519c5354eb43877366"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-LiveMigrationNegativeTest-44868247 Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 91effd0ede8847519c5354eb43877366 Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-44868247 Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-LiveMigrationNegativeTest-44868247-project-admin Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 28fa3c14b1d648d7ba27286986d2123a Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-LiveMigrationNegativeTest-44868247-project-admin Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: {"os-migrateLive": {"host": "tempest-host-1798547482", "block_migration": true, "disk_over_commit": false}} Oct 27 10:08:36.657452 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: exception: Compute host tempest-host-1798547482 could not be found. Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '05477c33-3427-45c5-88ce-1f0dcfc68874', 'body': {'os-migrateLive': {'host': 'tempest-host-1798547482', 'block_migration': True, 'disk_over_commit': False}}} Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:08:36.658102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1798547482 could not be found. Oct 27 10:08:36.659119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1798547482 could not be found. Oct 27 10:08:36.660083 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1798547482 could not be found. Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Returning 400 to user: Compute host tempest-host-1798547482 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92b6b058-8d39-488d-9f6d-0712a64a77da tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874/action" status: 400 len: 100 microversion: 2.1 time: 0.718748 Oct 27 10:08:36.662379 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 123/239] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Oct 27 10:08:35 2022] POST /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874/action => generated 100 bytes in 720 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:08:36.714555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5bf9cd30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:36.718877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.719360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.719795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.728479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.729005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.729432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.736431 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] HTTP exception thrown: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Request method failure captured: Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/os-services/72646a76-f31b-4756-9301-58ce3488fbe9 HTTP/1.1 Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 56 Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlik6-7gzMPyUmeQiqkxCAYVgL31wuLowBu8Tf_qrm26z3XabGY6X7UENZoFgU4sgwuhoq5zuVg_vcjNuy36VBuQ5oHnzaCIk-JDuspXxmsMCmqiW4o3TMI85g3e236XrIgVl5rv7NqCy0DNQnm-b_wXWO9eR9pKLVu7erfi8goW2M8 Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 275290f233e54ccb8c766e6bedccef4d Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1944760809 Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:36.738394 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/275290f233e54ccb8c766e6bedccef4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/275290f233e54ccb8c766e6bedccef4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_275290f233e54ccb8c766e6bedccef4d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/275290f233e54ccb8c766e6bedccef4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1944760809 Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 275290f233e54ccb8c766e6bedccef4d Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1944760809 Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: bb6ef18a00454e1faef77c4bb31bef57 Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:08:36.739622 n-d-854663-10 devstack@n-api.service[120720]: exception: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '72646a76-f31b-4756-9301-58ce3488fbe9', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.740331 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.741452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:36.742543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:36.742543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:36.742543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.742543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Returning 404 to user: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:36.742543 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9585cd2-a3c8-4dd6-a053-68e77165ec74 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-services/72646a76-f31b-4756-9301-58ce3488fbe9" status: 404 len: 110 microversion: 2.53 time: 0.080288 Oct 27 10:08:36.742543 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 124/240] 10.222.0.76 () {62 vars in 1309 bytes} [Thu Oct 27 10:08:36 2022] PUT /compute/v2.1/os-services/72646a76-f31b-4756-9301-58ce3488fbe9 => generated 110 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:36.778644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:36.786905 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-543e6808-f002-442e-9f5e-eee49779b104 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1462 microversion: 2.1 time: 0.175512 Oct 27 10:08:36.787578 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 117/241] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:36 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1462 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:36.792037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0c80bb5-131c-4af9-814d-fed685252144 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1880468590"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:36.795521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-b0c80bb5-131c-4af9-814d-fed685252144 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Generated uuid 0a950c4c-ca9a-44a4-8c77-338a0372b26d for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:36.821120 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0c80bb5-131c-4af9-814d-fed685252144 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.032003 Oct 27 10:08:36.821572 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 118/242] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:36.831813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e69c6c0e-004c-4280-ba29-f2ac4addd4de tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-845534242"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:36.835224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-e69c6c0e-004c-4280-ba29-f2ac4addd4de tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Generated uuid ae172ac7-38c9-4310-88a2-97be3d8d48f6 for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:36.854157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89cf37dc-d885-40b9-9cc4-9d4a72e7e384 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:36.855875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-89cf37dc-d885-40b9-9cc4-9d4a72e7e384 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a41e5967b0e844158016fc5040faa0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f375b3a158714827bb0b5cd7597e68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:36.857314 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e69c6c0e-004c-4280-ba29-f2ac4addd4de tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.034713 Oct 27 10:08:36.858220 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 119/243] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89cf37dc-d885-40b9-9cc4-9d4a72e7e384 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] Request method failure captured: Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlij-Mckh8cNrpXWXvtQVCutBHDc7W_henmRyVP7lRsxU3Fx6rq2SqOcXGTOIS-1d4EVHG68ctPLGAFYWN6-AYA4WDGpAmzFXwVMcF7rXfzJyWpLwDnGO_yhYuzPOwaDo_eLW-JnmgLtr1_r_t3PN63xojtYYIxOIfyeZuwapN7AbSA Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f375b3a158714827bb0b5cd7597e68f3 Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:36.859492 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f375b3a158714827bb0b5cd7597e68f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f375b3a158714827bb0b5cd7597e68f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f375b3a158714827bb0b5cd7597e68f3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f375b3a158714827bb0b5cd7597e68f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f375b3a158714827bb0b5cd7597e68f3 Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: a41e5967b0e844158016fc5040faa0bc Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project Oct 27 10:08:36.860912 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: action_args: {} Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:36.861468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 10:08:36.862504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:36.863492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:36.863816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:36.864770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89cf37dc-d885-40b9-9cc4-9d4a72e7e384 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:36.865889 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-89cf37dc-d885-40b9-9cc4-9d4a72e7e384 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] 10.222.0.76 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.124535 Oct 27 10:08:36.866689 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 125/244] 10.222.0.76 () {58 vars in 1185 bytes} [Thu Oct 27 10:08:36 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 126 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:36.871821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-61499188", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:36.873436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.873924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.874356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.875040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:36.875483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:36.875985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:36.926451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:08:37.086761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:37.094879 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1d4e829d-3b3f-46c9-97d8-7bbdae6a536a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1468 microversion: 2.1 time: 0.235572 Oct 27 10:08:37.095488 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 120/245] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:36 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1468 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:37.099974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5bf69ee0>, body: {"status": "disabled"} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:37.103839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.104313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.104774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.114425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.114425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.114425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.122030 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] HTTP exception thrown: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Request method failure captured: Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: request: PUT /compute/v2.1/os-services/72646a76-f31b-4756-9301-58ce3488fbe9 HTTP/1.1 Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 22 Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlik6-7gzMPyUmeQiqkxCAYVgL31wuLowBu8Tf_qrm26z3XabGY6X7UENZoFgU4sgwuhoq5zuVg_vcjNuy36VBuQ5oHnzaCIk-JDuspXxmsMCmqiW4o3TMI85g3e236XrIgVl5rv7NqCy0DNQnm-b_wXWO9eR9pKLVu7erfi8goW2M8 Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 275290f233e54ccb8c766e6bedccef4d Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1944760809 Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:37.124023 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/275290f233e54ccb8c766e6bedccef4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/275290f233e54ccb8c766e6bedccef4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_275290f233e54ccb8c766e6bedccef4d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/275290f233e54ccb8c766e6bedccef4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1944760809 Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 275290f233e54ccb8c766e6bedccef4d Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1944760809 Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: bb6ef18a00454e1faef77c4bb31bef57 Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: {"status": "disabled"} Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: exception: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.125324 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '72646a76-f31b-4756-9301-58ce3488fbe9', 'body': {'status': 'disabled'}} Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.126098 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:37.128227 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:37.129535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.129535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.129535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Returning 404 to user: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:37.129535 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e93275e-9d5d-4b3e-b15d-8036b1bf1f78 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-services/72646a76-f31b-4756-9301-58ce3488fbe9" status: 404 len: 110 microversion: 2.53 time: 0.029190 Oct 27 10:08:37.129535 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 121/246] 10.222.0.76 () {62 vars in 1309 bytes} [Thu Oct 27 10:08:37 2022] PUT /compute/v2.1/os-services/72646a76-f31b-4756-9301-58ce3488fbe9 => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:37.181447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:08:37.182257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:08:37.182903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:08:37.183479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:08:37.184026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:08:37.193988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.195412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.196081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.197100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.197768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.198588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.217365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Getting quotas for project 1f8e5cdaf2e749069986ccb0b5a971a1. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:08:37.221825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Getting quotas for user 4443955683da4a3cb1936b26f8daea67 and project 1f8e5cdaf2e749069986ccb0b5a971a1. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:08:37.235648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:08:37.238111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:08:37.246347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d702e71a-b1af-4ea1-961a-d28fb32a2d8f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:37.246967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d702e71a-b1af-4ea1-961a-d28fb32a2d8f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:37.253202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d702e71a-b1af-4ea1-961a-d28fb32a2d8f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.253685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d702e71a-b1af-4ea1-961a-d28fb32a2d8f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.254112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d702e71a-b1af-4ea1-961a-d28fb32a2d8f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.254828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d702e71a-b1af-4ea1-961a-d28fb32a2d8f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.255271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d702e71a-b1af-4ea1-961a-d28fb32a2d8f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.255687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d702e71a-b1af-4ea1-961a-d28fb32a2d8f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.274122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:37.290939 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01759adc-6351-4c71-845c-15e47ef50463 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.422638 Oct 27 10:08:37.291560 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 126/247] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:08:37.425702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09a2f46b-c13b-419b-8ae7-1ae359c6e4df tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:37.429768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-09a2f46b-c13b-419b-8ae7-1ae359c6e4df tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'cc77b4584c764a0489ba90f017c1c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fbb8dbd3741dcbf059b7957f02d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09a2f46b-c13b-419b-8ae7-1ae359c6e4df tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Request method failure captured: Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 40 Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh60cHpmXcuNZpyZ24mV-O4ntf4iLYteQgr0WKwPv6MN9CZe1dvSut8Cltt--aUn6Jg5gzMpp7vnStwQLg0WzJd34SsCnO6DazY4Jef4HSgXrBGmM3oZLfZ7EFe9AD4GV6AjcBKDTs7PjCiU585omFCeVmdI3UnRGOxg-Q63i-YFU0 Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:37.432570 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_316fbb8dbd3741dcbf059b7957f02d1a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: cc77b4584c764a0489ba90f017c1c7c1 Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: {"add_host": {"host": "n-h2-854663-10"}} Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:37.434162 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '5', 'body': {'add_host': {'host': 'n-h2-854663-10'}}} Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:37.435022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 10:08:37.436341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.437628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09a2f46b-c13b-419b-8ae7-1ae359c6e4df tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:37.438122 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09a2f46b-c13b-419b-8ae7-1ae359c6e4df tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] 10.222.0.76 "POST /compute/v2.1/os-aggregates/5/action" status: 403 len: 118 microversion: 2.1 time: 0.144842 Oct 27 10:08:37.438804 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 127/248] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:37 2022] POST /compute/v2.1/os-aggregates/5/action => generated 118 bytes in 147 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:37.444207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ccd47cbc-9058-4401-b7a0-270066f1ed84 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:37.456609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccd47cbc-9058-4401-b7a0-270066f1ed84 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.457304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccd47cbc-9058-4401-b7a0-270066f1ed84 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.457836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccd47cbc-9058-4401-b7a0-270066f1ed84 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.560194 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d702e71a-b1af-4ea1-961a-d28fb32a2d8f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1615 microversion: 2.1 time: 0.432922 Oct 27 10:08:37.561460 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 122/249] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:37 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1615 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:37.573088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40cc780e-0794-4b84-9f87-ff2af4a3c2eb tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:37.574990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-40cc780e-0794-4b84-9f87-ff2af4a3c2eb tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a41e5967b0e844158016fc5040faa0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f375b3a158714827bb0b5cd7597e68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40cc780e-0794-4b84-9f87-ff2af4a3c2eb tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] Request method failure captured: Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2010:08:36 HTTP/1.1 Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlij-Mckh8cNrpXWXvtQVCutBHDc7W_henmRyVP7lRsxU3Fx6rq2SqOcXGTOIS-1d4EVHG68ctPLGAFYWN6-AYA4WDGpAmzFXwVMcF7rXfzJyWpLwDnGO_yhYuzPOwaDo_eLW-JnmgLtr1_r_t3PN63xojtYYIxOIfyeZuwapN7AbSA Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f375b3a158714827bb0b5cd7597e68f3 Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:37.577352 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f375b3a158714827bb0b5cd7597e68f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f375b3a158714827bb0b5cd7597e68f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f375b3a158714827bb0b5cd7597e68f3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f375b3a158714827bb0b5cd7597e68f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f375b3a158714827bb0b5cd7597e68f3 Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: a41e5967b0e844158016fc5040faa0bc Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project Oct 27 10:08:37.578770 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '2022-10-27 10:08:36'} Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:37.579425 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 10:08:37.580601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.581500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40cc780e-0794-4b84-9f87-ff2af4a3c2eb tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:37.581500 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-40cc780e-0794-4b84-9f87-ff2af4a3c2eb tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561 tempest-InstanceUsageAuditLogNegativeTestJSON-1707216561-project] 10.222.0.76 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27 10:08:36" status: 403 len: 128 microversion: 2.1 time: 0.018607 Oct 27 10:08:37.581621 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 123/250] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:08:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2010%3A08%3A36 => generated 128 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:37.589996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5be94790>, body: {"status": "enabled"} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:37.596499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.597473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.597913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.598053 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ccd47cbc-9058-4401-b7a0-270066f1ed84 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.157699 Oct 27 10:08:37.598644 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 128/251] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:37 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:37.607113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.607503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.607964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.609292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2101806842", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:37.613899 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] HTTP exception thrown: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Request method failure captured: Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: request: PUT /compute/v2.1/os-services/72646a76-f31b-4756-9301-58ce3488fbe9 HTTP/1.1 Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 21 Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlik6-7gzMPyUmeQiqkxCAYVgL31wuLowBu8Tf_qrm26z3XabGY6X7UENZoFgU4sgwuhoq5zuVg_vcjNuy36VBuQ5oHnzaCIk-JDuspXxmsMCmqiW4o3TMI85g3e236XrIgVl5rv7NqCy0DNQnm-b_wXWO9eR9pKLVu7erfi8goW2M8 Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 275290f233e54ccb8c766e6bedccef4d Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1944760809 Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:37.615520 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/275290f233e54ccb8c766e6bedccef4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/275290f233e54ccb8c766e6bedccef4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_275290f233e54ccb8c766e6bedccef4d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/275290f233e54ccb8c766e6bedccef4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1944760809 Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 275290f233e54ccb8c766e6bedccef4d Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1944760809 Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: bb6ef18a00454e1faef77c4bb31bef57 Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: {"status": "enabled"} Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: exception: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.616843 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '72646a76-f31b-4756-9301-58ce3488fbe9', 'body': {'status': 'enabled'}} Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.617630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:37.618703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:37.619800 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. Oct 27 10:08:37.619800 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:37.619800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Returning 404 to user: Service 72646a76-f31b-4756-9301-58ce3488fbe9 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:37.619800 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a2703f6-2704-45e9-b2a1-68d8d2a9e813 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-services/72646a76-f31b-4756-9301-58ce3488fbe9" status: 404 len: 110 microversion: 2.53 time: 0.034603 Oct 27 10:08:37.619800 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 124/252] 10.222.0.76 () {62 vars in 1309 bytes} [Thu Oct 27 10:08:37 2022] PUT /compute/v2.1/os-services/72646a76-f31b-4756-9301-58ce3488fbe9 => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:37.623411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f889da93-d4b0-480b-998f-a8cd6ccb4227 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:37.624249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f889da93-d4b0-480b-998f-a8cd6ccb4227 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:37.678244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:08:37.706687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f889da93-d4b0-480b-998f-a8cd6ccb4227 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:37.718075 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f889da93-d4b0-480b-998f-a8cd6ccb4227 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1218 microversion: 2.1 time: 0.099027 Oct 27 10:08:37.719364 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 125/253] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:37 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:37.724158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0a4ef7f-1949-41a9-aa0f-936568783a00 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:37.763892 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0a4ef7f-1949-41a9-aa0f-936568783a00 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.043163 Oct 27 10:08:37.772943 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 126/254] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:37 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:37.778769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:37.780016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:37.788106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.788654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.789677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.790744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:37.791928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:37.792538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:37.989690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:08:37.990494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:08:37.991189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:08:37.991795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:08:37.992569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:08:38.003307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.004033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.004725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.009639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.010120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.010879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.030983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Getting quotas for project 12700bbe431149d18786ca6a80f99a10. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:08:38.035461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Getting quotas for user 086f3e5cbee145128f98a1cbe6133280 and project 12700bbe431149d18786ca6a80f99a10. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:08:38.048918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:08:38.051164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:08:38.069743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd5e1914552af4a1eadf82dd0b120bd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7144e356384886be4823540b47851b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:38.070416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] flavor_id is None. Assuming migration. {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 10:08:38.070911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 10:08:38.107725 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0bc8ce12-f140-4fd8-bb01-92e8b87dd5fb tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507978 Oct 27 10:08:38.108369 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 129/255] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:08:38.113194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01d890c4-d5f3-484e-a512-8c214c4e9bbe tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.122409 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01d890c4-d5f3-484e-a512-8c214c4e9bbe tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.012806 Oct 27 10:08:38.123287 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 130/256] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:08:38 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:38.128045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd32a9c1-c0f9-4cbe-9d7d-2a65e25540ce tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.132411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd32a9c1-c0f9-4cbe-9d7d-2a65e25540ce tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.132924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd32a9c1-c0f9-4cbe-9d7d-2a65e25540ce tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.133361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd32a9c1-c0f9-4cbe-9d7d-2a65e25540ce tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.134090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd32a9c1-c0f9-4cbe-9d7d-2a65e25540ce tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.134539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd32a9c1-c0f9-4cbe-9d7d-2a65e25540ce tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.135519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd32a9c1-c0f9-4cbe-9d7d-2a65e25540ce tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.196564 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd32a9c1-c0f9-4cbe-9d7d-2a65e25540ce tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.072113 Oct 27 10:08:38.197207 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 131/257] 10.222.0.76 () {60 vars in 1178 bytes} [Thu Oct 27 10:08:38 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:08:38.202960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3f4ebde-fa17-40db-82b1-242c9d813334 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-462842865"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:38.206208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.aggregate [None req-f3f4ebde-fa17-40db-82b1-242c9d813334 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Generated uuid 6c7070d2-0db2-4c3a-9423-39115c145e05 for aggregate {{(pid=120720) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:38.235929 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3f4ebde-fa17-40db-82b1-242c9d813334 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.036205 Oct 27 10:08:38.237394 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 132/258] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:38 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:38.243259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d4676f3-a12d-4cb9-96ca-d81ae46e1540 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.244487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d4676f3-a12d-4cb9-96ca-d81ae46e1540 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:38.327449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d4676f3-a12d-4cb9-96ca-d81ae46e1540 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:38.337439 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d4676f3-a12d-4cb9-96ca-d81ae46e1540 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1219 microversion: 2.1 time: 0.098671 Oct 27 10:08:38.338995 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 133/259] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:38 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:38.359901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9585c974-c3ce-4cdf-be6e-865191e3f34d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854663-10"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:38.376129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9585c974-c3ce-4cdf-be6e-865191e3f34d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.376614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9585c974-c3ce-4cdf-be6e-865191e3f34d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.377074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9585c974-c3ce-4cdf-be6e-865191e3f34d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.422096 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f2b458e5-c0be-4065-b1cd-8fbc54b89e6e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a/action" status: 202 len: 0 microversion: 2.1 time: 0.647885 Oct 27 10:08:38.425554 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 127/260] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:08:37 2022] POST /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:08:38.431101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c547ac17-d241-4677-9557-d9bf3ba56c9c tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.435422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c547ac17-d241-4677-9557-d9bf3ba56c9c tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.435911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c547ac17-d241-4677-9557-d9bf3ba56c9c tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.436352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c547ac17-d241-4677-9557-d9bf3ba56c9c tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.437190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c547ac17-d241-4677-9557-d9bf3ba56c9c tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.437644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c547ac17-d241-4677-9557-d9bf3ba56c9c tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.438065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c547ac17-d241-4677-9557-d9bf3ba56c9c tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.463859 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c547ac17-d241-4677-9557-d9bf3ba56c9c tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.037659 Oct 27 10:08:38.464476 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 128/261] 10.222.0.76 () {60 vars in 1211 bytes} [Thu Oct 27 10:08:38 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:08:38.469286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1533897527"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:38.489310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.489797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.490415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.500438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.501137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.501725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.512434 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1533897527 could not be found. Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Request method failure captured: Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 58 Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh8sjmPgPINVi86oHkut8Ucs4kqErs4sBtyZi42Pph0JoV-qnrOYgyvMc8VSkW_pgwA62jtuUTN926pvWW_-z8KQSHEk5GlCDQzzjeb8URGzECybc8AGFy8RFJ-rU7UepmiTZI3wnausniNcg0mxhH_QWG0epfaolTMKuXbl2vY0EE Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:38.514886 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a0de98870014b0fbb549b8201a0ff49", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d1915adb5757414db446dac9b093aa92 Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: {"add_host": {"host": "tempest-nonexist_host-1533897527"}} Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:38.516152 n-d-854663-10 devstack@n-api.service[120719]: exception: Compute host tempest-nonexist_host-1533897527 could not be found. Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '7', 'body': {'add_host': {'host': 'tempest-nonexist_host-1533897527'}}} Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1533897527' is not mapped to any cell Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:38.516870 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 27 10:08:38.517897 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1533897527 could not be found. Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1533897527 could not be found. Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:38.521707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1533897527 could not be found. Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1533897527 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ed15b5c-5c69-44d1-a1cc-c2e000d15a4a tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/7/action" status: 404 len: 111 microversion: 2.1 time: 0.050862 Oct 27 10:08:38.524986 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 129/262] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:38 2022] POST /compute/v2.1/os-aggregates/7/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:38.527671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.527671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:38.541984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.542604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.543145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.544003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.544759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.545469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.626044 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9585c974-c3ce-4cdf-be6e-865191e3f34d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.270731 Oct 27 10:08:38.633138 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 134/263] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:38 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:38.638399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6dc7d62e-e9ea-4b03-bd04-15901745c7b5 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.641987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dc7d62e-e9ea-4b03-bd04-15901745c7b5 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.642469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dc7d62e-e9ea-4b03-bd04-15901745c7b5 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.642899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dc7d62e-e9ea-4b03-bd04-15901745c7b5 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.645867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dc7d62e-e9ea-4b03-bd04-15901745c7b5 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.646638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dc7d62e-e9ea-4b03-bd04-15901745c7b5 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.647378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dc7d62e-e9ea-4b03-bd04-15901745c7b5 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.687023 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6dc7d62e-e9ea-4b03-bd04-15901745c7b5 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.052533 Oct 27 10:08:38.687989 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 135/264] 10.222.0.76 () {60 vars in 1178 bytes} [Thu Oct 27 10:08:38 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:08:38.705894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56300c9f-9caf-43e5-9cb5-62c39dbf4047 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.751020 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56300c9f-9caf-43e5-9cb5-62c39dbf4047 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.056560 Oct 27 10:08:38.751612 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 136/265] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:38 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:38.757742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:38.759308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7169019e-0a82-4c44-9b22-24f15846eb47 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.769905 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6455d40-f54f-4c86-9fb6-7079e874de84 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1471 microversion: 2.1 time: 0.246550 Oct 27 10:08:38.770571 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 130/266] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:38 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1471 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:38.777453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5ba89bb-541d-4c42-b488-74f169fa5d63 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.782584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5ba89bb-541d-4c42-b488-74f169fa5d63 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.784287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5ba89bb-541d-4c42-b488-74f169fa5d63 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.784756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5ba89bb-541d-4c42-b488-74f169fa5d63 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.786563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5ba89bb-541d-4c42-b488-74f169fa5d63 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.787312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5ba89bb-541d-4c42-b488-74f169fa5d63 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.787900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5ba89bb-541d-4c42-b488-74f169fa5d63 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.803100 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7169019e-0a82-4c44-9b22-24f15846eb47 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.050369 Oct 27 10:08:38.804252 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 137/267] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:38 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:38.814020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.814798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:38.822920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.823630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.824140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.825099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.825654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.826175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.830360 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5ba89bb-541d-4c42-b488-74f169fa5d63 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?host=n-d-854663-10&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.057984 Oct 27 10:08:38.836221 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 131/268] 10.222.0.76 () {60 vars in 1237 bytes} [Thu Oct 27 10:08:38 2022] GET /compute/v2.1/os-services?host=n-d-854663-10&binary=xxx => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:38.844747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8024d7d-fc54-4be1-aa71-b03008c1486f tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8024d7d-fc54-4be1-aa71-b03008c1486f tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Request method failure captured: Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 283 Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh8sjmPgPINVi86oHkut8Ucs4kqErs4sBtyZi42Pph0JoV-qnrOYgyvMc8VSkW_pgwA62jtuUTN926pvWW_-z8KQSHEk5GlCDQzzjeb8URGzECybc8AGFy8RFJ-rU7UepmiTZI3wnausniNcg0mxhH_QWG0epfaolTMKuXbl2vY0EE Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:38.857426 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a0de98870014b0fbb549b8201a0ff49", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d1915adb5757414db446dac9b093aa92 Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:38.858711 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:08:38.859229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:38.860027 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:38.861926 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:38.863612 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:08:38.863612 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:08:38.863612 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:08:38.863612 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:38.863612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8024d7d-fc54-4be1-aa71-b03008c1486f tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:38.864452 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8024d7d-fc54-4be1-aa71-b03008c1486f tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.021155 Oct 27 10:08:38.864452 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 132/269] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 27 10:08:38 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:38.880648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e3a124e-f53c-4d82-8519-d394d57e555d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1907445567"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:38.884395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-6e3a124e-f53c-4d82-8519-d394d57e555d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Generated uuid 4665a09b-be5b-4d20-956b-4aac836afdc7 for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:38.931365 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e3a124e-f53c-4d82-8519-d394d57e555d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057926 Oct 27 10:08:38.932974 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 133/270] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:38.946402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c1d95694-fcf2-4609-bd55-8c61da75ff5d tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:38.951120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1d95694-fcf2-4609-bd55-8c61da75ff5d tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.951882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1d95694-fcf2-4609-bd55-8c61da75ff5d tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.953262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1d95694-fcf2-4609-bd55-8c61da75ff5d tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.954160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1d95694-fcf2-4609-bd55-8c61da75ff5d tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:38.954837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1d95694-fcf2-4609-bd55-8c61da75ff5d tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:38.955488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1d95694-fcf2-4609-bd55-8c61da75ff5d tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:38.984764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:38.997497 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a1dc0d3-a223-443b-a1fe-e91646eb574f tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1270 microversion: 2.1 time: 0.191926 Oct 27 10:08:38.998264 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 138/271] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:38 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1270 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:38.999461 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c1d95694-fcf2-4609-bd55-8c61da75ff5d tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.065221 Oct 27 10:08:39.001249 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 134/272] 10.222.0.76 () {60 vars in 1178 bytes} [Thu Oct 27 10:08:38 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:08:39.007175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-434a5e3a-17e2-4ff4-bae1-ee7b1276ff24 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:39.015467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f0e960b8-f720-4afb-acde-21ef7ab6e84d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-434a5e3a-17e2-4ff4-bae1-ee7b1276ff24 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Request method failure captured: Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 27 Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh8sjmPgPINVi86oHkut8Ucs4kqErs4sBtyZi42Pph0JoV-qnrOYgyvMc8VSkW_pgwA62jtuUTN926pvWW_-z8KQSHEk5GlCDQzzjeb8URGzECybc8AGFy8RFJ-rU7UepmiTZI3wnausniNcg0mxhH_QWG0epfaolTMKuXbl2vY0EE Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:39.023930 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a0de98870014b0fbb549b8201a0ff49", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: d1915adb5757414db446dac9b093aa92 Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: {"aggregate": {"name": ""}} Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:39.025646 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '' Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:39.026517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:08:39.027975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.029294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-434a5e3a-17e2-4ff4-bae1-ee7b1276ff24 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:39.030237 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-434a5e3a-17e2-4ff4-bae1-ee7b1276ff24 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.029335 Oct 27 10:08:39.030838 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 139/273] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:38 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:39.036512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0e960b8-f720-4afb-acde-21ef7ab6e84d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.037408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0e960b8-f720-4afb-acde-21ef7ab6e84d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.038095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0e960b8-f720-4afb-acde-21ef7ab6e84d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.052419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d16c1c8f-d629-49e7-a241-18840f7a5694 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:39.061934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d16c1c8f-d629-49e7-a241-18840f7a5694 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.064326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d16c1c8f-d629-49e7-a241-18840f7a5694 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.065229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d16c1c8f-d629-49e7-a241-18840f7a5694 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.066354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d16c1c8f-d629-49e7-a241-18840f7a5694 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.067020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d16c1c8f-d629-49e7-a241-18840f7a5694 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.067441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d16c1c8f-d629-49e7-a241-18840f7a5694 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.140544 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d16c1c8f-d629-49e7-a241-18840f7a5694 tempest-ServicesAdminNegativeV253TestJSON-1944760809 tempest-ServicesAdminNegativeV253TestJSON-1944760809-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.103706 Oct 27 10:08:39.141599 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 140/274] 10.222.0.76 () {60 vars in 1239 bytes} [Thu Oct 27 10:08:39 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:39.156650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4459650-e256-47b6-841d-c210c491760d tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-207636197"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:39.177418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4459650-e256-47b6-841d-c210c491760d tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'cc77b4584c764a0489ba90f017c1c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fbb8dbd3741dcbf059b7957f02d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4459650-e256-47b6-841d-c210c491760d tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Request method failure captured: Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 59 Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh60cHpmXcuNZpyZ24mV-O4ntf4iLYteQgr0WKwPv6MN9CZe1dvSut8Cltt--aUn6Jg5gzMpp7vnStwQLg0WzJd34SsCnO6DazY4Jef4HSgXrBGmM3oZLfZ7EFe9AD4GV6AjcBKDTs7PjCiU585omFCeVmdI3UnRGOxg-Q63i-YFU0 Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:39.182423 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_316fbb8dbd3741dcbf059b7957f02d1a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: cc77b4584c764a0489ba90f017c1c7c1 Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: {"aggregate": {"name": "tempest-test_aggregate-207636197"}} Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:39.183753 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-207636197'}}} Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:39.184499 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:39.185577 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 10:08:39.186654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.194528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4459650-e256-47b6-841d-c210c491760d tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:39.196121 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4459650-e256-47b6-841d-c210c491760d tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.045364 Oct 27 10:08:39.196258 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 141/275] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:39 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:39.279115 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f0e960b8-f720-4afb-acde-21ef7ab6e84d tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 243 microversion: 2.1 time: 0.274105 Oct 27 10:08:39.287117 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 135/276] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:39 2022] POST /compute/v2.1/os-aggregates/8/action => generated 243 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:39.293518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71589580-9ff8-4206-9ef7-bb20ddb47559 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1109667960"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:39.298790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-71589580-9ff8-4206-9ef7-bb20ddb47559 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Generated uuid cbef3e2a-cefb-4669-b924-a244250fe471 for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:39.340608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71589580-9ff8-4206-9ef7-bb20ddb47559 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052111 Oct 27 10:08:39.348824 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 136/277] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:39.358220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b25b8dd8-51fb-4744-8c7c-da24265941f9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:39.385923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25b8dd8-51fb-4744-8c7c-da24265941f9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.386916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25b8dd8-51fb-4744-8c7c-da24265941f9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.387688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25b8dd8-51fb-4744-8c7c-da24265941f9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.538334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9effe12b-9ca8-4b13-89e2-98e443ea4fd5 tempest-ServicesAdminNegativeV253TestJSON-2039317004 tempest-ServicesAdminNegativeV253TestJSON-2039317004-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:39.547517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9effe12b-9ca8-4b13-89e2-98e443ea4fd5 tempest-ServicesAdminNegativeV253TestJSON-2039317004 tempest-ServicesAdminNegativeV253TestJSON-2039317004-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9ba83bacc1d44cf8b9b11199dee23d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5384da03ae41b2ade0617cfb446e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9effe12b-9ca8-4b13-89e2-98e443ea4fd5 tempest-ServicesAdminNegativeV253TestJSON-2039317004 tempest-ServicesAdminNegativeV253TestJSON-2039317004-project] Request method failure captured: Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlijpdj8O7XTUsbNQrM08linoAxTkZ1aOT6_Ev7hgEdRV6TMiwhNcCkrVsCNqIj39mMZg-i305v0QqHG_cFw-sKR5dw3H3L0lyd2fz2Mk6RQsSTlFwHjIZ6k1TTI1r-j6jRBUEMHEOHoL6pMqptQCdmJXye2FImFMI26x2usnRGPrrA Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3a5384da03ae41b2ade0617cfb446e8b Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2039317004 Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:39.550433 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3a5384da03ae41b2ade0617cfb446e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3a5384da03ae41b2ade0617cfb446e8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3a5384da03ae41b2ade0617cfb446e8b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3a5384da03ae41b2ade0617cfb446e8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2039317004 Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3a5384da03ae41b2ade0617cfb446e8b Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2039317004 Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2039317004-project Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9ba83bacc1d44cf8b9b11199dee23d5c Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2039317004-project Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 10:08:39.551644 n-d-854663-10 devstack@n-api.service[120720]: action_args: {} Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:39.552367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 10:08:39.554719 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.557113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9effe12b-9ca8-4b13-89e2-98e443ea4fd5 tempest-ServicesAdminNegativeV253TestJSON-2039317004 tempest-ServicesAdminNegativeV253TestJSON-2039317004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:39.558187 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9effe12b-9ca8-4b13-89e2-98e443ea4fd5 tempest-ServicesAdminNegativeV253TestJSON-2039317004 tempest-ServicesAdminNegativeV253TestJSON-2039317004-project] 10.222.0.76 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.359593 Oct 27 10:08:39.559205 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 142/278] 10.222.0.76 () {60 vars in 1178 bytes} [Thu Oct 27 10:08:39 2022] GET /compute/v2.1/os-services => generated 112 bytes in 361 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:08:39.568268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69c8db0c-21d9-448c-a757-943daead97be tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1109667960"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:39.572520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.aggregate [None req-69c8db0c-21d9-448c-a757-943daead97be tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Generated uuid ed650283-76db-4ff7-99fd-586c48e0e126 for aggregate {{(pid=120720) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:39.583788 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-69c8db0c-21d9-448c-a757-943daead97be tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1109667960 already exists. Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69c8db0c-21d9-448c-a757-943daead97be tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Request method failure captured: Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 60 Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh8sjmPgPINVi86oHkut8Ucs4kqErs4sBtyZi42Pph0JoV-qnrOYgyvMc8VSkW_pgwA62jtuUTN926pvWW_-z8KQSHEk5GlCDQzzjeb8URGzECybc8AGFy8RFJ-rU7UepmiTZI3wnausniNcg0mxhH_QWG0epfaolTMKuXbl2vY0EE Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:39.586307 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a0de98870014b0fbb549b8201a0ff49", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: d1915adb5757414db446dac9b093aa92 Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: {"aggregate": {"name": "tempest-test_aggregate-1109667960"}} Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:39.587759 n-d-854663-10 devstack@n-api.service[120720]: exception: Aggregate tempest-test_aggregate-1109667960 already exists. Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1109667960'}}} Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 27 10:08:39.588613 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1109667960 already exists. Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:39.589699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1109667960 already exists. Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1109667960 already exists. Oct 27 10:08:39.591327 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.593150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69c8db0c-21d9-448c-a757-943daead97be tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1109667960 already exists. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:39.594207 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69c8db0c-21d9-448c-a757-943daead97be tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.033633 Oct 27 10:08:39.597635 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 143/279] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:39 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 35 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:39.604005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:39.604953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:39.611566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.613146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.613886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.614820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.615563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.616132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.678640 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b25b8dd8-51fb-4744-8c7c-da24265941f9 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.331894 Oct 27 10:08:39.682605 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 137/280] 10.222.0.76 () {60 vars in 1191 bytes} [Thu Oct 27 10:08:39 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:39.690677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1285e6d6-28fa-460c-bcab-1b6d1ddd7a1d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:39.725873 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1285e6d6-28fa-460c-bcab-1b6d1ddd7a1d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.041960 Oct 27 10:08:39.731092 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 138/281] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:39 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:39.738826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aef07f89-3c8e-4392-8b6f-b07ab4c5685b tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:39.754291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:39.764691 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fda10b8c-2885-4afe-8a0d-fc946504a4f6 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1271 microversion: 2.1 time: 0.168500 Oct 27 10:08:39.765773 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 144/282] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:39 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:39.772285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d73fdfbf-442d-4461-947c-bc0e2819823c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1972239973"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:39.777996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.aggregate [None req-d73fdfbf-442d-4461-947c-bc0e2819823c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Generated uuid 0409b643-764a-4926-a3f0-254037a9c9c5 for aggregate {{(pid=120720) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:39.792397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:DELETE=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:39.795003 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aef07f89-3c8e-4392-8b6f-b07ab4c5685b tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.061974 Oct 27 10:08:39.796585 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 139/283] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:39 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:39.802474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:39.804579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:39.812473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.813337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.817789 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d73fdfbf-442d-4461-947c-bc0e2819823c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050607 Oct 27 10:08:39.818715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.818986 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 145/284] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:39.820884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.821640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.823063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.826536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff9dacae-b9e4-440c-a8e1-ff61db068c36 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-761304485"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:39.838459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.aggregate [None req-ff9dacae-b9e4-440c-a8e1-ff61db068c36 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Generated uuid 6403962a-11a5-4852-85f7-c748fd891755 for aggregate {{(pid=120720) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:39.924980 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff9dacae-b9e4-440c-a8e1-ff61db068c36 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103420 Oct 27 10:08:39.925777 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 146/285] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:39.940103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0635a806-7cbf-4017-866c-f01f3a743793 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:39.942018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0635a806-7cbf-4017-866c-f01f3a743793 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'cc77b4584c764a0489ba90f017c1c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fbb8dbd3741dcbf059b7957f02d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0635a806-7cbf-4017-866c-f01f3a743793 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Request method failure captured: Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-aggregates/10 HTTP/1.1 Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh60cHpmXcuNZpyZ24mV-O4ntf4iLYteQgr0WKwPv6MN9CZe1dvSut8Cltt--aUn6Jg5gzMpp7vnStwQLg0WzJd34SsCnO6DazY4Jef4HSgXrBGmM3oZLfZ7EFe9AD4GV6AjcBKDTs7PjCiU585omFCeVmdI3UnRGOxg-Q63i-YFU0 Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:39.944192 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_316fbb8dbd3741dcbf059b7957f02d1a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: cc77b4584c764a0489ba90f017c1c7c1 Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 10:08:39.945493 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '10'} Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:39.946167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 10:08:39.947142 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:39.950483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0635a806-7cbf-4017-866c-f01f3a743793 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:39.951829 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0635a806-7cbf-4017-866c-f01f3a743793 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/10" status: 403 len: 116 microversion: 2.1 time: 0.017030 Oct 27 10:08:39.952603 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 147/286] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:39 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:39.958040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-468da217-61bb-4b16-8fb4-f3ba52d64462 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Calling method '.version_select at 0x7f6d5be411f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:39.962284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-468da217-61bb-4b16-8fb4-f3ba52d64462 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.962843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-468da217-61bb-4b16-8fb4-f3ba52d64462 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.963520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-468da217-61bb-4b16-8fb4-f3ba52d64462 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.964497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-468da217-61bb-4b16-8fb4-f3ba52d64462 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:39.965159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-468da217-61bb-4b16-8fb4-f3ba52d64462 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:39.965583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-468da217-61bb-4b16-8fb4-f3ba52d64462 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:39.992642 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-468da217-61bb-4b16-8fb4-f3ba52d64462 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.038517 Oct 27 10:08:39.999839 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 148/287] 10.222.0.76 () {58 vars in 1128 bytes} [Thu Oct 27 10:08:39 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:40.005381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c075a0e-c841-4419-b0bf-ce93a96c1a34 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.034303 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c075a0e-c841-4419-b0bf-ce93a96c1a34 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.032041 Oct 27 10:08:40.040413 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 149/288] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:40 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:40.045774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12749a95-efd0-47dc-9e1c-310dcb1f8e4f tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.096432 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12749a95-efd0-47dc-9e1c-310dcb1f8e4f tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.053696 Oct 27 10:08:40.097075 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 150/289] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:40 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:40.111580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-933f092c-2071-411e-8082-2983f8567be2 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Calling method '.version_select at 0x7f6d5be41e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.115500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-933f092c-2071-411e-8082-2983f8567be2 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.116184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-933f092c-2071-411e-8082-2983f8567be2 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.116841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-933f092c-2071-411e-8082-2983f8567be2 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.130679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-933f092c-2071-411e-8082-2983f8567be2 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.131775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-933f092c-2071-411e-8082-2983f8567be2 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.132423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-933f092c-2071-411e-8082-2983f8567be2 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.168488 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-933f092c-2071-411e-8082-2983f8567be2 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.062849 Oct 27 10:08:40.169776 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 151/290] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:40.191412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.192448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:40.200583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.202403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.204318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.205405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.214199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.214910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.223846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:40.240826 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-550883dd-f6eb-45f3-8c69-bb7b5d82bcb8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1471 microversion: 2.1 time: 0.442781 Oct 27 10:08:40.242308 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 140/291] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:39 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:40.248223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd8250f3-a372-4add-8d8a-1febe6e94e42 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.256953 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-bd8250f3-a372-4add-8d8a-1febe6e94e42 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd8250f3-a372-4add-8d8a-1febe6e94e42 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Request method failure captured: Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh8BtxhJO-q-bznAKoCN3GDKe3ZcMp_Vrzx0bbHKljvF73N8cGogp5Ga8RDDJ3LQ8WYbCsIuNuu_rvNVvM2PKKxqh-LfbNsxnEcMYcCVkIKQbvx6aT5ak1RJWWz0hbg50RFLP-_r7ogg59UKyvg6rEomDNrnSu-iO-VwtFVnDSnSMc Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2e3019d485ba4641ae93a5259e08c7ca Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:40.259443 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2e3019d485ba4641ae93a5259e08c7ca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2e3019d485ba4641ae93a5259e08c7ca Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminTestJSON-83988323-project-admin Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: a88bc4b737654b48a632b23cb35a2739 Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminTestJSON-83988323-project-admin Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: exception: Aggregate 11 could not be found. Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '11'} Oct 27 10:08:40.260590 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.261436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 27 10:08:40.262405 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.266343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd8250f3-a372-4add-8d8a-1febe6e94e42 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:40.267488 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bd8250f3-a372-4add-8d8a-1febe6e94e42 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.023823 Oct 27 10:08:40.269141 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 141/292] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:40.275334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2287692-01e9-4be9-a001-e61e74308c8d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.306873 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e2287692-01e9-4be9-a001-e61e74308c8d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2287692-01e9-4be9-a001-e61e74308c8d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Request method failure captured: Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh8sjmPgPINVi86oHkut8Ucs4kqErs4sBtyZi42Pph0JoV-qnrOYgyvMc8VSkW_pgwA62jtuUTN926pvWW_-z8KQSHEk5GlCDQzzjeb8URGzECybc8AGFy8RFJ-rU7UepmiTZI3wnausniNcg0mxhH_QWG0epfaolTMKuXbl2vY0EE Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:40.315281 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a0de98870014b0fbb549b8201a0ff49", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d1915adb5757414db446dac9b093aa92 Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: exception: Aggregate -1 could not be found. Oct 27 10:08:40.317024 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '-1'} Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 10:08:40.319880 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.321403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.322485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.322485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.322485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:40.322485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:40.322485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 27 10:08:40.322485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.327121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2287692-01e9-4be9-a001-e61e74308c8d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:40.329638 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e2287692-01e9-4be9-a001-e61e74308c8d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.059292 Oct 27 10:08:40.332451 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 142/293] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:40 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:40.348063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ca36474-3094-42bc-bd0f-a5d0555181f9 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Calling method '.version_select at 0x7f6d5be35c10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.356394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ca36474-3094-42bc-bd0f-a5d0555181f9 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.360265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ca36474-3094-42bc-bd0f-a5d0555181f9 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.361072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ca36474-3094-42bc-bd0f-a5d0555181f9 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.362016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ca36474-3094-42bc-bd0f-a5d0555181f9 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.366854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ca36474-3094-42bc-bd0f-a5d0555181f9 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.367933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ca36474-3094-42bc-bd0f-a5d0555181f9 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.381391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:40.395192 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5007648b-14d9-4010-93b0-bf8b3bce465e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1276 microversion: 2.1 time: 0.220281 Oct 27 10:08:40.415097 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ca36474-3094-42bc-bd0f-a5d0555181f9 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.076996 Oct 27 10:08:40.415097 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 143/294] 10.222.0.76 () {58 vars in 1128 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:40.418826 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 152/295] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:40.420484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdf3ebb2-5615-4416-8efc-771cdb4c1b67 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.431769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa3a8208-cf07-487b-8c17-88eda09ae9c5 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1031580580"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:40.435633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.aggregate [None req-aa3a8208-cf07-487b-8c17-88eda09ae9c5 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Generated uuid 41645c80-bb52-4898-9457-323ed51fa379 for aggregate {{(pid=120720) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:40.436077 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fdf3ebb2-5615-4416-8efc-771cdb4c1b67 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdf3ebb2-5615-4416-8efc-771cdb4c1b67 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Request method failure captured: Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh8BtxhJO-q-bznAKoCN3GDKe3ZcMp_Vrzx0bbHKljvF73N8cGogp5Ga8RDDJ3LQ8WYbCsIuNuu_rvNVvM2PKKxqh-LfbNsxnEcMYcCVkIKQbvx6aT5ak1RJWWz0hbg50RFLP-_r7ogg59UKyvg6rEomDNrnSu-iO-VwtFVnDSnSMc Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2e3019d485ba4641ae93a5259e08c7ca Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:40.438569 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2e3019d485ba4641ae93a5259e08c7ca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2e3019d485ba4641ae93a5259e08c7ca Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminTestJSON-83988323-project-admin Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: a88bc4b737654b48a632b23cb35a2739 Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminTestJSON-83988323-project-admin Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: exception: Aggregate 11 could not be found. Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '11'} Oct 27 10:08:40.439715 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:40.440399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.441706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.443023 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.443023 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:40.443023 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:40.443023 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 27 10:08:40.443023 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.443023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdf3ebb2-5615-4416-8efc-771cdb4c1b67 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:40.443023 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fdf3ebb2-5615-4416-8efc-771cdb4c1b67 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.025707 Oct 27 10:08:40.443023 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 144/296] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:40 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:40.445497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e5455ae-e4c2-43c5-ac93-9234ca89ab0c tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Calling method '.version_select at 0x7f6d5bc99ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.454901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:40.458732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e5455ae-e4c2-43c5-ac93-9234ca89ab0c tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.459233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e5455ae-e4c2-43c5-ac93-9234ca89ab0c tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.460343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e5455ae-e4c2-43c5-ac93-9234ca89ab0c tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.486446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e5455ae-e4c2-43c5-ac93-9234ca89ab0c tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.487290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e5455ae-e4c2-43c5-ac93-9234ca89ab0c tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.489899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e5455ae-e4c2-43c5-ac93-9234ca89ab0c tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.512496 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e5455ae-e4c2-43c5-ac93-9234ca89ab0c tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts/n-h2-854663-10" status: 200 len: 471 microversion: 2.1 time: 0.070475 Oct 27 10:08:40.513751 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 145/297] 10.222.0.76 () {58 vars in 1173 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-hosts/n-h2-854663-10 => generated 471 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:40.521229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73e71381-9824-405a-a161-b4181ef93e1c tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2011602285", "name": "tempest-test_aggregate-458372080"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:40.528347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-73e71381-9824-405a-a161-b4181ef93e1c tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Generated uuid 9d20e28d-e53e-41d3-bf30-66ba5ab68e3b for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:40.531067 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa3a8208-cf07-487b-8c17-88eda09ae9c5 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.107379 Oct 27 10:08:40.532835 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 153/298] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:40 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:40.546464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c307e981-b541-4f5a-837d-b3c5d1a714e5 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Calling method '.version_select at 0x7f6d6004f1f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.564491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c307e981-b541-4f5a-837d-b3c5d1a714e5 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.565016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c307e981-b541-4f5a-837d-b3c5d1a714e5 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.574199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c307e981-b541-4f5a-837d-b3c5d1a714e5 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.582128 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73e71381-9824-405a-a161-b4181ef93e1c tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.067003 Oct 27 10:08:40.582738 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 146/299] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 27 10:08:40 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:40.587456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-836b14d0-29aa-4a6d-92cd-faabd9356a19 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.601999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-836b14d0-29aa-4a6d-92cd-faabd9356a19 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'cc77b4584c764a0489ba90f017c1c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fbb8dbd3741dcbf059b7957f02d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-836b14d0-29aa-4a6d-92cd-faabd9356a19 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Request method failure captured: Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh60cHpmXcuNZpyZ24mV-O4ntf4iLYteQgr0WKwPv6MN9CZe1dvSut8Cltt--aUn6Jg5gzMpp7vnStwQLg0WzJd34SsCnO6DazY4Jef4HSgXrBGmM3oZLfZ7EFe9AD4GV6AjcBKDTs7PjCiU585omFCeVmdI3UnRGOxg-Q63i-YFU0 Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:40.603774 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_316fbb8dbd3741dcbf059b7957f02d1a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: cc77b4584c764a0489ba90f017c1c7c1 Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 10:08:40.605001 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '12'} Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:40.605680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.611180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-836b14d0-29aa-4a6d-92cd-faabd9356a19 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:40.612960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-836b14d0-29aa-4a6d-92cd-faabd9356a19 tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] 10.222.0.76 "GET /compute/v2.1/os-aggregates/12" status: 403 len: 114 microversion: 2.1 time: 0.021526 Oct 27 10:08:40.612960 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 147/300] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-aggregates/12 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:40.619602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3f38e66-9282-4bea-aa5a-da7474c77c2c tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.641281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c307e981-b541-4f5a-837d-b3c5d1a714e5 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.641779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c307e981-b541-4f5a-837d-b3c5d1a714e5 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.642218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c307e981-b541-4f5a-837d-b3c5d1a714e5 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.667170 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f3f38e66-9282-4bea-aa5a-da7474c77c2c tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.057884 Oct 27 10:08:40.670804 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 148/301] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:40 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:40.680542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6362b758-a286-44cc-8824-1d7f3004d986 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.708543 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c307e981-b541-4f5a-837d-b3c5d1a714e5 tempest-HostsAdminTestJSON-1551089674 tempest-HostsAdminTestJSON-1551089674-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hosts/n-h1-854663-10" status: 200 len: 603 microversion: 2.1 time: 0.174442 Oct 27 10:08:40.719137 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 154/302] 10.222.0.76 () {58 vars in 1173 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-hosts/n-h1-854663-10 => generated 603 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:40.725448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50cbc0c5-3722-42aa-a784-1b92a571f3d8 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.734624 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6362b758-a286-44cc-8824-1d7f3004d986 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.061829 Oct 27 10:08:40.738534 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-50cbc0c5-3722-42aa-a784-1b92a571f3d8 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50cbc0c5-3722-42aa-a784-1b92a571f3d8 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Request method failure captured: Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh8BtxhJO-q-bznAKoCN3GDKe3ZcMp_Vrzx0bbHKljvF73N8cGogp5Ga8RDDJ3LQ8WYbCsIuNuu_rvNVvM2PKKxqh-LfbNsxnEcMYcCVkIKQbvx6aT5ak1RJWWz0hbg50RFLP-_r7ogg59UKyvg6rEomDNrnSu-iO-VwtFVnDSnSMc Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2e3019d485ba4641ae93a5259e08c7ca Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:40.740763 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2e3019d485ba4641ae93a5259e08c7ca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2e3019d485ba4641ae93a5259e08c7ca Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminTestJSON-83988323-project-admin Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: a88bc4b737654b48a632b23cb35a2739 Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminTestJSON-83988323-project-admin Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: exception: Aggregate 13 could not be found. Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '13'} Oct 27 10:08:40.741910 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.742648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 27 10:08:40.743642 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.747003 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 149/303] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:40 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:40.748340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50cbc0c5-3722-42aa-a784-1b92a571f3d8 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:40.749710 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50cbc0c5-3722-42aa-a784-1b92a571f3d8 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.029203 Oct 27 10:08:40.750462 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 155/304] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:40.755561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f42e887-911c-4c68-9b31-487334ccb074 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.779414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8ff5fc4-69ba-48e3-95e8-7cfd3dfc3b56 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.800991 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-8f42e887-911c-4c68-9b31-487334ccb074 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f42e887-911c-4c68-9b31-487334ccb074 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Request method failure captured: Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh8sjmPgPINVi86oHkut8Ucs4kqErs4sBtyZi42Pph0JoV-qnrOYgyvMc8VSkW_pgwA62jtuUTN926pvWW_-z8KQSHEk5GlCDQzzjeb8URGzECybc8AGFy8RFJ-rU7UepmiTZI3wnausniNcg0mxhH_QWG0epfaolTMKuXbl2vY0EE Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:40.803728 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a0de98870014b0fbb549b8201a0ff49", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d1915adb5757414db446dac9b093aa92 Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: exception: Aggregate -1 could not be found. Oct 27 10:08:40.805714 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '-1'} Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.806884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 27 10:08:40.808559 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.811064 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-d8ff5fc4-69ba-48e3-95e8-7cfd3dfc3b56 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8ff5fc4-69ba-48e3-95e8-7cfd3dfc3b56 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Request method failure captured: Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh8BtxhJO-q-bznAKoCN3GDKe3ZcMp_Vrzx0bbHKljvF73N8cGogp5Ga8RDDJ3LQ8WYbCsIuNuu_rvNVvM2PKKxqh-LfbNsxnEcMYcCVkIKQbvx6aT5ak1RJWWz0hbg50RFLP-_r7ogg59UKyvg6rEomDNrnSu-iO-VwtFVnDSnSMc Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2e3019d485ba4641ae93a5259e08c7ca Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:08:40.812993 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2e3019d485ba4641ae93a5259e08c7ca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e3019d485ba4641ae93a5259e08c7ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2e3019d485ba4641ae93a5259e08c7ca Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-83988323 Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminTestJSON-83988323-project-admin Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: a88bc4b737654b48a632b23cb35a2739 Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminTestJSON-83988323-project-admin Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: exception: Aggregate 13 could not be found. Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '13'} Oct 27 10:08:40.814311 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:40.815056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.816059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.817182 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.817182 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:40.817182 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:40.817182 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 27 10:08:40.817182 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.817182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8ff5fc4-69ba-48e3-95e8-7cfd3dfc3b56 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:40.817182 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8ff5fc4-69ba-48e3-95e8-7cfd3dfc3b56 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.059631 Oct 27 10:08:40.822250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f42e887-911c-4c68-9b31-487334ccb074 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:40.829134 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 156/305] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:40 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:40.833386 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f42e887-911c-4c68-9b31-487334ccb074 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.085541 Oct 27 10:08:40.835848 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 150/306] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:40.848303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.851281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:40.857925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1f82751-e586-4fa2-9aef-fbb894e9f539 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-104771322"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:40.867219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-e1f82751-e586-4fa2-9aef-fbb894e9f539 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Generated uuid 95ac4980-fb89-4700-a58d-0727895bb627 for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:40.871903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.872584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.873153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.874628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:40.875179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:40.876800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:40.925290 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1f82751-e586-4fa2-9aef-fbb894e9f539 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085895 Oct 27 10:08:40.926239 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 151/307] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:40.951594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f25c079-e079-4fcb-81a6-3f28b4525d6f tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:40.954756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f25c079-e079-4fcb-81a6-3f28b4525d6f tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'cc77b4584c764a0489ba90f017c1c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fbb8dbd3741dcbf059b7957f02d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f25c079-e079-4fcb-81a6-3f28b4525d6f tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Request method failure captured: Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh60cHpmXcuNZpyZ24mV-O4ntf4iLYteQgr0WKwPv6MN9CZe1dvSut8Cltt--aUn6Jg5gzMpp7vnStwQLg0WzJd34SsCnO6DazY4Jef4HSgXrBGmM3oZLfZ7EFe9AD4GV6AjcBKDTs7PjCiU585omFCeVmdI3UnRGOxg-Q63i-YFU0 Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:40.958480 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_316fbb8dbd3741dcbf059b7957f02d1a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: cc77b4584c764a0489ba90f017c1c7c1 Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 10:08:40.959733 n-d-854663-10 devstack@n-api.service[120719]: action_args: {} Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:40.960374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 10:08:40.962006 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:40.982134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f25c079-e079-4fcb-81a6-3f28b4525d6f tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:40.984423 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f25c079-e079-4fcb-81a6-3f28b4525d6f tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] 10.222.0.76 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.049072 Oct 27 10:08:40.985382 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 152/308] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:41.004794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1a8263b2-7c9a-4214-a5e2-be5c32e39812 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:41.020542 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1a8263b2-7c9a-4214-a5e2-be5c32e39812 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.028753 Oct 27 10:08:41.023912 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 153/309] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:41.026861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:41.043688 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-537a2543-8421-404c-92f6-30ecccace333 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1277 microversion: 2.1 time: 0.219558 Oct 27 10:08:41.044694 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 157/310] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:40 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:41.048023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-553c2dab-1811-4247-aa30-d3c890d631a2 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-5169959"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:41.055571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16858f81-2430-482f-b70d-e33ddefdb1ff tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:41.060892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-553c2dab-1811-4247-aa30-d3c890d631a2 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Generated uuid ed705548-3967-499b-b524-2e9063760aec for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:41.113689 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-553c2dab-1811-4247-aa30-d3c890d631a2 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.077840 Oct 27 10:08:41.121484 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 154/311] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:41 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:41.125480 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16858f81-2430-482f-b70d-e33ddefdb1ff tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.078770 Oct 27 10:08:41.126617 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 158/312] 10.222.0.76 () {60 vars in 1194 bytes} [Thu Oct 27 10:08:41 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:41.136023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf5f73a5-07b7-4ca1-80c4-26c40ce3fea1 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:41.140360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46b539c9-ddd8-4c1d-a9da-b30204833716 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:41.156224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf5f73a5-07b7-4ca1-80c4-26c40ce3fea1 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:41.157190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf5f73a5-07b7-4ca1-80c4-26c40ce3fea1 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:41.157811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf5f73a5-07b7-4ca1-80c4-26c40ce3fea1 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:41.165328 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46b539c9-ddd8-4c1d-a9da-b30204833716 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.029020 Oct 27 10:08:41.167743 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 159/313] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:08:41 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:08:41.185669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a87e253b-80ba-479b-b764-8ac8897d0025 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:41.272812 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a87e253b-80ba-479b-b764-8ac8897d0025 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.096752 Oct 27 10:08:41.283116 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 160/314] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:41 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 27 10:08:41.293891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:41.294518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:41.305670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:41.306228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:41.306652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:41.307362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:41.307813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:41.308235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:41.425206 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bf5f73a5-07b7-4ca1-80c4-26c40ce3fea1 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 241 microversion: 2.1 time: 0.301783 Oct 27 10:08:41.426755 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 155/315] 10.222.0.76 () {60 vars in 1194 bytes} [Thu Oct 27 10:08:41 2022] POST /compute/v2.1/os-aggregates/15/action => generated 241 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:41.432467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-415829d1-8eec-4353-9e0f-6d2751ca5091 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1756508208", "availability_zone": "tempest-test_az-399514184"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:41.436605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-415829d1-8eec-4353-9e0f-6d2751ca5091 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Generated uuid c8d9de64-6f01-4af3-aa65-8f23d10f34b1 for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:41.488513 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-415829d1-8eec-4353-9e0f-6d2751ca5091 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.059778 Oct 27 10:08:41.489517 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 156/316] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 27 10:08:41 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:41.501494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:41.503406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:41.515083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:41.515573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:41.516009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:41.516750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:41.517201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:41.518678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:41.844959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:41.868966 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-417e893a-18f9-4ac6-a180-43a3760bd40b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1471 microversion: 2.1 time: 0.578023 Oct 27 10:08:41.870142 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 161/317] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:41 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1471 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:41.886357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8576dc5e-5112-47a1-93de-c383a295479b tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854663-10"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:41.899531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:41.909582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8576dc5e-5112-47a1-93de-c383a295479b tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'cc77b4584c764a0489ba90f017c1c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fbb8dbd3741dcbf059b7957f02d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8576dc5e-5112-47a1-93de-c383a295479b tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Request method failure captured: Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 43 Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh60cHpmXcuNZpyZ24mV-O4ntf4iLYteQgr0WKwPv6MN9CZe1dvSut8Cltt--aUn6Jg5gzMpp7vnStwQLg0WzJd34SsCnO6DazY4Jef4HSgXrBGmM3oZLfZ7EFe9AD4GV6AjcBKDTs7PjCiU585omFCeVmdI3UnRGOxg-Q63i-YFU0 Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:41.911290 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_316fbb8dbd3741dcbf059b7957f02d1a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/316fbb8dbd3741dcbf059b7957f02d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 316fbb8dbd3741dcbf059b7957f02d1a Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780 Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: cc77b4584c764a0489ba90f017c1c7c1 Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1965022780-project Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: {"remove_host": {"host": "n-h2-854663-10"}} Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:41.912700 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'n-h2-854663-10'}}} Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:41.916623 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 10:08:41.917833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:41.919046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8576dc5e-5112-47a1-93de-c383a295479b tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:41.919046 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8576dc5e-5112-47a1-93de-c383a295479b tempest-AggregatesAdminNegativeTestJSON-1965022780 tempest-AggregatesAdminNegativeTestJSON-1965022780-project] 10.222.0.76 "POST /compute/v2.1/os-aggregates/15/action" status: 403 len: 121 microversion: 2.1 time: 0.041288 Oct 27 10:08:41.919204 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-047c12e5-e8d4-493f-9ecb-08fca6e73b84 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1318 microversion: 2.1 time: 0.424494 Oct 27 10:08:41.919204 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 157/318] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:41 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:41.920648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a42bd9a2-1258-405a-9315-e9014b419908 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1756508208_new", "availability_zone": "tempest-test_az-399514184_new"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:41.925160 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 162/319] 10.222.0.76 () {60 vars in 1194 bytes} [Thu Oct 27 10:08:41 2022] POST /compute/v2.1/os-aggregates/15/action => generated 121 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:41.933963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90cb72ff-cf45-4db1-9b88-c29100cf7f4c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854663-10"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:41.969783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90cb72ff-cf45-4db1-9b88-c29100cf7f4c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:41.970278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90cb72ff-cf45-4db1-9b88-c29100cf7f4c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:41.970711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90cb72ff-cf45-4db1-9b88-c29100cf7f4c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.182294 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90cb72ff-cf45-4db1-9b88-c29100cf7f4c tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 225 microversion: 2.1 time: 0.251893 Oct 27 10:08:42.182838 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 163/320] 10.222.0.76 () {60 vars in 1194 bytes} [Thu Oct 27 10:08:41 2022] POST /compute/v2.1/os-aggregates/15/action => generated 225 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:08:42.187976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.201110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:42.212915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a42bd9a2-1258-405a-9315-e9014b419908 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.213405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a42bd9a2-1258-405a-9315-e9014b419908 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.215350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a42bd9a2-1258-405a-9315-e9014b419908 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.216205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.225795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.226767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.227832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.228556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.229233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.282549 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a42bd9a2-1258-405a-9315-e9014b419908 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 335 microversion: 2.1 time: 0.364812 Oct 27 10:08:42.290107 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 158/321] 10.222.0.76 () {60 vars in 1173 bytes} [Thu Oct 27 10:08:41 2022] PUT /compute/v2.1/os-aggregates/16 => generated 335 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:42.296826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee2550a4-f477-4a45-99e7-d7f60d54c2c4 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.331009 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee2550a4-f477-4a45-99e7-d7f60d54c2c4 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.045753 Oct 27 10:08:42.332154 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 159/322] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:42 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:42.340744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-19030ade-b5cc-44c1-a61f-bb24ba4a5bdf tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.356600 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-19030ade-b5cc-44c1-a61f-bb24ba4a5bdf tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.023040 Oct 27 10:08:42.364161 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 160/323] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:08:42 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:42.370035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fc6c57c-7026-4104-90ec-2d4ec68ed46d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-499839564"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:42.374730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-2fc6c57c-7026-4104-90ec-2d4ec68ed46d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Generated uuid febfbfce-caee-4d89-8b30-448052f77ade for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:42.405399 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fc6c57c-7026-4104-90ec-2d4ec68ed46d tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046348 Oct 27 10:08:42.407339 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 161/324] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:42.414244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5568fc09-9143-4072-9cfb-9507f3cc4c1b tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.488701 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5568fc09-9143-4072-9cfb-9507f3cc4c1b tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.069407 Oct 27 10:08:42.489987 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 162/325] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:42 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:42.503227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:42.517660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.518147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.518584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.524613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.525208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.525646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.535351 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.compute.aggregates [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 27 10:08:42.535955 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Request method failure captured: Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 42 Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh8sjmPgPINVi86oHkut8Ucs4kqErs4sBtyZi42Pph0JoV-qnrOYgyvMc8VSkW_pgwA62jtuUTN926pvWW_-z8KQSHEk5GlCDQzzjeb8URGzECybc8AGFy8RFJ-rU7UepmiTZI3wnausniNcg0mxhH_QWG0epfaolTMKuXbl2vY0EE Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:08:42.538080 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a0de98870014b0fbb549b8201a0ff49", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a0de98870014b0fbb549b8201a0ff49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1a0de98870014b0fbb549b8201a0ff49 Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-873171904 Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d1915adb5757414db446dac9b093aa92 Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: {"remove_host": {"host": "nonexist_host"}} Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:42.539372 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot remove host nonexist_host in aggregate 17 Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 27 10:08:42.540054 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 27 10:08:42.541114 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.542146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.543275 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:42.543275 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:42.543275 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:42.543275 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:42.543275 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Oct 27 10:08:42.543275 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.543593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:42.543688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:42.543688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1e8e2ef-53a8-4866-8771-7e92566883b9 tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.051503 Oct 27 10:08:42.549156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 163/326] 10.222.0.76 () {60 vars in 1194 bytes} [Thu Oct 27 10:08:42 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:08:42.550660 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-236ac9d0-5d7f-41bd-84b9-7fd4cc00701f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1319 microversion: 2.1 time: 0.366764 Oct 27 10:08:42.555444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e62fe7dd-e493-46bd-a21f-a9317cdd9ebc tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1391362061"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:42.557090 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 164/327] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:42 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:42.563114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e259bc39-6203-4237-b482-6c422a77c56e tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.563854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.aggregate [None req-e62fe7dd-e493-46bd-a21f-a9317cdd9ebc tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Generated uuid 6cf4402f-cad2-497c-9d3c-d15f91ab55be for aggregate {{(pid=120719) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:08:42.594365 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e62fe7dd-e493-46bd-a21f-a9317cdd9ebc tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046689 Oct 27 10:08:42.602689 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 164/328] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:08:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:42.612894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e79d9922-ae15-4b06-81b2-a2e11ae495f3 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.627742 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e259bc39-6203-4237-b482-6c422a77c56e tempest-AggregatesAdminNegativeTestJSON-873171904 tempest-AggregatesAdminNegativeTestJSON-873171904-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.069491 Oct 27 10:08:42.628565 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e79d9922-ae15-4b06-81b2-a2e11ae495f3 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.024300 Oct 27 10:08:42.629541 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 165/329] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:08:42 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:42.633787 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 165/330] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:42 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:42.646899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65a86d97-76fc-477b-8d6e-82c3530ff019 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.724972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65a86d97-76fc-477b-8d6e-82c3530ff019 tempest-AggregatesAdminTestJSON-83988323 tempest-AggregatesAdminTestJSON-83988323-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.083429 Oct 27 10:08:42.725569 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 166/331] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:08:42 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:08:42.740738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.741264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:42.757057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.762269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.763589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.764353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.765215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.772086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.807393 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] HTTP exception thrown: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Request method failure captured: Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 HTTP/1.1 Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh58SZJjAs697BoMKgU7XbSW_a9akOMkaPC5_Hjmnfox9Z7cgv6eAC06-j6rOycxkwhIJebTg3ixYe4nmWXtHHBwHzBT2hgh7TEB81hsa-4GCkVpNIaou_7o722pm2dz_tR_lxn7cW1paqEdSAFDyRsu-f5t0U2sNKwCNa8fWqGdvc Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7ff65e0901dc4084bca6423c66002967 Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AggregatesAdminTestJSON-262221765 Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:42.809040 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7ff65e0901dc4084bca6423c66002967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7ff65e0901dc4084bca6423c66002967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7ff65e0901dc4084bca6423c66002967", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7ff65e0901dc4084bca6423c66002967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AggregatesAdminTestJSON-262221765 Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7ff65e0901dc4084bca6423c66002967 Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-262221765 Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AggregatesAdminTestJSON-262221765-project Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8a658de6fc314b07938ad013f78dfe69 Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AggregatesAdminTestJSON-262221765-project Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.810313 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '3fc51aea-cbe7-435e-9b95-5ba843803540'} Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:42.811003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.812026 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.813340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Returning 404 to user: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:42.813340 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56356ea0-7d5b-4450-a925-7ac75e445c7f tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 404 len: 111 microversion: 2.1 time: 0.079332 Oct 27 10:08:42.817271 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 166/332] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:08:42 2022] DELETE /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:42.826449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.827249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] [instance: 3fc51aea-cbe7-435e-9b95-5ba843803540] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:42.840058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.842099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.842556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.845208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.850808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.851536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.885059 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] HTTP exception thrown: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Request method failure captured: Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 HTTP/1.1 Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh58SZJjAs697BoMKgU7XbSW_a9akOMkaPC5_Hjmnfox9Z7cgv6eAC06-j6rOycxkwhIJebTg3ixYe4nmWXtHHBwHzBT2hgh7TEB81hsa-4GCkVpNIaou_7o722pm2dz_tR_lxn7cW1paqEdSAFDyRsu-f5t0U2sNKwCNa8fWqGdvc Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 7ff65e0901dc4084bca6423c66002967 Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AggregatesAdminTestJSON-262221765 Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:08:42.886627 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7ff65e0901dc4084bca6423c66002967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7ff65e0901dc4084bca6423c66002967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7ff65e0901dc4084bca6423c66002967", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7ff65e0901dc4084bca6423c66002967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AggregatesAdminTestJSON-262221765 Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 7ff65e0901dc4084bca6423c66002967 Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-262221765 Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AggregatesAdminTestJSON-262221765-project Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 8a658de6fc314b07938ad013f78dfe69 Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AggregatesAdminTestJSON-262221765-project Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.887825 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '3fc51aea-cbe7-435e-9b95-5ba843803540'} Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:42.888506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. Oct 27 10:08:42.894944 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:08:42.896270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] Returning 404 to user: Instance 3fc51aea-cbe7-435e-9b95-5ba843803540 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:42.896270 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9eb36e17-598f-49c9-8093-095d988c697d tempest-AggregatesAdminTestJSON-262221765 tempest-AggregatesAdminTestJSON-262221765-project] 10.222.0.76 "GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540" status: 404 len: 111 microversion: 2.1 time: 0.066150 Oct 27 10:08:42.896270 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 167/333] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:42 2022] GET /compute/v2.1/servers/3fc51aea-cbe7-435e-9b95-5ba843803540 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:08:42.903905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.905748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:42.913559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.915132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.916012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.916862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.917584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.918621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.948015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:42.949334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:42.962728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.963905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.968692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:42.970194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:42.971035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:42.971869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:43.373120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:43.387914 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7962b325-7e3c-44b7-acca-a1a6770b402d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1471 microversion: 2.1 time: 0.490129 Oct 27 10:08:43.389894 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 167/334] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:42 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1471 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:43.444561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:43.468897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d49386eb-a36b-4569-a17c-1c87ed191f6c tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1318 microversion: 2.1 time: 0.526807 Oct 27 10:08:43.470395 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 168/335] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:42 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:43.584134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:43.585557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:43.604209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:43.605170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:43.608991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:43.610854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:43.613967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:43.614957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:43.819621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:43.830122 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94d7ca87-edce-4ecd-8a9b-1dd6a5a6d217 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1319 microversion: 2.1 time: 0.252168 Oct 27 10:08:43.832132 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 168/336] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:43 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:43.861016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c7e30347-f75d-4803-ab13-05f251580c0d req-f56d2553-7f16-4982-a2a1-81050a5d7f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6fe40a2-f8c2-479b-b30c-0749399e80de", "tag": "b5a8f87c-e03e-4748-8037-d11302905adc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:43.876852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:43.879951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c7e30347-f75d-4803-ab13-05f251580c0d req-f56d2553-7f16-4982-a2a1-81050a5d7f20 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:43.880651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c7e30347-f75d-4803-ab13-05f251580c0d req-f56d2553-7f16-4982-a2a1-81050a5d7f20 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:43.881365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c7e30347-f75d-4803-ab13-05f251580c0d req-f56d2553-7f16-4982-a2a1-81050a5d7f20 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:43.898972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c7e30347-f75d-4803-ab13-05f251580c0d req-f56d2553-7f16-4982-a2a1-81050a5d7f20 service nova] Creating event network-changed:b5a8f87c-e03e-4748-8037-d11302905adc for instance a6fe40a2-f8c2-479b-b30c-0749399e80de on n-h1-854663-10 Oct 27 10:08:43.908094 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c7e30347-f75d-4803-ab13-05f251580c0d req-f56d2553-7f16-4982-a2a1-81050a5d7f20 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051136 Oct 27 10:08:43.909352 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 169/337] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:44.417361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:44.419172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:44.431293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:44.433138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:44.433585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:44.434301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:44.434757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:44.435177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:44.512201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:44.513132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:44.538121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:44.539890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:44.546821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:44.547634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:44.548534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:44.549014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:44.737868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:44.750376 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a49a0384-5bd8-4182-9f46-4040208bd3ce tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1476 microversion: 2.1 time: 0.339289 Oct 27 10:08:44.751958 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 169/338] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:44 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:44.817867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:44.832898 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3dee6b56-f13d-42d9-b955-f49af54b1b40 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1318 microversion: 2.1 time: 0.342268 Oct 27 10:08:44.833937 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 170/339] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:44 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:44.853520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:44.854812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:44.867408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:44.868013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:44.868483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:44.869316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:44.869930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:44.870435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:44.919459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:45.526722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:45.536827 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f9d902f-fce7-4f80-8f56-757fbef57dc7 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1319 microversion: 2.1 time: 0.687526 Oct 27 10:08:45.561239 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 170/340] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:44 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:45.786133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:45.790041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:45.810539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:45.814674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:45.815654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:45.819029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:45.821876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:45.823261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:45.855779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:45.856793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:45.870720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:45.871220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:45.871661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:45.875081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:45.875542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:45.888406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:46.265858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:46.276523 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b8af7472-fdfd-45bb-b676-460ac85792c3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1476 microversion: 2.1 time: 0.502979 Oct 27 10:08:46.280996 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 171/341] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:45 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1476 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:46.301192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0c9676c5-2da3-49a2-bbd7-7e904c3f66e6 req-ffe53e2c-836d-4a48-a602-20ba653d0800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5871198d-fb20-42e6-85b1-fb99cc8848ad", "tag": "ff31c127-f464-4c8e-8118-3cf96e133cbd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:46.330473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0c9676c5-2da3-49a2-bbd7-7e904c3f66e6 req-ffe53e2c-836d-4a48-a602-20ba653d0800 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:46.338177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0c9676c5-2da3-49a2-bbd7-7e904c3f66e6 req-ffe53e2c-836d-4a48-a602-20ba653d0800 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:46.338635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0c9676c5-2da3-49a2-bbd7-7e904c3f66e6 req-ffe53e2c-836d-4a48-a602-20ba653d0800 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:46.364407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:46.368261 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0c9676c5-2da3-49a2-bbd7-7e904c3f66e6 req-ffe53e2c-836d-4a48-a602-20ba653d0800 service nova] Creating event network-changed:ff31c127-f464-4c8e-8118-3cf96e133cbd for instance 5871198d-fb20-42e6-85b1-fb99cc8848ad on n-h1-854663-10 Oct 27 10:08:46.378026 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8011b012-9979-4ec8-aa4e-9fc2c403f7a2 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1318 microversion: 2.1 time: 0.526417 Oct 27 10:08:46.378709 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0c9676c5-2da3-49a2-bbd7-7e904c3f66e6 req-ffe53e2c-836d-4a48-a602-20ba653d0800 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089175 Oct 27 10:08:46.378982 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 171/342] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:45 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:46.382262 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 172/343] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:46.563628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:46.565175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:46.573960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:46.574691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:46.575301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:46.576211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:46.576840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:46.577401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:47.149764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:47.163712 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-003498e1-e5af-4d90-be4a-7ce421378976 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1319 microversion: 2.1 time: 0.604312 Oct 27 10:08:47.168940 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 172/344] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:46 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:47.305477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:47.306409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:47.320080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:47.322102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:47.324167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:47.326197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:47.326651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:47.327077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:47.407052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:47.408080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:47.417128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:47.417863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:47.418566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:47.421811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:47.422683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:47.424107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:47.712266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:47.801470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:47.811329 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf924b5d-8018-4ba7-ace5-1adb6f7f0f81 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1318 microversion: 2.1 time: 0.409245 Oct 27 10:08:47.811843 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 173/345] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:47 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:48.195897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:48.196521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:48.203345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:48.203837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:48.204271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:48.205000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:48.205501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:48.205860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:48.332151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:48.582093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:48.590240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:48.608021 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e349e9c-acdf-46bf-adc6-29dcbe3e68ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1476 microversion: 2.1 time: 1.299306 Oct 27 10:08:48.610318 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 173/346] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:47 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1476 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:48.839194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:48.839828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:48.853751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:48.859156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:48.859765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:48.860675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:48.861305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:48.861874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:48.957141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:48.966205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70212f15-49ea-4ba8-9cfb-7446b3b75b34 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1319 microversion: 2.1 time: 0.774290 Oct 27 10:08:48.972102 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 174/347] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:48 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1319 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:49.470176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80905c16-b00b-4cfd-b47e-3c370fca5079 tempest-AZAdminNegativeTestJSON-520832578 tempest-AZAdminNegativeTestJSON-520832578-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:49.472522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-80905c16-b00b-4cfd-b47e-3c370fca5079 tempest-AZAdminNegativeTestJSON-520832578 tempest-AZAdminNegativeTestJSON-520832578-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e4d7242d96314c4a9f73e6a8d042175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '128b468534d54830a6b1d83d7e25fca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80905c16-b00b-4cfd-b47e-3c370fca5079 tempest-AZAdminNegativeTestJSON-520832578 tempest-AZAdminNegativeTestJSON-520832578-project] Request method failure captured: Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlivHCicFcVf6-vZy8A3mNfIWU83qRyKbz_MQxZTu-w5_dWRAUBx-dhYoaWB2dduPEf5V0cSXv9kwoGHuCKzkWZzjr4CE9WNlB8ksqHs8HSkGR2_KOZ5o45pVUYBa4FNd2Z74JtaKsvp0HyYwdDb5S98zm4w9P8sn3cQIEnOZBsNAZo Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 128b468534d54830a6b1d83d7e25fca3 Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AZAdminNegativeTestJSON-520832578 Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:49.474328 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/128b468534d54830a6b1d83d7e25fca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/128b468534d54830a6b1d83d7e25fca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_128b468534d54830a6b1d83d7e25fca3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/128b468534d54830a6b1d83d7e25fca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AZAdminNegativeTestJSON-520832578 Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 128b468534d54830a6b1d83d7e25fca3 Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-520832578 Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AZAdminNegativeTestJSON-520832578-project Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: e4d7242d96314c4a9f73e6a8d042175b Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AZAdminNegativeTestJSON-520832578-project Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 10:08:49.476576 n-d-854663-10 devstack@n-api.service[120720]: action_args: {} Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:08:49.478418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:49.481282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80905c16-b00b-4cfd-b47e-3c370fca5079 tempest-AZAdminNegativeTestJSON-520832578 tempest-AZAdminNegativeTestJSON-520832578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:49.483207 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80905c16-b00b-4cfd-b47e-3c370fca5079 tempest-AZAdminNegativeTestJSON-520832578 tempest-AZAdminNegativeTestJSON-520832578-project] 10.222.0.76 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.466616 Oct 27 10:08:49.500164 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 175/348] 10.222.0.76 () {58 vars in 1185 bytes} [Thu Oct 27 10:08:49 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 486 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:49.632678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:49.633803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:49.652876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:49.653855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:49.654514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:49.655457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:49.656176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:49.657171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:49.840208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:49.853995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4bedb807-da52-4036-ab04-07a58d35a14a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1318 microversion: 2.1 time: 1.020269 Oct 27 10:08:49.864415 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 174/349] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:48 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1318 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:50.064083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:50.073241 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f50db4af-c7fd-4d16-8a59-f98463017885 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1476 microversion: 2.1 time: 0.444846 Oct 27 10:08:50.074353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 176/350] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:49 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1476 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:50.080026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:50.081028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:50.090183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:50.091032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:50.092789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:50.093833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:50.095114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:50.095686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:50.147910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:50.206873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa8a7c59-39dc-4ec8-aa95-f65dd1d775ec tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Calling method '.version_select at 0x7f6d5be94940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:50.337998 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa8a7c59-39dc-4ec8-aa95-f65dd1d775ec tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 200 len: 371 microversion: 2.1 time: 0.472121 Oct 27 10:08:50.340004 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 175/351] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 10:08:49 2022] GET /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:50.364185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee3934d6-120b-4593-ae5b-bc1b7006b9dc tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5bc03310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:50.495062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3934d6-120b-4593-ae5b-bc1b7006b9dc tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:50.495590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3934d6-120b-4593-ae5b-bc1b7006b9dc tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:50.496029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3934d6-120b-4593-ae5b-bc1b7006b9dc tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:50.496820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3934d6-120b-4593-ae5b-bc1b7006b9dc tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:50.497269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3934d6-120b-4593-ae5b-bc1b7006b9dc tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:50.497687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3934d6-120b-4593-ae5b-bc1b7006b9dc tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:50.699699 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee3934d6-120b-4593-ae5b-bc1b7006b9dc tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 200 len: 328 microversion: 2.1 time: 0.347883 Oct 27 10:08:50.705117 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 176/352] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:50 2022] PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 328 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:50.797616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:50.806445 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab85f35e-c10d-4962-8be4-2daab36c7e39 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1319 microversion: 2.1 time: 0.730778 Oct 27 10:08:50.817102 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 177/353] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:50 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1319 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:50.889944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:50.890562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:50.908484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:50.909124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:50.909510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:50.913969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:50.914547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:50.917599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:50.938037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-08b337c3-8052-497d-9fb5-743f44ca69c0 req-767e9e5e-9949-414a-9d15-ba7eca6176e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6fe40a2-f8c2-479b-b30c-0749399e80de", "name": "network-vif-plugged", "status": "completed", "tag": "b5a8f87c-e03e-4748-8037-d11302905adc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:50.960767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-08b337c3-8052-497d-9fb5-743f44ca69c0 req-767e9e5e-9949-414a-9d15-ba7eca6176e8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:50.962157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-08b337c3-8052-497d-9fb5-743f44ca69c0 req-767e9e5e-9949-414a-9d15-ba7eca6176e8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:50.965649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-08b337c3-8052-497d-9fb5-743f44ca69c0 req-767e9e5e-9949-414a-9d15-ba7eca6176e8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:51.000327 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-08b337c3-8052-497d-9fb5-743f44ca69c0 req-767e9e5e-9949-414a-9d15-ba7eca6176e8 service nova] Creating event network-vif-plugged:b5a8f87c-e03e-4748-8037-d11302905adc for instance a6fe40a2-f8c2-479b-b30c-0749399e80de on n-h1-854663-10 Oct 27 10:08:51.011298 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-08b337c3-8052-497d-9fb5-743f44ca69c0 req-767e9e5e-9949-414a-9d15-ba7eca6176e8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078289 Oct 27 10:08:51.016572 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 178/354] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:51.210923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-89682683", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:51.317753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:08:51.888186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:51.908090 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0705d95e-daa0-4cab-95a0-188646997dee tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1318 microversion: 2.1 time: 1.023762 Oct 27 10:08:51.910336 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 177/355] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:50 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1318 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:51.919476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:51.927952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:51.944878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:51.945777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:51.948235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:51.951717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:51.952503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:51.953216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:52.261877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:08:52.264167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:08:52.265120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:08:52.265840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:08:52.266450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:08:52.282671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:52.283977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:52.284777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:52.285978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:52.286794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:52.287432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:52.320274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Getting quotas for project f1868f6ca1cd4a25a4520c18ea1b329e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:08:52.325357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:52.327697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Getting quotas for user 2a4a4e3733844775be71086f3b5c13c6 and project f1868f6ca1cd4a25a4520c18ea1b329e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:08:52.350678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.utils [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] cores quota exceeded for f1868f6ca1cd4a25a4520c18ea1b329e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120720) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 10:08:52.352865 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Request method failure captured: Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 143 Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliwdzePFxvFrV1hMVnTbGQVfLC_WSsVo-bBbJQ31pe1F88QTiyAXebbLPZXWdjF-rmmNbS0itWjbXV9vU9QOLe1tLsFEKl4_Y0Hog1azMVa28hEPKrEYalnSN2tpyoZ2fKQRdCYi4roEL5Cab02DOW2IIjoCXm5X-Y3OooxvcAqGxA Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f1868f6ca1cd4a25a4520c18ea1b329e Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:52.375531 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f1868f6ca1cd4a25a4520c18ea1b329e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f1868f6ca1cd4a25a4520c18ea1b329e Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-QuotasAdminNegativeTest-2058762776-project Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2a4a4e3733844775be71086f3b5c13c6 Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-QuotasAdminNegativeTest-2058762776-project Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-89682683", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} Oct 27 10:08:52.376892 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-89682683', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452'}}} Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 10:08:52.377837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:52.378909 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:52.383002 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:52.385855 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:52.385855 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:52.385855 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:52.385855 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:52.385855 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 10:08:52.385855 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:52.385855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:52.385855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12c7320b-a1a6-42ba-89f9-b4061e23a1f9 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.356983 Oct 27 10:08:52.385855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 179/356] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:51 2022] POST /compute/v2.1/servers => generated 111 bytes in 1361 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:52.388595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:52.389654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:52.419272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:52.419713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:52.425161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:52.437778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:52.440632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:52.441548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:52.751023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:52.766878 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e9417b7-d9ec-4576-aa28-02dc3e72f553 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1476 microversion: 2.1 time: 0.854086 Oct 27 10:08:52.766878 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 178/357] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:51 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1476 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:52.774486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb9076a2-2adf-4057-80bd-54f378c3ed42 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5bb841f0>, body: {"quota_set": {"cores": 20}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:53.297123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb9076a2-2adf-4057-80bd-54f378c3ed42 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.300082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb9076a2-2adf-4057-80bd-54f378c3ed42 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.301120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb9076a2-2adf-4057-80bd-54f378c3ed42 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:53.305781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb9076a2-2adf-4057-80bd-54f378c3ed42 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.308918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb9076a2-2adf-4057-80bd-54f378c3ed42 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.315711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb9076a2-2adf-4057-80bd-54f378c3ed42 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:53.433615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:53.447715 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c799055b-fbcc-42b9-8470-b2e2e43d72d3 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1319 microversion: 2.1 time: 1.068428 Oct 27 10:08:53.450682 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 180/358] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:52 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1319 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:53.467236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:53.474375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:53.484745 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb9076a2-2adf-4057-80bd-54f378c3ed42 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 200 len: 329 microversion: 2.1 time: 0.716746 Oct 27 10:08:53.485452 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 179/359] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:52 2022] PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 329 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:53.500093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e28508b-dd88-4c45-9425-5c9181ddbf4a tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Calling method '.version_select at 0x7f6d5bc99160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:53.501669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.503928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.514353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:53.522266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.522807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.523258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:53.640004 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e28508b-dd88-4c45-9425-5c9181ddbf4a tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 200 len: 371 microversion: 2.1 time: 0.145220 Oct 27 10:08:53.652422 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 180/360] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 10:08:53 2022] GET /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:53.675239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc48b577-45f7-4013-bb5f-46adf100bb8d tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5bb84940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:53.785300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc48b577-45f7-4013-bb5f-46adf100bb8d tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.785992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc48b577-45f7-4013-bb5f-46adf100bb8d tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.786575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc48b577-45f7-4013-bb5f-46adf100bb8d tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:53.787506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc48b577-45f7-4013-bb5f-46adf100bb8d tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.788279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc48b577-45f7-4013-bb5f-46adf100bb8d tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.789127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc48b577-45f7-4013-bb5f-46adf100bb8d tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:53.870952 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc48b577-45f7-4013-bb5f-46adf100bb8d tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 200 len: 328 microversion: 2.1 time: 0.208926 Oct 27 10:08:53.872202 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 181/361] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:53 2022] PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:53.890989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:53.891704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:53.906835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.907326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.907753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:53.908450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.913187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.914130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:54.353202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:54.364433 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ceacaa88-cea9-444d-9c6f-49a93774247b tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1467 microversion: 2.1 time: 0.902676 Oct 27 10:08:54.365423 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 181/362] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:53 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1467 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:54.396775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1875906165", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:54.487467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:08:54.836258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:54.846800 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39400b15-e20f-4122-89a8-c28dc2a29d8c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1476 microversion: 2.1 time: 0.973250 Oct 27 10:08:54.849865 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 182/363] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:53 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1476 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:54.864792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1209344b-9dd1-4912-a636-4a4ec380c338 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:54.870200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1209344b-9dd1-4912-a636-4a4ec380c338 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:54.893606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1209344b-9dd1-4912-a636-4a4ec380c338 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:54.894210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1209344b-9dd1-4912-a636-4a4ec380c338 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:54.894923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1209344b-9dd1-4912-a636-4a4ec380c338 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:54.895845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1209344b-9dd1-4912-a636-4a4ec380c338 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:54.896691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1209344b-9dd1-4912-a636-4a4ec380c338 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:54.897386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1209344b-9dd1-4912-a636-4a4ec380c338 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.079537 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1209344b-9dd1-4912-a636-4a4ec380c338 tempest-DeleteServersAdminTestJSON-1671563776 tempest-DeleteServersAdminTestJSON-1671563776-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de/action" status: 202 len: 0 microversion: 2.1 time: 0.228398 Oct 27 10:08:55.080339 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 183/364] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:08:54 2022] POST /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:08:55.088259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:55.088916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:55.117149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.118013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.118698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.119633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.121158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.122064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.742903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:08:55.743361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:08:55.743927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:08:55.744337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:08:55.745328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:08:55.763787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.764641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.765450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.767640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.768427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.770792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.805990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Getting quotas for project f1868f6ca1cd4a25a4520c18ea1b329e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:08:55.806962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:55.816691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Getting quotas for user 2a4a4e3733844775be71086f3b5c13c6 and project f1868f6ca1cd4a25a4520c18ea1b329e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:08:55.818844 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92512702-540f-4021-b869-49f6b4509a94 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1319 microversion: 2.1 time: 0.734253 Oct 27 10:08:55.819872 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 184/365] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:55 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1319 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:55.840887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.utils [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] instances quota exceeded for f1868f6ca1cd4a25a4520c18ea1b329e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120720) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 10:08:55.841431 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 10:08:55.842138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Request method failure captured: Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 145 Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliwdzePFxvFrV1hMVnTbGQVfLC_WSsVo-bBbJQ31pe1F88QTiyAXebbLPZXWdjF-rmmNbS0itWjbXV9vU9QOLe1tLsFEKl4_Y0Hog1azMVa28hEPKrEYalnSN2tpyoZ2fKQRdCYi4roEL5Cab02DOW2IIjoCXm5X-Y3OooxvcAqGxA Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f1868f6ca1cd4a25a4520c18ea1b329e Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:55.844078 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f1868f6ca1cd4a25a4520c18ea1b329e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f1868f6ca1cd4a25a4520c18ea1b329e Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-QuotasAdminNegativeTest-2058762776-project Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2a4a4e3733844775be71086f3b5c13c6 Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-QuotasAdminNegativeTest-2058762776-project Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1875906165", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} Oct 27 10:08:55.845621 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1875906165', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452'}}} Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 10:08:55.846304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:55.847395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:55.850449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:55.854108 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:55.854108 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:55.854108 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:55.854108 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:55.854108 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 10:08:55.854108 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:55.854108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:55.855582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:55.855582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.855582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.855582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.856016 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c102454-3502-4066-a5f8-f7b96155dc44 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.473073 Oct 27 10:08:55.856234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.856344 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 182/366] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:54 2022] POST /compute/v2.1/servers => generated 119 bytes in 1475 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:55.856458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.858570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.860346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f2df573f-9797-4b6b-9363-aa0c403264db req-72e420a9-ba21-4e60-9ec3-91deec8e5998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5871198d-fb20-42e6-85b1-fb99cc8848ad", "name": "network-vif-plugged", "status": "completed", "tag": "ff31c127-f464-4c8e-8118-3cf96e133cbd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:55.890771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f2df573f-9797-4b6b-9363-aa0c403264db req-72e420a9-ba21-4e60-9ec3-91deec8e5998 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.891247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f2df573f-9797-4b6b-9363-aa0c403264db req-72e420a9-ba21-4e60-9ec3-91deec8e5998 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.891668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f2df573f-9797-4b6b-9363-aa0c403264db req-72e420a9-ba21-4e60-9ec3-91deec8e5998 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.909943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.911046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.911763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.912383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lazy-loading 'fault' on Instance uuid a6fe40a2-f8c2-479b-b30c-0749399e80de {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:08:55.913409 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f2df573f-9797-4b6b-9363-aa0c403264db req-72e420a9-ba21-4e60-9ec3-91deec8e5998 service nova] Creating event network-vif-plugged:ff31c127-f464-4c8e-8118-3cf96e133cbd for instance 5871198d-fb20-42e6-85b1-fb99cc8848ad on n-h1-854663-10 Oct 27 10:08:55.930704 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f2df573f-9797-4b6b-9363-aa0c403264db req-72e420a9-ba21-4e60-9ec3-91deec8e5998 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074449 Oct 27 10:08:55.931925 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 183/367] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:55.937098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56f3b66c-3b48-4fb7-87a5-42e00879d711 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5bde7040>, body: {"quota_set": {"instances": 10}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:56.262643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f3b66c-3b48-4fb7-87a5-42e00879d711 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:56.263362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f3b66c-3b48-4fb7-87a5-42e00879d711 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:56.264586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f3b66c-3b48-4fb7-87a5-42e00879d711 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:56.265545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f3b66c-3b48-4fb7-87a5-42e00879d711 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:56.268451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f3b66c-3b48-4fb7-87a5-42e00879d711 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:56.276257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f3b66c-3b48-4fb7-87a5-42e00879d711 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:56.479180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:56.503790 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1d2c5c8a-faa2-4171-adc3-9936e04a2b6a tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1450 microversion: 2.1 time: 0.666800 Oct 27 10:08:56.504852 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 185/368] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:55 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1450 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:56.509416 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56f3b66c-3b48-4fb7-87a5-42e00879d711 tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 200 len: 329 microversion: 2.1 time: 0.574502 Oct 27 10:08:56.518344 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 184/369] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:55 2022] PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 329 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:56.522189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:56.523188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:56.532496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef4c0d5c-e491-44cc-9ee7-c073ef199a8e tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Calling method '.version_select at 0x7f6d5be16670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:56.539558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:56.542807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:56.543687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:56.549088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:56.549973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:56.550621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:56.675721 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef4c0d5c-e491-44cc-9ee7-c073ef199a8e tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 200 len: 371 microversion: 2.1 time: 0.155957 Oct 27 10:08:56.685471 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 185/370] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 10:08:56 2022] GET /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:56.694581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:56.696086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:56.707303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:56.708524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:56.709210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:56.710411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:56.711011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:56.711454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:56.747532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:08:56.962225 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0de26126-3359-4866-b60a-96204ff397d7 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 204 len: 0 microversion: 2.1 time: 0.274642 Oct 27 10:08:56.968788 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 186/371] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:08:56 2022] DELETE /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:08:56.974446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5cacbdec-b833-4a54-a25f-f666d9322d8f tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5bd62c10>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:57.082399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cacbdec-b833-4a54-a25f-f666d9322d8f tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:57.082885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cacbdec-b833-4a54-a25f-f666d9322d8f tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:57.083308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cacbdec-b833-4a54-a25f-f666d9322d8f tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:57.084026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cacbdec-b833-4a54-a25f-f666d9322d8f tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:57.084472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cacbdec-b833-4a54-a25f-f666d9322d8f tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:57.084971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cacbdec-b833-4a54-a25f-f666d9322d8f tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:57.150424 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5cacbdec-b833-4a54-a25f-f666d9322d8f tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 200 len: 325 microversion: 2.1 time: 0.181069 Oct 27 10:08:57.163985 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 187/372] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:56 2022] PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 325 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:57.180371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:57.181133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:57.196451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:57.196972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:57.197408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:57.198122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:57.198573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:57.198997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:57.779037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:57.787985 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-380f71f4-8861-467d-9fd5-3b97d9f181cb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1476 microversion: 2.1 time: 1.281590 Oct 27 10:08:57.791650 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 186/373] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:56 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1476 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:57.802930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:57.805474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:57.815988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:57.819628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:57.821564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:57.823568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:57.826686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:57.827388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:57.881769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:57.882697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:57.883298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:57.883869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lazy-loading 'fault' on Instance uuid a6fe40a2-f8c2-479b-b30c-0749399e80de {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:08:58.209033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:58.229382 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb6b66e9-446b-4015-ab29-75c8bcacf710 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1319 microversion: 2.1 time: 1.063486 Oct 27 10:08:58.231239 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 188/374] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:57 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1319 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:58.243000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1884801765", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:58.362316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:08:58.731826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:58.743012 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8df281fb-4afc-40f5-91de-380d630b558e tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1456 microversion: 2.1 time: 0.949180 Oct 27 10:08:58.744354 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 187/375] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:57 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1456 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:58.823485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:58.825248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:58.838359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:58.838998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:58.839524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:58.840370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:58.841399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:58.841918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:59.314968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:59.329255 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ff5635d-227a-4280-9ef3-054e8b7daa14 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1476 microversion: 2.1 time: 0.518832 Oct 27 10:08:59.331343 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 188/376] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:58 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1476 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:59.341518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:59.344930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:59.354363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:59.355667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:59.356352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:59.357309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:59.358158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:59.358810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:59.479021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:08:59.479574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:08:59.479882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:08:59.480280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:08:59.480697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:08:59.501066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:59.501701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:59.502161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:59.502980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:59.503418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:59.504004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:59.560205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Getting quotas for project f1868f6ca1cd4a25a4520c18ea1b329e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:08:59.575611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Getting quotas for user 2a4a4e3733844775be71086f3b5c13c6 and project f1868f6ca1cd4a25a4520c18ea1b329e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:08:59.593355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.utils [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] ram quota exceeded for f1868f6ca1cd4a25a4520c18ea1b329e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120720) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 10:08:59.594708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Request method failure captured: Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 145 Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliwdzePFxvFrV1hMVnTbGQVfLC_WSsVo-bBbJQ31pe1F88QTiyAXebbLPZXWdjF-rmmNbS0itWjbXV9vU9QOLe1tLsFEKl4_Y0Hog1azMVa28hEPKrEYalnSN2tpyoZ2fKQRdCYi4roEL5Cab02DOW2IIjoCXm5X-Y3OooxvcAqGxA Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f1868f6ca1cd4a25a4520c18ea1b329e Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:08:59.610959 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f1868f6ca1cd4a25a4520c18ea1b329e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f1868f6ca1cd4a25a4520c18ea1b329e Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-QuotasAdminNegativeTest-2058762776-project Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2a4a4e3733844775be71086f3b5c13c6 Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-QuotasAdminNegativeTest-2058762776-project Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1884801765", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} Oct 27 10:08:59.612482 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1884801765', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452'}}} Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 10:08:59.613358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:59.614525 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:59.615844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:08:59.618313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:08:59.618313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:08:59.618313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:08:59.618313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:08:59.618313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 10:08:59.618313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:08:59.618313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:08:59.618313 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05aaec9a-d7f5-40ef-bd11-b146e371b02d tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.379662 Oct 27 10:08:59.619215 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 189/377] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:08:58 2022] POST /compute/v2.1/servers => generated 110 bytes in 1385 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:08:59.629843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58ff05d1-597c-482c-8b53-cb953f15b5ee tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5bd62670>, body: {"quota_set": {"ram": 51200}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:00.073933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ff05d1-597c-482c-8b53-cb953f15b5ee tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.074640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ff05d1-597c-482c-8b53-cb953f15b5ee tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.075769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ff05d1-597c-482c-8b53-cb953f15b5ee tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.076920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ff05d1-597c-482c-8b53-cb953f15b5ee tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.077582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ff05d1-597c-482c-8b53-cb953f15b5ee tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.078209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ff05d1-597c-482c-8b53-cb953f15b5ee tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.148327 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58ff05d1-597c-482c-8b53-cb953f15b5ee tempest-QuotasAdminNegativeTest-1106054091 tempest-QuotasAdminNegativeTest-1106054091-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 200 len: 329 microversion: 2.1 time: 0.527576 Oct 27 10:09:00.149251 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 190/378] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:08:59 2022] PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 329 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:00.157278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7e81d5be-94bd-423d-b62d-1ba38e385910 req-5378925f-09ca-4c72-8c87-f3a26485c8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6fe40a2-f8c2-479b-b30c-0749399e80de", "name": "network-vif-deleted", "tag": "b5a8f87c-e03e-4748-8037-d11302905adc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:00.171742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7e81d5be-94bd-423d-b62d-1ba38e385910 req-5378925f-09ca-4c72-8c87-f3a26485c8ca service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.172231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7e81d5be-94bd-423d-b62d-1ba38e385910 req-5378925f-09ca-4c72-8c87-f3a26485c8ca service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.172752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7e81d5be-94bd-423d-b62d-1ba38e385910 req-5378925f-09ca-4c72-8c87-f3a26485c8ca service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.186936 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7e81d5be-94bd-423d-b62d-1ba38e385910 req-5378925f-09ca-4c72-8c87-f3a26485c8ca service nova] Creating event network-vif-deleted:b5a8f87c-e03e-4748-8037-d11302905adc for instance a6fe40a2-f8c2-479b-b30c-0749399e80de on n-h1-854663-10 Oct 27 10:09:00.193805 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7e81d5be-94bd-423d-b62d-1ba38e385910 req-5378925f-09ca-4c72-8c87-f3a26485c8ca service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042089 Oct 27 10:09:00.195193 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 191/379] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:00.204248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:00.205379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:00.216787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.217275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.217701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.218398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.219523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.220120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.269012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:00.274633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.275155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.275966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.276524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lazy-loading 'fault' on Instance uuid a6fe40a2-f8c2-479b-b30c-0749399e80de {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:09:00.356825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:00.370767 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6cb5d24f-3875-4ac2-a12b-4faaa608711f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1468 microversion: 2.1 time: 1.037086 Oct 27 10:09:00.384691 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 189/380] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:59 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1468 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:00.384691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f2a12bc-9926-4a73-9e70-e653ad375608 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Action: 'update', calling method: .version_select at 0x7f6d5bb848b0>, body: {"quota_set": {"ram": 0}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:00.391188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443955683da4a3cb1936b26f8daea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8e5cdaf2e749069986ccb0b5a971a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:00.402427 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01c10801-65f8-42e7-91ae-cdd8088991a8 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 200 len: 1308 microversion: 2.1 time: 0.200296 Oct 27 10:09:00.403269 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 192/381] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:00 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:00.418320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f2a12bc-9926-4a73-9e70-e653ad375608 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '2a4a4e3733844775be71086f3b5c13c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1868f6ca1cd4a25a4520c18ea1b329e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f2a12bc-9926-4a73-9e70-e653ad375608 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Request method failure captured: Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: request: PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e HTTP/1.1 Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 25 Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliwdzePFxvFrV1hMVnTbGQVfLC_WSsVo-bBbJQ31pe1F88QTiyAXebbLPZXWdjF-rmmNbS0itWjbXV9vU9QOLe1tLsFEKl4_Y0Hog1azMVa28hEPKrEYalnSN2tpyoZ2fKQRdCYi4roEL5Cab02DOW2IIjoCXm5X-Y3OooxvcAqGxA Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f1868f6ca1cd4a25a4520c18ea1b329e Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:09:00.420770 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f1868f6ca1cd4a25a4520c18ea1b329e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f1868f6ca1cd4a25a4520c18ea1b329e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f1868f6ca1cd4a25a4520c18ea1b329e Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2058762776 Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-QuotasAdminNegativeTest-2058762776-project Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2a4a4e3733844775be71086f3b5c13c6 Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-QuotasAdminNegativeTest-2058762776-project Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: {"quota_set": {"ram": 0}} Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 10:09:00.421951 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f1868f6ca1cd4a25a4520c18ea1b329e', 'body': {'quota_set': {'ram': 0}}} Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:09:00.422682 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:00.423705 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:00.425700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:00.425700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:00.425700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:09:00.425700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:09:00.425700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 10:09:00.425700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:00.425700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f2a12bc-9926-4a73-9e70-e653ad375608 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:00.425700 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f2a12bc-9926-4a73-9e70-e653ad375608 tempest-QuotasAdminNegativeTest-2058762776 tempest-QuotasAdminNegativeTest-2058762776-project] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e" status: 403 len: 116 microversion: 2.1 time: 0.049102 Oct 27 10:09:00.427022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:00.427022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:00.435667 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 190/382] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:09:00 2022] PUT /compute/v2.1/os-quota-sets/f1868f6ca1cd4a25a4520c18ea1b329e => generated 116 bytes in 63 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:09:00.447946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.453704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.458863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:00.459443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:00.460257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.461295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.463520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.465412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.483026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.483515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.493700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.498873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.501780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.503044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.554146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:00.597640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lazy-loading 'flavor' on Instance uuid 5871198d-fb20-42e6-85b1-fb99cc8848ad {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:09:00.849496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1,nova_cell1:UPDATE=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:00.875950 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4fc64d9d-a237-4d67-88e4-5a9d341b36c9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad/action" status: 202 len: 0 microversion: 2.1 time: 0.438405 Oct 27 10:09:00.888202 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 191/383] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:09:00 2022] POST /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:00.912220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:00.913290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:00.936876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.939408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.942789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.957122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.957707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.958155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:01.773220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:01.804379 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2ea8312-c245-4f3d-9761-657e87b9b27e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1476 microversion: 2.1 time: 1.399406 Oct 27 10:09:01.806790 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 193/384] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:00 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1476 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:01.819798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:01.822611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:01.838174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:01.838970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:01.839722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:01.840885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:01.842782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:01.843429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:01.869756 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] HTTP exception thrown: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Request method failure captured: Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de HTTP/1.1 Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh9dWBneWs2_8qSZQpjA-3AHsoAlGM7L9amsMkIou0kugFX0fypEpWJhbbWyVzJCCsWRUvzjRvq8IL1z_Dwe9_sMoNAl3fbh9tMNA8sq74lInl_hdYx76sbST162hzOMtT2y5_Gic2z088ufdpG3XQnVP9x6G3pgak5C1d2Utg0uF4 Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:09:01.871811 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1f8e5cdaf2e749069986ccb0b5a971a1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 4443955683da4a3cb1936b26f8daea67 Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.873067 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a6fe40a2-f8c2-479b-b30c-0749399e80de'} Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:01.873722 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.874782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.878177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Returning 404 to user: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:01.879332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71ae3f75-676f-4ac6-9f3f-121fae795073 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 404 len: 111 microversion: 2.1 time: 0.071203 Oct 27 10:09:01.887037 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 194/385] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:01 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:09:01.891427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:01.902455 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf86454c-6966-4b43-b7d6-781107c61851 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1476 microversion: 2.1 time: 1.012738 Oct 27 10:09:01.903696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:01.906994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:01.917864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:01.918838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:01.919483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:01.920703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:01.921354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:01.922402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:01.923401 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 192/386] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:00 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1476 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:01.946161 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] HTTP exception thrown: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Request method failure captured: Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de HTTP/1.1 Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh9dWBneWs2_8qSZQpjA-3AHsoAlGM7L9amsMkIou0kugFX0fypEpWJhbbWyVzJCCsWRUvzjRvq8IL1z_Dwe9_sMoNAl3fbh9tMNA8sq74lInl_hdYx76sbST162hzOMtT2y5_Gic2z088ufdpG3XQnVP9x6G3pgak5C1d2Utg0uF4 Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:09:01.948205 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1f8e5cdaf2e749069986ccb0b5a971a1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 4443955683da4a3cb1936b26f8daea67 Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.949945 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a6fe40a2-f8c2-479b-b30c-0749399e80de'} Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:01.950671 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:01.952186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:01.956066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Returning 404 to user: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:01.957738 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-109c70bb-d94a-4781-bb09-fc4aa8acf689 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 404 len: 111 microversion: 2.1 time: 0.067733 Oct 27 10:09:01.962762 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 195/387] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:09:01 2022] DELETE /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:09:01.969092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:01.969980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: a6fe40a2-f8c2-479b-b30c-0749399e80de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:01.982213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:01.982707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:01.983224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:01.984010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:01.984463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:01.985565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:02.002832 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] HTTP exception thrown: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Request method failure captured: Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de HTTP/1.1 Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh9dWBneWs2_8qSZQpjA-3AHsoAlGM7L9amsMkIou0kugFX0fypEpWJhbbWyVzJCCsWRUvzjRvq8IL1z_Dwe9_sMoNAl3fbh9tMNA8sq74lInl_hdYx76sbST162hzOMtT2y5_Gic2z088ufdpG3XQnVP9x6G3pgak5C1d2Utg0uF4 Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:09:02.004931 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1f8e5cdaf2e749069986ccb0b5a971a1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 4443955683da4a3cb1936b26f8daea67 Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:02.006312 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'a6fe40a2-f8c2-479b-b30c-0749399e80de'} Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:02.007224 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. Oct 27 10:09:02.009352 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.012351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Returning 404 to user: Instance a6fe40a2-f8c2-479b-b30c-0749399e80de could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:02.014559 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2352667e-a06f-49cf-af63-090462f12da3 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de" status: 404 len: 111 microversion: 2.1 time: 0.050808 Oct 27 10:09:02.024393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:02.025156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:02.030694 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 193/388] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:01 2022] GET /compute/v2.1/servers/a6fe40a2-f8c2-479b-b30c-0749399e80de => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:09:02.034013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:02.034877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:02.035464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:02.036300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:02.036943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:02.037503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:02.055074 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] HTTP exception thrown: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Request method failure captured: Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d HTTP/1.1 Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlh9dWBneWs2_8qSZQpjA-3AHsoAlGM7L9amsMkIou0kugFX0fypEpWJhbbWyVzJCCsWRUvzjRvq8IL1z_Dwe9_sMoNAl3fbh9tMNA8sq74lInl_hdYx76sbST162hzOMtT2y5_Gic2z088ufdpG3XQnVP9x6G3pgak5C1d2Utg0uF4 Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:09:02.056800 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1f8e5cdaf2e749069986ccb0b5a971a1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 4443955683da4a3cb1936b26f8daea67 Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.058202 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '3e77d7f7-01d9-4f67-b567-d759d30cfe3d'} Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:02.059000 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.060363 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.061767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Returning 404 to user: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:02.061767 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e071099-6d56-4696-ab3a-71a3bdd79583 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 404 len: 111 microversion: 2.1 time: 0.038556 Oct 27 10:09:02.069322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:02.070238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] [instance: 3e77d7f7-01d9-4f67-b567-d759d30cfe3d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:02.076422 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 196/389] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:09:02 2022] DELETE /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:09:02.083886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:02.085124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:02.086288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:02.087043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:02.088457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:02.089064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:02.110256 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] HTTP exception thrown: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Request method failure captured: Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d HTTP/1.1 Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlh9dWBneWs2_8qSZQpjA-3AHsoAlGM7L9amsMkIou0kugFX0fypEpWJhbbWyVzJCCsWRUvzjRvq8IL1z_Dwe9_sMoNAl3fbh9tMNA8sq74lInl_hdYx76sbST162hzOMtT2y5_Gic2z088ufdpG3XQnVP9x6G3pgak5C1d2Utg0uF4 Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:09:02.113346 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1f8e5cdaf2e749069986ccb0b5a971a1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1f8e5cdaf2e749069986ccb0b5a971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1f8e5cdaf2e749069986ccb0b5a971a1 Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-567278589 Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 4443955683da4a3cb1936b26f8daea67 Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersAdminTestJSON-567278589-project Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.115642 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '3e77d7f7-01d9-4f67-b567-d759d30cfe3d'} Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:02.116746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. Oct 27 10:09:02.118436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:02.121046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] Returning 404 to user: Instance 3e77d7f7-01d9-4f67-b567-d759d30cfe3d could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:02.122585 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55d3e689-6057-40de-b615-047704a55205 tempest-DeleteServersAdminTestJSON-567278589 tempest-DeleteServersAdminTestJSON-567278589-project] 10.222.0.76 "GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d" status: 404 len: 111 microversion: 2.1 time: 0.059270 Oct 27 10:09:02.131561 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 194/390] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:02 2022] GET /compute/v2.1/servers/3e77d7f7-01d9-4f67-b567-d759d30cfe3d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:09:02.832492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:02.833694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:02.860568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:02.861572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:02.862276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:02.863398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:02.866975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:02.867697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:02.935938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:02.937913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:02.964347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:02.966737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:02.970982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:02.973243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:02.976984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:02.978079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:03.798798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=22 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:03.865622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=28 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:04.000141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:04.011533 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3eb9274b-b2af-4492-915f-fb27cd587627 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1475 microversion: 2.1 time: 1.186672 Oct 27 10:09:04.029861 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 197/391] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:02 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1475 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:04.039204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4cd5f833-b328-4dd7-87c3-3f48ea331886 req-2f94a010-8ac9-4724-b3a0-bc86e70d0b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb77378-15a7-4ccf-ac15-96574a205e0a", "name": "network-vif-unplugged", "status": "completed", "tag": "ba2f9293-c098-436c-8a1a-23b264e8b733"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:04.052926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4cd5f833-b328-4dd7-87c3-3f48ea331886 req-2f94a010-8ac9-4724-b3a0-bc86e70d0b93 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:04.053660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4cd5f833-b328-4dd7-87c3-3f48ea331886 req-2f94a010-8ac9-4724-b3a0-bc86e70d0b93 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:04.055073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4cd5f833-b328-4dd7-87c3-3f48ea331886 req-2f94a010-8ac9-4724-b3a0-bc86e70d0b93 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:04.082928 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4cd5f833-b328-4dd7-87c3-3f48ea331886 req-2f94a010-8ac9-4724-b3a0-bc86e70d0b93 service nova] Creating event network-vif-unplugged:ba2f9293-c098-436c-8a1a-23b264e8b733 for instance 3eb77378-15a7-4ccf-ac15-96574a205e0a on n-h1-854663-10 Oct 27 10:09:04.094697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:04.098638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-4cd5f833-b328-4dd7-87c3-3f48ea331886 req-2f94a010-8ac9-4724-b3a0-bc86e70d0b93 service nova] Instance 3eb77378-15a7-4ccf-ac15-96574a205e0a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:09:04.108545 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d8e82d5-32ea-444f-9fd8-1e2d90f4c0df tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1459 microversion: 2.1 time: 1.176972 Oct 27 10:09:04.109207 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 195/392] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:02 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1459 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:04.115951 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4cd5f833-b328-4dd7-87c3-3f48ea331886 req-2f94a010-8ac9-4724-b3a0-bc86e70d0b93 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084347 Oct 27 10:09:04.117512 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 198/393] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:04.135237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6791bf4-5d6f-4703-b67e-0e1fbceeadf3 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:04.136093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f6791bf4-5d6f-4703-b67e-0e1fbceeadf3 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:04.148341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6791bf4-5d6f-4703-b67e-0e1fbceeadf3 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:04.154124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6791bf4-5d6f-4703-b67e-0e1fbceeadf3 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:04.156965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6791bf4-5d6f-4703-b67e-0e1fbceeadf3 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:04.170110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6791bf4-5d6f-4703-b67e-0e1fbceeadf3 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:04.170868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6791bf4-5d6f-4703-b67e-0e1fbceeadf3 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:04.171458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6791bf4-5d6f-4703-b67e-0e1fbceeadf3 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.036290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:05.037582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:05.050786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.054535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.055148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.057895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.058764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.060490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.196352 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f6791bf4-5d6f-4703-b67e-0e1fbceeadf3 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1612 microversion: 2.1 time: 1.064408 Oct 27 10:09:05.210806 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 196/394] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:04 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1612 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:05.223818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2022e2b9-80a1-401d-b3e1-a7b9fd9da6ad tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:05.246582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2022e2b9-80a1-401d-b3e1-a7b9fd9da6ad tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.247091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2022e2b9-80a1-401d-b3e1-a7b9fd9da6ad tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.252024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2022e2b9-80a1-401d-b3e1-a7b9fd9da6ad tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.255307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2022e2b9-80a1-401d-b3e1-a7b9fd9da6ad tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.255812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2022e2b9-80a1-401d-b3e1-a7b9fd9da6ad tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.256251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2022e2b9-80a1-401d-b3e1-a7b9fd9da6ad tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.324481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:05.425071 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2022e2b9-80a1-401d-b3e1-a7b9fd9da6ad tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.204844 Oct 27 10:09:05.428179 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 197/395] 10.222.0.76 () {58 vars in 1176 bytes} [Thu Oct 27 10:09:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:05.440523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854663-10", "block_migration": true, "disk_over_commit": false}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:05.447401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:05.454985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.455656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.457818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.458683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.459633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.460196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.590567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Lazy-loading 'flavor' on Instance uuid 5871198d-fb20-42e6-85b1-fb99cc8848ad {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:09:05.625897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 5871198d-fb20-42e6-85b1-fb99cc8848ad while it is in vm_state suspended Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Request method failure captured: Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad/action HTTP/1.1 Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 98 Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliP2ttrI66ntL1T0hT_E7Rlh9rN9rQV3O4tryyjnEbNK2iKqEaqpJBo5rK8PsSeHXWuWYEtdougx0JhO60DUQXel_HGLZLHmo9fSD_0fZj7FR26FoPaMk77SPx5bdVpExeQImLMAQnYkUXgGxk20ISSdcIIiSf4g9qBMJWDnqREInU Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 91effd0ede8847519c5354eb43877366 Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-LiveMigrationNegativeTest-44868247 Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:09:05.628386 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/91effd0ede8847519c5354eb43877366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/91effd0ede8847519c5354eb43877366"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_91effd0ede8847519c5354eb43877366", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/91effd0ede8847519c5354eb43877366"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-LiveMigrationNegativeTest-44868247 Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 91effd0ede8847519c5354eb43877366 Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-44868247 Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-LiveMigrationNegativeTest-44868247-project-admin Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 28fa3c14b1d648d7ba27286986d2123a Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-LiveMigrationNegativeTest-44868247-project-admin Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: {"os-migrateLive": {"host": "n-h2-854663-10", "block_migration": true, "disk_over_commit": false}} Oct 27 10:09:05.629723 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot 'os-migrateLive' instance 5871198d-fb20-42e6-85b1-fb99cc8848ad while it is in vm_state suspended Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '5871198d-fb20-42e6-85b1-fb99cc8848ad', 'body': {'os-migrateLive': {'host': 'n-h2-854663-10', 'block_migration': True, 'disk_over_commit': False}}} Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 10:09:05.630460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5871198d-fb20-42e6-85b1-fb99cc8848ad in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:09:05.631506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 5871198d-fb20-42e6-85b1-fb99cc8848ad while it is in vm_state suspended Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 5871198d-fb20-42e6-85b1-fb99cc8848ad while it is in vm_state suspended Oct 27 10:09:05.632841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:05.634896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 5871198d-fb20-42e6-85b1-fb99cc8848ad while it is in vm_state suspended {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:05.635822 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38a03c9b-79c0-4003-bf55-6638d8ac8ca9 tempest-LiveMigrationNegativeTest-44868247 tempest-LiveMigrationNegativeTest-44868247-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad/action" status: 409 len: 155 microversion: 2.1 time: 0.199815 Oct 27 10:09:05.648317 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 198/396] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:09:05 2022] POST /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad/action => generated 155 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:09:05.669829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:05.670346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:05.687984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.690772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.691732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.692477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.694585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.696091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.753465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:05.762465 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39b276b8-4c1c-4b47-89f3-bca1af4f2e64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1475 microversion: 2.1 time: 0.730445 Oct 27 10:09:05.769326 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 199/397] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:05 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1475 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:05.785000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:09:05.936204 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4c20f82-d15a-4c8b-9474-189e133a44fa tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 204 len: 0 microversion: 2.1 time: 0.286384 Oct 27 10:09:05.941077 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 199/398] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:09:05 2022] DELETE /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:09:05.946514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:05.947436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:05.968629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.972291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.973131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.975941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.977236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.980006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:06.172945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b0cbda32-e956-437f-8de2-f1a594b190ce req-c4217005-d3c2-421e-89ce-5291b050c095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb77378-15a7-4ccf-ac15-96574a205e0a", "tag": "ba2f9293-c098-436c-8a1a-23b264e8b733"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:06.196286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b0cbda32-e956-437f-8de2-f1a594b190ce req-c4217005-d3c2-421e-89ce-5291b050c095 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:06.196814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b0cbda32-e956-437f-8de2-f1a594b190ce req-c4217005-d3c2-421e-89ce-5291b050c095 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:06.197384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b0cbda32-e956-437f-8de2-f1a594b190ce req-c4217005-d3c2-421e-89ce-5291b050c095 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:06.224806 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b0cbda32-e956-437f-8de2-f1a594b190ce req-c4217005-d3c2-421e-89ce-5291b050c095 service nova] Creating event network-changed:ba2f9293-c098-436c-8a1a-23b264e8b733 for instance 3eb77378-15a7-4ccf-ac15-96574a205e0a on n-h1-854663-10 Oct 27 10:09:06.260307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-b0cbda32-e956-437f-8de2-f1a594b190ce req-c4217005-d3c2-421e-89ce-5291b050c095 service nova] Instance 3eb77378-15a7-4ccf-ac15-96574a205e0a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:09:06.276598 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b0cbda32-e956-437f-8de2-f1a594b190ce req-c4217005-d3c2-421e-89ce-5291b050c095 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108665 Oct 27 10:09:06.277911 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 200/399] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:09:06.578800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:06.593094 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3de80eb-8f28-4753-9eaf-7e3997a8b702 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1465 microversion: 2.1 time: 0.651141 Oct 27 10:09:06.596439 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 200/400] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:05 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1465 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:06.795714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:06.795714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:06.810228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:06.810717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:06.811362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:06.812231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:06.817883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:06.818675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:07.141093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:07.156608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d2f1cd9d-a855-499c-a81c-2fa0ce725e95 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1475 microversion: 2.1 time: 0.366700 Oct 27 10:09:07.180002 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 201/401] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:06 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1475 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:07.626494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:07.631989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:07.650008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:07.650898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:07.651706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:07.652717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:07.664499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:07.665924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:08.187502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:08.189907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:08.207998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:08.209860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:08.211093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:08.212463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:08.215530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:08.216130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:08.749252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:08.762289 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66213047-0105-4dc2-9e78-98efe52e4460 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1465 microversion: 2.1 time: 1.147365 Oct 27 10:09:08.763254 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 201/402] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:07 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1465 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:09.287222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:09.304890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9305723e-3962-4ae6-8071-aa072f873641 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1475 microversion: 2.1 time: 1.122458 Oct 27 10:09:09.305531 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 202/403] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:08 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1475 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:09.787172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:09.788578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:09.821235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:09.828488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:09.832179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:09.835994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:09.841082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:09.844059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:10.091327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:10.140070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=44 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:10.331928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:10.332721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:10.342356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:10.353406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:10.355621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:10.356574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:10.359034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:10.359699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:10.571974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:10.584795 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddf3dc08-547a-47ca-8de4-cfa099f786ce tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 200 len: 1423 microversion: 2.1 time: 0.801897 Oct 27 10:09:10.585595 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 202/404] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:09 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 1423 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:11.168635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-644142747", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:11.290786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:09:12.470543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:12.480343 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-02dfe8d9-844c-4bd1-a5ac-ba163c356e22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1473 microversion: 2.1 time: 2.153799 Oct 27 10:09:12.484293 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 203/405] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:10 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1473 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:12.640351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5133db74-962d-439a-8785-b9b1d40c0f8e req-5231b49d-5f7c-47de-adb1-871e48463471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5871198d-fb20-42e6-85b1-fb99cc8848ad", "name": "network-vif-deleted", "tag": "ff31c127-f464-4c8e-8118-3cf96e133cbd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:12.654666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5133db74-962d-439a-8785-b9b1d40c0f8e req-5231b49d-5f7c-47de-adb1-871e48463471 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.655330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5133db74-962d-439a-8785-b9b1d40c0f8e req-5231b49d-5f7c-47de-adb1-871e48463471 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.655838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5133db74-962d-439a-8785-b9b1d40c0f8e req-5231b49d-5f7c-47de-adb1-871e48463471 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.679619 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5133db74-962d-439a-8785-b9b1d40c0f8e req-5231b49d-5f7c-47de-adb1-871e48463471 service nova] Creating event network-vif-deleted:ff31c127-f464-4c8e-8118-3cf96e133cbd for instance 5871198d-fb20-42e6-85b1-fb99cc8848ad on n-h1-854663-10 Oct 27 10:09:12.707812 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5133db74-962d-439a-8785-b9b1d40c0f8e req-5231b49d-5f7c-47de-adb1-871e48463471 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200764 Oct 27 10:09:12.724051 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 204/406] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:12.732952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:12.733983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 5871198d-fb20-42e6-85b1-fb99cc8848ad] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:12.742531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.743461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.744080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.744971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.750307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.750991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.769908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:12.770808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:12.771423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:12.772031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:12.772607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:12.788053 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] HTTP exception thrown: Instance 5871198d-fb20-42e6-85b1-fb99cc8848ad could not be found. Oct 27 10:09:12.788824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.789409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.789942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.790776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.791324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Request method failure captured: Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad HTTP/1.1 Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliON6E8wK7SUs6Uxi6VPaEMM_LzhwcDKEIiOYp6pd3AVToD6f4H8Et--yYs9FTrUDA7xblhxBXMVHpWZ-Z1F_ftFHVhs08af99EgZUCWZOlVeSMP5V3PKvpM909HL-aDqWc-BBotVhqwTDBykBWFeI2WVPrfjEsABK-eXbSCXMedN0 Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 12700bbe431149d18786ca6a80f99a10 Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-LiveMigrationNegativeTest-500619019 Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:09:12.791453 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/12700bbe431149d18786ca6a80f99a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/12700bbe431149d18786ca6a80f99a10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_12700bbe431149d18786ca6a80f99a10", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/12700bbe431149d18786ca6a80f99a10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-LiveMigrationNegativeTest-500619019 Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 12700bbe431149d18786ca6a80f99a10 Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-500619019 Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-LiveMigrationNegativeTest-500619019-project Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 086f3e5cbee145128f98a1cbe6133280 Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-LiveMigrationNegativeTest-500619019-project Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 5871198d-fb20-42e6-85b1-fb99cc8848ad could not be found. Oct 27 10:09:12.792903 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '5871198d-fb20-42e6-85b1-fb99cc8848ad'} Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5871198d-fb20-42e6-85b1-fb99cc8848ad could not be found. Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:12.793727 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5871198d-fb20-42e6-85b1-fb99cc8848ad could not be found. Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5871198d-fb20-42e6-85b1-fb99cc8848ad could not be found. Oct 27 10:09:12.795062 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:12.796281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.798434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Returning 404 to user: Instance 5871198d-fb20-42e6-85b1-fb99cc8848ad could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:12.799661 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5fc1581b-7504-41af-8ef2-c589358c9c73 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad" status: 404 len: 111 microversion: 2.1 time: 0.073373 Oct 27 10:09:12.800363 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 205/407] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:12 2022] GET /compute/v2.1/servers/5871198d-fb20-42e6-85b1-fb99cc8848ad => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:09:12.853437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Getting quotas for project 8830099ef30d4bb28259b6763cb4f3b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:12.861532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Getting quotas for user a65debf5e54e4030a0ab162671bd03a5 and project 8830099ef30d4bb28259b6763cb4f3b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:12.886046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:09:12.891430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:09:12.905431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a7150ac-8914-476e-9353-e3223f80e693 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-873722745", "id": 1559491554, "os-flavor-access:is_public": "True"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:12.940973 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a7150ac-8914-476e-9353-e3223f80e693 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.138532 Oct 27 10:09:12.941353 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 206/408] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:12 2022] POST /compute/v2.1/flavors => generated 429 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:12.953754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:12.954262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:12.962424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.962652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.965257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.966020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.966656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.967240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.992081 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41e7011f-9db2-45b0-b0d8-371725a187a7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.403100 Oct 27 10:09:12.996469 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 203/409] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:09:13.001218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02a8181e-efec-4326-b745-8cbd147a8e96 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:13.002653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:09:13.045933 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02a8181e-efec-4326-b745-8cbd147a8e96 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1559491554" status: 202 len: 0 microversion: 2.1 time: 0.048215 Oct 27 10:09:13.046635 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 204/410] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:09:12 2022] DELETE /compute/v2.1/flavors/1559491554 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:13.058234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4acd218d-b47d-4cf7-bb89-1f8bec4db80d tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:13.119491 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4acd218d-b47d-4cf7-bb89-1f8bec4db80d tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065125 Oct 27 10:09:13.127785 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 205/411] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:13.150576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8e59d8f1-6b8c-4460-a397-c3d6d3a540ed tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-939688768", "id": 70118156, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:13.194809 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8e59d8f1-6b8c-4460-a397-c3d6d3a540ed tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.049812 Oct 27 10:09:13.205697 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 206/412] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:13 2022] POST /compute/v2.1/flavors => generated 410 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:13.214700 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-99cb3ecd-2548-46e2-9608-888041be9368 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "DELETE /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 204 len: 0 microversion: 2.1 time: 0.272074 Oct 27 10:09:13.219299 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 207/413] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:09:12 2022] DELETE /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:09:13.225934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:13.227716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:13.230047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f4dcca6-d4e4-41d7-b379-e5f3703bf9f0 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:13.240736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:13.252460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:13.253326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:13.258324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:13.259665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:13.260335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:13.269695 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f4dcca6-d4e4-41d7-b379-e5f3703bf9f0 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.062462 Oct 27 10:09:13.309927 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 207/414] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:13 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:13.344032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1753502558", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:13.435360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:09:14.201173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:14.225060 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7352f55-9d98-4156-8670-372e11fa1496 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1474 microversion: 2.1 time: 1.003859 Oct 27 10:09:14.228374 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 208/415] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:13 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1474 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:14.245160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d3ca9d1-f2b9-4a5a-b9c7-cd3afab75519 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:14.304128 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d3ca9d1-f2b9-4a5a-b9c7-cd3afab75519 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/70118156" status: 202 len: 0 microversion: 2.1 time: 0.068933 Oct 27 10:09:14.305063 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 209/416] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:09:14 2022] DELETE /compute/v2.1/flavors/70118156 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:14.339476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:14.340377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:14.362487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:14.364307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:14.368769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:14.369733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:14.376170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:14.376935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:14.826012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:14.827199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:14.827827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:14.829952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:14.830534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:14.853496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:14.854427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:14.855108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:14.856084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:14.857067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:14.857687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:14.909518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Getting quotas for project 8830099ef30d4bb28259b6763cb4f3b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:14.922865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Getting quotas for user a65debf5e54e4030a0ab162671bd03a5 and project 8830099ef30d4bb28259b6763cb4f3b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:14.952813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:09:14.958107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:14.969898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:14.978117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:09:15.007452 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8356c4e-bd2a-432a-8a0d-e5e2ddc428cc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1470 microversion: 2.1 time: 0.674718 Oct 27 10:09:15.015327 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 210/417] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:14 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1470 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:15.028900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-812d7430-37c3-41c3-bbed-41650ee22ec1 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:15.120905 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-812d7430-37c3-41c3-bbed-41650ee22ec1 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.103881 Oct 27 10:09:15.122328 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 211/418] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:15.158738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a66c0383-afb6-4c57-b5fb-84e62f6388d8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:15.161972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a66c0383-afb6-4c57-b5fb-84e62f6388d8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:15.209060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a66c0383-afb6-4c57-b5fb-84e62f6388d8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.209888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a66c0383-afb6-4c57-b5fb-84e62f6388d8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.212998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a66c0383-afb6-4c57-b5fb-84e62f6388d8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:15.215635 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f991aebd-8d36-443c-be5f-ded159945655 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.896943 Oct 27 10:09:15.218674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a66c0383-afb6-4c57-b5fb-84e62f6388d8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.219178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a66c0383-afb6-4c57-b5fb-84e62f6388d8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.219612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a66c0383-afb6-4c57-b5fb-84e62f6388d8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:15.229669 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 208/419] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:09:15.260407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63dba1d1-fed6-47e3-b0f9-ae8d1d9f67e3 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1755318960", "id": 1015758011, "os-flavor-access:is_public": "True"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:15.310161 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63dba1d1-fed6-47e3-b0f9-ae8d1d9f67e3 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.074822 Oct 27 10:09:15.316339 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 209/420] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:15 2022] POST /compute/v2.1/flavors => generated 429 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:15.322590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a557f98-1eee-4558-94fd-61108c3ec276 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:15.331567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a557f98-1eee-4558-94fd-61108c3ec276 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:15.351670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:15.569841 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a66c0383-afb6-4c57-b5fb-84e62f6388d8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a/action" status: 204 len: 0 microversion: 2.1 time: 0.441272 Oct 27 10:09:15.574561 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 212/421] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:09:15 2022] POST /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a/action => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:09:15.603538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:15.621353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:15.648044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.655015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.656482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:15.659243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.659840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.665203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:16.127249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a557f98-1eee-4558-94fd-61108c3ec276 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:16.135875 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a557f98-1eee-4558-94fd-61108c3ec276 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1214 microversion: 2.1 time: 0.818114 Oct 27 10:09:16.140335 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 210/422] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:15 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1214 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:16.156516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0888a771-97b7-4ad1-819b-bebdb7862c02 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:16.197131 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0888a771-97b7-4ad1-819b-bebdb7862c02 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1015758011" status: 202 len: 0 microversion: 2.1 time: 0.055349 Oct 27 10:09:16.197725 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 211/423] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:09:16 2022] DELETE /compute/v2.1/flavors/1015758011 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:16.216105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:16.216957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:16.237441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:16.237941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:16.238384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:16.239096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:16.242432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:16.242935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:16.537141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:16.550484 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5a2ee535-8244-4be0-b23e-fa649832958a tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1432 microversion: 2.1 time: 0.971516 Oct 27 10:09:16.551388 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 213/424] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:15 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1432 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:16.568623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-617bec39-73c4-4208-be38-309d82cf28f1 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:16.635400 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-617bec39-73c4-4208-be38-309d82cf28f1 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082493 Oct 27 10:09:16.656625 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 214/425] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:16.669161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-acff985c-3815-4ee9-bd25-d5c5824f85c1 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-538320862", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:16.718940 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-acff985c-3815-4ee9-bd25-d5c5824f85c1 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.056556 Oct 27 10:09:16.720106 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 215/426] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:16 2022] POST /compute/v2.1/flavors => generated 506 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:16.734572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-32cbcbe7-cd8a-44e1-86dc-2c7b589a342f tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:16.775541 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-32cbcbe7-cd8a-44e1-86dc-2c7b589a342f tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/d462f9f4-dba6-4d31-a955-462d95691d2c" status: 202 len: 0 microversion: 2.1 time: 0.045444 Oct 27 10:09:16.777117 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 216/427] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:09:16 2022] DELETE /compute/v2.1/flavors/d462f9f4-dba6-4d31-a955-462d95691d2c => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:16.785328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc1bb02e-3088-4413-925a-6345f007afbf tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:16.854626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc1bb02e-3088-4413-925a-6345f007afbf tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072920 Oct 27 10:09:16.869243 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 217/428] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:16.895620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4910383-6a4e-4778-83ad-ae37b0ef6767 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1884846789", "id": "096e9201-a0ed-4968-9dfa-24e5fe0823dc", "os-flavor-access:is_public": "True"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:16.943097 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4910383-6a4e-4778-83ad-ae37b0ef6767 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.055083 Oct 27 10:09:16.943769 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 218/429] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:16 2022] POST /compute/v2.1/flavors => generated 507 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:16.959510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b89454e-9aa2-457f-b4f5-7a5fd4af58a4 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:17.015864 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b89454e-9aa2-457f-b4f5-7a5fd4af58a4 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/096e9201-a0ed-4968-9dfa-24e5fe0823dc" status: 202 len: 0 microversion: 2.1 time: 0.062250 Oct 27 10:09:17.016652 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 219/430] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:09:16 2022] DELETE /compute/v2.1/flavors/096e9201-a0ed-4968-9dfa-24e5fe0823dc => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:17.051994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4fa8876-99f7-4b79-8551-a454337c37e0 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:17.113248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:17.115213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4fa8876-99f7-4b79-8551-a454337c37e0 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087271 Oct 27 10:09:17.119231 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 220/431] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:17.136404 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ea86091-1c35-492b-97b0-4c7e18f0b23e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1470 microversion: 2.1 time: 0.934103 Oct 27 10:09:17.137245 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 212/432] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:16 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1470 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:17.143211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-674a9593-1c1e-43bf-8207-6dadabee0752 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1349749898", "id": 1645753436, "os-flavor-access:is_public": "True"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:17.168066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:17.178103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:17.199185 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-674a9593-1c1e-43bf-8207-6dadabee0752 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.059577 Oct 27 10:09:17.206823 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 221/433] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:17 2022] POST /compute/v2.1/flavors => generated 414 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:09:17.207095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:17.207590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:17.208152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:17.209120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:17.210051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:17.210618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:17.223706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ca71e19-27c1-4547-8319-31387ac8320f tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:17.283511 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ca71e19-27c1-4547-8319-31387ac8320f tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/1645753436" status: 200 len: 414 microversion: 2.1 time: 0.075359 Oct 27 10:09:17.286023 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 222/434] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:09:17 2022] GET /compute/v2.1/flavors/1645753436 => generated 414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:17.700532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25015418-7139-4cdd-b166-f4b8a44811ef tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:17.800473 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25015418-7139-4cdd-b166-f4b8a44811ef tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.507195 Oct 27 10:09:17.839406 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 223/435] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:17 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:17.867189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e6af022c-811b-41ee-9437-42feddadffd8 req-5b5be1d7-7175-47dd-84ec-89541ca22af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05477c33-3427-45c5-88ce-1f0dcfc68874", "name": "network-vif-deleted", "tag": "1668331e-2153-46cb-8660-beb90803f0a6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:17.900576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e6af022c-811b-41ee-9437-42feddadffd8 req-5b5be1d7-7175-47dd-84ec-89541ca22af0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:17.905457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e6af022c-811b-41ee-9437-42feddadffd8 req-5b5be1d7-7175-47dd-84ec-89541ca22af0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:17.906439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e6af022c-811b-41ee-9437-42feddadffd8 req-5b5be1d7-7175-47dd-84ec-89541ca22af0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:17.950009 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e6af022c-811b-41ee-9437-42feddadffd8 req-5b5be1d7-7175-47dd-84ec-89541ca22af0 service nova] Creating event network-vif-deleted:1668331e-2153-46cb-8660-beb90803f0a6 for instance 05477c33-3427-45c5-88ce-1f0dcfc68874 on n-h1-854663-10 Oct 27 10:09:17.963097 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e6af022c-811b-41ee-9437-42feddadffd8 req-5b5be1d7-7175-47dd-84ec-89541ca22af0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108516 Oct 27 10:09:17.964018 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 224/436] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:17.972008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:17.984408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:17.985161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:17.999306 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d0237cd0-dc87-4704-99a9-7d7707301b5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1266 microversion: 2.1 time: 0.839315 Oct 27 10:09:18.008533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:18.017915 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 213/437] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:17 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1266 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:18.018356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:18.018824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:18.019611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:18.025968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bda14482-4e18-496c-ad84-5628593ab1a9 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:18.029349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:18.029817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:18.075055 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bda14482-4e18-496c-ad84-5628593ab1a9 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1645753436" status: 202 len: 0 microversion: 2.1 time: 0.053127 Oct 27 10:09:18.077198 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 214/438] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:09:18 2022] DELETE /compute/v2.1/flavors/1645753436 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:18.086543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-059837f1-98d1-42ba-b791-0450c57dc11d tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:18.151618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:18.157680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:18.169136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:18.169710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lazy-loading 'fault' on Instance uuid 05477c33-3427-45c5-88ce-1f0dcfc68874 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:09:18.184393 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-059837f1-98d1-42ba-b791-0450c57dc11d tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.094035 Oct 27 10:09:18.187328 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 215/439] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:18.203084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:18.203992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:18.237142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:18.239029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:18.241631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:18.242908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:18.244694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:18.250219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:18.730329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086f3e5cbee145128f98a1cbe6133280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12700bbe431149d18786ca6a80f99a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:18.738718 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5e7618d-3426-4297-96a0-0ec1434d2fd2 tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 200 len: 1308 microversion: 2.1 time: 0.769379 Oct 27 10:09:18.759708 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 225/440] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:17 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 1308 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:18.768959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da68295c-7f33-4b5f-a803-d04a46b16d90 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1337805704", "id": 1191887625, "os-flavor-access:is_public": "False"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:18.817575 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da68295c-7f33-4b5f-a803-d04a46b16d90 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.071015 Oct 27 10:09:18.824835 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 226/441] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:18 2022] POST /compute/v2.1/flavors => generated 430 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:18.837762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfbf1802-3a0e-4dd6-8357-cd26bf366476 tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "1191887625"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:18.859112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:18.895008 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-dfbf1802-3a0e-4dd6-8357-cd26bf366476 tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] HTTP exception thrown: Flavor 1191887625 could not be found. Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfbf1802-3a0e-4dd6-8357-cd26bf366476 tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] Request method failure captured: Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 107 Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWljGK6M3sMlMmdyNHQAMkstGP7s2MJ-hUQznyT2fifkGH0f6Rs5DCSR6JC6pVeVeR9pERoJCD-2E0oSVD8Gx13AQxzhFDPNtYsbwMSw66T2PErmal7xQx_KkPAGeUlTq5QaZZsF5p8GaVcFTedfNudzjmY_8QZ3kZPGHpSL1RTh8et0 Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2f514a1fc3434f4f9ecd3c9b063e26b6 Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FlavorsAdminTestJSON-1485141080 Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:09:18.898918 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2f514a1fc3434f4f9ecd3c9b063e26b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2f514a1fc3434f4f9ecd3c9b063e26b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2f514a1fc3434f4f9ecd3c9b063e26b6", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2f514a1fc3434f4f9ecd3c9b063e26b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FlavorsAdminTestJSON-1485141080 Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2f514a1fc3434f4f9ecd3c9b063e26b6 Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1485141080 Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FlavorsAdminTestJSON-1485141080-project Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: c20f782c00f14d1dbb69ea0559a711fe Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FlavorsAdminTestJSON-1485141080-project Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "test", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "1191887625"}} Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:09:18.900225 n-d-854663-10 devstack@n-api.service[120719]: exception: Flavor 1191887625 could not be found. Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '1191887625'}}} Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1191887625 could not be found. Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:18.901052 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1191887625 could not be found. Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:18.902242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:18.903519 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:18.903519 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:18.903519 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:18.903519 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1191887625 could not be found. Oct 27 10:09:18.903519 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:18.908542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfbf1802-3a0e-4dd6-8357-cd26bf366476 tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] Returning 400 to user: Flavor 1191887625 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:18.909835 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dfbf1802-3a0e-4dd6-8357-cd26bf366476 tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.076608 Oct 27 10:09:18.916046 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 227/442] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:18 2022] POST /compute/v2.1/servers => generated 81 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:09:18.938627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12ff3f7d-79bb-44d1-a404-4f6d7a338a69 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:18.980020 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12ff3f7d-79bb-44d1-a404-4f6d7a338a69 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1191887625" status: 202 len: 0 microversion: 2.1 time: 0.062266 Oct 27 10:09:18.981414 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 228/443] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:09:18 2022] DELETE /compute/v2.1/flavors/1191887625 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:18.989512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8bb59e64-8fde-4f8d-b02f-30c501122a46 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.044891 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8bb59e64-8fde-4f8d-b02f-30c501122a46 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059216 Oct 27 10:09:19.052145 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 229/444] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:19.062351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.063342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:19.090884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:19.091546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:19.092103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:19.092983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:19.093705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:19.094233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:19.326215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:19.335492 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-44d8019d-1396-4370-a6b2-a6f43d12ee2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1272 microversion: 2.1 time: 0.281682 Oct 27 10:09:19.339122 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 230/445] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:19.350516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2653da2-5145-4e0d-9e80-8570d69f130b tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-118804409", "id": 533778882, "os-flavor-access:is_public": "False"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:19.435157 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b2653da2-5145-4e0d-9e80-8570d69f130b tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.085482 Oct 27 10:09:19.444115 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 231/446] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:19 2022] POST /compute/v2.1/flavors => generated 411 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:19.449266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccc30077-5db0-4b95-930a-e4a0bad1a9e2 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1400536290", "id": 1350382385, "os-flavor-access:is_public": "True"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:19.492151 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ccc30077-5db0-4b95-930a-e4a0bad1a9e2 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.046543 Oct 27 10:09:19.494697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 232/447] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:19 2022] POST /compute/v2.1/flavors => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:19.509963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b87126b-5345-4b33-a9cf-fb44c241c623 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.553792 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b87126b-5345-4b33-a9cf-fb44c241c623 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.049503 Oct 27 10:09:19.557915 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 233/448] 10.222.0.76 () {58 vars in 1169 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:19.565931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:19.579366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8f11b19-761f-414f-9dd1-653764619919 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.590371 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d87aab77-c54e-4231-b592-746e0d2f8913 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1470 microversion: 2.1 time: 1.392789 Oct 27 10:09:19.591152 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 216/449] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:18 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1470 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:19.613432 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8f11b19-761f-414f-9dd1-653764619919 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.044675 Oct 27 10:09:19.614540 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 234/450] 10.222.0.76 () {58 vars in 1177 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:19.629490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f9e5667-f580-4781-b2ca-04fe494d05be tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.673161 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f9e5667-f580-4781-b2ca-04fe494d05be tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.047453 Oct 27 10:09:19.673934 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 217/451] 10.222.0.76 () {58 vars in 1171 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:19.687219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78ed8ec7-1907-4b0d-9e7d-6d5850946c33 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.721573 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78ed8ec7-1907-4b0d-9e7d-6d5850946c33 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.038105 Oct 27 10:09:19.722644 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 235/452] 10.222.0.76 () {58 vars in 1169 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:19.739679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6a511ff-4226-475d-ad3e-bdc6438550d2 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.753569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:19.769329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.770876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] [instance: 05477c33-3427-45c5-88ce-1f0dcfc68874] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:19.782842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:19.800854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:19.801862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:19.805873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:19.810423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:19.813855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:19.821471 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6a511ff-4226-475d-ad3e-bdc6438550d2 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.085781 Oct 27 10:09:19.824244 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 218/453] 10.222.0.76 () {58 vars in 1169 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:19.837204 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] HTTP exception thrown: Instance 05477c33-3427-45c5-88ce-1f0dcfc68874 could not be found. Oct 27 10:09:19.847250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94350ec6-b9da-45a9-bbfd-4daa9965cb01 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Request method failure captured: Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 HTTP/1.1 Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliON6E8wK7SUs6Uxi6VPaEMM_LzhwcDKEIiOYp6pd3AVToD6f4H8Et--yYs9FTrUDA7xblhxBXMVHpWZ-Z1F_ftFHVhs08af99EgZUCWZOlVeSMP5V3PKvpM909HL-aDqWc-BBotVhqwTDBykBWFeI2WVPrfjEsABK-eXbSCXMedN0 Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 12700bbe431149d18786ca6a80f99a10 Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-LiveMigrationNegativeTest-500619019 Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:09:19.857168 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/12700bbe431149d18786ca6a80f99a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/12700bbe431149d18786ca6a80f99a10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_12700bbe431149d18786ca6a80f99a10", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/12700bbe431149d18786ca6a80f99a10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-LiveMigrationNegativeTest-500619019 Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 12700bbe431149d18786ca6a80f99a10 Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-500619019 Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-LiveMigrationNegativeTest-500619019-project Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 086f3e5cbee145128f98a1cbe6133280 Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-LiveMigrationNegativeTest-500619019-project Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 05477c33-3427-45c5-88ce-1f0dcfc68874 could not be found. Oct 27 10:09:19.858466 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '05477c33-3427-45c5-88ce-1f0dcfc68874'} Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05477c33-3427-45c5-88ce-1f0dcfc68874 could not be found. Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:19.859147 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05477c33-3427-45c5-88ce-1f0dcfc68874 could not be found. Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05477c33-3427-45c5-88ce-1f0dcfc68874 could not be found. Oct 27 10:09:19.860216 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:09:19.864715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] Returning 404 to user: Instance 05477c33-3427-45c5-88ce-1f0dcfc68874 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:19.870009 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5622a607-e504-46fe-8472-2aa4354e829f tempest-LiveMigrationNegativeTest-500619019 tempest-LiveMigrationNegativeTest-500619019-project] 10.222.0.76 "GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874" status: 404 len: 111 microversion: 2.1 time: 0.104735 Oct 27 10:09:19.870894 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 236/454] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/servers/05477c33-3427-45c5-88ce-1f0dcfc68874 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:09:19.900471 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94350ec6-b9da-45a9-bbfd-4daa9965cb01 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.058239 Oct 27 10:09:19.901806 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 219/455] 10.222.0.76 () {58 vars in 1175 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:19.926205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5d1e193f-cff9-4824-a6b2-14c82310028e tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.974507 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5d1e193f-cff9-4824-a6b2-14c82310028e tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.051964 Oct 27 10:09:19.978964 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 237/456] 10.222.0.76 () {58 vars in 1173 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:19.998664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-524fd480-551c-4004-b2a3-de714b7a057a tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:20.041744 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-524fd480-551c-4004-b2a3-de714b7a057a tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.047294 Oct 27 10:09:20.047852 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 220/457] 10.222.0.76 () {58 vars in 1169 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:20.073622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1903e1b4-b4e6-401b-8786-bb24f762cb39 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:20.117277 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1903e1b4-b4e6-401b-8786-bb24f762cb39 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1350382385" status: 202 len: 0 microversion: 2.1 time: 0.048315 Oct 27 10:09:20.118431 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 238/458] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:09:20 2022] DELETE /compute/v2.1/flavors/1350382385 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:20.126451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f731b450-7019-4786-afdc-98c3c9f5c2cf tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:20.161267 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f731b450-7019-4786-afdc-98c3c9f5c2cf tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038308 Oct 27 10:09:20.170436 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 221/459] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:20.196557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c299ea5-c4a3-4cc9-9c41-624fd5d2ffbc tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:20.241048 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c299ea5-c4a3-4cc9-9c41-624fd5d2ffbc tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/533778882" status: 202 len: 0 microversion: 2.1 time: 0.050376 Oct 27 10:09:20.242359 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 239/460] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:09:20 2022] DELETE /compute/v2.1/flavors/533778882 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:20.250167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2002b99d-7504-4b25-a285-dd17a827e668 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:20.319624 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2002b99d-7504-4b25-a285-dd17a827e668 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072292 Oct 27 10:09:20.320831 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 222/461] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:20.344173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73b210f2-c155-4785-969d-e3b3f0d9a523 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-334919072", "id": 1814367823, "os-flavor-access:is_public": "False"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:20.362765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:20.363797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:20.374290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:20.376606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:20.383469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:20.386613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:20.387410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:20.389270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:20.407643 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73b210f2-c155-4785-969d-e3b3f0d9a523 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.068480 Oct 27 10:09:20.419053 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 240/462] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:20 2022] POST /compute/v2.1/flavors => generated 414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:20.931005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-662389172", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "50cb7bc6-6235-4029-9fd6-9407e53e51ed"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:21.076860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] validate_networks() for [('50cb7bc6-6235-4029-9fd6-9407e53e51ed', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:09:21.372183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:21.383476 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ba3d415-548f-4360-8d13-df2b26d34711 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1272 microversion: 2.1 time: 1.024504 Oct 27 10:09:21.385952 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 223/463] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:20 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1272 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:21.394750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1bb78253-72fa-41af-a8f8-b5ca45181a30 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:21.467673 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1bb78253-72fa-41af-a8f8-b5ca45181a30 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080390 Oct 27 10:09:21.472840 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 224/464] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:21.483490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:21.487799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:21.501880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:21.502377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:21.502993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:21.503996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:21.506119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:21.509223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:22.443124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:22.452255 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb1cdf74-2ef7-491a-bea6-03c05b0afcef tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1462 microversion: 2.1 time: 0.977844 Oct 27 10:09:22.455811 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 225/465] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:21 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1462 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:22.464195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c11fb32a-df56-4f28-a9ef-3bd0e6fd0868 tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:22.517318 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c11fb32a-df56-4f28-a9ef-3bd0e6fd0868 tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046342 Oct 27 10:09:22.518534 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 226/466] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:22.524009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:22.533176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:22.552329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:22.553072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:22.553748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:22.554513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:22.554975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:22.555413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:22.909328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:22.920081 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-27fd3f54-116d-46ec-bca5-ffac08306db9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1272 microversion: 2.1 time: 0.400285 Oct 27 10:09:22.938282 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 227/467] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:22 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1272 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:22.950117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac66ad2c-cb8f-4ab2-a031-ee503dc3e2d4 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:22.954116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac66ad2c-cb8f-4ab2-a031-ee503dc3e2d4 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:22.965145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac66ad2c-cb8f-4ab2-a031-ee503dc3e2d4 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:22.968288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac66ad2c-cb8f-4ab2-a031-ee503dc3e2d4 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:22.968976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac66ad2c-cb8f-4ab2-a031-ee503dc3e2d4 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:22.969948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac66ad2c-cb8f-4ab2-a031-ee503dc3e2d4 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:22.972373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac66ad2c-cb8f-4ab2-a031-ee503dc3e2d4 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:22.973424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac66ad2c-cb8f-4ab2-a031-ee503dc3e2d4 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:23.883558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:23.885570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:23.886855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:23.887485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:23.888059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:23.914033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:23.914798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:23.916920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:23.919474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:23.920583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:23.926196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:23.982305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for project 8e2d013afa6544b3972160d82f111127. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:23.986859 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac66ad2c-cb8f-4ab2-a031-ee503dc3e2d4 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1615 microversion: 2.1 time: 1.047146 Oct 27 10:09:24.002241 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 228/468] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:22 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1615 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:24.004148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for user dd2f7b7849014a6bae41317a3e68426e and project 8e2d013afa6544b3972160d82f111127. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:24.032108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:09:24.039205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:09:24.039446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8da90936-ec04-4e16-b425-6148f2858a85 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:24.088093 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8da90936-ec04-4e16-b425-6148f2858a85 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1814367823" status: 202 len: 0 microversion: 2.1 time: 0.076218 Oct 27 10:09:24.089600 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 229/469] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:09:24 2022] DELETE /compute/v2.1/flavors/1814367823 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:24.116595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:24.140077 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff8951a2-bbe9-4301-ab33-9a80b87feb16 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.719481 Oct 27 10:09:24.141640 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 241/470] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3722 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:09:24.143193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:24.149221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-06210670-0327-47b4-aaf3-48f756b975d2 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '.version_select at 0x7f6d5ba9c790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:24.155232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06210670-0327-47b4-aaf3-48f756b975d2 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:24.156042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06210670-0327-47b4-aaf3-48f756b975d2 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:24.156475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06210670-0327-47b4-aaf3-48f756b975d2 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:24.160327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:24.161098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:24.162370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:24.164034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:24.165552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:24.166413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:24.197869 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-06210670-0327-47b4-aaf3-48f756b975d2 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.054226 Oct 27 10:09:24.208722 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 242/471] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:09:24 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:24.236400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15adfad9-a74c-4b08-914b-c63905d8174c tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:24.307668 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15adfad9-a74c-4b08-914b-c63905d8174c tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.106810 Oct 27 10:09:24.322033 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 243/472] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:24.322033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-159e2181-d7ae-4085-ac22-7f0707105ff7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:24.322033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-159e2181-d7ae-4085-ac22-7f0707105ff7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:24.620356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:24.631439 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b76026db-64b7-4a74-890c-10eef51c3d4b tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1272 microversion: 2.1 time: 0.538226 Oct 27 10:09:24.632067 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 230/473] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:24 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1272 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:24.663104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7372a8e2-3259-4ab4-86d5-195e0ac59322 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1453149475", "id": 349837686, "os-flavor-access:is_public": "True"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:24.708928 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7372a8e2-3259-4ab4-86d5-195e0ac59322 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.057639 Oct 27 10:09:24.711851 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 231/474] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:24 2022] POST /compute/v2.1/flavors => generated 411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:24.723682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1563573540", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:24.845565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:09:24.886137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:24.930427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-159e2181-d7ae-4085-ac22-7f0707105ff7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:24.949212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-159e2181-d7ae-4085-ac22-7f0707105ff7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:24.954768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-159e2181-d7ae-4085-ac22-7f0707105ff7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:24.958231 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-159e2181-d7ae-4085-ac22-7f0707105ff7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1261 microversion: 2.25 time: 0.645860 Oct 27 10:09:24.961733 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 244/475] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:24 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1261 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:24.978382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6a319cf-11e9-48de-beca-6fb47b5af4cc tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:25.091265 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6a319cf-11e9-48de-beca-6fb47b5af4cc tempest-FlavorsAdminTestJSON-1485141080 tempest-FlavorsAdminTestJSON-1485141080-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.115347 Oct 27 10:09:25.097789 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 245/476] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:24 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:25.120729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec133f7c-c059-4e84-b833-9b261a44f733 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:25.166741 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec133f7c-c059-4e84-b833-9b261a44f733 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/349837686" status: 202 len: 0 microversion: 2.1 time: 0.049820 Oct 27 10:09:25.168288 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 246/477] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:09:25 2022] DELETE /compute/v2.1/flavors/349837686 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:25.176233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3718ccd-5e0c-4a19-88bc-fb47a61ac122 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:25.220809 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3718ccd-5e0c-4a19-88bc-fb47a61ac122 tempest-FlavorsAdminTestJSON-974827674 tempest-FlavorsAdminTestJSON-974827674-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048285 Oct 27 10:09:25.236600 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 247/478] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:25.656691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:25.657460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:25.678226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:25.678912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:25.679662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:25.680527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:25.681149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:25.681715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:26.136180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:26.204853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:26.215164 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-48e9c161-8fd6-48a9-9800-f421ee8e324d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1272 microversion: 2.1 time: 0.563246 Oct 27 10:09:26.215749 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 248/479] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:25 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1272 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:26.233798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:26.235852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:26.266928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:26.266928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:26.266928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:26.267544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:26.267999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:26.268417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:26.701073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:26.713842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:26.715855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:26.721732 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5c12e52-8a7b-40f9-8ff5-777592b9b8da tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1313 microversion: 2.25 time: 0.504919 Oct 27 10:09:26.748485 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 249/480] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:26 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:26.824238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:26.824674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:26.825169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:26.825726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:26.826132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:26.852040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:26.852601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:26.855432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:26.856608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:26.858815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:26.861912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:26.936110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for project 895a8ef842a242469ffa508e1cf9f378. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:26.954279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for user ae3b45c026064d6c946f50a4d9d32c2f and project 895a8ef842a242469ffa508e1cf9f378. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:26.991765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:09:27.006743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:09:27.164197 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5b3c169-feaa-4954-b7eb-8b2ed3576935 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.449252 Oct 27 10:09:27.171791 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 232/481] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:09:27.179998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f31b503-46a4-439d-8138-42e79ca58ac0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:27.180495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f31b503-46a4-439d-8138-42e79ca58ac0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:27.444484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f31b503-46a4-439d-8138-42e79ca58ac0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:27.454624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-221643315", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "f584544f-ec56-4541-905d-7537ec4732b5"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:27.478023 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f31b503-46a4-439d-8138-42e79ca58ac0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1213 microversion: 2.1 time: 0.301992 Oct 27 10:09:27.480097 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 233/482] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:27 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1213 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:27.484689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:27.511455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:27.528883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:27.529376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:27.544042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:27.545091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:27.548161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:27.550084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:27.599683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] validate_networks() for [('f584544f-ec56-4541-905d-7537ec4732b5', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:09:27.646130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:29.002528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:29.018830 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-49479520-bed8-48de-b9d2-dbfd3bb1f36d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1314 microversion: 2.1 time: 1.534268 Oct 27 10:09:29.026808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 234/483] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:27 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1314 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:29.045836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:29.046455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:29.059533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:29.060029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:29.060461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:29.063137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:29.070369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:29.074551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:29.505749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:29.515174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:29.516763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:29.535421 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94bcb960-7a92-439b-a85b-65527f71283c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1319 microversion: 2.25 time: 0.507386 Oct 27 10:09:29.542750 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 235/484] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:29 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:29.917091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-142ab1da-26dd-4153-9d14-71c2769b6b07 tempest-QuotaClassesAdmin257Test-728947319 tempest-QuotaClassesAdmin257Test-728947319-project-admin] Calling method '.version_select at 0x7f6d5bcf5670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:29.940296 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-142ab1da-26dd-4153-9d14-71c2769b6b07 tempest-QuotaClassesAdmin257Test-728947319 tempest-QuotaClassesAdmin257Test-728947319-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.395973 Oct 27 10:09:29.941653 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 236/485] 10.222.0.76 () {60 vars in 1226 bytes} [Thu Oct 27 10:09:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:09:29.948794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:29.952533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:29.959986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:29.960509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:29.960895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:29.961302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:29.961707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:29.968308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:29.971094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:29.971927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:29.973625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:29.978670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:29.978947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:29.979156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:29.979879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:29.983395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:29.988746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:29.990078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:29.990682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:30.038763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:30.052975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for user 5db106c72e8745de8266a3ab7a5fe531 and project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:30.075814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:09:30.083365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:09:30.120962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=12,nova_api:INSERT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:30.217963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:30.227736 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-483e3dcf-ae8b-46b0-845b-6646581f0d31 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.464139 Oct 27 10:09:30.228486 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 250/486] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:09:30.246026 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d2a8ae61-f745-4779-9150-c328cda876cd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1271 microversion: 2.1 time: 0.301885 Oct 27 10:09:30.251210 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 237/487] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:29 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1271 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:30.264175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7af1d78-1a06-466b-83de-926e488f0ac3 tempest-QuotaClassesAdmin257Test-728947319 tempest-QuotaClassesAdmin257Test-728947319-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5ba4cee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:30.268498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:30.275266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:30.300141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:30.301842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:30.304306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:30.305349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:30.306105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:30.307490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:30.708486 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7af1d78-1a06-466b-83de-926e488f0ac3 tempest-QuotaClassesAdmin257Test-728947319 tempest-QuotaClassesAdmin257Test-728947319-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.464786 Oct 27 10:09:30.717688 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 251/488] 10.222.0.76 () {62 vars in 1247 bytes} [Thu Oct 27 10:09:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:09:30.734647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3a32282c-4c09-4194-b101-f3301ab06965 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:30.738091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3a32282c-4c09-4194-b101-f3301ab06965 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:31.174766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:31.186600 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ed91a22-8c5b-4a64-a5d8-ad596a586285 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1314 microversion: 2.1 time: 0.932793 Oct 27 10:09:31.189986 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 238/489] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:30 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1314 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:31.196537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d017f228-8ade-4da2-8896-737e48e1aa8a req-de4447ac-b637-447c-9fc7-774031f770cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03eeed8-34c3-4fcb-b086-570b834451c3", "tag": "8a6e6cca-c72b-46eb-8788-607169424408"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:31.210840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d017f228-8ade-4da2-8896-737e48e1aa8a req-de4447ac-b637-447c-9fc7-774031f770cc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:31.211546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d017f228-8ade-4da2-8896-737e48e1aa8a req-de4447ac-b637-447c-9fc7-774031f770cc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:31.212189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d017f228-8ade-4da2-8896-737e48e1aa8a req-de4447ac-b637-447c-9fc7-774031f770cc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:31.280970 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d017f228-8ade-4da2-8896-737e48e1aa8a req-de4447ac-b637-447c-9fc7-774031f770cc service nova] Creating event network-changed:8a6e6cca-c72b-46eb-8788-607169424408 for instance c03eeed8-34c3-4fcb-b086-570b834451c3 on n-h1-854663-10 Oct 27 10:09:31.348040 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d017f228-8ade-4da2-8896-737e48e1aa8a req-de4447ac-b637-447c-9fc7-774031f770cc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155226 Oct 27 10:09:31.352961 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 239/490] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:31.390760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:31.393493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:31.409900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:31.410403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:31.410847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:31.413029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:31.414400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:31.414848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:31.518513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3a32282c-4c09-4194-b101-f3301ab06965 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:31.529610 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3a32282c-4c09-4194-b101-f3301ab06965 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1210 microversion: 2.1 time: 0.808076 Oct 27 10:09:31.530745 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 252/491] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:30 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1210 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:31.548950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55c9cae6-ed72-41e3-98e8-d985ac7073ad tempest-QuotaClassesAdmin257Test-728947319 tempest-QuotaClassesAdmin257Test-728947319-project-admin] Calling method '.version_select at 0x7f6d5bb84430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:31.589805 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55c9cae6-ed72-41e3-98e8-d985ac7073ad tempest-QuotaClassesAdmin257Test-728947319 tempest-QuotaClassesAdmin257Test-728947319-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.052857 Oct 27 10:09:31.591931 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 253/492] 10.222.0.76 () {60 vars in 1226 bytes} [Thu Oct 27 10:09:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:09:31.603146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:31.603783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:31.619125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:31.626078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:31.626537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:31.631636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:31.634011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:31.637025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:31.780608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:31.795338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:31.800629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:31.804452 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-584eec26-c254-45b8-bd6e-0a7ce0e87483 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1319 microversion: 2.25 time: 0.450030 Oct 27 10:09:31.808248 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 240/493] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:31 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:31.819727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d255f5d5-33cc-44ad-a9da-0bb835dcb301 tempest-QuotaClassesAdmin257Test-728947319 tempest-QuotaClassesAdmin257Test-728947319-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5be403a0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:31.834705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:31.857682 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-294a834e-b3af-4755-9da7-16505e2fd661 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1271 microversion: 2.1 time: 0.260802 Oct 27 10:09:31.860955 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 254/494] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:31 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:31.986398 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d255f5d5-33cc-44ad-a9da-0bb835dcb301 tempest-QuotaClassesAdmin257Test-728947319 tempest-QuotaClassesAdmin257Test-728947319-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.176303 Oct 27 10:09:32.014508 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 241/495] 10.222.0.76 () {62 vars in 1247 bytes} [Thu Oct 27 10:09:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:09:32.219879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:32.220569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:32.233232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:32.233816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:32.234418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:32.235444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:32.236270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:32.237231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:32.559396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:32.560633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:32.585656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:32.586516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:32.587215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:32.590696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:32.591543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:32.592416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:33.052747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:33.064581 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9bd8f081-e08f-4dd8-b9f7-ad4a72f048a9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1268 microversion: 2.1 time: 0.513141 Oct 27 10:09:33.067069 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 242/496] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:32 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1268 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:33.102743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:33.105639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:33.119123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:33.120085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:33.125710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:33.145115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:33.147269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:33.149094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:33.237725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:33.250377 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd82cc31-e197-425e-beb1-3401c66cdb94 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1314 microversion: 2.1 time: 1.035246 Oct 27 10:09:33.253603 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 255/497] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:32 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1314 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:33.265635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:33.266642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:33.283116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:33.285852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:33.287764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:33.289687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:33.290377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:33.292160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:34.002811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:34.037136 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b435bbc1-9aa3-4685-ad05-1bb97d0a67ba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1271 microversion: 2.1 time: 0.779380 Oct 27 10:09:34.039670 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 256/498] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:33 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1271 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:34.408164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:34.435601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:34.438483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:34.441947 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af9301d0-3f1e-49d0-9f0e-203bea212c03 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 1.344959 Oct 27 10:09:34.442548 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 243/499] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:33 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:34.471539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4e3a141c-8a26-4847-82e3-fc1f3598a0a6 req-349856cf-46f4-45fa-813c-9a5d133dae07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89e4759-6f67-4c74-a3e6-6110b6f5125f", "tag": "45983a74-7ba2-4509-8be1-0bea03112348"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:34.493482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4e3a141c-8a26-4847-82e3-fc1f3598a0a6 req-349856cf-46f4-45fa-813c-9a5d133dae07 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:34.494422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4e3a141c-8a26-4847-82e3-fc1f3598a0a6 req-349856cf-46f4-45fa-813c-9a5d133dae07 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:34.497238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4e3a141c-8a26-4847-82e3-fc1f3598a0a6 req-349856cf-46f4-45fa-813c-9a5d133dae07 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:34.506790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9fffe30a-371c-48a5-a9fd-3ce0f225e914 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Action: 'create', calling method: .version_select at 0x7f6d5ba43550>, body: {"keypair": {"name": "tempest-keypair-2029523177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6CHniecH1JSnCbXxqvTMMRqWREL5UZqG1OhGuzEstUnGV3wt3iD378gAjhPiA89Zla5WLp749VhTK9ttMwJ9WKWIkUkGnDmqIb4ifXrAE5cjHoB/EyIZHg9JA4B9zMkg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:34.515687 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4e3a141c-8a26-4847-82e3-fc1f3598a0a6 req-349856cf-46f4-45fa-813c-9a5d133dae07 service nova] Creating event network-changed:45983a74-7ba2-4509-8be1-0bea03112348 for instance a89e4759-6f67-4c74-a3e6-6110b6f5125f on n-h2-854663-10 Oct 27 10:09:34.522490 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4e3a141c-8a26-4847-82e3-fc1f3598a0a6 req-349856cf-46f4-45fa-813c-9a5d133dae07 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071778 Oct 27 10:09:34.523578 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 244/500] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:34.553094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-9fffe30a-371c-48a5-a9fd-3ce0f225e914 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Getting quotas for project 75d00e63cbd24dbc8caef82092921e5a. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:34.561573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:34.562310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:34.563485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-9fffe30a-371c-48a5-a9fd-3ce0f225e914 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Getting quotas for user 45e4b1cad46f43c1a1aac0e2ba5425ae and project 75d00e63cbd24dbc8caef82092921e5a. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:34.579129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:34.580241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:34.580708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:34.584142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:34.584967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:34.587902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:34.634967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9fffe30a-371c-48a5-a9fd-3ce0f225e914 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.585566 Oct 27 10:09:34.636942 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 257/501] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:09:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:34.653108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:34.659459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:34.678834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:34.680338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:34.683940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:34.685107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:34.685967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:34.686958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:34.953206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:34.967149 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4eb3eef-d427-43f5-a262-795ef91eb121 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1268 microversion: 2.1 time: 0.442141 Oct 27 10:09:34.986230 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 245/502] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:34 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1268 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:35.075015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:35.076946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:35.103840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:35.104355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:35.105833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:35.106574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:35.107029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:35.107465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:35.434557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:35.444630 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91c55f23-23df-4735-a067-a7e3f3e73495 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1314 microversion: 2.1 time: 0.804629 Oct 27 10:09:35.450815 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 258/503] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:34 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:35.469246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:35.470270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:35.480074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:35.483891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:35.484338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:35.485281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:35.485608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:35.486022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:35.884544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:35.905840 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b0c9cea-462f-4998-88e9-0a4f2ad52274 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 0.842952 Oct 27 10:09:35.921334 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 246/504] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:35 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:36.182044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:36.190491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9910e53-d436-4e5c-86a1-d1cde7f05e87 tempest-FlavorMetadataValidation-1826606846 tempest-FlavorMetadataValidation-1826606846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2072126796", "id": 1354507216, "os-flavor-access:is_public": "True"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:36.219266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:36.221190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:36.222629 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c39b3ddf-895a-4f4c-8490-8e1784a16ee8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.757433 Oct 27 10:09:36.223849 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 259/505] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:35 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:09:36.235658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:36.241919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:36.257476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:36.258062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:36.259218 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9910e53-d436-4e5c-86a1-d1cde7f05e87 tempest-FlavorMetadataValidation-1826606846 tempest-FlavorMetadataValidation-1826606846-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.328494 Oct 27 10:09:36.259937 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 247/506] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:09:35 2022] POST /compute/v2.1/flavors => generated 471 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:09:36.268498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:36.268498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:36.268498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:36.268498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:36.274085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b8751d1-8541-4b1b-8219-c46ae78dfcc4 tempest-FlavorMetadataValidation-1826606846 tempest-FlavorMetadataValidation-1826606846-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:36.371475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:36.380359 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-facc590c-4935-4a98-a5fb-3bc56fd1b7a7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1268 microversion: 2.1 time: 0.154877 Oct 27 10:09:36.389653 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 260/507] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:36 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:36.481442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:36.482208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:36.489636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:36.495019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:36.495586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:36.496418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:36.496998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:36.499382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:36.655551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=3,nova_api:INSERT=5,nova_api:UPDATE=7 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:36.704269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b8751d1-8541-4b1b-8219-c46ae78dfcc4 tempest-FlavorMetadataValidation-1826606846 tempest-FlavorMetadataValidation-1826606846-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors/1354507216/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.434563 Oct 27 10:09:36.705228 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 248/508] 10.222.0.76 () {62 vars in 1265 bytes} [Thu Oct 27 10:09:36 2022] POST /compute/v2.1/flavors/1354507216/os-extra_specs => generated 62 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:36.716226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31625d3f-602f-42e5-8596-334290db45c0 tempest-FlavorMetadataValidation-1826606846 tempest-FlavorMetadataValidation-1826606846-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:36.772067 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31625d3f-602f-42e5-8596-334290db45c0 tempest-FlavorMetadataValidation-1826606846 tempest-FlavorMetadataValidation-1826606846-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1354507216" status: 202 len: 0 microversion: 2.86 time: 0.060187 Oct 27 10:09:36.772692 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 249/509] 10.222.0.76 () {60 vars in 1202 bytes} [Thu Oct 27 10:09:36 2022] DELETE /compute/v2.1/flavors/1354507216 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:09:36.781318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed6d9525-bc35-45c1-a23a-891c3e4a9405 tempest-FlavorMetadataValidation-1826606846 tempest-FlavorMetadataValidation-1826606846-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:36.854030 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed6d9525-bc35-45c1-a23a-891c3e4a9405 tempest-FlavorMetadataValidation-1826606846 tempest-FlavorMetadataValidation-1826606846-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.076809 Oct 27 10:09:36.860938 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 250/510] 10.222.0.76 () {60 vars in 1187 bytes} [Thu Oct 27 10:09:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:09:36.935821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:36.937125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:36.945286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:36.952992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:36.953722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:36.954582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:36.955448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:36.956050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:36.957223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:37.692378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:37.701022 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73f60154-9dec-4b83-ad74-5832b216f5f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1314 microversion: 2.1 time: 1.229227 Oct 27 10:09:37.704737 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 261/511] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:36 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1314 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:37.724372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a59b8f6b-9935-4a94-9a31-1fcff2f6219f req-f7eda852-2e1e-403d-8639-221afb30b109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03eeed8-34c3-4fcb-b086-570b834451c3", "name": "network-vif-deleted", "tag": "8a6e6cca-c72b-46eb-8788-607169424408"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:37.756358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a59b8f6b-9935-4a94-9a31-1fcff2f6219f req-f7eda852-2e1e-403d-8639-221afb30b109 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:37.756872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a59b8f6b-9935-4a94-9a31-1fcff2f6219f req-f7eda852-2e1e-403d-8639-221afb30b109 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:37.757295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a59b8f6b-9935-4a94-9a31-1fcff2f6219f req-f7eda852-2e1e-403d-8639-221afb30b109 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:37.767849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:37.770882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:37.776996 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-078d4c9b-d1e9-48b6-a8f2-8a45cbb50708 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 0.845347 Oct 27 10:09:37.784612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.compute.server_external_events [req-a59b8f6b-9935-4a94-9a31-1fcff2f6219f req-f7eda852-2e1e-403d-8639-221afb30b109 service nova] Unable to find a host for instance c03eeed8-34c3-4fcb-b086-570b834451c3. Dropping event network-vif-deleted {{(pid=120719) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 10:09:37.786519 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a59b8f6b-9935-4a94-9a31-1fcff2f6219f req-f7eda852-2e1e-403d-8639-221afb30b109 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.079884 Oct 27 10:09:37.787611 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 262/512] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 10:09:37.792568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:37.793410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:37.798247 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 251/513] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:36 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:37.804720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:37.805659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:37.812450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:37.813368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:37.814238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:37.814861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:37.815357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:37.815932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:37.816256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:37.816631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:37.817388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:37.817858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:37.818882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:37.825134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:38.388556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:38.399881 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-142fd596-1e21-4aee-a1be-bb577ad33c43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.597813 Oct 27 10:09:38.401801 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 252/514] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:37 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:38.442226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:38.456188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:38.461589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:38.463466 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5d46edc9-1796-4ce9-8b46-7895d27bc1b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.674705 Oct 27 10:09:38.485309 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 263/515] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:37 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:38.731220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:38.732745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:38.759078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:38.759810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:38.760395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:38.764302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:38.765000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:38.765580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:38.808857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:38.810258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:38.836436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:38.840648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:38.844116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:38.846434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:38.848078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:38.849221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:39.279193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:39.303189 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19f5024a-8775-490e-ae2f-fd4aca935b7e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1314 microversion: 2.1 time: 0.576015 Oct 27 10:09:39.322173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 253/516] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:38 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:39.389802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:39.405547 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-611643b1-ae29-4056-b3d3-bacf4daddb6e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 0.601356 Oct 27 10:09:39.407927 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 264/517] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:38 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:39.430551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:39.431501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:39.444024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:39.445706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:39.446758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:39.449741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:39.450880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:39.451997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:39.501859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:39.502578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:39.521165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:39.522060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:39.522576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:39.527869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:39.529026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:39.530916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:40.008620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:40.467521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:40.478543 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-366da059-d41e-42d4-b98a-9ff1bc5562db tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 1.053018 Oct 27 10:09:40.481748 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 254/518] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:39 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:40.495616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:40.502800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2797a23e-626d-4988-af13-8889d254d1d7 req-b5754b3f-4dd5-4617-82b7-bab36e0b1a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be88582-e288-4713-bdbb-c7771e2af40b", "tag": "92013d1a-4514-4c94-b7b4-1360511dfb99"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:40.509190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:40.510937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:40.513106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4d300f9-b447-4592-902d-5bcc202a1d88 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 1.017398 Oct 27 10:09:40.516293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2797a23e-626d-4988-af13-8889d254d1d7 req-b5754b3f-4dd5-4617-82b7-bab36e0b1a30 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:40.518707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2797a23e-626d-4988-af13-8889d254d1d7 req-b5754b3f-4dd5-4617-82b7-bab36e0b1a30 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:40.520688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2797a23e-626d-4988-af13-8889d254d1d7 req-b5754b3f-4dd5-4617-82b7-bab36e0b1a30 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:40.527835 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 265/519] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:39 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:40.541573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:40.542462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:40.549635 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2797a23e-626d-4988-af13-8889d254d1d7 req-b5754b3f-4dd5-4617-82b7-bab36e0b1a30 service nova] Creating event network-changed:92013d1a-4514-4c94-b7b4-1360511dfb99 for instance 1be88582-e288-4713-bdbb-c7771e2af40b on n-h1-854663-10 Oct 27 10:09:40.551599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:40.552603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:40.553324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:40.554330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:40.554936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:40.555510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:40.561765 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2797a23e-626d-4988-af13-8889d254d1d7 req-b5754b3f-4dd5-4617-82b7-bab36e0b1a30 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077603 Oct 27 10:09:40.563444 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 255/520] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:40.576422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:40.577411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:40.595007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:40.595692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:40.596298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:40.597244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:40.597696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:40.601855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:40.973818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:40.989035 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e592e878-820e-4d76-b3f1-76f24fcf87e6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 0.423356 Oct 27 10:09:41.008219 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 256/521] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:40 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:41.014911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-12bc101b-b0a2-4a65-960a-bc60416aba63 req-b797ccb7-88fb-46d6-98bd-0bcce9e2723c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89e4759-6f67-4c74-a3e6-6110b6f5125f", "name": "network-vif-plugged", "status": "completed", "tag": "45983a74-7ba2-4509-8be1-0bea03112348"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:41.026979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-12bc101b-b0a2-4a65-960a-bc60416aba63 req-b797ccb7-88fb-46d6-98bd-0bcce9e2723c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:41.027708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-12bc101b-b0a2-4a65-960a-bc60416aba63 req-b797ccb7-88fb-46d6-98bd-0bcce9e2723c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:41.028440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-12bc101b-b0a2-4a65-960a-bc60416aba63 req-b797ccb7-88fb-46d6-98bd-0bcce9e2723c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:41.049280 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-12bc101b-b0a2-4a65-960a-bc60416aba63 req-b797ccb7-88fb-46d6-98bd-0bcce9e2723c service nova] Creating event network-vif-plugged:45983a74-7ba2-4509-8be1-0bea03112348 for instance a89e4759-6f67-4c74-a3e6-6110b6f5125f on n-h2-854663-10 Oct 27 10:09:41.062727 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-12bc101b-b0a2-4a65-960a-bc60416aba63 req-b797ccb7-88fb-46d6-98bd-0bcce9e2723c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052802 Oct 27 10:09:41.063533 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 257/522] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:41.152303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:41.166102 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95b6a27a-9d40-41a2-9bea-8c22b4d3cb56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1314 microversion: 2.1 time: 0.637029 Oct 27 10:09:41.167904 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 266/523] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:40 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:41.506727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:41.507542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:41.522002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:41.522773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:41.523335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:41.524414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:41.524998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:41.532365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:41.544237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:41.544921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:41.554400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:41.554899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:41.555339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:41.556059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:41.556509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:41.556968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:41.971818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:42.330901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:42.359322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:42.361573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:42.363037 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6f449a1-41a6-44ba-87f2-3759fa7da591 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.824239 Oct 27 10:09:42.389924 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 267/524] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:41 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:42.395067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:42.400971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:42.414671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:42.417179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:42.419614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:42.420424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:42.420933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:42.421400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:42.533690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:42.545467 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f31ffd00-5ffb-4e89-96e2-76d0b73e5d25 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 1.044739 Oct 27 10:09:42.546965 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 258/525] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:41 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:42.554123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:42.554923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:42.563880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:42.564772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:42.565383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:42.566434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:42.567087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:42.567985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:42.603140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:43.024075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:43.033180 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a4bbed7-ccce-449c-a7a3-60a590dbf651 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1314 microversion: 2.1 time: 0.484884 Oct 27 10:09:43.033779 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 259/526] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:42 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:43.054800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2f40aa49-3fc8-4a50-b2d7-4d0f7fc95200 req-9b4f98b0-9ff3-4f22-8bd1-81bff826efbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b50483e-af66-4d8d-b553-e465cd1389e9", "tag": "2e4bd57c-5519-4d76-a1db-9fe07d5d4d69"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:43.067152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:43.076404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f40aa49-3fc8-4a50-b2d7-4d0f7fc95200 req-9b4f98b0-9ff3-4f22-8bd1-81bff826efbc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:43.076925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f40aa49-3fc8-4a50-b2d7-4d0f7fc95200 req-9b4f98b0-9ff3-4f22-8bd1-81bff826efbc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:43.077362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f40aa49-3fc8-4a50-b2d7-4d0f7fc95200 req-9b4f98b0-9ff3-4f22-8bd1-81bff826efbc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:43.087643 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62c09d19-8d37-4760-b4ea-8e7c1e9b7d02 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 0.700911 Oct 27 10:09:43.092601 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 268/527] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:42 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:43.101567 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2f40aa49-3fc8-4a50-b2d7-4d0f7fc95200 req-9b4f98b0-9ff3-4f22-8bd1-81bff826efbc service nova] Creating event network-changed:2e4bd57c-5519-4d76-a1db-9fe07d5d4d69 for instance 8b50483e-af66-4d8d-b553-e465cd1389e9 on n-h2-854663-10 Oct 27 10:09:43.117331 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2f40aa49-3fc8-4a50-b2d7-4d0f7fc95200 req-9b4f98b0-9ff3-4f22-8bd1-81bff826efbc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071872 Oct 27 10:09:43.118515 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 260/528] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:43.389212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:43.389836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:43.401989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:43.406037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:43.408900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:43.409362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:43.409812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:43.410247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:43.575999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:43.577768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:43.611034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:43.611885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:43.612906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:43.615748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:43.616822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:43.617525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:43.860515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:43.873422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:43.875309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:43.876680 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a443141d-f787-436a-bbb4-c307d07f14fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1305 microversion: 2.25 time: 0.491532 Oct 27 10:09:43.877951 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 269/529] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:43 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1305 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:44.056230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:44.056884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:44.066569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:44.067057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:44.067506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:44.068258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:44.073607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:44.075647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:44.401949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:44.416770 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bffd1045-3c08-4a99-b338-cc89e1d5c732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.848542 Oct 27 10:09:44.430086 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 261/530] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:43 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:44.435256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:44.436056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:44.451921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:44.452409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:44.452875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:44.453621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:44.454074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:44.454529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:44.527715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:44.540982 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9fb6797a-124f-495c-b7aa-12a47ac7e00e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1464 microversion: 2.1 time: 0.487895 Oct 27 10:09:44.542349 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 270/531] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:44 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1464 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:44.571675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:44.573194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:44.580395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=7 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:44.625831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:44.629744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:44.630448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:44.633348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:44.635248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:44.635844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:44.780873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:44.790216 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f837dd16-b366-49eb-8a27-4146924876a0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 0.371393 Oct 27 10:09:44.791013 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 262/532] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:44 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:44.991623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Calling method '.version_select at 0x7f6d5bc4b790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:44.994671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:44.995334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:44.995775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.011566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.012456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.013074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.028053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.028727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.030172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.040742 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c92e5f0-cdfb-489f-846b-ac6890ec51c9 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.195427 Oct 27 10:09:45.045848 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 263/533] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:45.058307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:45.058970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:45.066058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.067304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.068121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.068930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.069635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.070218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.107254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:45.133277 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b5f6c37-6101-4b29-bcb4-d8d8212f236c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1313 microversion: 2.1 time: 0.568057 Oct 27 10:09:45.134548 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 271/534] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:44 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:45.151401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Calling method '.version_select at 0x7f6d5bb848b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:45.153921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.155312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.156643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.200116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.202317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.203338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.256266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.256797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.257239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.275238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:45.297993 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d05cfb04-8638-4f83-89e3-ae0d8c2581b7 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/n-h2-854663-10/servers" status: 200 len: 355 microversion: 2.1 time: 0.157068 Oct 27 10:09:45.298636 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 272/535] 10.222.0.76 () {58 vars in 1215 bytes} [Thu Oct 27 10:09:45 2022] GET /compute/v2.1/os-hypervisors/n-h2-854663-10/servers => generated 355 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:45.304823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:45.308305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-25c455c3-58d7-44e4-a9ae-c4931ecda82b req-57679e79-3398-4862-99f0-83b80e3195b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d33774-5dae-4e3e-8ebe-25d783fd65c8", "tag": "cb50cfc5-06f5-4c79-a079-ac2a73e062e8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:45.314075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:45.322139 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d9e5dd0-ec38-480c-ac64-ae67b63194c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1263 microversion: 2.25 time: 0.275070 Oct 27 10:09:45.323704 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 264/536] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:45 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1263 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:45.336864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-25c455c3-58d7-44e4-a9ae-c4931ecda82b req-57679e79-3398-4862-99f0-83b80e3195b0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.337345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-25c455c3-58d7-44e4-a9ae-c4931ecda82b req-57679e79-3398-4862-99f0-83b80e3195b0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.338864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-25c455c3-58d7-44e4-a9ae-c4931ecda82b req-57679e79-3398-4862-99f0-83b80e3195b0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.353840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Calling method '.version_select at 0x7f6d5bde7940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:45.356987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.359758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.361974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.363244 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-25c455c3-58d7-44e4-a9ae-c4931ecda82b req-57679e79-3398-4862-99f0-83b80e3195b0 service nova] Creating event network-changed:cb50cfc5-06f5-4c79-a079-ac2a73e062e8 for instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 on n-h1-854663-10 Oct 27 10:09:45.370478 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-25c455c3-58d7-44e4-a9ae-c4931ecda82b req-57679e79-3398-4862-99f0-83b80e3195b0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069938 Oct 27 10:09:45.371285 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 273/537] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:45.389510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.389946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.390566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.405708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.406682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.407274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.415420 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1c97808-5756-4572-b46e-3189d08740e0 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.090351 Oct 27 10:09:45.417071 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 265/538] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:09:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:45.428491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34e6d6ad-9562-411f-9bcb-aaaa075476c6 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Calling method '.version_select at 0x7f6d5ba43ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:45.430385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34e6d6ad-9562-411f-9bcb-aaaa075476c6 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.430963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34e6d6ad-9562-411f-9bcb-aaaa075476c6 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.431465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34e6d6ad-9562-411f-9bcb-aaaa075476c6 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.441135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:45.441953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:45.447276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34e6d6ad-9562-411f-9bcb-aaaa075476c6 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.447917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34e6d6ad-9562-411f-9bcb-aaaa075476c6 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.449369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34e6d6ad-9562-411f-9bcb-aaaa075476c6 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.453011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.453513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.453958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.458436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.458931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.459372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.460061 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34e6d6ad-9562-411f-9bcb-aaaa075476c6 tempest-HypervisorAdminUnderV252Test-756575026 tempest-HypervisorAdminUnderV252Test-756575026-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors/n-h2-854663-10/search" status: 200 len: 105 microversion: 2.1 time: 0.036492 Oct 27 10:09:45.461334 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 274/539] 10.222.0.76 () {58 vars in 1212 bytes} [Thu Oct 27 10:09:45 2022] GET /compute/v2.1/os-hypervisors/n-h2-854663-10/search => generated 105 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:45.712285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-d268f966-4635-45c0-afd9-fe8f5d1e3295 req-3088bca8-fc80-4e92-bbe3-bf3bff138830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03eeed8-34c3-4fcb-b086-570b834451c3", "tag": "47a0bb7b-ed01-4e2b-88f6-d97b5c72da33"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:45.728409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=84,nova_api:UPDATE=7 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:45.747318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d268f966-4635-45c0-afd9-fe8f5d1e3295 req-3088bca8-fc80-4e92-bbe3-bf3bff138830 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.748309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d268f966-4635-45c0-afd9-fe8f5d1e3295 req-3088bca8-fc80-4e92-bbe3-bf3bff138830 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.749349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d268f966-4635-45c0-afd9-fe8f5d1e3295 req-3088bca8-fc80-4e92-bbe3-bf3bff138830 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.787741 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-d268f966-4635-45c0-afd9-fe8f5d1e3295 req-3088bca8-fc80-4e92-bbe3-bf3bff138830 service nova] Creating event network-changed:47a0bb7b-ed01-4e2b-88f6-d97b5c72da33 for instance c03eeed8-34c3-4fcb-b086-570b834451c3 on n-h2-854663-10 Oct 27 10:09:45.799102 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-d268f966-4635-45c0-afd9-fe8f5d1e3295 req-3088bca8-fc80-4e92-bbe3-bf3bff138830 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090573 Oct 27 10:09:45.802316 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 275/540] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:45.843528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:45.849368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:45.864283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.866801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.867674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:45.870756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:45.871652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:45.873827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:46.350718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:46.360288 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8bb5322f-333a-43eb-b7ee-b5a7ed5d05fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.923656 Oct 27 10:09:46.381382 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 266/541] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:45 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:46.395701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:46.396361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:46.407387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:46.408391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:46.409514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:46.410430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:46.411321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:46.411973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:46.893550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:46.907597 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38cac9bd-971e-42c0-81f0-8483fc2d49bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 1.095036 Oct 27 10:09:46.909865 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 276/542] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:45 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:46.916913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:46.917431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:46.923638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:46.924313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:46.924962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:46.925825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:46.926666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:46.927454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:46.963152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:46.972635 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d64cd389-9584-4264-8298-f182af818dd1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1313 microversion: 2.1 time: 0.590051 Oct 27 10:09:46.976315 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 267/543] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:46 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:46.983555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1332333248", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "7233b255-11be-4680-880e-1263043546b9"}], "security_groups": [{"name": "tempest-securitygroup--113721163"}], "key_name": "tempest-keypair-2029523177", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:47.226694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:47.236235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:47.238115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:47.239772 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e62f925-04ab-48f7-bada-578573658dd2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1313 microversion: 2.25 time: 0.327770 Oct 27 10:09:47.252904 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 277/544] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:46 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:47.313906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] validate_networks() for [('7233b255-11be-4680-880e-1263043546b9', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:09:47.395364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:47.396488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:47.406718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:47.407462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:47.407869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:47.408585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:47.409163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:47.409854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:47.941660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:47.962088 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a3958c4-6888-4c02-b3d0-43cc83a40407 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1254 microversion: 2.1 time: 0.571043 Oct 27 10:09:47.962434 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 278/545] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:47 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1254 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:47.977584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-29169e10-3a79-4463-b9b3-a9901cc8d990 req-47bca2ba-e7bc-4b21-9446-7a8c95a056bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be88582-e288-4713-bdbb-c7771e2af40b", "name": "network-vif-deleted", "tag": "92013d1a-4514-4c94-b7b4-1360511dfb99"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:47.995025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-29169e10-3a79-4463-b9b3-a9901cc8d990 req-47bca2ba-e7bc-4b21-9446-7a8c95a056bd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:47.999073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-29169e10-3a79-4463-b9b3-a9901cc8d990 req-47bca2ba-e7bc-4b21-9446-7a8c95a056bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:48.001723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-29169e10-3a79-4463-b9b3-a9901cc8d990 req-47bca2ba-e7bc-4b21-9446-7a8c95a056bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:48.026706 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-29169e10-3a79-4463-b9b3-a9901cc8d990 req-47bca2ba-e7bc-4b21-9446-7a8c95a056bd service nova] Creating event network-vif-deleted:92013d1a-4514-4c94-b7b4-1360511dfb99 for instance 1be88582-e288-4713-bdbb-c7771e2af40b on n-h2-854663-10 Oct 27 10:09:48.037995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-29169e10-3a79-4463-b9b3-a9901cc8d990 req-47bca2ba-e7bc-4b21-9446-7a8c95a056bd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073451 Oct 27 10:09:48.039220 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 279/546] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:48.091553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:48.093323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:48.102643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:48.103814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:48.104460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:48.105498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:48.106835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:48.108120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:48.816977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:48.833954 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1fdba7f-848e-49a1-ada7-2ac1cabeb890 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 0.792971 Oct 27 10:09:48.840757 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 280/547] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:48 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:48.850910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:48.859208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:48.873256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:48.873989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:48.874900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:48.875760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:48.876986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:48.878201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:48.921955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:49.086816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:49.088058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:49.088401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:49.088832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:49.089610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:49.106538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:49.107719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:49.111365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:49.113154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:49.114739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:49.116608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:49.170172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Getting quotas for project 75d00e63cbd24dbc8caef82092921e5a. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:49.179188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Getting quotas for user 45e4b1cad46f43c1a1aac0e2ba5425ae and project 75d00e63cbd24dbc8caef82092921e5a. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:49.221657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:49.226417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:09:49.234053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:09:49.237633 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3832696-32ae-4cb4-88a8-e086dc6faf3a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1313 microversion: 2.1 time: 0.395841 Oct 27 10:09:49.256377 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 281/548] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:48 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:49.280847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:49.283109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:49.320441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:49.324872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:49.325670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:49.327783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:49.329465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:49.332988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:49.363698 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97b093b8-77fc-40cb-94b3-5e62a7d035ce tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.384264 Oct 27 10:09:49.369015 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 268/549] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:09:49.625030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:49.644253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:49.652525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:49.656221 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bbdbbce7-9b30-4941-ac96-de3c0d81d6a3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1319 microversion: 2.25 time: 0.398769 Oct 27 10:09:49.660260 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 282/550] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:49 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:49.671555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:49.687767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:49.709916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:49.712783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:49.718401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:49.720896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:49.721713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:49.724429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:49.971955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:49.980788 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5874d325-51ff-4ad0-b361-e520bcc1499a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1206 microversion: 2.1 time: 0.317798 Oct 27 10:09:49.988880 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 283/551] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:49 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1206 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:50.011633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ba9ccefb-a294-4492-91a0-3817292647f0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:50.016900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ba9ccefb-a294-4492-91a0-3817292647f0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:50.197297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d32e861-bd52-4ada-9d49-79c3bc123740 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:50.215676 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d32e861-bd52-4ada-9d49-79c3bc123740 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.845232 Oct 27 10:09:50.216516 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 269/552] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:09:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:50.229213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:50.230014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:50.243680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:50.248521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:50.249269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:50.250820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:50.251289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:50.251725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:50.261372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba9ccefb-a294-4492-91a0-3817292647f0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:50.274925 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ba9ccefb-a294-4492-91a0-3817292647f0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1242 microversion: 2.1 time: 0.284770 Oct 27 10:09:50.282285 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 284/553] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:49 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1242 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:50.305833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b9af8d67-09dc-4b4c-9fbc-64ab34fa4c36 req-5c5324bc-63a8-4da3-93ff-b15ddbd6bd8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d33774-5dae-4e3e-8ebe-25d783fd65c8", "name": "network-vif-deleted", "tag": "cb50cfc5-06f5-4c79-a079-ac2a73e062e8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:50.333772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b9af8d67-09dc-4b4c-9fbc-64ab34fa4c36 req-5c5324bc-63a8-4da3-93ff-b15ddbd6bd8d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:50.336897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b9af8d67-09dc-4b4c-9fbc-64ab34fa4c36 req-5c5324bc-63a8-4da3-93ff-b15ddbd6bd8d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:50.337508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b9af8d67-09dc-4b4c-9fbc-64ab34fa4c36 req-5c5324bc-63a8-4da3-93ff-b15ddbd6bd8d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:50.412310 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b9af8d67-09dc-4b4c-9fbc-64ab34fa4c36 req-5c5324bc-63a8-4da3-93ff-b15ddbd6bd8d service nova] Creating event network-vif-deleted:cb50cfc5-06f5-4c79-a079-ac2a73e062e8 for instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 on n-h2-854663-10 Oct 27 10:09:50.431688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b9af8d67-09dc-4b4c-9fbc-64ab34fa4c36 req-5c5324bc-63a8-4da3-93ff-b15ddbd6bd8d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129754 Oct 27 10:09:50.432351 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 285/554] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:50.760045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:50.780874 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff4aad2f-6120-4013-ab84-5f8034410b47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 0.554600 Oct 27 10:09:50.781686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 270/555] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:50 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:50.802768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:50.805067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:50.825636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:50.829221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:50.829880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:50.830846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:50.831451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:50.833139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:50.836996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ba38bc68-0c35-4a69-8572-94a317da27b0 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-535185611", "id": 1224059415, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:50.873997 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ba38bc68-0c35-4a69-8572-94a317da27b0 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.436973 Oct 27 10:09:50.875768 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 286/556] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:50 2022] POST /compute/v2.1/flavors => generated 424 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:50.887914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:50.889362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:50.898160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:50.898842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:50.899436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:50.900415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:50.901049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:50.901626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:51.357044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:51.370457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3307617f-9e12-4930-94c4-0cf52833ddbd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1313 microversion: 2.1 time: 0.584608 Oct 27 10:09:51.371057 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 271/557] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:50 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:51.389778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e2d5d367-9fc5-41d8-a671-c7c845fb8bcd req-1455c21c-eec5-4dac-9eed-5a74f5762b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b50483e-af66-4d8d-b553-e465cd1389e9", "name": "network-vif-plugged", "status": "completed", "tag": "2e4bd57c-5519-4d76-a1db-9fe07d5d4d69"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:51.407939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e2d5d367-9fc5-41d8-a671-c7c845fb8bcd req-1455c21c-eec5-4dac-9eed-5a74f5762b7d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:51.408589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e2d5d367-9fc5-41d8-a671-c7c845fb8bcd req-1455c21c-eec5-4dac-9eed-5a74f5762b7d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:51.409617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e2d5d367-9fc5-41d8-a671-c7c845fb8bcd req-1455c21c-eec5-4dac-9eed-5a74f5762b7d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:51.440339 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e2d5d367-9fc5-41d8-a671-c7c845fb8bcd req-1455c21c-eec5-4dac-9eed-5a74f5762b7d service nova] Creating event network-vif-plugged:2e4bd57c-5519-4d76-a1db-9fe07d5d4d69 for instance 8b50483e-af66-4d8d-b553-e465cd1389e9 on n-h2-854663-10 Oct 27 10:09:51.446330 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e2d5d367-9fc5-41d8-a671-c7c845fb8bcd req-1455c21c-eec5-4dac-9eed-5a74f5762b7d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072432 Oct 27 10:09:51.447893 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 272/558] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:51.456809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5bfeda2-66be-4203-9150-2eca37e96243 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:51.468990 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5bfeda2-66be-4203-9150-2eca37e96243 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017806 Oct 27 10:09:51.475637 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 273/559] 10.222.0.76 () {58 vars in 1182 bytes} [Thu Oct 27 10:09:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:09:51.487116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:51.489617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:51.507095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:51.508741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:51.509253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:51.510006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:51.514757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:51.519136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:51.529022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:51.547135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:51.558796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:51.567471 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38acda74-3658-47de-9c9f-8533e33aa06a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.688642 Oct 27 10:09:51.571920 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 287/560] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:50 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:51.596695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:51.603966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:51.628637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:51.629248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:51.629747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:51.630461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:51.630912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:51.631365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:51.728901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:51.738355 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be660eb0-0449-438c-a005-c7604bb89743 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1268 microversion: 2.1 time: 0.260951 Oct 27 10:09:51.739217 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 274/561] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:51 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1268 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:51.763135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ea67e57-fa17-49eb-a8cb-465629909ed2 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-42195455", "id": 177036954, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:51.791322 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ea67e57-fa17-49eb-a8cb-465629909ed2 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.050612 Oct 27 10:09:51.792711 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 275/562] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:51 2022] POST /compute/v2.1/flavors => generated 420 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:51.798744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:51.812456 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b86a4b14-b67c-4b6a-8fad-e30b60c19553 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1294 microversion: 2.1 time: 0.233420 Oct 27 10:09:51.814011 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 288/563] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:51 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1294 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:51.854668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:51.855469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:51.871957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:51.874803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:51.875721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:51.876677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:51.878229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:51.881008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:52.038881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-429832931", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": "none"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:52.152371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:52.159235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:52.160421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:52.161310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:52.163283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:52.186634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:52.187402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:52.188019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:52.189830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:52.190427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:52.190874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:52.230230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Getting quotas for project b7c9f82698a1461d921f6d7d97f587da. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:52.252622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Getting quotas for user dba40c9d9b7347c2a04da70533b1aba7 and project b7c9f82698a1461d921f6d7d97f587da. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:52.260810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=2,nova_api:INSERT=6,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:52.272894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:52.274839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:09:52.279261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:09:52.287773 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7aaa1cb3-33a7-4e7a-86b5-a53567541586 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1313 microversion: 2.1 time: 0.447685 Oct 27 10:09:52.299557 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 289/564] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:51 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:52.313707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b51b711-d4ca-4b14-8d9c-b32e0e49a4c4 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:52.323658 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3b51b711-d4ca-4b14-8d9c-b32e0e49a4c4 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022675 Oct 27 10:09:52.334739 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 290/565] 10.222.0.76 () {58 vars in 1182 bytes} [Thu Oct 27 10:09:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:09:52.340261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4938f10f-2403-4a0c-ae36-91628b3e3e4f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Action: 'create', calling method: .version_select at 0x7f6d5bb84790>, body: {"keypair": {"name": "tempest-keypair-2080193100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeepmorya2tJGGW23okUOFrMbDmb8dYrgR6aniqwQsODmKG1WWFkAy0nzgI5n9u7xoaozwizU5NuQYXyO3ra8dSrX10F6ocuwaC2hM1sA/v8rjiQDJgrOHQIwNK3BAKVw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:52.367507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4938f10f-2403-4a0c-ae36-91628b3e3e4f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Getting quotas for project 53cec1ab41cb408bab6c71ee8345de63. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:52.376107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4938f10f-2403-4a0c-ae36-91628b3e3e4f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Getting quotas for user 9a92b84bbef9472fa37a1e09b438be26 and project 53cec1ab41cb408bab6c71ee8345de63. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:52.385453 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2367418-dbfa-463f-ba7c-332c65309592 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.591341 Oct 27 10:09:52.386406 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 276/566] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:09:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:09:52.430381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2aa6af7e-d590-40b1-8727-11fc8031c314 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:52.431388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2aa6af7e-d590-40b1-8727-11fc8031c314 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:52.433566 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4938f10f-2403-4a0c-ae36-91628b3e3e4f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097337 Oct 27 10:09:52.442951 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 291/567] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:09:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:52.450669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:52.451310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:52.473999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:52.476231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:52.477619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:52.478563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:52.480231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:52.481087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:52.638096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2aa6af7e-d590-40b1-8727-11fc8031c314 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:52.646254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2aa6af7e-d590-40b1-8727-11fc8031c314 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:52.647690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2aa6af7e-d590-40b1-8727-11fc8031c314 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:52.693116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2aa6af7e-d590-40b1-8727-11fc8031c314 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1452 microversion: 2.91 time: 0.285385 Oct 27 10:09:52.693761 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 277/568] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:52 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1452 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:52.709450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:52.710241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:52.724979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:52.725462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:52.736346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:52.737764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:52.738477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:52.739288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:53.272522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:53.285159 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76aac81c-ec57-46d9-9136-2115f76cb082 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1313 microversion: 2.1 time: 0.840066 Oct 27 10:09:53.286666 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 292/569] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:52 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:53.292399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:53.293958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:53.304096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:53.305909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:53.308528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:53.309612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:53.310546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:53.311182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:53.346199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:53.362429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:53.368636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:53.373267 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b149cd5-9f01-4c61-b840-1a7732121ed1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.677961 Oct 27 10:09:53.374934 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 278/570] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:52 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:53.381252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:53.382264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:53.394109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:53.402956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:53.403952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:53.405657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:53.406641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:53.407405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:53.693852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:53.705101 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5caba6db-89b1-4282-b27d-95020a955e29 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1300 microversion: 2.1 time: 0.328739 Oct 27 10:09:53.705702 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 279/571] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:53 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1300 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:53.722138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:53.723793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:53.736779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:53.738330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:53.740945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:53.741804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:53.742352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:53.745595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:54.166594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:54.179225 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e0c4670-375d-4c8b-b75c-9a94fa5efe0d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.891155 Oct 27 10:09:54.193165 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 293/572] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:53 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:54.200809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0402ce30-7681-415d-b890-3850c0006cec req-86ea0b68-b05e-40f6-b25a-fd5589bbbd24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be88582-e288-4713-bdbb-c7771e2af40b", "tag": "85249995-24f5-4745-9051-333609fd2ea1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:54.228635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0402ce30-7681-415d-b890-3850c0006cec req-86ea0b68-b05e-40f6-b25a-fd5589bbbd24 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:54.229341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0402ce30-7681-415d-b890-3850c0006cec req-86ea0b68-b05e-40f6-b25a-fd5589bbbd24 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:54.229926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0402ce30-7681-415d-b890-3850c0006cec req-86ea0b68-b05e-40f6-b25a-fd5589bbbd24 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:54.255886 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0402ce30-7681-415d-b890-3850c0006cec req-86ea0b68-b05e-40f6-b25a-fd5589bbbd24 service nova] Creating event network-changed:85249995-24f5-4745-9051-333609fd2ea1 for instance 1be88582-e288-4713-bdbb-c7771e2af40b on n-h2-854663-10 Oct 27 10:09:54.267045 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0402ce30-7681-415d-b890-3850c0006cec req-86ea0b68-b05e-40f6-b25a-fd5589bbbd24 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072224 Oct 27 10:09:54.269067 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 294/573] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:54.278763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:54.280166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:54.289805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:54.291136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:54.291642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:54.292796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:54.293314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:54.293865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:54.319918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:54.334213 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e1824c6-a1bb-460d-bf56-899054a0ab83 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1462 microversion: 2.1 time: 0.622935 Oct 27 10:09:54.337610 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 280/574] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:53 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1462 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:54.342598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:54.358606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:54.374574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:54.375271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:54.375881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:54.376799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:54.377528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:54.378295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:54.614282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:54.634977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:54.641707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:54.670045 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f015b6ef-5968-4a1f-9349-35bbf9411441 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1504 microversion: 2.91 time: 0.393066 Oct 27 10:09:54.670938 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 295/575] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:54 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:54.703123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:54.711423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:54.731368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:54.731912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:54.732454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:54.733876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:54.734389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:54.734986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:54.838684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:54.843998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:54.850422 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb82ef6f-1e3c-454a-8443-26f780de4105 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1313 microversion: 2.1 time: 0.511451 Oct 27 10:09:54.852377 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 281/576] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:54 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:54.866442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 10:09:54.875458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:54.876137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:54.877489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:54.878002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:54.879243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:54.890423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:54.891618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:54.904293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:54.907592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:54.908297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:54.911457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:54.925234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:54.926069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:55.047199 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ca6c2adb-ce70-49e0-b7e2-831d27876ebe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9/action" status: 202 len: 0 microversion: 2.1 time: 0.359507 Oct 27 10:09:55.048105 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 296/577] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:09:54 2022] POST /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:55.058392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-229a538e-bdad-4b0e-a6f0-0ad10ceb4b50 req-dd7236fb-1f95-4fd0-a320-cffb419e6333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03eeed8-34c3-4fcb-b086-570b834451c3", "name": "network-vif-plugged", "status": "completed", "tag": "47a0bb7b-ed01-4e2b-88f6-d97b5c72da33"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:55.071067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-229a538e-bdad-4b0e-a6f0-0ad10ceb4b50 req-dd7236fb-1f95-4fd0-a320-cffb419e6333 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:55.071555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-229a538e-bdad-4b0e-a6f0-0ad10ceb4b50 req-dd7236fb-1f95-4fd0-a320-cffb419e6333 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:55.072135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-229a538e-bdad-4b0e-a6f0-0ad10ceb4b50 req-dd7236fb-1f95-4fd0-a320-cffb419e6333 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:55.091071 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-229a538e-bdad-4b0e-a6f0-0ad10ceb4b50 req-dd7236fb-1f95-4fd0-a320-cffb419e6333 service nova] Creating event network-vif-plugged:47a0bb7b-ed01-4e2b-88f6-d97b5c72da33 for instance c03eeed8-34c3-4fcb-b086-570b834451c3 on n-h2-854663-10 Oct 27 10:09:55.098303 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-229a538e-bdad-4b0e-a6f0-0ad10ceb4b50 req-dd7236fb-1f95-4fd0-a320-cffb419e6333 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044445 Oct 27 10:09:55.099020 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 297/578] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:55.110051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:55.110813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:55.118725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:55.119261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:55.119699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:55.120431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:55.120895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:55.121364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:55.173511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:55.178366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:55.195406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:55.197474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:55.200966 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddcf0ea0-7178-4e43-be00-0bbb38bc1ca7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.314488 Oct 27 10:09:55.201872 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 282/579] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:54 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:55.206857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:55.214781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:55.230360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:55.239430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:55.240197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:55.242880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:55.244796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:55.246489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.162354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:56.178082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:56.188219 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-956da113-086e-4464-803f-b3dece5026db tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1471 microversion: 2.1 time: 0.984017 Oct 27 10:09:56.188961 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c858cf2-957b-4503-abcd-6de976f0bd5a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1367 microversion: 2.1 time: 1.083997 Oct 27 10:09:56.198057 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 283/580] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:55 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1471 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:56.212814 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 298/581] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:55 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1367 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:56.226277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:56.226899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:56.228951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:56.230216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:56.245081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:56.245588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:56.246159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:56.246656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:56.247088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.247801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:56.248445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.249180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:56.249630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:56.250051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.250379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:56.250965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.483842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:56.493371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:56.494824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:56.500171 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc6205be-3fcb-4815-ab27-ddae63a9a14a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1510 microversion: 2.91 time: 0.286218 Oct 27 10:09:56.500757 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 299/582] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:56 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:56.510038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:56.510038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:56.513627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:56.514427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:56.514958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.515804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:56.516363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:56.517935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.801074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:56.809538 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-380d0720-5ae2-44b6-a71c-6b2c5f27c203 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.600430 Oct 27 10:09:56.810109 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 284/583] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:56 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:56.815303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:56.816274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:56.822941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:56.823430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:56.823863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.824547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:56.825380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:56.825803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.910405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:56.918630 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77456255-4af4-46ef-9c9b-6813992a4539 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1313 microversion: 2.1 time: 0.416749 Oct 27 10:09:56.919185 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 300/584] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:56 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:56.923544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f893de91-9762-483c-ab2c-b26596bd9344 req-538d3aa8-1327-4f4e-9102-84cf71f25c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d33774-5dae-4e3e-8ebe-25d783fd65c8", "tag": "409267d5-e4ab-444d-9925-abd53434f4dc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:56.934965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f893de91-9762-483c-ab2c-b26596bd9344 req-538d3aa8-1327-4f4e-9102-84cf71f25c17 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:56.935447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f893de91-9762-483c-ab2c-b26596bd9344 req-538d3aa8-1327-4f4e-9102-84cf71f25c17 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:56.935853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f893de91-9762-483c-ab2c-b26596bd9344 req-538d3aa8-1327-4f4e-9102-84cf71f25c17 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:56.947759 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f893de91-9762-483c-ab2c-b26596bd9344 req-538d3aa8-1327-4f4e-9102-84cf71f25c17 service nova] Creating event network-changed:409267d5-e4ab-444d-9925-abd53434f4dc for instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 on n-h2-854663-10 Oct 27 10:09:56.952779 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f893de91-9762-483c-ab2c-b26596bd9344 req-538d3aa8-1327-4f4e-9102-84cf71f25c17 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032492 Oct 27 10:09:56.953399 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 301/585] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:57.182375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:57.196201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:57.200632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:57.204019 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78bb89be-1c33-4cf4-9d0a-5fdbc719f5aa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.392879 Oct 27 10:09:57.204786 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 285/586] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:56 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:57.215187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:57.215891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:57.226798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:57.228074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:57.228873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:57.230461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:57.230942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:57.236011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:57.236822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:57.238000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:57.240282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:57.240437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:57.250337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:57.251373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:57.251992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:57.252707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:58.129314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:58.137689 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5297d77c-b8aa-4639-830c-99cd374a3aff tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1471 microversion: 2.1 time: 0.927960 Oct 27 10:09:58.138271 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 302/587] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:57 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1471 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:58.142735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:58.143337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:58.150109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:58.150781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:58.151365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:58.152233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:58.152861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:58.153459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:58.174179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:58.193841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:58.212413 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-abaa856d-575d-4a46-8ff3-ee2cf6f0a6a4 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1367 microversion: 2.1 time: 0.986854 Oct 27 10:09:58.213929 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 286/588] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:57 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1367 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:58.218848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:58.219637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:58.227809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:58.228912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:58.229555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:58.230500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:58.231607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:58.232358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:58.342640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:58.351247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:58.352813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:58.358947 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a07e127d-aa7e-492d-bb74-7be2f57de68b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1531 microversion: 2.91 time: 0.219675 Oct 27 10:09:58.372828 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 303/589] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:58 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1531 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:58.372828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:58.372828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:58.372828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:58.372828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:58.373356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:58.374003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:58.374656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:58.375249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:58.748455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:58.757839 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-061f7487-546d-419d-bb48-d59d575f83b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.542655 Oct 27 10:09:58.758670 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 287/590] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:58 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:58.763593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:58.764262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:58.770546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:58.771261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:58.771713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:58.772459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:58.773000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:58.773476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:58.972876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:58.986909 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-897cc309-545b-4697-8bb6-ece418ba5757 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1313 microversion: 2.1 time: 0.625803 Oct 27 10:09:59.000962 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 304/591] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:58 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:59.134683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:59.143040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:59.144752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:59.145968 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13a1838b-a73f-4b9e-8a5c-0e68243433d3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.386132 Oct 27 10:09:59.146529 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 288/592] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:58 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:59.169426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1d022745-e747-4ee5-ae7f-63d11446e3dd req-5ccda4cd-32d8-47ae-b001-f457dbd12e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a159ce32-162c-4abe-a82d-98d52c1b4a1d", "tag": "ae097714-3d62-4de8-b685-b4fd4c106f2c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:59.180603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1d022745-e747-4ee5-ae7f-63d11446e3dd req-5ccda4cd-32d8-47ae-b001-f457dbd12e16 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:59.181421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1d022745-e747-4ee5-ae7f-63d11446e3dd req-5ccda4cd-32d8-47ae-b001-f457dbd12e16 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:59.182038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1d022745-e747-4ee5-ae7f-63d11446e3dd req-5ccda4cd-32d8-47ae-b001-f457dbd12e16 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:59.195542 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1d022745-e747-4ee5-ae7f-63d11446e3dd req-5ccda4cd-32d8-47ae-b001-f457dbd12e16 service nova] Creating event network-changed:ae097714-3d62-4de8-b685-b4fd4c106f2c for instance a159ce32-162c-4abe-a82d-98d52c1b4a1d on n-h2-854663-10 Oct 27 10:09:59.204765 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1d022745-e747-4ee5-ae7f-63d11446e3dd req-5ccda4cd-32d8-47ae-b001-f457dbd12e16 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042158 Oct 27 10:09:59.207690 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 289/593] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:59.216950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-438546001", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "177036954", "adminPass": "***", "networks": [{"uuid": "da8fce7d-e4f7-43ce-ba6d-5054f1b8720a"}], "security_groups": [{"name": "tempest-securitygroup--1333909223"}], "key_name": "tempest-keypair-2080193100", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:59.282030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:59.282643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:59.292132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:59.292628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:59.293331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:59.294144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:59.294761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:59.295189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:59.430196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] validate_networks() for [('da8fce7d-e4f7-43ce-ba6d-5054f1b8720a', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:09:59.437807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lazy-loading 'services' on Instance uuid 6348df04-190c-4588-a3e2-40f1b1e0f753 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:09:59.504214 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8cc30c8d-7246-4621-a968-693d410fd5c6 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1938 microversion: 2.91 time: 0.501849 Oct 27 10:09:59.504998 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 305/594] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:09:59 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1938 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:09:59.526734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:59.527176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:59.543242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:59.543792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:59.544268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:59.545046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:59.545473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:59.546122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:00.241992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:00.264707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a927b9c-52f4-46cf-8377-0a0b5837f045 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1471 microversion: 2.1 time: 0.739876 Oct 27 10:10:00.286523 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 306/595] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:59 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1471 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:00.292908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:00.293586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:00.300604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:00.301366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:00.302649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:00.303572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:00.304225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:00.305029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:00.977785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:00.985991 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e9c7476-ba03-43b1-acba-770e89beafc6 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1367 microversion: 2.1 time: 0.697876 Oct 27 10:10:00.986572 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 307/596] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:00 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1367 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:00.991448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:00.992044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:00.998100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:00.998598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:00.999019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:00.999710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.000155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.001080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.127057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lazy-loading 'services' on Instance uuid 6348df04-190c-4588-a3e2-40f1b1e0f753 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:01.145233 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe955348-969d-480a-b725-3aff1612f367 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1938 microversion: 2.91 time: 0.157464 Oct 27 10:10:01.145833 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 308/597] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:00 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1938 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:01.150311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:01.150936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:01.157525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.157661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.158079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.158853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.159207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.159859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.174822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:10:01.176514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:10:01.177001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:10:01.177584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:10:01.177997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:10:01.188611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.189170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.189690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.190596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.191199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.191664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.210421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Getting quotas for project 53cec1ab41cb408bab6c71ee8345de63. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:10:01.215097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Getting quotas for user 9a92b84bbef9472fa37a1e09b438be26 and project 53cec1ab41cb408bab6c71ee8345de63. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:10:01.227377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:10:01.231494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:10:01.283622 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cef36b57-7f34-41bd-bd71-eab3c871b51e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.074761 Oct 27 10:10:01.290814 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 290/598] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:10:01.291127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:01.291810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:01.298884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.299369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.299800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.300548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.301022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.301443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.657218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:01.666629 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3903b0fa-00ef-46d7-91fb-65d3c276949f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.519592 Oct 27 10:10:01.667227 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 309/599] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:01 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:01.671903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:01.672940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:01.678983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.679795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.680375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.681686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.682896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.683522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.771922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:01.780158 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e683856-6812-41da-a813-883f557152ce tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1462 microversion: 2.1 time: 0.493027 Oct 27 10:10:01.780744 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 291/600] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:01 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1462 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:01.785492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e614e9d7-33c8-41c8-a683-dee80a5c2e51 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:01.789288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e614e9d7-33c8-41c8-a683-dee80a5c2e51 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.790026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e614e9d7-33c8-41c8-a683-dee80a5c2e51 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.790676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e614e9d7-33c8-41c8-a683-dee80a5c2e51 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.791638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e614e9d7-33c8-41c8-a683-dee80a5c2e51 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.792346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e614e9d7-33c8-41c8-a683-dee80a5c2e51 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.793003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e614e9d7-33c8-41c8-a683-dee80a5c2e51 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.822708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e614e9d7-33c8-41c8-a683-dee80a5c2e51 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.040589 Oct 27 10:10:01.823312 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 292/601] 10.222.0.76 () {60 vars in 1217 bytes} [Thu Oct 27 10:10:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:10:01.829206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:01.830086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:01.836645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.837168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.837643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:01.838341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:01.838790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:01.839217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:02.008818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:02.030543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:02.032869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:02.034374 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c897a823-10ad-4880-9d0f-998520e465c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.365752 Oct 27 10:10:02.035327 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 310/602] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:01 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:02.040789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:02.041603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:02.045119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:02.049581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:02.050542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:02.051194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:02.052047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:02.052687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:02.053301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:02.184756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:02.199821 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5d3a2e42-7621-4fdb-8279-90070cd6c15a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1258 microversion: 2.1 time: 0.162211 Oct 27 10:10:02.201207 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 311/603] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:02 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:02.207810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:02.208778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:02.217828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:02.219300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:02.219792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:02.221059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:02.223139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:02.223648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:02.239896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:02.257251 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01920d7f-6930-4a65-bea6-c0661158dce5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1471 microversion: 2.1 time: 0.428622 Oct 27 10:10:02.258192 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 293/604] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:01 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1471 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:02.267417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1545929030", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c03eeed8-34c3-4fcb-b086-570b834451c3"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:02.289116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lazy-loading 'flavor' on Instance uuid 6348df04-190c-4588-a3e2-40f1b1e0f753 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:02.368308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:10:02.397633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:02.687789 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3af2d207-99de-4ced-98fd-24c13a44cd52 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "POST /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753/action" status: 202 len: 0 microversion: 2.91 time: 0.485057 Oct 27 10:10:02.690132 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 312/605] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:10:02 2022] POST /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:10:02.702568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:02.705748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:02.726114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:02.726889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:02.727548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:02.728490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:02.729177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:02.729805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.018298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:03.030466 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0e67459-f4ce-41d0-b84a-63bc1164e337 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1367 microversion: 2.1 time: 0.338647 Oct 27 10:10:03.031431 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 313/606] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:02 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:03.049694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9f6f0022-4175-4910-bcc6-caf8853660e8 req-429adf15-e79c-4549-899a-e235e56e5aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be88582-e288-4713-bdbb-c7771e2af40b", "name": "network-vif-plugged", "status": "completed", "tag": "85249995-24f5-4745-9051-333609fd2ea1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:03.085157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9f6f0022-4175-4910-bcc6-caf8853660e8 req-429adf15-e79c-4549-899a-e235e56e5aa9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.085948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9f6f0022-4175-4910-bcc6-caf8853660e8 req-429adf15-e79c-4549-899a-e235e56e5aa9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.086599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9f6f0022-4175-4910-bcc6-caf8853660e8 req-429adf15-e79c-4549-899a-e235e56e5aa9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.103940 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9f6f0022-4175-4910-bcc6-caf8853660e8 req-429adf15-e79c-4549-899a-e235e56e5aa9 service nova] Creating event network-vif-plugged:85249995-24f5-4745-9051-333609fd2ea1 for instance 1be88582-e288-4713-bdbb-c7771e2af40b on n-h2-854663-10 Oct 27 10:10:03.111703 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9f6f0022-4175-4910-bcc6-caf8853660e8 req-429adf15-e79c-4549-899a-e235e56e5aa9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068973 Oct 27 10:10:03.116175 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 314/607] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:03.123177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:03.123903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:03.137261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:10:03.138377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:10:03.139085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:10:03.139713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:10:03.140316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:10:03.144386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.145594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.146376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.147896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.148551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.149211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.161615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.162094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.162526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.163253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.163705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.164183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.184591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Getting quotas for project 8830099ef30d4bb28259b6763cb4f3b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:10:03.190825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Getting quotas for user a65debf5e54e4030a0ab162671bd03a5 and project 8830099ef30d4bb28259b6763cb4f3b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:10:03.205598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:10:03.208587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:10:03.263334 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08df241a-fea1-4237-b4d6-2ef4aac984e3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003933 Oct 27 10:10:03.266459 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 294/608] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:10:03.272446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:03.273571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:03.282132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.282964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.283648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.284649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.285393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.286030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.582069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:03.597355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:03.601667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:03.615501 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd50340c-2fd7-4057-a908-23dcc624f594 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.347697 Oct 27 10:10:03.617605 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 295/609] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:03 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:03.626287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:03.631976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:03.647410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.651101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.651740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.654810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.655497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.660762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.692962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:03.704205 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0119797f-bfb8-43eb-bfe5-23d5bc446381 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.586303 Oct 27 10:10:03.709661 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 315/610] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:03 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:03.719427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:03.730988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:03.760425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.760968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.761415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.762210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.762663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.763087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.918556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:03.931064 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ca62497-62d5-4b89-8294-a829732ceefa tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1320 microversion: 2.1 time: 0.219926 Oct 27 10:10:03.947120 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 316/611] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:03 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:03.961838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:03.962708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:03.976197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.978241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.978763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:03.980549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:03.981815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:03.984265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.112092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:04.123298 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7ccf937f-907e-4fa6-a66a-72f7b0da1477 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1218 microversion: 2.1 time: 0.174831 Oct 27 10:10:04.123894 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 317/612] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:03 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:04.138651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:04.141734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:04.156212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.171050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:04.174118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.174582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.179388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.179876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.180820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.183648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:04.186579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:04.193020 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9980e1e-54d2-4ed4-bad4-32c3d3e43fa5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1361 microversion: 2.25 time: 0.574155 Oct 27 10:10:04.193934 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 296/613] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:03 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1361 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:04.206287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:04.207435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:04.220083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.220978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.221698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.222825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.231051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.231833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.242850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:04.668219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:04.679293 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b5b07c9-7eeb-4681-b618-c1f52d748f87 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.548209 Oct 27 10:10:04.679890 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 318/614] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:04 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:04.702977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:04.707740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:04.714278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.715007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.715658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.716540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.717172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.717747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.783935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:04.818982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:04.828050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:04.829816 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab7315dc-0513-46a5-a3b7-f798cb02c097 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1367 microversion: 2.1 time: 0.634336 Oct 27 10:10:04.830083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:04.830407 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 297/615] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:04 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1367 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:04.836217 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac3b18f5-8c2e-44a9-93eb-0674c0e66dd9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.137054 Oct 27 10:10:04.837276 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 319/616] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:04 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:04.854980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:04.858272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:04.866309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.867048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.867812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.868783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.869323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.869831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.959801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:04.960944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:04.976326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.977029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.977474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:04.981797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:04.982282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:04.985710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:05.483986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:05.494549 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-79b33c8f-7a8c-4980-bc53-428b8e2ac268 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1320 microversion: 2.1 time: 0.538624 Oct 27 10:10:05.496153 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 320/617] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:04 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:05.501872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1b10a1e8-e9e8-4da6-abe6-a681f999e1c5 req-e5629c7e-78f1-4d61-9ac4-cc362cf146c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d33774-5dae-4e3e-8ebe-25d783fd65c8", "name": "network-vif-plugged", "status": "completed", "tag": "409267d5-e4ab-444d-9925-abd53434f4dc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:05.530812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1b10a1e8-e9e8-4da6-abe6-a681f999e1c5 req-e5629c7e-78f1-4d61-9ac4-cc362cf146c6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:05.531497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1b10a1e8-e9e8-4da6-abe6-a681f999e1c5 req-e5629c7e-78f1-4d61-9ac4-cc362cf146c6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:05.532724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1b10a1e8-e9e8-4da6-abe6-a681f999e1c5 req-e5629c7e-78f1-4d61-9ac4-cc362cf146c6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:05.549621 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1b10a1e8-e9e8-4da6-abe6-a681f999e1c5 req-e5629c7e-78f1-4d61-9ac4-cc362cf146c6 service nova] Creating event network-vif-plugged:409267d5-e4ab-444d-9925-abd53434f4dc for instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 on n-h2-854663-10 Oct 27 10:10:05.562728 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1b10a1e8-e9e8-4da6-abe6-a681f999e1c5 req-e5629c7e-78f1-4d61-9ac4-cc362cf146c6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065101 Oct 27 10:10:05.564079 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 321/618] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:05.572173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:05.573652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:05.582950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:05.583717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:05.584944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:05.586448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:05.587398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:05.589873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:05.729703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:05.739450 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-380f2f78-d812-4b41-8272-9efea4042c57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.888198 Oct 27 10:10:05.743349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:05.748823 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 298/619] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:04 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:05.762306 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce11909d-bb6b-4807-bb8d-a25c3ff69ef5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1266 microversion: 2.1 time: 0.196451 Oct 27 10:10:05.762564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:05.765786 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 322/620] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:05 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:05.769487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:05.777037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:05.777807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:05.778464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:05.779777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:05.780434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:05.781087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:05.782760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:05.783449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:05.794161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:05.799226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:05.799446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:05.800639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:05.801476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:05.802067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:06.163951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:06.178919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:06.180974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:06.182676 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99d4dd06-3044-4347-8b73-072749678555 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1557 microversion: 2.25 time: 0.432567 Oct 27 10:10:06.184409 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 299/621] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:05 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1557 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:06.192821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:06.194793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:06.209384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:06.211149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:06.212196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:06.214167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:06.215249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:06.216037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:06.282473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:06.292943 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7407d2cd-f8bf-49a4-93cc-435ad9b76b6b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.525847 Oct 27 10:10:06.294529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 323/622] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:05 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:06.304847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:06.305654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:06.317137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:06.319458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:06.320415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:06.321433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:06.322041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:06.323426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:06.548103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:06.584413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:06.590407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:06.616775 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fda064d5-bfbe-48f4-aa62-97a096377247 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.316919 Oct 27 10:10:06.618020 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 324/623] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:06 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:06.646050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:06.662474 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-112c8911-1fd9-4c10-ba49-944916c1c441 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1367 microversion: 2.1 time: 0.476383 Oct 27 10:10:06.682750 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 300/624] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:06 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1367 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:06.691675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:06.692317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:06.718920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:06.719413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:06.719857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:06.726578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:06.729250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:06.729737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:06.964154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:06.964787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:06.970792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:06.971270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:06.971771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:06.972746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:06.973571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:06.974208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:07.011307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:07.021514 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc6eda0f-577e-493e-9dd8-77e3d8a961fe tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1388 microversion: 2.1 time: 0.336272 Oct 27 10:10:07.022815 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 301/625] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:06 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1388 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:07.028434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:07.030131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:07.038239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:07.039013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:07.039554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:07.040288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:07.043188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:07.044369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:07.061177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:07.398037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:07.424406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 1be88582-e288-4713-bdbb-c7771e2af40b {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:07.429557 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6366727-0a6c-4433-922d-369addf5998c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1310 microversion: 2.1 time: 0.401753 Oct 27 10:10:07.431191 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 302/626] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:07 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1310 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:07.448003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:07.449491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:07.466650 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-229b172a-15d7-4fc8-b8fd-198210a6ed7f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 2051 microversion: 2.25 time: 0.845005 Oct 27 10:10:07.472218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:07.473674 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 325/627] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:06 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 2051 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:07.498215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:07.504653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:07.505704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:07.506505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:07.507156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:07.508002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:07.511165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:07.522128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:07.522720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:07.523455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:07.524306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:07.524860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:07.525342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:07.665024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:07.680831 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-947f2e1b-9afb-488b-8ec3-6aafa8a0a962 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1272 microversion: 2.1 time: 0.246794 Oct 27 10:10:07.682242 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 303/628] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:07 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:07.688549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:07.689347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:07.697050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:07.714093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:07.714866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:07.715611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:07.716507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:07.718601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:07.719208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:08.006115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:08.014601 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0da2837c-4ca8-41e0-85cf-5008b6eb37e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.519179 Oct 27 10:10:08.025060 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 326/629] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:07 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:08.037084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-63c6c80f-eda5-453f-bf62-9ab2ee74c67e req-38985a4d-d6af-4c93-ae5f-6555e63bba0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a159ce32-162c-4abe-a82d-98d52c1b4a1d", "name": "network-vif-plugged", "status": "completed", "tag": "ae097714-3d62-4de8-b685-b4fd4c106f2c"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:08.050369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-63c6c80f-eda5-453f-bf62-9ab2ee74c67e req-38985a4d-d6af-4c93-ae5f-6555e63bba0a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:08.051163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-63c6c80f-eda5-453f-bf62-9ab2ee74c67e req-38985a4d-d6af-4c93-ae5f-6555e63bba0a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:08.051791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-63c6c80f-eda5-453f-bf62-9ab2ee74c67e req-38985a4d-d6af-4c93-ae5f-6555e63bba0a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:08.065850 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-63c6c80f-eda5-453f-bf62-9ab2ee74c67e req-38985a4d-d6af-4c93-ae5f-6555e63bba0a service nova] Creating event network-vif-plugged:ae097714-3d62-4de8-b685-b4fd4c106f2c for instance a159ce32-162c-4abe-a82d-98d52c1b4a1d on n-h2-854663-10 Oct 27 10:10:08.071343 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-63c6c80f-eda5-453f-bf62-9ab2ee74c67e req-38985a4d-d6af-4c93-ae5f-6555e63bba0a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044708 Oct 27 10:10:08.072500 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 327/630] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:08.078384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:08.079339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:08.086993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:08.087691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:08.088302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:08.089392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:08.089996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:08.091222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:08.252282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:08.264475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:08.266440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:08.273488 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ddb2bb10-5fcf-4154-acb7-7aea71baab93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.199599 Oct 27 10:10:08.274670 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 328/631] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:08 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:08.283542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 1be88582-e288-4713-bdbb-c7771e2af40b {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:08.283813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:08.284789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:08.292064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:08.292882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:08.293778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:08.294646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:08.295419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:08.295995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:08.388421 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddd4abc1-2b5f-4ef3-a82d-6e05ad562f66 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 2051 microversion: 2.25 time: 0.704407 Oct 27 10:10:08.389837 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 304/632] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:07 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 2051 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:08.411089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:08.415049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:08.426186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:08.427923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:08.427923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:08.428844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:08.429962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:08.430548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:08.993282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:09.013464 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31c50707-c029-49fb-9b4c-431ab4cac812 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1367 microversion: 2.1 time: 0.736340 Oct 27 10:10:09.016529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 329/633] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:08 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1367 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:09.029841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0206077b-d58e-4a22-9f6b-b92360e527ca tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:09.036934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0206077b-d58e-4a22-9f6b-b92360e527ca tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.038685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0206077b-d58e-4a22-9f6b-b92360e527ca tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.039308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0206077b-d58e-4a22-9f6b-b92360e527ca tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.042441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0206077b-d58e-4a22-9f6b-b92360e527ca tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.043104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0206077b-d58e-4a22-9f6b-b92360e527ca tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.043756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0206077b-d58e-4a22-9f6b-b92360e527ca tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.096304 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0206077b-d58e-4a22-9f6b-b92360e527ca tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.075454 Oct 27 10:10:09.115383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:09.120911 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 330/634] 10.222.0.76 () {60 vars in 1217 bytes} [Thu Oct 27 10:10:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:10:09.139462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:09.140890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:09.149031 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76a3e6e8-8f02-4fba-a6cc-454cb3dec06b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1388 microversion: 2.1 time: 0.757796 Oct 27 10:10:09.149714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.150356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.150857 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 305/635] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:08 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1388 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:09.150981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.152534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.153079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.153600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.170322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:09.171032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:09.181404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.182007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.183247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.184200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.184760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.185251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.646523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:09.657741 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a859d3a-0bd5-4e84-b8e6-d7dada8a3cb6 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1314 microversion: 2.1 time: 0.504771 Oct 27 10:10:09.658340 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 306/636] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:09 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:09.663201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:09.667256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1ac436ae-cf57-4754-bbb0-d1e0aac7b7c2 req-fa521aab-24f5-49e3-9a0b-3a7586b339ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ee331c-acfa-4bdb-abeb-8145043083a5", "tag": "bdcb63e0-5ead-464c-99d6-20cb557a74a4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:09.683620 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b5273d8-bf72-4795-b8eb-b7abc8658ccf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1493 microversion: 2.1 time: 0.558731 Oct 27 10:10:09.684412 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 331/637] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:09 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1493 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:09.697353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1ac436ae-cf57-4754-bbb0-d1e0aac7b7c2 req-fa521aab-24f5-49e3-9a0b-3a7586b339ab service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.697353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1ac436ae-cf57-4754-bbb0-d1e0aac7b7c2 req-fa521aab-24f5-49e3-9a0b-3a7586b339ab service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.697353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1ac436ae-cf57-4754-bbb0-d1e0aac7b7c2 req-fa521aab-24f5-49e3-9a0b-3a7586b339ab service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.713995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:09.714902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:09.721330 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1ac436ae-cf57-4754-bbb0-d1e0aac7b7c2 req-fa521aab-24f5-49e3-9a0b-3a7586b339ab service nova] Creating event network-changed:bdcb63e0-5ead-464c-99d6-20cb557a74a4 for instance f4ee331c-acfa-4bdb-abeb-8145043083a5 on n-h2-854663-10 Oct 27 10:10:09.722778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.723390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.723850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.724551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.729096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.729936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.757137 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1ac436ae-cf57-4754-bbb0-d1e0aac7b7c2 req-fa521aab-24f5-49e3-9a0b-3a7586b339ab service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085691 Oct 27 10:10:09.758133 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 307/638] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:09.766702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854663-10", "block_migration": "auto"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:09.772814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:09.787567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.792206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.792767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.793496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:09.793965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:09.794389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:09.864912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'flavor' on Instance uuid 1be88582-e288-4713-bdbb-c7771e2af40b {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:09.886775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Going to try to live migrate instance to n-h1-854663-10 {{(pid=120720) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:10:10.733797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:10.753568 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-711830d7-4b57-4a72-bb61-e537aa8babcd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 1.053422 Oct 27 10:10:10.757387 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 332/639] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:09 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:10.762362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:10.780492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:10.795136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:10.795903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:10.796598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:10.797556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:10.798264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:10.798894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:11.196797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:11.213312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:11.219566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:11.243543 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd8668d2-55b3-4516-bea6-05d75d625b02 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.484776 Oct 27 10:10:11.248214 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 333/640] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:10 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:11.528069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d76f65af-96b1-439c-9aff-af952ebfeecc tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:11.529377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d76f65af-96b1-439c-9aff-af952ebfeecc tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:11.541910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d76f65af-96b1-439c-9aff-af952ebfeecc tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:11.544294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d76f65af-96b1-439c-9aff-af952ebfeecc tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:11.544932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d76f65af-96b1-439c-9aff-af952ebfeecc tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:11.546545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d76f65af-96b1-439c-9aff-af952ebfeecc tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:11.548605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d76f65af-96b1-439c-9aff-af952ebfeecc tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:11.549262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d76f65af-96b1-439c-9aff-af952ebfeecc tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:11.799603 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d76f65af-96b1-439c-9aff-af952ebfeecc tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1646 microversion: 2.1 time: 0.546820 Oct 27 10:10:11.800276 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 334/641] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:11 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1646 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:11.808155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:11.808906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:11.837731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:11.838227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:11.838670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:11.839383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:11.839835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:11.840257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:12.196135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:12.208001 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a48fa49b-0df3-46f3-bc99-7373e169bc1e tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1557 microversion: 2.1 time: 0.404548 Oct 27 10:10:12.208989 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 335/642] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:11 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1557 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:12.240318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:12.241976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:12.256276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:12.257213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:12.258075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:12.259173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:12.260057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:12.260645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:12.289682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:12.644241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:12.656912 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-585ddc95-6cf6-4d28-bb55-4bf5688e828e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1388 microversion: 2.1 time: 0.426427 Oct 27 10:10:12.658256 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 336/643] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:12 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1388 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:12.665342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:12.666176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:12.686851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:12.690482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:12.693044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:12.693978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:12.694619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:12.699188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.163622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:13.172100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:13.177438 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5637f4a6-382c-495c-bf46-7b25c1b9f375 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1314 microversion: 2.1 time: 0.515665 Oct 27 10:10:13.178319 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 337/644] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:12 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:13.189245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:13.191967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:13.200268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=26 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:13.209635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.212910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.213459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.214742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.218281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.219708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.438609 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed760bcd-f6e6-42d1-8ab8-9b832911d277 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b/action" status: 202 len: 0 microversion: 2.25 time: 3.679143 Oct 27 10:10:13.439217 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 308/645] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:10:09 2022] POST /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b/action => generated 0 bytes in 3681 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:10:13.444408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6304e9c0-2da7-492e-99ba-e961f8f5c483 req-e1ef7b28-fee2-4660-a00b-04ae043d464d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2196499d-7e04-436d-958d-2b28ec88e019", "tag": "d1cf58cf-c5f0-468c-a2eb-124be532ebd7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:13.454497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6304e9c0-2da7-492e-99ba-e961f8f5c483 req-e1ef7b28-fee2-4660-a00b-04ae043d464d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.455086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6304e9c0-2da7-492e-99ba-e961f8f5c483 req-e1ef7b28-fee2-4660-a00b-04ae043d464d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.455753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6304e9c0-2da7-492e-99ba-e961f8f5c483 req-e1ef7b28-fee2-4660-a00b-04ae043d464d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.468559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6304e9c0-2da7-492e-99ba-e961f8f5c483 req-e1ef7b28-fee2-4660-a00b-04ae043d464d service nova] Creating event network-changed:d1cf58cf-c5f0-468c-a2eb-124be532ebd7 for instance 2196499d-7e04-436d-958d-2b28ec88e019 on n-h2-854663-10 Oct 27 10:10:13.474000 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6304e9c0-2da7-492e-99ba-e961f8f5c483 req-e1ef7b28-fee2-4660-a00b-04ae043d464d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033413 Oct 27 10:10:13.475178 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 309/646] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:13.480914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e5be677-5dc6-40b4-a2c1-f4fa1c591c2f tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:13.481987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e5be677-5dc6-40b4-a2c1-f4fa1c591c2f tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:13.489476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e5be677-5dc6-40b4-a2c1-f4fa1c591c2f tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.490235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e5be677-5dc6-40b4-a2c1-f4fa1c591c2f tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.490849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e5be677-5dc6-40b4-a2c1-f4fa1c591c2f tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.491714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e5be677-5dc6-40b4-a2c1-f4fa1c591c2f tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.492312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e5be677-5dc6-40b4-a2c1-f4fa1c591c2f tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.492967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e5be677-5dc6-40b4-a2c1-f4fa1c591c2f tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.605545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:13.621705 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-98bbbdb3-23d6-4788-bee0-d66bd6f7b3dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.442055 Oct 27 10:10:13.622960 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 338/647] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:13 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:13.630567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e0d6d25-632e-4f64-8cca-eca06ba52512 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:13.631931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e0d6d25-632e-4f64-8cca-eca06ba52512 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:13.643550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e0d6d25-632e-4f64-8cca-eca06ba52512 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.645532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e0d6d25-632e-4f64-8cca-eca06ba52512 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.646180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e0d6d25-632e-4f64-8cca-eca06ba52512 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.647259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e0d6d25-632e-4f64-8cca-eca06ba52512 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.648017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e0d6d25-632e-4f64-8cca-eca06ba52512 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.648694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e0d6d25-632e-4f64-8cca-eca06ba52512 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.830736 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e0d6d25-632e-4f64-8cca-eca06ba52512 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206573 Oct 27 10:10:13.833038 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 339/648] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:10:13 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:13.838269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:13.839109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:13.846541 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e5be677-5dc6-40b4-a2c1-f4fa1c591c2f tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1646 microversion: 2.1 time: 0.369781 Oct 27 10:10:13.847501 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 310/649] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:13 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1646 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:13.853043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:13.853872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:13.857859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.858646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.859315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.867247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.868090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.870996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.877780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.881215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.881932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:13.893899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:13.894736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:13.895444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.358683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:14.368900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:14.371189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:14.376728 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5612c7bd-3fcb-49e8-89cd-b4fab90bdc13 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.542430 Oct 27 10:10:14.377911 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 340/650] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:13 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:14.383183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:14.383977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:14.390322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.390997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.391580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.392435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.393061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.393653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.579837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:14.593504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:14.595508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:14.597104 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42b9932f-05b1-42c7-adc2-d6dbcd833b99 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1567 microversion: 2.25 time: 0.748466 Oct 27 10:10:14.598188 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 311/651] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:13 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1567 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:14.603501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a7bbe15c-c544-47b6-97b1-14192af1cab6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:14.609317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7bbe15c-c544-47b6-97b1-14192af1cab6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.611121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7bbe15c-c544-47b6-97b1-14192af1cab6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.611723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7bbe15c-c544-47b6-97b1-14192af1cab6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.612916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7bbe15c-c544-47b6-97b1-14192af1cab6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.613828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7bbe15c-c544-47b6-97b1-14192af1cab6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.614409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7bbe15c-c544-47b6-97b1-14192af1cab6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.644948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:14.655817 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a7bbe15c-c544-47b6-97b1-14192af1cab6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.056223 Oct 27 10:10:14.656216 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c35abbe2-cc16-4228-b99d-a9d19a338821 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1388 microversion: 2.1 time: 0.276263 Oct 27 10:10:14.656950 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 312/652] 10.222.0.76 () {58 vars in 1176 bytes} [Thu Oct 27 10:10:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:14.669006 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 341/653] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:14 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1388 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:14.669006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:14.669006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:14.674130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.675108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.675672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.676789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.677501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.677755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:14.678385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.678744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:14.686045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.686966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.687561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.688701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.689318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.689918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.895563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:14.909386 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50ccc7d5-bf26-4e59-8885-edebf90222af tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.248681 Oct 27 10:10:14.912004 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 342/654] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:14 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:14.918237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854663-10", "block_migration": true, "disk_over_commit": false}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:14.926898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:14.935739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:14.941792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.942680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.944117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.944232 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a2438d1-a09a-422b-9dce-063dacd0c3d0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1314 microversion: 2.1 time: 0.285655 Oct 27 10:10:14.944948 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 313/655] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:14 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:14.949461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:14.950147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:14.950844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:14.978973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lazy-loading 'flavor' on Instance uuid e8d33774-5dae-4e3e-8ebe-25d783fd65c8 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:14.993484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Going to try to live migrate instance to n-h1-854663-10 {{(pid=120719) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:10:15.413190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:15.414224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:15.424604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:15.425853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:15.426531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:15.427654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:15.428961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:15.429895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:15.537947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:15.548964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:15.551762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:15.557778 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b93ad1fb-dcaa-4e90-b78f-d179ce64d4b9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.152371 Oct 27 10:10:15.559030 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 314/656] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:15 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:15.625087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:15.627654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:15.638983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:15.639836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:15.641361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:15.642313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:15.642790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:15.643285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:15.813446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:15.878579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:15.880138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:15.882523 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf4721fc-def8-47aa-8b82-bd1cc7232a60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1567 microversion: 2.25 time: 0.261758 Oct 27 10:10:15.885436 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 315/657] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:15 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:15.890886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:15.891515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:15.902022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:15.902522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:15.903591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:15.904689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:15.905146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:15.905571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:16.133188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:16.145825 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9ab70ab-a723-4aad-bfe2-59f21abb75a3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1388 microversion: 2.1 time: 0.259101 Oct 27 10:10:16.161666 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 316/658] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:15 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1388 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:16.175067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:16.176371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:16.187745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:16.188571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:16.189231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:16.191560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:16.192437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:16.193401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:16.568328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:16.581710 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21838699-3f09-4d1c-a513-b11eb562e90b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.416094 Oct 27 10:10:16.582593 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 317/659] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:16 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:16.595154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:16.595772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:16.625649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:16.626293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:16.630239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:16.631421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:16.631895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:16.632323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:16.680631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:16.923183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:16.936234 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e6730f5-df7e-4640-9b25-79a1f55a28ee tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1314 microversion: 2.1 time: 0.352714 Oct 27 10:10:16.937607 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 318/660] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:16 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:16.946728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:16.948004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:16.954838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:16.956026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:16.956779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:16.957915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:16.958567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:16.958986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:17.222102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:17.238877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:17.242591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:17.255092 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-695e9362-5558-47f7-bc5d-e9dedd537f26 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.316018 Oct 27 10:10:17.256481 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 319/661] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:16 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:17.262295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-16abbd34-2271-4ad8-99d0-3d07a951d1b9 req-018094a3-16bb-44e1-a03d-0196b397c068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a159ce32-162c-4abe-a82d-98d52c1b4a1d", "tag": "ae097714-3d62-4de8-b685-b4fd4c106f2c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:17.280012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-16abbd34-2271-4ad8-99d0-3d07a951d1b9 req-018094a3-16bb-44e1-a03d-0196b397c068 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:17.282378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-16abbd34-2271-4ad8-99d0-3d07a951d1b9 req-018094a3-16bb-44e1-a03d-0196b397c068 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:17.284067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-16abbd34-2271-4ad8-99d0-3d07a951d1b9 req-018094a3-16bb-44e1-a03d-0196b397c068 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:17.309533 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-16abbd34-2271-4ad8-99d0-3d07a951d1b9 req-018094a3-16bb-44e1-a03d-0196b397c068 service nova] Creating event network-changed:ae097714-3d62-4de8-b685-b4fd4c106f2c for instance a159ce32-162c-4abe-a82d-98d52c1b4a1d on n-h2-854663-10 Oct 27 10:10:17.326732 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-16abbd34-2271-4ad8-99d0-3d07a951d1b9 req-018094a3-16bb-44e1-a03d-0196b397c068 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068661 Oct 27 10:10:17.327364 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 320/662] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:17.351026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:17.352246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:17.370348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:17.382992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:17.385412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:17.388316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:17.389141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:17.389991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:17.685390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:17.699532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:17.701403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:17.702824 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6069dc19-c27e-4e2e-9642-553f0589fc0e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1557 microversion: 2.25 time: 0.374370 Oct 27 10:10:17.704034 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 321/663] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:17 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1557 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:17.715825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:17.718064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:17.732861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:17.733275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:17.733710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:17.734415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:17.734868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:17.735286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:18.034284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:18.054329 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4f8455a-a67d-4b6c-95dc-5a26a76843cc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1388 microversion: 2.1 time: 0.347980 Oct 27 10:10:18.057967 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 322/664] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:17 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1388 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:18.070392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:18.072464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:18.086830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:18.088255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:18.088957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:18.093396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:18.094579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:18.095244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:18.637779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:18.647302 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-122af6bc-3a47-43dd-90e8-14bfa7f89bb5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.588031 Oct 27 10:10:18.651569 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 323/665] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:18 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:18.662688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a62142d-c3b3-4cde-a332-200d5ad628b4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '.version_select at 0x7f6d5bafa8b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:18.666646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a62142d-c3b3-4cde-a332-200d5ad628b4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:18.669130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a62142d-c3b3-4cde-a332-200d5ad628b4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:18.671863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a62142d-c3b3-4cde-a332-200d5ad628b4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:18.699649 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a62142d-c3b3-4cde-a332-200d5ad628b4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 1665 microversion: 2.25 time: 0.046630 Oct 27 10:10:18.710387 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 324/666] 10.222.0.76 () {60 vars in 1184 bytes} [Thu Oct 27 10:10:18 2022] GET /compute/v2.1/os-migrations => generated 1665 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:18.710387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:18.718809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:18.732100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:18.732755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:18.733257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:18.739204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:18.739814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:18.740416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:18.996488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:19.005075 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b38d79ed-a916-467a-87b0-9947c15988b2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1314 microversion: 2.1 time: 0.300570 Oct 27 10:10:19.014218 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 325/667] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:18 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:19.020017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:19.020274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:19.037054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.037479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.037914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.038642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.039087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.039500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.064166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:19.107972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-98b4ecad-aaa5-4aa1-9660-60806b7d4d9c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8/action" status: 202 len: 0 microversion: 2.1 time: 4.194564 Oct 27 10:10:19.109643 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 343/668] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:10:14 2022] POST /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8/action => generated 0 bytes in 4197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:10:19.118089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:19.119290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:19.135747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.136853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.137809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.138901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.139782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.141012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.177081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:19.223340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:19.224875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:19.251901 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff6abfc2-6d72-48b5-849e-78d5a1a97e1f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.233323 Oct 27 10:10:19.275224 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 326/669] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:19 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:19.294522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:19.295127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:19.341569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.343081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.364775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.365654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.366140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.366577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.434422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 1be88582-e288-4713-bdbb-c7771e2af40b {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:19.461465 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-03edd8ff-32e0-4913-a9ad-839f3d8f9931 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 2051 microversion: 2.25 time: 0.350483 Oct 27 10:10:19.487357 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 344/670] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:19 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 2051 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:19.514851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:19.515366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:19.529159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.532184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.532958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.533909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.536212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.537836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.776367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:19.790664 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-abad9124-de01-464a-a5d3-71be60c23c8f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1388 microversion: 2.1 time: 0.512878 Oct 27 10:10:19.791806 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 327/671] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:19 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1388 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:19.811475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:19.812121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:19.821780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.822270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.822702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.823413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:19.823866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:19.824288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:19.860348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:19.871454 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-28e2eff3-ac50-4db8-9792-86937cb053fa tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1503 microversion: 2.1 time: 0.371970 Oct 27 10:10:19.873706 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 345/672] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:19 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:19.884966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1145649508", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "50cb7bc6-6235-4029-9fd6-9407e53e51ed"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:19.982172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] validate_networks() for [('50cb7bc6-6235-4029-9fd6-9407e53e51ed', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:10:20.131674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:20.155467 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b62bf07a-4913-4c93-afcb-ee4f82dae6e0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.362234 Oct 27 10:10:20.156083 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 328/673] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:19 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:20.183219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:20.188822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:20.208442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:20.208988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:20.209426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:20.210627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:20.211083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:20.211509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:20.534283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:20.543300 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-93115969-89e1-41b4-a616-c50748c8fbfa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1314 microversion: 2.1 time: 0.367935 Oct 27 10:10:20.557228 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 329/674] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:20 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:20.566158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:20.567031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:20.574763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:20.575553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:20.576198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:20.577161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:20.577832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:20.578699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:20.682519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:20.698074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:20.699780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:20.705698 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-044f6837-5ad3-460f-b474-1c4e5611842d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.146908 Oct 27 10:10:20.706571 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 330/675] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:20 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:20.813991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:20.814700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:20.818759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:10:20.819917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:10:20.820616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:10:20.821198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:10:20.821925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:10:20.826485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:20.826984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:20.827420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:20.828150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:20.828589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:20.830575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:20.835793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:20.836533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:20.837171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:20.838071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:20.838882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:20.839644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:20.864250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for project 8e2d013afa6544b3972160d82f111127. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:10:20.874023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for user dd2f7b7849014a6bae41317a3e68426e and project 8e2d013afa6544b3972160d82f111127. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:10:20.905203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:10:20.907825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:10:21.002269 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0872e85d-7378-472f-b234-583df5353684 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.127191 Oct 27 10:10:21.006818 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 346/676] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:10:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:10:21.016622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:21.018287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:21.022033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:21.027184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:21.027821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:21.028260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:21.029350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:21.029806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:21.030224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:21.053192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:21.065654 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29c2aa03-73b4-44c2-9503-407f69eb3d3a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1388 microversion: 2.1 time: 0.252912 Oct 27 10:10:21.066821 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 331/677] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:20 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1388 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:21.085058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-fa623b4c-6630-49fa-9c7c-6ffedcde4a9b req-b05c864b-9d44-49c5-890f-47df13270bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ee331c-acfa-4bdb-abeb-8145043083a5", "name": "network-vif-plugged", "status": "completed", "tag": "bdcb63e0-5ead-464c-99d6-20cb557a74a4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:21.102191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa623b4c-6630-49fa-9c7c-6ffedcde4a9b req-b05c864b-9d44-49c5-890f-47df13270bca service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:21.103019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa623b4c-6630-49fa-9c7c-6ffedcde4a9b req-b05c864b-9d44-49c5-890f-47df13270bca service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:21.103609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa623b4c-6630-49fa-9c7c-6ffedcde4a9b req-b05c864b-9d44-49c5-890f-47df13270bca service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:21.121850 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-fa623b4c-6630-49fa-9c7c-6ffedcde4a9b req-b05c864b-9d44-49c5-890f-47df13270bca service nova] Creating event network-vif-plugged:bdcb63e0-5ead-464c-99d6-20cb557a74a4 for instance f4ee331c-acfa-4bdb-abeb-8145043083a5 on n-h2-854663-10 Oct 27 10:10:21.129269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-fa623b4c-6630-49fa-9c7c-6ffedcde4a9b req-b05c864b-9d44-49c5-890f-47df13270bca service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061108 Oct 27 10:10:21.130406 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 332/678] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:21.136563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a2c9ac-e3d0-45e1-b799-1d08b9a387c2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:21.137290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48a2c9ac-e3d0-45e1-b799-1d08b9a387c2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:21.239858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48a2c9ac-e3d0-45e1-b799-1d08b9a387c2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:21.261756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48a2c9ac-e3d0-45e1-b799-1d08b9a387c2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:21.263864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48a2c9ac-e3d0-45e1-b799-1d08b9a387c2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:21.265560 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48a2c9ac-e3d0-45e1-b799-1d08b9a387c2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1262 microversion: 2.25 time: 0.133550 Oct 27 10:10:21.268049 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 333/679] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:21 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1262 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:21.274109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:21.274898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:21.282514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:21.283154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:21.283798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:21.284645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:21.285287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:21.286161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:21.331671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:21.341719 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95307443-cdd1-412b-8151-eecaf1f08f57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1503 microversion: 2.1 time: 0.329356 Oct 27 10:10:21.342465 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 347/680] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:21 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:21.493803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:21.503976 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-146e83c0-e9fa-455a-aa3f-ab4239052a3a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.233443 Oct 27 10:10:21.505091 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 334/681] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:21 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:21.569924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:21.570948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:21.577508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:21.578105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:21.578431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:21.579209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:21.579659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:21.580078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:21.735120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:21.735938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:21.747519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:21.748124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:21.748554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:21.749354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:21.749799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:21.750214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:21.973864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:21.984552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:21.990185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:22.017670 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-904ce90a-be6e-437e-9874-6a3f845cb60f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.283484 Oct 27 10:10:22.018494 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 335/682] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:21 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:22.091408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:22.092490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:22.102379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:22.103467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:22.104098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:22.106157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:22.107266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:22.108089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:22.112512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:22.122081 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b272970-9709-4833-9366-84eb139e8aac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1314 microversion: 2.1 time: 0.555979 Oct 27 10:10:22.123182 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 348/683] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:21 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:22.295806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:22.296407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:22.303691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:22.304167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:22.304596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:22.305315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:22.305913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:22.306523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:22.400588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:22.407518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:22.410765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:22.412563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:22.413883 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-936b65be-070f-4639-8a5c-93468ec113e0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1314 microversion: 2.25 time: 0.122328 Oct 27 10:10:22.414629 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 349/684] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:22 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1314 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:10:22.420471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:22.421293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:22.428248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:22.428986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:22.429697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:22.430561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:22.431150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:22.431712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:22.450112 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6bb0e818-b687-4123-a283-6b558602703e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1388 microversion: 2.1 time: 0.365102 Oct 27 10:10:22.451639 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 336/685] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:22 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1388 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:22.527611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:22.528506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:22.536715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:22.537642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:22.538211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:22.539101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:22.539699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:22.540865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:22.773933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:22.786889 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-de82e643-1b85-4750-b837-0e9285bc365c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1503 microversion: 2.1 time: 0.370653 Oct 27 10:10:22.801050 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 350/686] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:22 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1503 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:22.995679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:23.007199 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74b2edb6-ffa5-4ba9-9caa-673c0afaeb64 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.483421 Oct 27 10:10:23.027059 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 337/687] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:22 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:23.049612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:23.050470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:23.069061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.069766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.070379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.072192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.073228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.073817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.146631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:23.147442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:23.156586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.157282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.157883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.158640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.159642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.160106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.166960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:23.190570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:23.194342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:23.201813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:23.203354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:23.209531 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a39c2f88-e4a1-4071-892f-11e7ee65e527 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.165901 Oct 27 10:10:23.210416 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 351/688] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:23 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:23.215052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-dde1c908-e6d4-40f3-8379-f2230177e4aa req-cadb3a88-6540-4d06-9b10-976b9918e70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2196499d-7e04-436d-958d-2b28ec88e019", "name": "network-vif-plugged", "status": "completed", "tag": "d1cf58cf-c5f0-468c-a2eb-124be532ebd7"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:23.225501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dde1c908-e6d4-40f3-8379-f2230177e4aa req-cadb3a88-6540-4d06-9b10-976b9918e70d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.226262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dde1c908-e6d4-40f3-8379-f2230177e4aa req-cadb3a88-6540-4d06-9b10-976b9918e70d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.226841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dde1c908-e6d4-40f3-8379-f2230177e4aa req-cadb3a88-6540-4d06-9b10-976b9918e70d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.250612 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-dde1c908-e6d4-40f3-8379-f2230177e4aa req-cadb3a88-6540-4d06-9b10-976b9918e70d service nova] Creating event network-vif-plugged:d1cf58cf-c5f0-468c-a2eb-124be532ebd7 for instance 2196499d-7e04-436d-958d-2b28ec88e019 on n-h2-854663-10 Oct 27 10:10:23.257838 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-dde1c908-e6d4-40f3-8379-f2230177e4aa req-cadb3a88-6540-4d06-9b10-976b9918e70d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046057 Oct 27 10:10:23.260980 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 352/689] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:23.441859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:23.445014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:23.446628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:23.453993 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1dbecd6e-1c34-4e57-80b5-60bb5fe36350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1314 microversion: 2.1 time: 0.312035 Oct 27 10:10:23.458672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.459166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.459626 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 338/690] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:23 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:23.459741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.460394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.460883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.461307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.480965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:23.481598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:23.488578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.489079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.489510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.490234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.490681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.491096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.615421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:23.626233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:23.627872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:23.629240 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d32d6335-bcf2-40f0-8bb1-294634f5132a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1314 microversion: 2.25 time: 0.191230 Oct 27 10:10:23.630861 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 353/691] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:23 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:23.796210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:23.804851 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-290a55c8-d882-4f49-aef9-e0326122b2fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1587 microversion: 2.1 time: 0.328305 Oct 27 10:10:23.805416 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 339/692] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:23 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1587 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:23.819631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:23.820366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:23.827042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.827564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e71a1a8d-1e0a-4e54-b7fe-6129202ad29f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:23.827687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.828039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e71a1a8d-1e0a-4e54-b7fe-6129202ad29f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:23.828202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.829207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.829730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.830342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.834626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71a1a8d-1e0a-4e54-b7fe-6129202ad29f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.835108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71a1a8d-1e0a-4e54-b7fe-6129202ad29f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.835538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71a1a8d-1e0a-4e54-b7fe-6129202ad29f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.836223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71a1a8d-1e0a-4e54-b7fe-6129202ad29f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:23.836690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71a1a8d-1e0a-4e54-b7fe-6129202ad29f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:23.837221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71a1a8d-1e0a-4e54-b7fe-6129202ad29f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:23.995899 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e71a1a8d-1e0a-4e54-b7fe-6129202ad29f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172062 Oct 27 10:10:24.004216 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 340/693] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:10:23 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:24.035588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:24.036165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:24.043122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.043885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.044373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.045113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.045561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.045980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.175294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:24.183811 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae6cc227-12e4-4ae9-a0d4-74ee1cb05cf3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1493 microversion: 2.1 time: 0.368299 Oct 27 10:10:24.184474 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 354/694] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:23 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1493 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:24.208918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-37d08397-bcb2-4be8-b00f-6d458594fa87 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '.version_select at 0x7f6d5ba9c9d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:24.213215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37d08397-bcb2-4be8-b00f-6d458594fa87 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.213808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37d08397-bcb2-4be8-b00f-6d458594fa87 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.214465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37d08397-bcb2-4be8-b00f-6d458594fa87 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.224176 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-37d08397-bcb2-4be8-b00f-6d458594fa87 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 1580 microversion: 2.1 time: 0.019459 Oct 27 10:10:24.234999 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 355/695] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:10:24 2022] GET /compute/v2.1/os-migrations => generated 1580 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:24.242154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f56c5aa-8024-4a60-86a6-297d97bdd213 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:24.243338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f56c5aa-8024-4a60-86a6-297d97bdd213 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:24.249820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f56c5aa-8024-4a60-86a6-297d97bdd213 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.250621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f56c5aa-8024-4a60-86a6-297d97bdd213 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.251330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f56c5aa-8024-4a60-86a6-297d97bdd213 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.252498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f56c5aa-8024-4a60-86a6-297d97bdd213 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.253490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f56c5aa-8024-4a60-86a6-297d97bdd213 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.254135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f56c5aa-8024-4a60-86a6-297d97bdd213 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.630941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:24.767069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:24.776696 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b44b24e3-5eef-41b6-b078-cd1e35c59dae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.745220 Oct 27 10:10:24.777266 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 341/696] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:24 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:24.782723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:24.783562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:24.790289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.791239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.791895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.792893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.793555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.794202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.912220 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f56c5aa-8024-4a60-86a6-297d97bdd213 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1646 microversion: 2.1 time: 0.675631 Oct 27 10:10:24.915244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:24.925275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:24.928044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:24.929816 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 356/697] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:24 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1646 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:24.933557 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e0525be-2761-4740-82b9-65336373e2d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.154990 Oct 27 10:10:24.934401 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 342/698] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:24 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:24.938190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:24.939005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:24.941639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:24.942483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:24.949484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.950375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.951059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.952037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.953008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.953812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.962509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.965146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.965864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:24.973689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:24.974542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:24.975200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:25.142135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:25.151934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:25.155129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:25.156458 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-849135b6-1c9e-4aed-b64d-10cd7d87b382 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1320 microversion: 2.25 time: 0.219390 Oct 27 10:10:25.157426 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 343/699] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:24 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:25.165375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:25.166055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:25.172509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:25.173092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:25.173618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:25.174474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:25.174988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:25.175918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:25.354260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:25.363141 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c63ce96-3bbc-48df-9414-e48dd597e4ed tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1314 microversion: 2.1 time: 0.431904 Oct 27 10:10:25.366699 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 357/700] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:24 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:25.370936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9c0a0193-6bc1-4856-9f08-980cd3c17a2b req-22b3abe3-561d-469e-ba86-2ba9d59af226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ee331c-acfa-4bdb-abeb-8145043083a5", "tag": "bdcb63e0-5ead-464c-99d6-20cb557a74a4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:25.382509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9c0a0193-6bc1-4856-9f08-980cd3c17a2b req-22b3abe3-561d-469e-ba86-2ba9d59af226 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:25.383464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9c0a0193-6bc1-4856-9f08-980cd3c17a2b req-22b3abe3-561d-469e-ba86-2ba9d59af226 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:25.384152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9c0a0193-6bc1-4856-9f08-980cd3c17a2b req-22b3abe3-561d-469e-ba86-2ba9d59af226 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:25.396191 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9c0a0193-6bc1-4856-9f08-980cd3c17a2b req-22b3abe3-561d-469e-ba86-2ba9d59af226 service nova] Creating event network-changed:bdcb63e0-5ead-464c-99d6-20cb557a74a4 for instance f4ee331c-acfa-4bdb-abeb-8145043083a5 on n-h2-854663-10 Oct 27 10:10:25.403411 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9c0a0193-6bc1-4856-9f08-980cd3c17a2b req-22b3abe3-561d-469e-ba86-2ba9d59af226 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036831 Oct 27 10:10:25.404680 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 358/701] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:25.413797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1889574367", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "f584544f-ec56-4541-905d-7537ec4732b5"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:25.473707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] validate_networks() for [('f584544f-ec56-4541-905d-7537ec4732b5', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:10:25.542623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:25.551249 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-892da718-70ae-49af-806c-6e09262f06e2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 200 len: 1587 microversion: 2.1 time: 0.391239 Oct 27 10:10:25.552130 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 344/702] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:25 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 1587 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:25.807901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:25.808424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:25.817667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:25.818459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:25.819292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:25.820016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:25.826119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:25.827038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:26.392930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:26.407724 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01f1ccb0-1be2-4198-82d5-59e170bec701 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.603913 Oct 27 10:10:26.423328 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 345/703] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:25 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:26.428731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:26.429703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:26.435629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:26.437323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:26.438190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:26.438837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:26.439861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:26.440705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:26.441337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:26.892269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:26.903072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:26.905571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:26.911873 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be0c5ce7-819f-4f8b-acd0-f4e50a1c940f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.487027 Oct 27 10:10:26.912790 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 346/704] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:26 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:26.918404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:26.919231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:26.925840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:26.926611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:26.927281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:26.928201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:26.928896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:26.931357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:27.183520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:10:27.183995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:10:27.184373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:10:27.184819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:10:27.185234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:10:27.201014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:27.201475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:27.201882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:27.202605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:27.203308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:27.203794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:27.222258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:10:27.227333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for user 5db106c72e8745de8266a3ab7a5fe531 and project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:10:27.240247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:10:27.242845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:10:27.296629 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d2c7394d-314d-4821-8e1f-e5dfd7aea0d0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.887970 Oct 27 10:10:27.297918 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 359/705] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:10:27.303296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:27.304158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:27.312949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:27.313747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:27.314384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:27.315419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:27.315981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:27.316406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:27.471784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:27.482268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:27.483889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:27.485250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f66f631-0286-4695-a22a-b65e4fd2fa7b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.571035 Oct 27 10:10:27.485894 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 347/706] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:26 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:27.491593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13684079-1f3e-4011-8c7c-2df1f5641e87 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:27.492346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13684079-1f3e-4011-8c7c-2df1f5641e87 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:27.624027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13684079-1f3e-4011-8c7c-2df1f5641e87 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:27.633283 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13684079-1f3e-4011-8c7c-2df1f5641e87 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1211 microversion: 2.1 time: 0.146070 Oct 27 10:10:27.643816 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 348/707] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:27 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1211 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:27.652788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:27.653431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:27.660301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:27.660841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:27.661493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:27.662512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:27.663191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:27.663798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:27.719945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:27.728441 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f725fef2-ca32-4956-91a5-89a72591c0f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1464 microversion: 2.1 time: 0.429274 Oct 27 10:10:27.729580 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 360/708] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:27 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1464 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:27.899557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd4144f5-a6cc-4f18-aa15-463294442d4d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:27.925321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd4144f5-a6cc-4f18-aa15-463294442d4d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Searching by: {'deleted': False, 'project_id': '6146a01177194bd7b24f0ef4e9cdf8fb'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:10:27.936053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd4144f5-a6cc-4f18-aa15-463294442d4d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:27.936551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd4144f5-a6cc-4f18-aa15-463294442d4d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:27.937008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd4144f5-a6cc-4f18-aa15-463294442d4d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:27.938855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd4144f5-a6cc-4f18-aa15-463294442d4d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:27.939450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd4144f5-a6cc-4f18-aa15-463294442d4d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:27.939902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd4144f5-a6cc-4f18-aa15-463294442d4d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:28.050315 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd4144f5-a6cc-4f18-aa15-463294442d4d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.300886 Oct 27 10:10:28.051201 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 361/709] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:10:27 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:10:28.056533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:28.057167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:28.063092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:28.063841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:28.064338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:28.065714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:28.066219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:28.066640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:28.194925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:28.203718 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56670712-d343-4706-ae9c-1692a399b331 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.556065 Oct 27 10:10:28.203877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:28.204510 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 349/710] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:27 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:28.224993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:28.233505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:28.235134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:28.246004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Searching by: {'deleted': False} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:10:28.253934 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76a0e9b5-e35c-4b51-95bb-40bced52c834 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.200523 Oct 27 10:10:28.255588 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 362/711] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:28 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:28.257730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:28.258441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:28.259124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:28.260114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:28.260783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:28.261428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:28.405643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:10:28.510944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:28.511980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:28.521122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:28.524494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:28.525240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:28.527705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:28.530003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:28.531076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:28.568799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:28.569289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:28.570739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:28.873347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:28.897107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:28.902447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:28.907342 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b895f5f8-2008-42f4-af71-95dc4cd14c13 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.399299 Oct 27 10:10:28.928447 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 363/712] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:28 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:10:28.934673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:28.935604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:28.956375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:28.957740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:28.959578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:28.961258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:28.966856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:28.967642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.079704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:29.097669 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8309c82d-4a5b-49a8-8e01-7592ea3f2849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1263 microversion: 2.1 time: 0.167912 Oct 27 10:10:29.098477 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 364/713] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:28 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:29.225469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-aa25f7a8-81f8-45e2-8865-e817e20a0746 req-019bbd2f-45c5-4de4-856a-ca34709240fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f892e7c-e0d0-47f8-a486-fdfbfc1fd264", "tag": "7937b0d8-fb5a-48f7-870e-5a6a3ddc6866"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:29.235963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aa25f7a8-81f8-45e2-8865-e817e20a0746 req-019bbd2f-45c5-4de4-856a-ca34709240fa service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.236997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aa25f7a8-81f8-45e2-8865-e817e20a0746 req-019bbd2f-45c5-4de4-856a-ca34709240fa service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.237672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aa25f7a8-81f8-45e2-8865-e817e20a0746 req-019bbd2f-45c5-4de4-856a-ca34709240fa service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.251249 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-aa25f7a8-81f8-45e2-8865-e817e20a0746 req-019bbd2f-45c5-4de4-856a-ca34709240fa service nova] Creating event network-changed:7937b0d8-fb5a-48f7-870e-5a6a3ddc6866 for instance 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 on n-h2-854663-10 Oct 27 10:10:29.257442 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-aa25f7a8-81f8-45e2-8865-e817e20a0746 req-019bbd2f-45c5-4de4-856a-ca34709240fa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035712 Oct 27 10:10:29.258612 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 365/714] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:10:29.267068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:29.269910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:29.297103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.297616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.298047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.300879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.300879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.300879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.369563 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9752e28-a274-4340-8fcc-234608b1a1ee tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19343 microversion: 2.1 time: 1.150757 Oct 27 10:10:29.370891 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 350/715] 10.222.0.76 () {58 vars in 1171 bytes} [Thu Oct 27 10:10:28 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19343 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:10:29.376637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:29.377663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:29.387833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.388651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.389595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.393340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.393845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.394290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.590658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:29.601765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:29.603543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:29.609170 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dbc74034-6fc2-4c44-8444-f2ae8463ca5c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.236608 Oct 27 10:10:29.610276 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 351/716] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:29 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:29.615135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d06be0be-6015-414e-935f-634390d2326e tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:29.620420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d06be0be-6015-414e-935f-634390d2326e tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Searching by: {'deleted': False, 'project_id': '6146a01177194bd7b24f0ef4e9cdf8fb'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:10:29.635429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d06be0be-6015-414e-935f-634390d2326e tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.636051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d06be0be-6015-414e-935f-634390d2326e tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.636546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d06be0be-6015-414e-935f-634390d2326e tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.637879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d06be0be-6015-414e-935f-634390d2326e tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.639995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d06be0be-6015-414e-935f-634390d2326e tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.640487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d06be0be-6015-414e-935f-634390d2326e tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.738404 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d06be0be-6015-414e-935f-634390d2326e tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/detail?tenant_id=8830099ef30d4bb28259b6763cb4f3b4" status: 200 len: 15 microversion: 2.1 time: 0.126827 Oct 27 10:10:29.739327 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 352/717] 10.222.0.76 () {58 vars in 1231 bytes} [Thu Oct 27 10:10:29 2022] GET /compute/v2.1/servers/detail?tenant_id=8830099ef30d4bb28259b6763cb4f3b4 => generated 15 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:10:29.763253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:29.770614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Searching by: {'tenant_id': '8830099ef30d4bb28259b6763cb4f3b4', 'deleted': False} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:10:29.776148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.776757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.777217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.777909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.778716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.779139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:29.812161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:10:29.927760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:29.929231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:29.929775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.115338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:30.146809 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d922bcc0-a09b-4c01-8de4-5a8d55bc34fe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.886626 Oct 27 10:10:30.169444 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 366/718] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:29 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:30.194759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:30.196633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:30.217892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.219400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.222468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.226071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.229255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.230248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.448473 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9478801d-013c-4035-8dd0-f0909fdb57b9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8830099ef30d4bb28259b6763cb4f3b4" status: 200 len: 4832 microversion: 2.1 time: 0.689914 Oct 27 10:10:30.450135 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 353/719] 10.222.0.76 () {58 vars in 1257 bytes} [Thu Oct 27 10:10:29 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8830099ef30d4bb28259b6763cb4f3b4 => generated 4832 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:30.468902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:30.470962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:30.486670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.488509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.489209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.491274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.491988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.493381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.679665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:30.691184 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-231989b0-7769-460c-8494-2d5877e155a2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1269 microversion: 2.1 time: 0.239685 Oct 27 10:10:30.691942 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 354/720] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:30 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1269 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:30.696616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15b188f7-efbc-4e75-9601-02f871207469 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:30.697224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:30.705785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15b188f7-efbc-4e75-9601-02f871207469 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Searching by: {'tenant_id': '6146a01177194bd7b24f0ef4e9cdf8fb', 'deleted': False} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:10:30.706454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:30.708135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:30.709405 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-85f5159c-217a-442d-9833-0d048ab5f2b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.538219 Oct 27 10:10:30.712148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15b188f7-efbc-4e75-9601-02f871207469 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.712625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15b188f7-efbc-4e75-9601-02f871207469 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.713256 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 367/721] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:30 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:30.713521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15b188f7-efbc-4e75-9601-02f871207469 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.714451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15b188f7-efbc-4e75-9601-02f871207469 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.715053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15b188f7-efbc-4e75-9601-02f871207469 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.715623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15b188f7-efbc-4e75-9601-02f871207469 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.731276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:30.731999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:30.748092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.748698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.749195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.750052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.750570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.751060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.756793 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15b188f7-efbc-4e75-9601-02f871207469 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6146a01177194bd7b24f0ef4e9cdf8fb" status: 200 len: 15 microversion: 2.1 time: 0.063424 Oct 27 10:10:30.769329 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 355/722] 10.222.0.76 () {58 vars in 1257 bytes} [Thu Oct 27 10:10:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6146a01177194bd7b24f0ef4e9cdf8fb => generated 15 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:10:30.782901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8407f72-2a9c-4e3b-949b-2b77cdd74174 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:30.789761 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8407f72-2a9c-4e3b-949b-2b77cdd74174 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011600 Oct 27 10:10:30.790317 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 356/723] 10.222.0.76 () {58 vars in 1189 bytes} [Thu Oct 27 10:10:30 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 10:10:30.813446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35d017c7-af52-46ab-bf67-0a5002bfabf9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:30.816433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-35d017c7-af52-46ab-bf67-0a5002bfabf9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:30.844517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35d017c7-af52-46ab-bf67-0a5002bfabf9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.845201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35d017c7-af52-46ab-bf67-0a5002bfabf9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.846049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35d017c7-af52-46ab-bf67-0a5002bfabf9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.847172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35d017c7-af52-46ab-bf67-0a5002bfabf9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.848063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35d017c7-af52-46ab-bf67-0a5002bfabf9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.848741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35d017c7-af52-46ab-bf67-0a5002bfabf9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.855864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:30.878237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:30.890512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:30.892811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:30.899156 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-176bba5e-7953-48c9-b184-3493b90657e5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.184826 Oct 27 10:10:30.899750 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 368/724] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:30 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:30.963463 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35d017c7-af52-46ab-bf67-0a5002bfabf9 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action" status: 202 len: 0 microversion: 2.1 time: 0.153637 Oct 27 10:10:30.964288 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 357/725] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:10:30 2022] POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:10:30.973045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:30.978377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:30.979133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:10:30.986246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.986780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.987273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:30.987948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:30.988398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:30.988965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.080005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:10:31.172119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:31.173221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:31.181808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.182700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.182842 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a16e0270-f6d7-4614-af9c-a967235254bc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.213991 Oct 27 10:10:31.183475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.185151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.185828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.186469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.191876 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 369/726] 10.222.0.76 () {58 vars in 1150 bytes} [Thu Oct 27 10:10:30 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:31.200769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3a580a7d-85fa-419c-bbfe-6c8a40590dc7 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:31.207936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3a580a7d-85fa-419c-bbfe-6c8a40590dc7 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:31.216205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a580a7d-85fa-419c-bbfe-6c8a40590dc7 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.216934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a580a7d-85fa-419c-bbfe-6c8a40590dc7 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.217557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a580a7d-85fa-419c-bbfe-6c8a40590dc7 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.218423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a580a7d-85fa-419c-bbfe-6c8a40590dc7 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.218875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a580a7d-85fa-419c-bbfe-6c8a40590dc7 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.219299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a580a7d-85fa-419c-bbfe-6c8a40590dc7 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.310987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:31.323281 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3a580a7d-85fa-419c-bbfe-6c8a40590dc7 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action" status: 202 len: 0 microversion: 2.1 time: 0.130118 Oct 27 10:10:31.323952 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 370/727] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:10:31 2022] POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:10:31.331964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b49ff88c-84df-49e7-84df-aa59e5877677 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:31.332578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b49ff88c-84df-49e7-84df-aa59e5877677 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:31.340322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b49ff88c-84df-49e7-84df-aa59e5877677 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.341184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b49ff88c-84df-49e7-84df-aa59e5877677 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.341791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b49ff88c-84df-49e7-84df-aa59e5877677 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.342643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b49ff88c-84df-49e7-84df-aa59e5877677 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.343400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b49ff88c-84df-49e7-84df-aa59e5877677 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.343976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b49ff88c-84df-49e7-84df-aa59e5877677 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.540181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:31.549618 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cee19159-4adc-433c-9a39-5546dfc3355f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.382233 Oct 27 10:10:31.550242 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 358/728] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:31 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:31.674571 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b49ff88c-84df-49e7-84df-aa59e5877677 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1615 microversion: 2.1 time: 0.346338 Oct 27 10:10:31.696578 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 371/729] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:31 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1615 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:31.705360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ea4cd61-fc9d-48ce-8b75-c85746480ca0 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:31.706003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ea4cd61-fc9d-48ce-8b75-c85746480ca0 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:31.728969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ea4cd61-fc9d-48ce-8b75-c85746480ca0 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.729476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:31.730091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:31.730546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ea4cd61-fc9d-48ce-8b75-c85746480ca0 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.730997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ea4cd61-fc9d-48ce-8b75-c85746480ca0 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.734135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ea4cd61-fc9d-48ce-8b75-c85746480ca0 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.736056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ea4cd61-fc9d-48ce-8b75-c85746480ca0 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.736776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ea4cd61-fc9d-48ce-8b75-c85746480ca0 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.756006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.758197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.758953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:31.760009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:31.760690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:31.761264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.001338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:32.012630 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ea4cd61-fc9d-48ce-8b75-c85746480ca0 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1615 microversion: 2.1 time: 0.315001 Oct 27 10:10:32.014712 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-27ef61c6-488d-4932-b576-4875042802b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.294719 Oct 27 10:10:32.025192 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 372/730] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:31 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:32.025381 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 359/731] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:31 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1615 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:32.034109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:32.034735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:32.037124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:32.037967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:32.043498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.043993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.044952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.045671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.045781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.046152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.046301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.046580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.047146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.047935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.048553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.049152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.148416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:32.158712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:32.160151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:32.165382 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-621eb5a7-29ad-4204-b8cc-0574f5da3828 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.138919 Oct 27 10:10:32.181846 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 360/732] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:32 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:32.186784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:32.193314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Searching by: {'host': 'n-h2-854663-10', 'deleted': False} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:10:32.199631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.200159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.200585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.201339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.201806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.202225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.214953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:32.224324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:32.225815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:32.227081 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-48079c4b-1f54-4fef-adad-60a7ff2ce13e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.200312 Oct 27 10:10:32.241500 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 373/733] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:32 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:32.300731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:10:32.362328 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ab566e9-be8e-4a8a-b88d-ccd3781dc959 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers?host=n-h2-854663-10&all_tenants=1" status: 200 len: 3632 microversion: 2.1 time: 0.179259 Oct 27 10:10:32.363355 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 361/734] 10.222.0.76 () {58 vars in 1192 bytes} [Thu Oct 27 10:10:32 2022] GET /compute/v2.1/servers?host=n-h2-854663-10&all_tenants=1 => generated 3632 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:32.378539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67a2a7ee-09b4-457a-94a7-40ae013f9d75 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:32.384850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67a2a7ee-09b4-457a-94a7-40ae013f9d75 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:10:32.389751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a2a7ee-09b4-457a-94a7-40ae013f9d75 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.390219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a2a7ee-09b4-457a-94a7-40ae013f9d75 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.390641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a2a7ee-09b4-457a-94a7-40ae013f9d75 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.391349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a2a7ee-09b4-457a-94a7-40ae013f9d75 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.391786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a2a7ee-09b4-457a-94a7-40ae013f9d75 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.392375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a2a7ee-09b4-457a-94a7-40ae013f9d75 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.491439 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67a2a7ee-09b4-457a-94a7-40ae013f9d75 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.117151 Oct 27 10:10:32.492092 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 374/735] 10.222.0.76 () {58 vars in 1196 bytes} [Thu Oct 27 10:10:32 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:10:32.504595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03deb09f-4e97-4761-a68a-d3de4d24068b tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:32.506867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03deb09f-4e97-4761-a68a-d3de4d24068b tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:32.513541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03deb09f-4e97-4761-a68a-d3de4d24068b tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.514025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03deb09f-4e97-4761-a68a-d3de4d24068b tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.514450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03deb09f-4e97-4761-a68a-d3de4d24068b tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.515232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03deb09f-4e97-4761-a68a-d3de4d24068b tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.515579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03deb09f-4e97-4761-a68a-d3de4d24068b tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.515988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03deb09f-4e97-4761-a68a-d3de4d24068b tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.573306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:32.574107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:32.583374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.584082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.584691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.585560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.586148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.586726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.616626 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03deb09f-4e97-4761-a68a-d3de4d24068b tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action" status: 202 len: 0 microversion: 2.1 time: 0.115825 Oct 27 10:10:32.618096 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 362/736] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:10:32 2022] POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:10:32.629686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:32.632958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:32.641902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.642457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.643604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.643834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.644145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.644768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.737539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:32.739960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:10:32.740685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:10:32.741390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:10:32.741901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:10:32.742471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:10:32.745642 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e3158c6-0206-4668-90b5-b183a2e4aae1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.176325 Oct 27 10:10:32.746551 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 375/737] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:32 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:32.809413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:32.815903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.816438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.816903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.817604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.818190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.818613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.846552 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44538e9b-f94f-443d-9392-0ac939a05f05 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action" status: 202 len: 1066 microversion: 2.1 time: 0.222253 Oct 27 10:10:32.847693 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 363/738] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:10:32 2022] POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action => generated 1066 bytes in 226 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 10:10:32.869695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:32.870546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:32.876861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.877338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.877766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:32.878519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:32.879146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:32.879566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:33.018169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:33.026418 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e372f07-7dc0-416b-9ac7-4b62cd8050ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.162742 Oct 27 10:10:33.026989 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 376/739] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:32 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:33.040813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:33.040813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:33.047095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:33.047703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:33.048157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:33.048956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:33.049400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:33.049812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:33.183274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:33.191584 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ba4c6be-f238-4600-98a3-bb7f25186a17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.156481 Oct 27 10:10:33.192161 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 364/740] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:33 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:33.197745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:33.198349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:33.205019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:33.205493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:33.205921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:33.206618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:33.207085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:33.207500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:33.254077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:33.254769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:33.261895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:33.262447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:33.262947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:33.263858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:33.264386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:33.264932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:33.279860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:33.289345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:33.291008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:33.297303 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-efac0308-89c7-4cd2-9af5-f3a9fb972775 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.103624 Oct 27 10:10:33.313247 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 377/741] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:33 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:33.401760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:33.412113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:33.413612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:33.414746 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-162396ba-b221-4239-a44c-4e037c2a1e97 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.164823 Oct 27 10:10:33.415330 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 365/742] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:33 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:10:33.469841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e942543-c3e7-498c-a778-2612f378cf27 tempest-NetworksTest-135081489 tempest-NetworksTest-135081489-project-admin] Calling method '.version_select at 0x7f6d5ba1cdc0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:33.600688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e942543-c3e7-498c-a778-2612f378cf27 tempest-NetworksTest-135081489 tempest-NetworksTest-135081489-project-admin] 10.222.0.76 "GET /compute/v2.1/os-networks" status: 200 len: 7439 microversion: 2.1 time: 0.259900 Oct 27 10:10:33.601301 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 378/743] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:10:33 2022] GET /compute/v2.1/os-networks => generated 7439 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:33.609686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47ce4903-9d57-4869-94bf-98a7358352c3 tempest-NetworksTest-135081489 tempest-NetworksTest-135081489-project-admin] Calling method '.version_select at 0x7f6d5be160d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:33.740911 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47ce4903-9d57-4869-94bf-98a7358352c3 tempest-NetworksTest-135081489 tempest-NetworksTest-135081489-project-admin] 10.222.0.76 "GET /compute/v2.1/os-networks/1f5b69b3-b392-4769-acea-e0cfb8d1d3ed" status: 200 len: 652 microversion: 2.1 time: 0.134728 Oct 27 10:10:33.741531 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 366/744] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:10:33 2022] GET /compute/v2.1/os-networks/1f5b69b3-b392-4769-acea-e0cfb8d1d3ed => generated 652 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:33.750871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3685a6a3-afee-42db-9b03-c201040c26e6 tempest-NetworksTest-135081489 tempest-NetworksTest-135081489-project-admin] Calling method '.version_select at 0x7f6d5b68ed30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:33.769770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:33.770477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:33.776888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:33.777376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:33.777879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:33.778829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:33.779280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:33.779696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:34.307367 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3685a6a3-afee-42db-9b03-c201040c26e6 tempest-NetworksTest-135081489 tempest-NetworksTest-135081489-project-admin] 10.222.0.76 "GET /compute/v2.1/os-networks" status: 200 len: 7439 microversion: 2.1 time: 0.560163 Oct 27 10:10:34.316478 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 379/745] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:10:33 2022] GET /compute/v2.1/os-networks => generated 7439 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:34.322958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:34.324576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:34.337293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:34.337860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:34.338466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:34.339348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:34.339957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:34.340547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:34.369665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:34.387723 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6bf34dba-721f-4dad-81b6-f30c3552a5fd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.621474 Oct 27 10:10:34.389419 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 367/746] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:33 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:34.394639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:34.396701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:34.407702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:34.408206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:34.408641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:34.413244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:34.413244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:34.413244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:34.653804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:34.666818 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b608bb09-3f93-4b69-83f0-f3a3909133c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.348314 Oct 27 10:10:34.668849 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 380/747] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:34 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:34.687998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:34.689656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:34.708475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:34.709513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:34.709998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:34.710413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:34.711283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:34.711722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:34.712299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:34.718845 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-883f143f-293d-43cc-8f15-4e52ca21567b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.328674 Oct 27 10:10:34.724009 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 368/748] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:34 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:34.741974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:34.742694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:34.750917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:34.751556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:34.752374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:34.753438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:34.755750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:34.756878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:34.785524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:34.821682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:34.832922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:34.834772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:34.841359 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-737ce5f7-2e48-4f3c-b534-b38f79a7b8a8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1558 microversion: 2.91 time: 0.163108 Oct 27 10:10:34.842413 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 381/749] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:34 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:35.041288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:35.056022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:35.059002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:35.062975 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f34eeb0-b904-4abc-98bb-bdac3efa6e34 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.342501 Oct 27 10:10:35.065632 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 369/750] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:34 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:35.255453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-87a2abea-1a87-4d26-bd23-e8b551d2c79f req-87941c50-56bd-42db-876b-88a10475e365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbcd2b3d-58b7-4b23-81b1-b055a3366dea", "tag": "f4524ae2-f0ff-40b9-bc49-e05a0706b1e0"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:35.266105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-87a2abea-1a87-4d26-bd23-e8b551d2c79f req-87941c50-56bd-42db-876b-88a10475e365 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:35.266660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-87a2abea-1a87-4d26-bd23-e8b551d2c79f req-87941c50-56bd-42db-876b-88a10475e365 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:35.267217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-87a2abea-1a87-4d26-bd23-e8b551d2c79f req-87941c50-56bd-42db-876b-88a10475e365 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:35.278683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-87a2abea-1a87-4d26-bd23-e8b551d2c79f req-87941c50-56bd-42db-876b-88a10475e365 service nova] Creating event network-changed:f4524ae2-f0ff-40b9-bc49-e05a0706b1e0 for instance fbcd2b3d-58b7-4b23-81b1-b055a3366dea on n-h2-854663-10 Oct 27 10:10:35.283610 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-87a2abea-1a87-4d26-bd23-e8b551d2c79f req-87941c50-56bd-42db-876b-88a10475e365 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033767 Oct 27 10:10:35.284305 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 382/751] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:10:35.411445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:35.412059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:35.418571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:35.419305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:35.419698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:35.420452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:35.420988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:35.421497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:35.559529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:35.568033 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-767ef5a1-da02-4897-9222-f7fe36916b7f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.160528 Oct 27 10:10:35.568611 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 370/752] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:35 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:35.694044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:35.694745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:35.701036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:35.701515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:35.701945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:35.702639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:35.703082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:35.703497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:35.743071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:35.744387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:35.751581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:35.752113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:35.752809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:35.753513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:35.754079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:35.754499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:35.900426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:35.909587 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-446776dc-0774-419d-b829-3a0880e449f8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.220735 Oct 27 10:10:35.910337 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 383/753] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:35 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:35.915133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:35.915721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:35.921888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:35.922547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:35.923143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:35.924131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:35.924868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:35.925631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:35.939436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:35.948514 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4674554f-60b6-47a1-a9f7-a2fe1ce70dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.209612 Oct 27 10:10:35.949222 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 371/754] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:35 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:36.009858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:36.018683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:36.020112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:36.025289 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc6800a9-4091-4292-96fa-06e556088895 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1558 microversion: 2.91 time: 0.113761 Oct 27 10:10:36.025867 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 384/755] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:35 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1558 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:36.092829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:36.093438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:36.099968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:36.101754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:36.102196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:36.102889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:36.103337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:36.103752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:36.242129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:36.250523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:36.252376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:36.253551 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd221ede-dbad-44c5-8cb3-fa0a6833df1a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.164708 Oct 27 10:10:36.254327 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 372/756] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:36 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:36.591736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:36.592351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:36.600012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:36.600790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:36.601409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:36.602295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:36.602897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:36.603651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:36.931544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:36.936612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:36.937259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:36.943239 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4caed436-10c2-4a1b-9638-208aef45371a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1476 microversion: 2.1 time: 0.355287 Oct 27 10:10:36.943981 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 385/757] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:36 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1476 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:36.958672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:36.959183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:36.959626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:36.960356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:36.963517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:36.964209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:36.973405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:36.974180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:36.980249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:36.981938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:36.982631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:36.983161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:36.984766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:36.985262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:36.986019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:37.234919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:37.438588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:37.444578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:37.447629 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c2683bc4-21f0-4f25-b150-c69bc1451855 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.518492 Oct 27 10:10:37.448901 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 373/758] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:36 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:37.464245 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afb039a3-8187-44e9-8a98-0e330a5d4529 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.495113 Oct 27 10:10:37.465290 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 386/759] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:36 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:37.468636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:37.470330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:37.470923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:37.471871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:37.480774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:37.481713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:37.482344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:37.483212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:37.483809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:37.484538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:37.486113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:37.486702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:37.487147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:37.487855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:37.488313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:37.488763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:37.697808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:37.709074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:37.710902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:37.719092 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9171b0eb-6aa3-4aa4-958b-9b51d322b064 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.268748 Oct 27 10:10:37.719673 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 374/760] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:37 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:37.835307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:37.849187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:37.853296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:37.855241 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-575ccc4a-0213-4441-9c93-9ca15747b2e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.388782 Oct 27 10:10:37.864967 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 387/761] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:37 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:37.891985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f94ac35-80c2-4ab3-baee-ae73ea7c17b1 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5bd624c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:37.971292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:37.972789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:37.975116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f94ac35-80c2-4ab3-baee-ae73ea7c17b1 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:37.976968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f94ac35-80c2-4ab3-baee-ae73ea7c17b1 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:37.977614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f94ac35-80c2-4ab3-baee-ae73ea7c17b1 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:37.979152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f94ac35-80c2-4ab3-baee-ae73ea7c17b1 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:37.979713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f94ac35-80c2-4ab3-baee-ae73ea7c17b1 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:37.980241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f94ac35-80c2-4ab3-baee-ae73ea7c17b1 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:37.980357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:37.980836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:37.981451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:37.982475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:37.983083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:37.983660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.060552 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f94ac35-80c2-4ab3-baee-ae73ea7c17b1 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/2b878a9dee924b6fb7c6ddbf90d0b78e" status: 200 len: 148 microversion: 2.57 time: 0.338725 Oct 27 10:10:38.067317 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 375/762] 10.222.0.76 () {62 vars in 1303 bytes} [Thu Oct 27 10:10:37 2022] PUT /compute/v2.1/os-quota-sets/2b878a9dee924b6fb7c6ddbf90d0b78e => generated 148 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:10:38.078315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e58b0eb3-c628-46a2-8b68-cc645ea582c9 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Calling method '.version_select at 0x7f6d5bafa670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:38.164097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58b0eb3-c628-46a2-8b68-cc645ea582c9 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.165527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58b0eb3-c628-46a2-8b68-cc645ea582c9 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.166143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58b0eb3-c628-46a2-8b68-cc645ea582c9 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.167056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58b0eb3-c628-46a2-8b68-cc645ea582c9 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.167733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58b0eb3-c628-46a2-8b68-cc645ea582c9 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.168154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58b0eb3-c628-46a2-8b68-cc645ea582c9 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.196893 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e58b0eb3-c628-46a2-8b68-cc645ea582c9 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/2b878a9dee924b6fb7c6ddbf90d0b78e/detail" status: 200 len: 463 microversion: 2.57 time: 0.128335 Oct 27 10:10:38.198453 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 376/763] 10.222.0.76 () {60 vars in 1304 bytes} [Thu Oct 27 10:10:38 2022] GET /compute/v2.1/os-quota-sets/2b878a9dee924b6fb7c6ddbf90d0b78e/detail => generated 463 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:10:38.207991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:38.216311 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-debb018a-2c22-4205-a34f-765f122e5c72 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1475 microversion: 2.1 time: 0.249051 Oct 27 10:10:38.237133 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 388/764] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:37 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1475 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:38.386602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Action: 'update', calling method: .version_select at 0x7f6d603195e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:38.464091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.464583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.465111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.465843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.466440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.466868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.473207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:38.474065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:38.483073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.487090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.489775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.490848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.493320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.493783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.524089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:38.565164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.565164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.565164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.565164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.565638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.566051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.643603 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b6aa189-2565-4dbd-bb18-8b75971d0f8d tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/2b878a9dee924b6fb7c6ddbf90d0b78e?user_id=4877c74122e84e5b8832398071c85490" status: 200 len: 148 microversion: 2.57 time: 0.261597 Oct 27 10:10:38.644776 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 377/765] 10.222.0.76 () {62 vars in 1384 bytes} [Thu Oct 27 10:10:38 2022] PUT /compute/v2.1/os-quota-sets/2b878a9dee924b6fb7c6ddbf90d0b78e?user_id=4877c74122e84e5b8832398071c85490 => generated 148 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:10:38.649337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:38.650674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:38.665102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.668333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.668824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.669571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.670538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.670970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.728400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:38.739701 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9da50dea-ab8f-4982-af59-b676152d7d5d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.270830 Oct 27 10:10:38.741513 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 389/766] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:38 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:38.755873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8bdd0e45-d08d-46ba-ae75-1a7ecb5806c0 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] Calling method '.version_select at 0x7f6d5b68edc0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:38.886824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:38.894495 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8bdd0e45-d08d-46ba-ae75-1a7ecb5806c0 tempest-QuotasAdminTestV257-518789217 tempest-QuotasAdminTestV257-518789217-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/2b878a9dee924b6fb7c6ddbf90d0b78e?user_id=4877c74122e84e5b8832398071c85490" status: 200 len: 190 microversion: 2.57 time: 0.151456 Oct 27 10:10:38.897094 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c1b4d40-3d58-47ee-b42f-780b34586d2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.251288 Oct 27 10:10:38.898772 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 390/768] 10.222.0.76 () {60 vars in 1364 bytes} [Thu Oct 27 10:10:38 2022] GET /compute/v2.1/os-quota-sets/2b878a9dee924b6fb7c6ddbf90d0b78e?user_id=4877c74122e84e5b8832398071c85490 => generated 190 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:10:38.899101 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 378/768] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:38 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:38.908813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c4d48f60-6e8e-4924-9660-96fac89b9fc9 req-64ae4a4d-7761-44a5-aa87-0b548c14c6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f892e7c-e0d0-47f8-a486-fdfbfc1fd264", "name": "network-vif-plugged", "status": "completed", "tag": "7937b0d8-fb5a-48f7-870e-5a6a3ddc6866"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:38.910354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:38.913767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:38.926670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.927626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.928303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.929277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.931528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c4d48f60-6e8e-4924-9660-96fac89b9fc9 req-64ae4a4d-7761-44a5-aa87-0b548c14c6a6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:38.932252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.932987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.936539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c4d48f60-6e8e-4924-9660-96fac89b9fc9 req-64ae4a4d-7761-44a5-aa87-0b548c14c6a6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:38.937420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c4d48f60-6e8e-4924-9660-96fac89b9fc9 req-64ae4a4d-7761-44a5-aa87-0b548c14c6a6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:38.957669 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c4d48f60-6e8e-4924-9660-96fac89b9fc9 req-64ae4a4d-7761-44a5-aa87-0b548c14c6a6 service nova] Creating event network-vif-plugged:7937b0d8-fb5a-48f7-870e-5a6a3ddc6866 for instance 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 on n-h2-854663-10 Oct 27 10:10:38.979635 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c4d48f60-6e8e-4924-9660-96fac89b9fc9 req-64ae4a4d-7761-44a5-aa87-0b548c14c6a6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074938 Oct 27 10:10:38.981410 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 379/769] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:38.996950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:38.997930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:39.005181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:39.005841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:39.006347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:39.007290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:39.007947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:39.008572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:39.053631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:39.056144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:39.076271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:39.086330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:39.112415 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9206c304-5a4c-457c-8e67-ff2e83f5b122 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.209578 Oct 27 10:10:39.128865 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 391/770] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:38 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:39.249363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:39.250149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:39.255573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:39.259243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:39.260395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:39.261463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:39.262547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:39.263159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:39.263736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:39.266699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:39.268409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:39.269689 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e25e473-623b-4cd2-ac86-8c1b9829c422 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.286979 Oct 27 10:10:39.280681 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 380/771] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:38 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:39.494711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:39.505489 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-604693c8-0498-4f2e-809d-aa28e38d674a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1475 microversion: 2.1 time: 0.261599 Oct 27 10:10:39.506643 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 392/772] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:39 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1475 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:39.763726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:39.764355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:39.777638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:39.779166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:39.780184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:39.781710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:39.784481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:39.786084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:39.922390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:39.923571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:39.934174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:39.935044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:39.936133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:39.937200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:39.937866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:39.938751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:39.955006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:39.964707 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b7e12e6-ff11-42a7-81d6-01343720884f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.205046 Oct 27 10:10:39.979628 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 381/773] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:39 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:40.115038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:40.128121 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72c9e140-8b8f-4833-b7f3-dad54ba6055e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.209538 Oct 27 10:10:40.146018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:40.146637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:40.146895 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 393/774] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:39 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:40.153402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:40.153680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:40.154120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:40.154901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:40.155342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:40.155938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:40.235388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:40.246471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:40.247937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:40.253935 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-103254a2-4885-446b-92d7-130011d37648 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.112441 Oct 27 10:10:40.254767 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 382/775] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:40 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:40.298365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:40.298978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:40.307900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:40.311346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:40.311857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:40.312601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:40.313088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:40.317386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:40.533488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:40.534455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:40.542216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:40.543246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:40.543684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:40.544390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:40.545085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:40.545694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:40.569382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:40.578344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:40.587061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:40.590630 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a38ff15a-5d31-43c1-84d2-be6b04b51d94 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.295882 Oct 27 10:10:40.591441 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 394/776] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:40 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:40.768565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:40.776623 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f86b0ca2-c573-4b8d-a810-80cfb98f1931 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1473 microversion: 2.1 time: 0.249417 Oct 27 10:10:40.778513 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 383/777] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:40 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1473 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:40.988651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:40.989361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:40.997703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:40.998601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:40.999263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.000182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.000894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.002006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-203a0eb8-264f-4135-9747-3cfd57c93559 req-77fe638d-3de2-4a9a-a5bf-f0d05160c35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b50483e-af66-4d8d-b553-e465cd1389e9", "name": "network-vif-unplugged", "status": "completed", "tag": "2e4bd57c-5519-4d76-a1db-9fe07d5d4d69"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:41.002561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.024241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-203a0eb8-264f-4135-9747-3cfd57c93559 req-77fe638d-3de2-4a9a-a5bf-f0d05160c35a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.025487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-203a0eb8-264f-4135-9747-3cfd57c93559 req-77fe638d-3de2-4a9a-a5bf-f0d05160c35a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.026626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-203a0eb8-264f-4135-9747-3cfd57c93559 req-77fe638d-3de2-4a9a-a5bf-f0d05160c35a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.045873 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-203a0eb8-264f-4135-9747-3cfd57c93559 req-77fe638d-3de2-4a9a-a5bf-f0d05160c35a service nova] Creating event network-vif-unplugged:2e4bd57c-5519-4d76-a1db-9fe07d5d4d69 for instance 8b50483e-af66-4d8d-b553-e465cd1389e9 on n-h2-854663-10 Oct 27 10:10:41.053130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-203a0eb8-264f-4135-9747-3cfd57c93559 req-77fe638d-3de2-4a9a-a5bf-f0d05160c35a service nova] Instance 8b50483e-af66-4d8d-b553-e465cd1389e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:10:41.065064 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-203a0eb8-264f-4135-9747-3cfd57c93559 req-77fe638d-3de2-4a9a-a5bf-f0d05160c35a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068047 Oct 27 10:10:41.066402 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 384/778] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:41.156256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:41.157494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:41.165316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.166053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.166654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.167675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.168283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.168888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.551647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:41.574455 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b234ccff-712b-40f3-956b-89eb11eaaee5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.590624 Oct 27 10:10:41.577464 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 395/779] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:40 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:41.584733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:41.585924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:41.594295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.595519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.596397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.598208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.598867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.599477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.611698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:41.625742 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b80d0aa6-cb67-4b77-8a86-ab7d7d3373f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.475288 Oct 27 10:10:41.626783 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 385/780] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:41 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:41.632361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:41.633240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:41.651735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.652568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.653602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.654634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.655268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.656061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.684040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:41.696822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:41.698322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:41.703869 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9570277f-2993-47f3-b187-49688701ba59 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.124643 Oct 27 10:10:41.705024 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 396/781] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:41 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:41.806434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:41.807296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:41.829891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.833949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.834766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.836944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:41.841999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:41.843022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:41.907478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:41.923696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:41.926700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:41.928457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d55578df-c740-4fce-bab8-197e485f1a01 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.300003 Oct 27 10:10:41.929806 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 386/782] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:41 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:42.042205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:42.052294 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dfe7f9d7-b957-420e-89a5-e1fe7058efeb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1473 microversion: 2.1 time: 0.250951 Oct 27 10:10:42.053458 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 397/783] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:41 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:42.604437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:42.606103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:42.623893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:42.627726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:42.627726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:42.627726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:42.628148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:42.629183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:42.649561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:42.650354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:42.652527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:42.669197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:42.669792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:42.670702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:42.678150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:42.679810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:42.680600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:42.895799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:42.918388 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f89f90d-e9f1-4c1b-8adb-0b6a8b8b28b1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.320460 Oct 27 10:10:42.939796 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 387/784] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:42 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:42.947548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:42.948160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:42.961701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:42.964206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:42.969109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:42.969962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:42.970416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:42.970943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:42.996559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:43.015381 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d78a50e3-2e7c-432d-8da0-79c0a0a584bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.369562 Oct 27 10:10:43.016717 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 398/785] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:42 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:43.037512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:43.038568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:43.050214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:43.051072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:43.051728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:43.052903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:43.053961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:43.054861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:43.075831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:43.080231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:43.093878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:43.096293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:43.115210 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b94d8ee-72f4-434f-b02c-6423c18b19dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.163967 Oct 27 10:10:43.116274 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 388/786] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:42 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:43.145379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:43.146514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:43.166865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:43.167465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:43.168014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:43.168987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:43.169436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:43.169952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:43.313950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:43.326854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:43.328327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:43.329689 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4f5203d-9079-4977-85e8-907d23998118 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1362 microversion: 2.25 time: 0.311604 Oct 27 10:10:43.331793 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 399/787] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:43 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:43.471743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:43.484890 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae10fd4a-1bae-44e4-8299-6f750d246ef9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.364479 Oct 27 10:10:43.507860 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 389/788] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:43 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:43.516018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3fc27c5e-585c-43a2-be20-153c1dd5dbbe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:43.516794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3fc27c5e-585c-43a2-be20-153c1dd5dbbe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:43.524776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fc27c5e-585c-43a2-be20-153c1dd5dbbe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:43.525650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fc27c5e-585c-43a2-be20-153c1dd5dbbe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:43.526346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fc27c5e-585c-43a2-be20-153c1dd5dbbe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:43.528759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fc27c5e-585c-43a2-be20-153c1dd5dbbe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:43.529429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fc27c5e-585c-43a2-be20-153c1dd5dbbe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:43.530099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fc27c5e-585c-43a2-be20-153c1dd5dbbe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:43.662481 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3fc27c5e-585c-43a2-be20-153c1dd5dbbe tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9/action" status: 204 len: 0 microversion: 2.1 time: 0.150275 Oct 27 10:10:43.665727 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 400/789] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:10:43 2022] POST /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9/action => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:10:43.678197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:43.678984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:43.687562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:43.688121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:43.688935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:43.690103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:43.690786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:43.691446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:43.949408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:43.950683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:43.979356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:43.993441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:43.995692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:44.000182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:44.001413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:44.002124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:44.053929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:44.063547 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fde2e496-0cea-46a9-b9bc-99494e8df1f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.392318 Oct 27 10:10:44.075510 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 390/790] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:43 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:44.096808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:44.097521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:44.118366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:44.119044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:44.119631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:44.120826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:44.122319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:44.123003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:44.684957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:44.699688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17f01f97-ad32-4b27-b537-cee18f94f282 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.752872 Oct 27 10:10:44.719654 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 401/791] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:43 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:44.728610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:44.729585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:44.749258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:44.751749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:44.752134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:44.753062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:44.754158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:44.755413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:44.756008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:44.761137 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee746109-05b8-4f1f-96b8-f308eb1ce849 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.673504 Oct 27 10:10:44.767864 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 391/792] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:44 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:44.778452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:44.779204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:44.792450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:44.793153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:44.798398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:44.799566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:44.800296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:44.800858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:45.024896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:45.038059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:45.040327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:45.060260 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-669ada76-05d3-4656-be12-0205964a4068 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.338154 Oct 27 10:10:45.061260 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 402/793] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:44 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:45.103653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:45.104490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:45.119806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:45.120583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:45.121205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:45.122146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:45.122741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:45.123323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:45.286754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:45.298109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:45.300119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:45.302842 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db7f203d-4636-4859-bdba-11aa0d8fbc70 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1559 microversion: 2.25 time: 0.532909 Oct 27 10:10:45.322578 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 392/794] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:44 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1559 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:45.335959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:45.336972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:45.346499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:45.347335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:45.347943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:45.349566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:45.350702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:45.351398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:45.859793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:45.900450 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-06cf4620-38a6-4eb5-8c38-75500b0bb28e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.801744 Oct 27 10:10:45.904594 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 403/795] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:45 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:45.911231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a93bdb4c-f198-4951-9675-7e1d14d48b36 req-66d66325-bbc0-4875-8a84-c470f60bbe0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcd2b3d-58b7-4b23-81b1-b055a3366dea", "name": "network-vif-plugged", "status": "completed", "tag": "f4524ae2-f0ff-40b9-bc49-e05a0706b1e0"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:45.921952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a93bdb4c-f198-4951-9675-7e1d14d48b36 req-66d66325-bbc0-4875-8a84-c470f60bbe0b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:45.922913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a93bdb4c-f198-4951-9675-7e1d14d48b36 req-66d66325-bbc0-4875-8a84-c470f60bbe0b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:45.923866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a93bdb4c-f198-4951-9675-7e1d14d48b36 req-66d66325-bbc0-4875-8a84-c470f60bbe0b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:45.957160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:45.969964 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a93bdb4c-f198-4951-9675-7e1d14d48b36 req-66d66325-bbc0-4875-8a84-c470f60bbe0b service nova] Creating event network-vif-plugged:f4524ae2-f0ff-40b9-bc49-e05a0706b1e0 for instance fbcd2b3d-58b7-4b23-81b1-b055a3366dea on n-h2-854663-10 Oct 27 10:10:45.981849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a93bdb4c-f198-4951-9675-7e1d14d48b36 req-66d66325-bbc0-4875-8a84-c470f60bbe0b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074956 Oct 27 10:10:45.983557 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 404/796] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:45.990750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:45.991828 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd7919e0-3f38-4615-95ae-983fea33fc2b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 2054 microversion: 2.25 time: 0.660430 Oct 27 10:10:45.992253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:45.992680 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 393/797] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:45 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 2054 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:46.003627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:46.004614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:46.010308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:46.012133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:46.013754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:46.014817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:46.015493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:46.016097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:46.023863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:46.028293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:46.029128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:46.030131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:46.030808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:46.031445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:46.815475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:46.825804 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d5ec6e7-63ef-4d60-87b6-46260da83adf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.840771 Oct 27 10:10:46.826913 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 405/798] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:45 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:46.831904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:46.838439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:46.846348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:46.847001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:46.847527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:46.848520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:46.849092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:46.849729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:46.894602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:46.905424 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dbc71220-24e9-45cb-b8e3-d9c15745c1ec tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.911250 Oct 27 10:10:46.923787 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 394/799] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:45 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:46.929349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:46.930234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:46.936775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:46.937346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:46.937871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:46.938835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:46.939447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:46.939932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.061123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:47.079864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:47.081511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:47.102818 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ffd4aed-8d07-4d9b-abf4-bf4f4fa68eec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.176050 Oct 27 10:10:47.116690 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 395/800] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:46 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:47.132589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:47.134386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:47.142268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.143166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.144582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.146377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.147053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.147689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.191251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:47.215528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1f98f452-8075-4f63-943f-904f56c9e9cd tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 2054 microversion: 2.25 time: 0.386796 Oct 27 10:10:47.216316 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 406/801] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:46 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 2054 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:47.244026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b76405d-f92c-44d4-9fd4-b021b53ef8f4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:47.247996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b76405d-f92c-44d4-9fd4-b021b53ef8f4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.248689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b76405d-f92c-44d4-9fd4-b021b53ef8f4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.249554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b76405d-f92c-44d4-9fd4-b021b53ef8f4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.250488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b76405d-f92c-44d4-9fd4-b021b53ef8f4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.251283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b76405d-f92c-44d4-9fd4-b021b53ef8f4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.252138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b76405d-f92c-44d4-9fd4-b021b53ef8f4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.285420 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b76405d-f92c-44d4-9fd4-b021b53ef8f4 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.045063 Oct 27 10:10:47.286037 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 407/802] 10.222.0.76 () {60 vars in 1217 bytes} [Thu Oct 27 10:10:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:10:47.298317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4f03d72-f14c-4c45-8c02-6581ce3c1fd5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:47.299173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4f03d72-f14c-4c45-8c02-6581ce3c1fd5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:47.305531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f03d72-f14c-4c45-8c02-6581ce3c1fd5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.306251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f03d72-f14c-4c45-8c02-6581ce3c1fd5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.306864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f03d72-f14c-4c45-8c02-6581ce3c1fd5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.308881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f03d72-f14c-4c45-8c02-6581ce3c1fd5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.309666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f03d72-f14c-4c45-8c02-6581ce3c1fd5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.310260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f03d72-f14c-4c45-8c02-6581ce3c1fd5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.314614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:47.446798 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4f03d72-f14c-4c45-8c02-6581ce3c1fd5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264/action" status: 202 len: 0 microversion: 2.25 time: 0.151496 Oct 27 10:10:47.448529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 408/803] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:10:47 2022] POST /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:10:47.456649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:47.457407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:47.461013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:47.464003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.464496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.464956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.465660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.466104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.466708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.476885 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b8806b21-6ca9-4d9f-aef8-177859857561 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.371650 Oct 27 10:10:47.477913 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 396/804] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:47 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:47.809337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:47.848497 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e682ade1-431e-47da-9ef9-8b54b07f460c tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 2059 microversion: 2.25 time: 0.396291 Oct 27 10:10:47.849154 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 409/805] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:47 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 2059 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:47.853045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:47.853670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:47.865950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.866449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.866888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.867600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.868057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.872354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.932800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:47.933487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:47.944927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.945349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.945797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:47.946521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:47.946971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:47.952845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:48.450249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:48.467904 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-89b0b7f2-c370-4c9b-9318-1d04d56f29ee tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.539564 Oct 27 10:10:48.487484 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 410/806] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:47 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:48.493245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3848df2a-50e8-4fb6-b96a-efb109636eca req-40744acf-07a8-444f-a078-268cda937563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b50483e-af66-4d8d-b553-e465cd1389e9", "name": "network-vif-plugged", "status": "completed", "tag": "2e4bd57c-5519-4d76-a1db-9fe07d5d4d69"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:48.506616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3848df2a-50e8-4fb6-b96a-efb109636eca req-40744acf-07a8-444f-a078-268cda937563 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:48.507445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3848df2a-50e8-4fb6-b96a-efb109636eca req-40744acf-07a8-444f-a078-268cda937563 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:48.508085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3848df2a-50e8-4fb6-b96a-efb109636eca req-40744acf-07a8-444f-a078-268cda937563 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:48.518645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:48.533936 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2843d294-bedd-4de9-b380-26dcc57cf0e9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1470 microversion: 2.1 time: 0.685222 Oct 27 10:10:48.535983 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 397/807] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:47 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1470 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:48.544347 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3848df2a-50e8-4fb6-b96a-efb109636eca req-40744acf-07a8-444f-a078-268cda937563 service nova] Creating event network-vif-plugged:2e4bd57c-5519-4d76-a1db-9fe07d5d4d69 for instance 8b50483e-af66-4d8d-b553-e465cd1389e9 on n-h2-854663-10 Oct 27 10:10:48.544970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:48.545779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:48.576922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:48.578008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-3848df2a-50e8-4fb6-b96a-efb109636eca req-40744acf-07a8-444f-a078-268cda937563 service nova] Instance 8b50483e-af66-4d8d-b553-e465cd1389e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:10:48.578874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:48.584611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:48.585732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:48.586516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:48.587537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:48.591237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=19 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:48.597896 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3848df2a-50e8-4fb6-b96a-efb109636eca req-40744acf-07a8-444f-a078-268cda937563 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108551 Oct 27 10:10:48.605776 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 411/808] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:48.614462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:48.631217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:48.649386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:48.651780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:48.652346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:48.655043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:48.655627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:48.656552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=30 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:48.657430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:48.873279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:48.878473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:48.887238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:48.893159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:48.907570 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0ad5ab6-334f-4f0f-8ae4-01cbbbdb77f7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.369166 Oct 27 10:10:48.910420 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 398/809] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:48 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:48.920642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:48.922044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:48.935874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:48.937801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:48.941177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:48.943064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:48.944517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:48.945278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:49.159078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:49.170018 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88cdf73d-c284-41ee-9f4a-a07e84b0675b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.561699 Oct 27 10:10:49.170617 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 412/810] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:48 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:49.210967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:49.231698 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f084d70b-d57a-40df-82fd-b51bcb5dfe5b tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 2039 microversion: 2.25 time: 0.319906 Oct 27 10:10:49.232594 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 399/811] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:48 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 2039 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:49.270845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854663-10", "block_migration": "auto"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:49.274812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:49.291907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:49.292739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:49.293421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:49.294224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:49.294896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:49.295525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:49.343894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'flavor' on Instance uuid 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:49.358096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Going to try to live migrate instance to n-h1-854663-10 {{(pid=120719) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:10:49.493617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:49.494287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:49.522304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:49.523013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:49.523101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:49.523784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:49.524238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:49.524673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:49.838347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:49.847607 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8cb3717-0525-4fa9-8096-3241efb87a65 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.358711 Oct 27 10:10:49.848534 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 400/812] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:49 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:49.853563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:49.854290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:49.865133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:49.865705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:49.866156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:49.866862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:49.867424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:49.867853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:50.127571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:50.142043 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5dc27c56-f608-4bcc-9f5d-48a734be4ca7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1476 microversion: 2.1 time: 0.291713 Oct 27 10:10:50.142846 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 401/813] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:49 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:50.156698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:50.157528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:50.165403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:50.170945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:50.172642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:50.175480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:50.178091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:50.178783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:50.316145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:50.329872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:50.355753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:50.397776 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac6a1648-b416-4858-956f-1291b3e43e0c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.252433 Oct 27 10:10:50.399640 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 402/814] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:50 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:50.421436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:50.422383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:50.441761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:50.442509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:50.445029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:50.446639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:50.449386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:50.450073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:50.704952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:50.717418 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7394d847-3877-4a53-9e80-7e617c167d89 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.315089 Oct 27 10:10:50.733655 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 403/815] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:50 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:50.883225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:50.885205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:50.907120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:50.910948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:50.911593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:50.912572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:50.913202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:50.915544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.270029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:51.272908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:51.289648 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1cc63d6e-3201-4eac-8391-23f633ffe7ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.406852 Oct 27 10:10:51.289648 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 404/816] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:50 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:51.289648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:51.289648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:51.298027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.298517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.299055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.299910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.300524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.302053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.575984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:51.585618 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c68ad0d-2fa4-4321-8289-5cc5705588c4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1476 microversion: 2.1 time: 0.300595 Oct 27 10:10:51.600686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 405/817] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:51 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:51.600686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:51.600686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:51.600686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.601184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.601184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.601184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.601184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.601518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.686049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:51.695553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:51.697922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:51.704113 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ea87fcd-2cde-4579-b5b8-78a9e61f6664 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.116606 Oct 27 10:10:51.724628 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 406/818] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:51 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:51.742831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:51.743569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:51.758558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.759070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.759506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.760290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.760770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.761284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.995687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:52.007771 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-596d4522-a9bd-4017-837f-f91e08f99eb4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.267618 Oct 27 10:10:52.020702 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 407/819] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:51 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:52.020702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c2c774d4-c932-482b-a12a-ebd364ed8d18 req-7a5c7124-6b24-4740-a08b-7f821b86e380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03eeed8-34c3-4fcb-b086-570b834451c3", "name": "network-vif-unplugged", "status": "completed", "tag": "47a0bb7b-ed01-4e2b-88f6-d97b5c72da33"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:52.028936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c2c774d4-c932-482b-a12a-ebd364ed8d18 req-7a5c7124-6b24-4740-a08b-7f821b86e380 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:52.029561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c2c774d4-c932-482b-a12a-ebd364ed8d18 req-7a5c7124-6b24-4740-a08b-7f821b86e380 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:52.030003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c2c774d4-c932-482b-a12a-ebd364ed8d18 req-7a5c7124-6b24-4740-a08b-7f821b86e380 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:52.044019 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c2c774d4-c932-482b-a12a-ebd364ed8d18 req-7a5c7124-6b24-4740-a08b-7f821b86e380 service nova] Creating event network-vif-unplugged:47a0bb7b-ed01-4e2b-88f6-d97b5c72da33 for instance c03eeed8-34c3-4fcb-b086-570b834451c3 on n-h2-854663-10 Oct 27 10:10:52.051340 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c2c774d4-c932-482b-a12a-ebd364ed8d18 req-7a5c7124-6b24-4740-a08b-7f821b86e380 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040601 Oct 27 10:10:52.052911 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 408/820] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:52.312183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:52.313340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:52.333468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:52.333468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:52.333468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:52.335378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:52.335841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:52.336272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:52.643411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:52.653814 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2077e7c9-b5ea-4609-86c9-74de154e92ba tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1311 microversion: 2.1 time: 0.347894 Oct 27 10:10:52.655314 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 409/821] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:52 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1311 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:52.662542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:52.663439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:52.671845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:52.672831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:52.673495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:52.674430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:52.675201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:52.675860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:52.876029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:52.895006 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0262a410-7bdb-4684-bb6a-f05ebe6ac625 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1476 microversion: 2.1 time: 0.238227 Oct 27 10:10:52.895966 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 410/822] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:52 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1476 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:52.903929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:52.904570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:52.919610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:52.920099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:52.920566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:52.921396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:52.921845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:52.922298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:52.992480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:53.002266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:53.006720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:53.008147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:53.010182 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a48b195-1bec-45b7-8f7b-18efe8acfc7b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.113226 Oct 27 10:10:53.011032 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 411/823] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:52 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:53.039931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:53.041323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:53.049154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.049740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.050178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.050880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.051471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.052480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.267769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:53.278015 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ecd5086-ff05-4a69-bdcb-40291b9cdaee tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.245385 Oct 27 10:10:53.279131 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 412/824] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:53 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:53.310523 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ec0a371-5d97-4b2f-9936-7bc937f37572 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264/action" status: 202 len: 0 microversion: 2.25 time: 4.052845 Oct 27 10:10:53.311529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 413/825] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:10:49 2022] POST /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264/action => generated 0 bytes in 4055 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:10:53.320908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:53.321527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:53.329331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.330136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.330916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.331699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.332197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.332631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.654690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:53.674448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:53.677759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:53.679595 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57fc1e52-bbbf-4531-a7e1-aed7dc0fdf45 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1569 microversion: 2.25 time: 0.361916 Oct 27 10:10:53.680836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:53.681766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:53.691767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.692285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.692722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.693545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.694001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.694677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.721900 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 413/826] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:53 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1569 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:53.920409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:53.921082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:53.925740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:53.934198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.934870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.935384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.942675 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c75324d3-f087-49cb-8827-9fd1ddb20af3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1494 microversion: 2.1 time: 0.265688 Oct 27 10:10:53.943954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.945646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.945646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.946682 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 414/827] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:53 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1494 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:53.968847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed0a9244-aaa8-4c3d-9f09-565fdaf7cb6d tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:53.970178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ed0a9244-aaa8-4c3d-9f09-565fdaf7cb6d tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:53.979482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed0a9244-aaa8-4c3d-9f09-565fdaf7cb6d tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.980316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed0a9244-aaa8-4c3d-9f09-565fdaf7cb6d tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.981007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed0a9244-aaa8-4c3d-9f09-565fdaf7cb6d tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.981947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed0a9244-aaa8-4c3d-9f09-565fdaf7cb6d tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.982818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed0a9244-aaa8-4c3d-9f09-565fdaf7cb6d tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.983644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed0a9244-aaa8-4c3d-9f09-565fdaf7cb6d tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.314363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:54.331227 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb0097ba-9d0b-408e-bcaa-3175a428cd66 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1476 microversion: 2.1 time: 0.414979 Oct 27 10:10:54.346342 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 414/828] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:53 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1476 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:54.351695 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed0a9244-aaa8-4c3d-9f09-565fdaf7cb6d tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1647 microversion: 2.1 time: 0.386254 Oct 27 10:10:54.352301 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 415/829] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:53 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1647 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:54.356806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:54.357516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:54.357907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:54.358428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:54.366994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.367485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.368331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.369361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.369814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.370238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.380070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.382420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.383148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.384548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.385245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.385913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.538146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:54.549961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:54.552001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:54.558967 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-472570c6-f4f2-4034-8d6b-323ab1926d55 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1535 microversion: 2.91 time: 0.211255 Oct 27 10:10:54.559753 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 415/830] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:54 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1535 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:54.576424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4f882c3-8fb2-4acc-88c4-b3220285ebb1 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:54.577181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4f882c3-8fb2-4acc-88c4-b3220285ebb1 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:54.585222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4f882c3-8fb2-4acc-88c4-b3220285ebb1 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.586515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4f882c3-8fb2-4acc-88c4-b3220285ebb1 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.587219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4f882c3-8fb2-4acc-88c4-b3220285ebb1 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.588233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4f882c3-8fb2-4acc-88c4-b3220285ebb1 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.588996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4f882c3-8fb2-4acc-88c4-b3220285ebb1 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.589783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4f882c3-8fb2-4acc-88c4-b3220285ebb1 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.725409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:54.735526 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d70f2fac-36a6-4d84-b6ef-3e8bb2658843 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.382379 Oct 27 10:10:54.749122 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 416/831] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:54 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:54.757613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:54.758227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:54.767448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.767951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.768624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.769579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.770247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.770875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.885444 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4f882c3-8fb2-4acc-88c4-b3220285ebb1 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1647 microversion: 2.1 time: 0.323652 Oct 27 10:10:54.898223 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 416/832] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:54 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1647 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:54.908585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-319a82cb-15f8-44d2-bbef-e00793894116 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:54.913316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319a82cb-15f8-44d2-bbef-e00793894116 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.913918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319a82cb-15f8-44d2-bbef-e00793894116 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.914485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319a82cb-15f8-44d2-bbef-e00793894116 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.915324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319a82cb-15f8-44d2-bbef-e00793894116 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.916331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319a82cb-15f8-44d2-bbef-e00793894116 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.916331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319a82cb-15f8-44d2-bbef-e00793894116 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.944914 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-319a82cb-15f8-44d2-bbef-e00793894116 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040642 Oct 27 10:10:54.946367 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 417/833] 10.222.0.76 () {58 vars in 1176 bytes} [Thu Oct 27 10:10:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:54.958731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d8eb8fa-220e-446a-a91c-8d1ab6d6304c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:54.959220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d8eb8fa-220e-446a-a91c-8d1ab6d6304c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:54.966609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8eb8fa-220e-446a-a91c-8d1ab6d6304c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.966959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8eb8fa-220e-446a-a91c-8d1ab6d6304c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.967488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8eb8fa-220e-446a-a91c-8d1ab6d6304c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.968290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8eb8fa-220e-446a-a91c-8d1ab6d6304c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.969113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8eb8fa-220e-446a-a91c-8d1ab6d6304c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.970506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8eb8fa-220e-446a-a91c-8d1ab6d6304c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.973040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:54.982656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:54.984353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:54.986276 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-53bd65d3-344b-4567-a2ab-b798648f0143 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1569 microversion: 2.25 time: 0.235761 Oct 27 10:10:55.001996 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 417/834] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:54 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:55.052327 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d8eb8fa-220e-446a-a91c-8d1ab6d6304c tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea/action" status: 202 len: 0 microversion: 2.1 time: 0.097692 Oct 27 10:10:55.056109 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 418/835] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:10:54 2022] POST /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:10:55.062401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bef80c1-154e-452c-9394-226b15f6c2ca tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:55.063109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1bef80c1-154e-452c-9394-226b15f6c2ca tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:55.070022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bef80c1-154e-452c-9394-226b15f6c2ca tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:55.070772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bef80c1-154e-452c-9394-226b15f6c2ca tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:55.071225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bef80c1-154e-452c-9394-226b15f6c2ca tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:55.072083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bef80c1-154e-452c-9394-226b15f6c2ca tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:55.072535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bef80c1-154e-452c-9394-226b15f6c2ca tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:55.073012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bef80c1-154e-452c-9394-226b15f6c2ca tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:55.360379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:55.361349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:55.368709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:55.369127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:55.369791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:55.370744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:55.371268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:55.371762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:55.672322 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bef80c1-154e-452c-9394-226b15f6c2ca tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1652 microversion: 2.1 time: 0.614323 Oct 27 10:10:55.673536 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 418/836] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:55 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1652 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:55.678510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:55.679300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:55.686710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:55.688101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:55.688835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:55.690444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:55.691770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:55.692515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:55.734426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:55.744606 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a44ee7d-3399-4686-9f50-8a994e0216c8 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1476 microversion: 2.1 time: 0.389158 Oct 27 10:10:55.745353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 419/837] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:55 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1476 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:55.765449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:55.766175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:55.773106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:55.773616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:55.774044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:55.774852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:55.775178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:55.775593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:55.841953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:55.852410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:55.855498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:55.861125 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-620d4695-f521-4577-a48f-c2fa8814b3dd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1535 microversion: 2.91 time: 0.186386 Oct 27 10:10:55.861830 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 419/838] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:55 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1535 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:56.014563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:56.016422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:56.023072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:56.023675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:56.024289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:56.025436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:56.026168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:56.026787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:56.042864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:56.056279 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76b96ace-fe23-4403-afe2-0a7dc5b79f0a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1470 microversion: 2.1 time: 0.296303 Oct 27 10:10:56.059386 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 420/839] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:55 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:56.281596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:56.297752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:56.299012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:56.300240 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80a86dc2-e228-4fc0-91d6-c908519b38a4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1569 microversion: 2.25 time: 0.289791 Oct 27 10:10:56.315261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 420/840] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:56 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1569 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:10:56.699536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1997d7bd-c092-4eec-bf9d-e18ea91aba79 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:56.700190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1997d7bd-c092-4eec-bf9d-e18ea91aba79 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:56.716200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1997d7bd-c092-4eec-bf9d-e18ea91aba79 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:56.717220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1997d7bd-c092-4eec-bf9d-e18ea91aba79 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:56.723358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1997d7bd-c092-4eec-bf9d-e18ea91aba79 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:56.725286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1997d7bd-c092-4eec-bf9d-e18ea91aba79 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:56.725942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1997d7bd-c092-4eec-bf9d-e18ea91aba79 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:56.726528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1997d7bd-c092-4eec-bf9d-e18ea91aba79 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:56.782319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:56.783385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:56.805104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:56.805596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:56.812654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:56.817099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:56.819016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:56.819652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:57.261460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:57.416752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:57.420692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:57.435809 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8580cbe-8a7d-4418-8c6d-e59f4180844a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1476 microversion: 2.1 time: 0.669231 Oct 27 10:10:57.449327 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 421/841] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:56 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1476 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:57.458623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:57.459345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:57.466281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:57.466772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:57.467209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:57.467905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:57.468529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:57.469273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:57.475401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:57.482836 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1997d7bd-c092-4eec-bf9d-e18ea91aba79 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1632 microversion: 2.1 time: 0.783278 Oct 27 10:10:57.483755 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 421/842] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:56 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1632 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:57.510930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:57.513948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:57.522507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:57.523009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:57.523595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:57.524800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:57.524800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:57.525183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:57.552542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:57.567133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:57.568929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:57.583021 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1565f5d6-ab78-4919-88ef-b29df420f44c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1538 microversion: 2.91 time: 0.132243 Oct 27 10:10:57.589256 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 422/843] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:57 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1538 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:57.604822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:57.613803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:57.624023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:57.628318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:57.629089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:57.630530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:57.631380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:57.647965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:57.956942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:57.970158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:57.971687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:57.972960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7a4bd64-9b32-4740-be7f-5d1838d9f816 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1544 microversion: 2.25 time: 0.382051 Oct 27 10:10:57.979428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:57.984923 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 423/844] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:57 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1544 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:57.996128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0f9ebeab-4eac-42b1-b7a3-c79eef036229 req-7eb7c28c-d8fa-47a0-8a69-a1cde8105aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03eeed8-34c3-4fcb-b086-570b834451c3", "name": "network-vif-plugged", "status": "completed", "tag": "47a0bb7b-ed01-4e2b-88f6-d97b5c72da33"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:57.999329 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d650d7f-c5c6-491d-b51a-ed0340d4e8a6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1462 microversion: 2.1 time: 0.501200 Oct 27 10:10:58.000274 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 422/845] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:57 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1462 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:58.005010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854663-10", "block_migration": true, "disk_over_commit": false}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:58.007637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:58.035155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0f9ebeab-4eac-42b1-b7a3-c79eef036229 req-7eb7c28c-d8fa-47a0-8a69-a1cde8105aa0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.035637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0f9ebeab-4eac-42b1-b7a3-c79eef036229 req-7eb7c28c-d8fa-47a0-8a69-a1cde8105aa0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.036066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0f9ebeab-4eac-42b1-b7a3-c79eef036229 req-7eb7c28c-d8fa-47a0-8a69-a1cde8105aa0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:58.041653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.042235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.043009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:58.043802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.044635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.044902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:58.075609 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0f9ebeab-4eac-42b1-b7a3-c79eef036229 req-7eb7c28c-d8fa-47a0-8a69-a1cde8105aa0 service nova] Creating event network-vif-plugged:47a0bb7b-ed01-4e2b-88f6-d97b5c72da33 for instance c03eeed8-34c3-4fcb-b086-570b834451c3 on n-h2-854663-10 Oct 27 10:10:58.083463 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0f9ebeab-4eac-42b1-b7a3-c79eef036229 req-7eb7c28c-d8fa-47a0-8a69-a1cde8105aa0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096947 Oct 27 10:10:58.084394 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 424/846] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:10:58.095938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lazy-loading 'flavor' on Instance uuid fbcd2b3d-58b7-4b23-81b1-b055a3366dea {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:10:58.105822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:58.117881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:58.130795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.131458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.131955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:58.132729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.133304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.133816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:58.156644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Going to try to live migrate instance to n-h1-854663-10 {{(pid=120720) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:10:58.348977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-854663-10". {{(pid=120719) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 10:10:58.404051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:58.542269 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13663497-cfeb-4216-a5af-e760dece9db2 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753/action" status: 202 len: 0 microversion: 2.91 time: 0.456382 Oct 27 10:10:58.547930 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 425/847] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:10:58 2022] POST /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:10:58.552940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e572552d-042c-4af6-bf11-36f3be69110f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '.version_select at 0x7f6d5b501f70>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:58.570525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e572552d-042c-4af6-bf11-36f3be69110f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.571012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e572552d-042c-4af6-bf11-36f3be69110f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.571443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e572552d-042c-4af6-bf11-36f3be69110f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:58.607953 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e572552d-042c-4af6-bf11-36f3be69110f tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 2507 microversion: 2.25 time: 0.058516 Oct 27 10:10:58.615347 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 426/848] 10.222.0.76 () {60 vars in 1184 bytes} [Thu Oct 27 10:10:58 2022] GET /compute/v2.1/os-migrations => generated 2507 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:58.625437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:58.626055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:58.666168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.666659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.668035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:58.668768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.669222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.669641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:59.114645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:59.129584 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76b65767-4d0e-492f-a4d8-0d0b58bc063d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1462 microversion: 2.1 time: 0.509909 Oct 27 10:10:59.130267 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 427/849] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:58 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1462 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:59.151863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:59.153118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:59.165277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:59.167298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:59.168588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:59.182672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:59.184385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:59.186364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:59.780610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:59.790366 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-45efac7c-847b-4f7d-be7b-216adc793042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1476 microversion: 2.1 time: 0.657905 Oct 27 10:10:59.804541 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 428/850] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:59 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1476 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:59.811936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:59.813479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:59.821141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:59.821636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:59.822063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:59.822768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:59.823392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:59.823814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:59.963854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:59.973728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:59.975225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:59.980311 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7fe2f906-486a-4e51-b629-ada770862fa0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1488 microversion: 2.91 time: 0.173940 Oct 27 10:10:59.980928 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 429/851] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:59 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1488 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:10:59.985788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:59.986393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:59.992308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:59.992990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:59.993579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:59.994452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:59.995040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:59.995628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:00.329720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:11:00.360569 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dff713d7-7616-4b44-be9b-beb6faef9b86 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 2039 microversion: 2.25 time: 0.378108 Oct 27 10:11:00.373306 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 430/852] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:10:59 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 2039 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:00.395349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4a5893f-f798-4024-849f-398bf1dd1664 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'create', calling method: .version_select at 0x7f6d5b571160>, body: {"keypair": {"name": "tempest-keypair-1183838655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITNQMehocO17vG9wDOggXpHhf1z2GR6bQSxZoUV2EG97Pepes9I7eByPwxk4wW506W9oeVE3Qo0HTb7eASWIMZ2fyDWESyycnGbkNz1c5Vqbj1vYwPbYPoSxAEwE7Th4Q=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:00.423950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c4a5893f-f798-4024-849f-398bf1dd1664 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for project 895a8ef842a242469ffa508e1cf9f378. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:00.430898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c4a5893f-f798-4024-849f-398bf1dd1664 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for user ae3b45c026064d6c946f50a4d9d32c2f and project 895a8ef842a242469ffa508e1cf9f378. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:00.466767 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4a5893f-f798-4024-849f-398bf1dd1664 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091509 Oct 27 10:11:00.468982 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 431/853] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:11:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:00.475918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-abffe1a5-0639-43fa-a731-64d712db862a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Action: 'create', calling method: .version_select at 0x7f6d5b5130d0>, body: {"keypair": {"name": "tempest-keypair-1353544103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh4BbA+61qIyqnP7/yg2H/FyA/lEV8xQbKjbrBPwsO/wkH8O1d692DKJOep14y1Rfg5vgAai7V6sNBeKT0DBmhWe1bEXKRMrtVNlZnFpsO0iQtcVvzehJJBorV4Z6YIzg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:00.523056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-abffe1a5-0639-43fa-a731-64d712db862a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for project 8e2d013afa6544b3972160d82f111127. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:00.543349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-abffe1a5-0639-43fa-a731-64d712db862a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for user dd2f7b7849014a6bae41317a3e68426e and project 8e2d013afa6544b3972160d82f111127. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:00.606816 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-abffe1a5-0639-43fa-a731-64d712db862a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.136000 Oct 27 10:11:00.608213 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 432/854] 10.222.0.76 () {62 vars in 1200 bytes} [Thu Oct 27 10:11:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 10:11:00.752012 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c083f7c9-4dca-42cf-8664-5f06b65cf685 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea/action" status: 202 len: 0 microversion: 2.1 time: 2.750448 Oct 27 10:11:00.753608 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 423/855] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:10:58 2022] POST /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea/action => generated 0 bytes in 2753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:11:00.762468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:00.763153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:00.772573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:00.776112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:00.778111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:00.778941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:00.782122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:00.782829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:00.816540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:00.817444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:00.842474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:00.843681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:00.844762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:00.852688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:00.853453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:00.855665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:01.474984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:01.485152 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd29558c-56d1-4bee-ad26-b8f8f1a290c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1504 microversion: 2.1 time: 0.727012 Oct 27 10:11:01.500450 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 433/856] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:00 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1504 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:01.509461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:01.512854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:01.531375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:01.532721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:01.533368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:01.535069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:01.535694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:01.536270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:01.552470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:01.563630 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac49853b-bba6-4b1a-bf46-3326304da980 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1476 microversion: 2.1 time: 0.753080 Oct 27 10:11:01.564913 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 424/857] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:00 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1476 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:01.644485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:01.657933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:01.659630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:01.666009 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c0d73dd-e939-4b5c-b382-9268fd9ca10b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.162871 Oct 27 10:11:01.666924 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 434/858] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:01 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:02.517576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:02.519982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:02.530027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:02.533646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:02.534093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:02.538074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:02.539693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:02.545475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:02.590544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:02.591184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:02.600004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:02.603259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:02.604446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:02.605228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:02.607279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:02.609017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:03.046215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:03.057917 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46250347-4c7f-4936-a9fd-099e98175ea9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1462 microversion: 2.1 time: 0.471684 Oct 27 10:11:03.079613 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 435/859] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:02 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1462 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:03.084600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:03.092917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:03.099229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:03.115185 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1403eee4-b1aa-4b7b-8d36-64aa962ee6ff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1504 microversion: 2.1 time: 0.604906 Oct 27 10:11:03.120832 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 425/860] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:02 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1504 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:03.124158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:03.124906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:03.125483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:03.126440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:03.127027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:03.127581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:03.136456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:03.161351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:03.192647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:03.194481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:03.197690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:03.199269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:03.199936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:03.203500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:03.443252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:03.457415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:03.472888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:03.495829 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd9f04c4-65fa-44c9-89d4-7ab72d7e4b17 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.414997 Oct 27 10:11:03.500629 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 436/861] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:03 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:03.549764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:03.566040 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1864c89-8a87-4df5-9a15-a5ba268b988d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1462 microversion: 2.1 time: 0.444087 Oct 27 10:11:03.566897 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 426/862] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:03 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1462 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:03.598357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:03.602687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:03.636300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:03.647073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:03.656499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:03.659852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:03.660951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:03.663887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:04.139176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:04.140575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:04.161695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:04.162546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:04.164072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:04.165008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:04.171249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:04.176168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:04.617453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:04.633831 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4c6d8bd-ee11-4da8-b9d0-24723de0cd0c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1479 microversion: 2.1 time: 0.498947 Oct 27 10:11:04.638506 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 427/863] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:04 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1479 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:04.659233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:04.661419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:04.673521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:04.675384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:04.682393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:04.683484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:04.684118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:04.685600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:04.857888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:04.877376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:04.885993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:04.908368 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4d5bef8-e73b-41b3-9bd1-82bc6d3c9806 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.262173 Oct 27 10:11:04.909355 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 428/864] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:04 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:04.914638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-312190d6-4248-429e-aa08-a2fc9e706937 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '.version_select at 0x7f6d5bab1d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:04.925643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-312190d6-4248-429e-aa08-a2fc9e706937 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:04.929627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-312190d6-4248-429e-aa08-a2fc9e706937 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:04.931307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-312190d6-4248-429e-aa08-a2fc9e706937 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:04.933674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:04.969404 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-312190d6-4248-429e-aa08-a2fc9e706937 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 2350 microversion: 2.1 time: 0.054769 Oct 27 10:11:04.970430 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 429/865] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:11:04 2022] GET /compute/v2.1/os-migrations => generated 2350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:04.995728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eed9287e-1920-42d2-ba03-d6189fb42433 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:04.996572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eed9287e-1920-42d2-ba03-d6189fb42433 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:05.014390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed9287e-1920-42d2-ba03-d6189fb42433 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:05.018138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed9287e-1920-42d2-ba03-d6189fb42433 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:05.018827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed9287e-1920-42d2-ba03-d6189fb42433 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:05.019778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed9287e-1920-42d2-ba03-d6189fb42433 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:05.021199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed9287e-1920-42d2-ba03-d6189fb42433 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:05.022621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed9287e-1920-42d2-ba03-d6189fb42433 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:05.470411 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eed9287e-1920-42d2-ba03-d6189fb42433 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1632 microversion: 2.1 time: 0.482977 Oct 27 10:11:05.472315 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 430/866] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:04 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1632 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:05.480156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ba742f5-304d-4e9c-94f3-663e05b69364 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '.version_select at 0x7f6d5b7fc3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:05.483615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba742f5-304d-4e9c-94f3-663e05b69364 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:05.484155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba742f5-304d-4e9c-94f3-663e05b69364 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:05.494032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba742f5-304d-4e9c-94f3-663e05b69364 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:05.525526 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ba742f5-304d-4e9c-94f3-663e05b69364 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 2350 microversion: 2.1 time: 0.052077 Oct 27 10:11:05.535470 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 431/867] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:11:05 2022] GET /compute/v2.1/os-migrations => generated 2350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:05.540476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2ed6a80-f42e-4ec9-b0ce-a077aa5d2af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Action: 'create', calling method: .version_select at 0x7f6d61524f70>, body: {"keypair": {"name": "tempest-keypair-755539163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr+JVe0S5wAdxaVA/qRh2QHTrj/ZgK2Myh+0lXXfls/rF4gb5/zDCcyUwPs2N0HkGpzxew4bdhf16XOIzYBOcStLvcmAcQ4eWIGNhHNXe529KsUKNmogIK08VxRyIC0ZQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:05.622282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-a2ed6a80-f42e-4ec9-b0ce-a077aa5d2af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:05.641445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-a2ed6a80-f42e-4ec9-b0ce-a077aa5d2af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for user 5db106c72e8745de8266a3ab7a5fe531 and project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:05.706214 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a2ed6a80-f42e-4ec9-b0ce-a077aa5d2af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [e44c52f7-f17a-4366-90cf-172ab593c76f] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:11:06.721329 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [None req-a2ed6a80-f42e-4ec9-b0ce-a077aa5d2af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [e44c52f7-f17a-4366-90cf-172ab593c76f] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 43892. Oct 27 10:11:06.761339 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2ed6a80-f42e-4ec9-b0ce-a077aa5d2af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.222046 Oct 27 10:11:06.768082 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 432/868] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:11:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:06.782932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba85af90-743c-4e33-ab1b-536832de219e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:06.825716 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba85af90-743c-4e33-ab1b-536832de219e tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.060356 Oct 27 10:11:06.839078 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 433/869] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:11:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:06.850565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:06.851423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:06.861340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:06.862559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:06.863241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:06.864242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:06.864972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:06.866338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:07.221968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:07.235767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:07.243376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:07.270655 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fcefe8e0-8031-4829-91b4-61b6a322fcab tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.430119 Oct 27 10:11:07.276147 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 434/870] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:06 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:07.305028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-635aec1c-4978-4b09-a1be-0c17270a0714 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-616169045", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:07.358150 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-635aec1c-4978-4b09-a1be-0c17270a0714 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.077173 Oct 27 10:11:07.360382 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 435/871] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 27 10:11:07 2022] POST /compute/v2.1/flavors => generated 498 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:07.375271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-baf6f618-32d5-44d3-a877-6b31a5be4043 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:07.428335 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-baf6f618-32d5-44d3-a877-6b31a5be4043 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.058051 Oct 27 10:11:07.447555 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 436/872] 10.222.0.76 () {58 vars in 1182 bytes} [Thu Oct 27 10:11:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:11:07.515543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1255545401", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "50cb7bc6-6235-4029-9fd6-9407e53e51ed"}], "security_groups": [{"name": "tempest-securitygroup--1197192401"}], "key_name": "tempest-keypair-1353544103", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:07.918377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:11:07.926638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:11:07.927680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:11:07.929792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:11:07.930566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:11:08.014916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] validate_networks() for [('50cb7bc6-6235-4029-9fd6-9407e53e51ed', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:11:08.118501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:08.142424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:08.148461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:08.149792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:08.152953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:08.153610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:08.157700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:08.317701 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6ed406c-6f21-4df1-8662-365e5b6914b5 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action" status: 202 len: 1066 microversion: 2.1 time: 4.723504 Oct 27 10:11:08.324136 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 437/873] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:11:03 2022] POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action => generated 1066 bytes in 4731 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 10:11:08.358340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1367694975", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "69b97d16-8178-4c4f-a34e-1009f47f531e"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:08.523923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:11:10.123990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:11:10.124531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:11:10.132690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:11:10.133650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:11:10.134249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:11:10.165157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.165632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.173834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.174982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.180860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.189476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.239242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:11:10.239745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:11:10.240044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:11:10.240442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:11:10.240954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:11:10.284421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.288382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.288886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.289718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.290173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.290588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.305158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for project 8e2d013afa6544b3972160d82f111127. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:10.346329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for user dd2f7b7849014a6bae41317a3e68426e and project 8e2d013afa6544b3972160d82f111127. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:10.347367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:10.407756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:11:10.422228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:11:10.436590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for project 895a8ef842a242469ffa508e1cf9f378. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:10.450134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for user ae3b45c026064d6c946f50a4d9d32c2f and project 895a8ef842a242469ffa508e1cf9f378. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:10.481120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:11:10.484853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:11:10.602181 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-978fe8c5-5c2f-48ec-abdf-893668d122d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 3.111483 Oct 27 10:11:10.603422 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f0abfeb5-d265-41e8-a203-dd184f28ad99 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.264543 Oct 27 10:11:10.604421 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 438/874] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:11:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:11:10.616336 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 437/875] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:11:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 3126 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:11:10.678944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:10.680594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:10.681622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:10.686974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:10.716992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.718805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.719436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.722780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.724437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.724691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.725612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.726773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.727817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.728896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.729477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.729825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.991608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:11.006112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:11.031766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:11.044334 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f922cc66-ccc8-4297-864d-9d428ee48264 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.424282 Oct 27 10:11:11.058324 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 439/876] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:10 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:11.102707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5af3ab8b-3d9c-4604-8d1b-0bcd0d3a4263 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:11.104557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5af3ab8b-3d9c-4604-8d1b-0bcd0d3a4263 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:11.537079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5af3ab8b-3d9c-4604-8d1b-0bcd0d3a4263 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:11.548329 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5af3ab8b-3d9c-4604-8d1b-0bcd0d3a4263 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1279 microversion: 2.1 time: 0.455110 Oct 27 10:11:11.552480 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 440/877] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:11 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1279 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:11.563675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c9d8030-ede3-4d05-b33a-6191e0217277 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:11.564894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c9d8030-ede3-4d05-b33a-6191e0217277 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:11.573262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:11.591581 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3ce1986-a8f2-4abc-a873-94f2ce0a3dac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.972890 Oct 27 10:11:11.626055 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 438/878] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:10 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:11.680040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c9d8030-ede3-4d05-b33a-6191e0217277 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:11.692091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c9d8030-ede3-4d05-b33a-6191e0217277 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:11.694229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c9d8030-ede3-4d05-b33a-6191e0217277 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:11.696127 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c9d8030-ede3-4d05-b33a-6191e0217277 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1286 microversion: 2.25 time: 0.141768 Oct 27 10:11:11.711702 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 441/879] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:11 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:12.111814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:12.130159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:12.165238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:12.166119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:12.168610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:12.172623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:12.173410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:12.174191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:12.356490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:12.372136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:12.373727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:12.391540 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05e3c79b-1e29-45a9-8060-0053a94ac59a tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.300978 Oct 27 10:11:12.401353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 439/880] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:12 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:12.449989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1297929727", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "f584544f-ec56-4541-905d-7537ec4732b5"}], "security_groups": [{"name": "tempest-securitygroup--2000961705"}], "key_name": "tempest-keypair-755539163", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:12.587670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:12.589078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:12.596706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] validate_networks() for [('f584544f-ec56-4541-905d-7537ec4732b5', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:11:12.612890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:12.612890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:12.612890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:12.612890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:12.613475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:12.613475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.062288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:13.075591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e6b2cec5-6c40-4284-9591-eaeaa07a53bb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1283 microversion: 2.1 time: 0.490369 Oct 27 10:11:13.076830 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 440/881] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:12 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1283 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:13.082412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:13.095384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:13.105481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:13.106260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:13.106868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.110003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:13.110737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:13.111404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.779349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:11:13.781367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:11:13.782120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:11:13.789109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:13.792381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:11:13.794666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:11:13.806429 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bfadf561-2cf6-4e4f-81a7-2d23f6c67a2d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.728007 Oct 27 10:11:13.817794 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 441/882] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:13 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:13.824475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:13.827568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:13.828376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:13.829829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.833041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:13.833245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:13.835591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:13.838798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.856383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:13.859876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:13.860526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.862800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:13.865712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:13.866640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.895361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:13.926197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:13.946075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for user 5db106c72e8745de8266a3ab7a5fe531 and project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:14.026361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:11:14.031279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:11:14.059835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:14.069070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:14.078359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:14.090615 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76c902e9-37c7-4457-b4e8-109a9233a2e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1290 microversion: 2.25 time: 0.269264 Oct 27 10:11:14.091618 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 442/883] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:13 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1290 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:14.115709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:14.129614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:14.136578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:14.152260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:14.163802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:14.165616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:14.171196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:14.172291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:14.174093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:14.207027 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-94be04e8-0079-4f05-91b0-28d8d9a1b638 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.762719 Oct 27 10:11:14.208326 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 442/884] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:11:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:11:14.213268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:14.214165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:14.221886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=91,nova_api:INSERT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:14.225853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:14.227063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:14.227767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:14.228704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:14.229338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:14.230223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:14.391816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:14.405772 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72c0124e-f1cf-4af7-bef0-f41d18301078 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1283 microversion: 2.1 time: 0.195909 Oct 27 10:11:14.420490 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 443/885] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:14 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1283 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:14.475726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6fa3687d-aedf-45aa-8779-cc08c2077a90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:14.480261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6fa3687d-aedf-45aa-8779-cc08c2077a90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:14.553712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:14.642273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:14.646046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:14.719238 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5496240-f685-40e9-abcd-6264db1ee61c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.622247 Oct 27 10:11:14.735420 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 443/886] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:14 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:14.851353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:14.852775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:14.868169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:14.872258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:14.873047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:14.874140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fa3687d-aedf-45aa-8779-cc08c2077a90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:14.888265 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6fa3687d-aedf-45aa-8779-cc08c2077a90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1234 microversion: 2.1 time: 0.462041 Oct 27 10:11:14.888983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:14.889803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:14.892908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:14.899287 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 444/887] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:14 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1234 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:15.128309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:15.128962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:15.160545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.166521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.168490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:15.176228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.177860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.188075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:15.481456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:15.505616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:15.508908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:15.519695 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a3fb09d-ce6f-4f78-b3f1-73bdb99ea103 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1282 microversion: 2.25 time: 0.397291 Oct 27 10:11:15.528332 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 445/888] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:15 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1282 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:15.558552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:15.559297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:15.623724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.634254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.639018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:15.640217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.643771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.645302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:15.667860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:15.679285 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de1d3c4e-a79c-4edc-8d63-505cf45957c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.831577 Oct 27 10:11:15.680608 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 444/889] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:14 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:15.774169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:15.775217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:15.793521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.795559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.797461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:15.814149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.816399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.818419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:15.867167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:15.879465 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e9f65c08-e1db-44cd-8c3b-c3e8e0ec6d39 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1331 microversion: 2.1 time: 0.343270 Oct 27 10:11:15.881702 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 446/890] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:15 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1331 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:15.934444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:15.935706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:15.950976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.953787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.954233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:15.954961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.956896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.957336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:16.054857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:16.065801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:16.078290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:16.084691 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1fc7144-c224-49bd-b530-196263c37c99 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.315569 Oct 27 10:11:16.099751 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 445/891] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:15 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:16.111756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:16.121241 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e395868c-62c4-4329-bbb5-35fab8aaffa6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1238 microversion: 2.1 time: 0.197181 Oct 27 10:11:16.123902 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 447/892] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:15 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1238 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:16.565325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:16.566409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:16.591093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:16.595204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:16.597049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:16.599398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:16.600359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:16.601153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:16.725736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:16.729981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:16.738467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:16.738976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:16.744233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:16.745101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:16.745582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:16.750215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:16.808861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:16.819498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:16.821962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:16.822429 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a32dd91d-1ddf-4ffb-8539-e8829c57e5ae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1282 microversion: 2.25 time: 0.262327 Oct 27 10:11:16.823189 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 446/893] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:16 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1282 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:16.913016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:16.913824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:16.924304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:16.926273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:16.926900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:16.928156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:16.929538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:16.930828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.105225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.120599 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6bc88026-c0c3-464c-ac56-204812d68d53 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1331 microversion: 2.1 time: 0.210719 Oct 27 10:11:17.121557 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 447/894] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:16 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1331 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:17.129476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:17.133086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:17.149795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.160824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.162634 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-11e26b2c-181c-4744-b495-ac95761a3cf7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.442452 Oct 27 10:11:17.163403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.181942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.182952 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 448/895] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:16 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:17.185946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.186897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.189312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.198157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:17.200654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:17.221123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.222158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.222703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.223532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.224097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.224625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.340300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.350049 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41861aa9-be69-47b6-b46d-0f838df6c17f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1230 microversion: 2.1 time: 0.165627 Oct 27 10:11:17.355005 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 449/896] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:17 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1230 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:17.372519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.416445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.418376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.427113 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-897a054d-0beb-4ba4-b169-26c91169e3da tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.304268 Oct 27 10:11:17.433027 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 448/897] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:17 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:17.856604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:17.857359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:17.867400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.868165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.868847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.870027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.871283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.872538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.943817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.953388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.956807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.958045 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-241d6ede-a11c-49bc-bbf9-0224dd6b43fa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1282 microversion: 2.25 time: 0.105463 Oct 27 10:11:17.959023 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 450/898] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:17 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:18.150182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:18.151539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:18.161148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.162018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.162870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.163658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.166020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.166571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.194783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:18.195484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:18.214085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.214599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.215078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.225903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.226419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.226866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.311881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:18.319718 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5248f5fe-288e-43ca-9d82-8b7b3f026f86 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1331 microversion: 2.1 time: 0.174234 Oct 27 10:11:18.324157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 449/899] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:18 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1331 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:18.384074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:18.384700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:18.394397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.394898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.395330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.404985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.406168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.406768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.414171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:18.424786 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc780a1f-23db-4082-9d78-b968e25ea984 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.235370 Oct 27 10:11:18.457638 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 451/900] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:18 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:18.464301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:18.465461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:18.473641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.474144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.474721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.475438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.476010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.476441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.485098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:18.493439 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75417481-2fea-4d13-a3a0-fd5821bc3b08 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1230 microversion: 2.1 time: 0.113641 Oct 27 10:11:18.495465 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 450/901] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:18 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:18.585844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:18.598567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:18.604898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:18.620975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d552473b-26f9-4823-90c6-31fc46f86567 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.161489 Oct 27 10:11:18.635701 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 452/902] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:18 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:18.856700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-26f7fd19-accc-4b46-a790-9d9fd439b805 req-77a40e9d-8fc0-472b-adf8-d6d3c687438f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb77378-15a7-4ccf-ac15-96574a205e0a", "name": "network-vif-plugged", "status": "completed", "tag": "ba2f9293-c098-436c-8a1a-23b264e8b733"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:18.869498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-26f7fd19-accc-4b46-a790-9d9fd439b805 req-77a40e9d-8fc0-472b-adf8-d6d3c687438f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.870193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-26f7fd19-accc-4b46-a790-9d9fd439b805 req-77a40e9d-8fc0-472b-adf8-d6d3c687438f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.870817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-26f7fd19-accc-4b46-a790-9d9fd439b805 req-77a40e9d-8fc0-472b-adf8-d6d3c687438f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.887265 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-26f7fd19-accc-4b46-a790-9d9fd439b805 req-77a40e9d-8fc0-472b-adf8-d6d3c687438f service nova] Creating event network-vif-plugged:ba2f9293-c098-436c-8a1a-23b264e8b733 for instance 3eb77378-15a7-4ccf-ac15-96574a205e0a on n-h1-854663-10 Oct 27 10:11:18.909591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-26f7fd19-accc-4b46-a790-9d9fd439b805 req-77a40e9d-8fc0-472b-adf8-d6d3c687438f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057102 Oct 27 10:11:18.910340 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 451/903] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:18.912783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-06810a17-4012-4633-b5a8-b62389f2002c tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23a274bf-5624-40a5-b87a-92ec7292df1a"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:18.916108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-06810a17-4012-4633-b5a8-b62389f2002c tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:18.928003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06810a17-4012-4633-b5a8-b62389f2002c tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.929010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06810a17-4012-4633-b5a8-b62389f2002c tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.929647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06810a17-4012-4633-b5a8-b62389f2002c tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.930579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06810a17-4012-4633-b5a8-b62389f2002c tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.931448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06810a17-4012-4633-b5a8-b62389f2002c tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.932042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06810a17-4012-4633-b5a8-b62389f2002c tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.984327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:18.985068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:18.991848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.992446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.993148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.996777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.997857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.998452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.074352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.083023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.084453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.085745 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1503dca6-4264-4d94-b0aa-6c625b2de4d5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1282 microversion: 2.25 time: 0.105944 Oct 27 10:11:19.090656 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 452/904] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:18 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:19.345469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:19.348360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:19.355857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:19.356621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:19.357245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.358146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:19.358865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:19.359364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.425940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.434189 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f035a83c-0ea2-468b-82e5-5a3d1c8cb60b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1331 microversion: 2.1 time: 0.092691 Oct 27 10:11:19.435097 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 453/905] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:19 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:19.450686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:19.451513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:19.458287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:19.458890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:19.459442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.460354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:19.460926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:19.461441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.611483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.620588 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61689494-88af-44bb-9630-d97b687914bf tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.174759 Oct 27 10:11:19.621298 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 454/906] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:19 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:19.625917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:19.626801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:19.633884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:19.634473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:19.635017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.635807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:19.636697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:19.637232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.704142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.712931 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2bb287b-f466-480d-b84e-8bd06d510d57 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1230 microversion: 2.1 time: 0.090549 Oct 27 10:11:19.713891 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 455/907] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:19 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:19.718963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:19.719607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:19.734395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:19.734888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:19.735328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.736071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:19.736546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:19.737136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.843266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.853048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.854650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.862093 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f10c7e0c-9a37-46e5-b04f-92fa0433eff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.147045 Oct 27 10:11:19.881311 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 456/908] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:19 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:20.113118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:20.113320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:20.119683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.120155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.120589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.121320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.121858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.122177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.223622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:20.251649 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-06810a17-4012-4633-b5a8-b62389f2002c tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "POST /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.345254 Oct 27 10:11:20.258953 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 453/909] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:11:18 2022] POST /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 194 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:20.269567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:20.285187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:20.286712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:20.287884 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eef9373a-7ef3-415c-9fa1-f33b839ab4a8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1338 microversion: 2.25 time: 0.180907 Oct 27 10:11:20.288647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 457/910] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:20 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1338 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:20.460498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:20.461394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:20.468506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.469217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.469613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.470335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.470974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.471402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.553456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:20.568329 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-514b73f6-992d-44d5-a724-a8b37532c3e1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1337 microversion: 2.1 time: 0.112373 Oct 27 10:11:20.580781 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 454/911] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:20 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:20.646069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:20.647798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:20.652339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:20.658002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.666891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.668906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.669688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.670163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.670623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.737612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:20.738393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:20.745199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.745908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.746538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.747507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.748171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.748854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.841744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:20.854873 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-18884a73-1dae-4d6c-af50-3c8c01824f86 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1230 microversion: 2.1 time: 0.121950 Oct 27 10:11:20.860368 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 455/912] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:20 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1230 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:20.891434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:20.892300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:20.899031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.899784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.900454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.901561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.902510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.903395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.910467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:20.918594 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ebee0bf-f956-4401-b65c-358608d4200a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.277655 Oct 27 10:11:20.919097 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 458/913] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:20 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:21.022196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:21.037990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:21.039577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:21.045474 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-51fb8c24-1ff3-442e-9e88-317ec2c2de91 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.158202 Oct 27 10:11:21.066763 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 456/914] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:20 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:21.313950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:21.314493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:21.324540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:21.339538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:21.340153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:21.346489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:21.347287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:21.347729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:21.531590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:21.535218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:21.550235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:21.552123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:21.553831 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69164bf2-3eb3-4888-8aaf-6bb2b1562ae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1338 microversion: 2.25 time: 0.244323 Oct 27 10:11:21.554575 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 459/915] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:21 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1338 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:21.593168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:21.594077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:21.600616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:21.601355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:21.602299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:21.603203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:21.603808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:21.604396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:21.884765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:21.885384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:21.895250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:21.895742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:21.900507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:21.907090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:21.907582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:21.908029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:22.204633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:22.220459 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca5d06d8-853a-4f9e-8003-8f8b9120ded0 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1230 microversion: 2.1 time: 0.332891 Oct 27 10:11:22.222109 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 460/916] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:21 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1230 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:22.241703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:22.243214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:22.265383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:22.265870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:22.266510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:22.267401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:22.268031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:22.268631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:22.497722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:22.521330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:22.529114 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-704f7e86-0f43-45bd-9748-8b99c5c16621 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1379 microversion: 2.1 time: 0.940191 Oct 27 10:11:22.540034 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 457/917] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:21 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1379 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:22.565821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:22.566496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:22.596898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:22.598489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:22.598950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:22.599683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:22.600144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:22.600573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:22.734354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:22.747138 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5cdb7620-8588-4fde-94a3-202e1399bcc3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.523662 Oct 27 10:11:22.750708 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 461/918] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:22 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:22.773613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:22.778873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:22.802767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:22.803731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:22.804368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:22.805339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:22.806381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:22.807016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:22.941114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:22.948651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:22.958426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:22.974914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:22.981116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:22.983546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:22.989783 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-298c6c8b-f9ed-402a-b55d-293eb0dc6bc1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1344 microversion: 2.25 time: 0.219103 Oct 27 10:11:22.992699 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e45de6a-f7c8-4fb3-a997-af835166be33 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.450081 Oct 27 10:11:22.993332 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 462/919] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:22 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1344 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:22.997673 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 458/920] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:22 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:23.251638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:23.252610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:23.262195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-54563542-977e-456d-96ed-3f84d4d11570 req-b585eb4e-f9d1-491e-8663-45cfaa0daef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7", "tag": "4d13e56c-1fad-4227-983b-7b7a9cffcefd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:23.269460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:23.271643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:23.289723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:23.296834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:23.297743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:23.299010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:23.310137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-54563542-977e-456d-96ed-3f84d4d11570 req-b585eb4e-f9d1-491e-8663-45cfaa0daef4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:23.313366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-54563542-977e-456d-96ed-3f84d4d11570 req-b585eb4e-f9d1-491e-8663-45cfaa0daef4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:23.314463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-54563542-977e-456d-96ed-3f84d4d11570 req-b585eb4e-f9d1-491e-8663-45cfaa0daef4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:23.330275 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-54563542-977e-456d-96ed-3f84d4d11570 req-b585eb4e-f9d1-491e-8663-45cfaa0daef4 service nova] Creating event network-changed:4d13e56c-1fad-4227-983b-7b7a9cffcefd for instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 on n-h2-854663-10 Oct 27 10:11:23.338960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-54563542-977e-456d-96ed-3f84d4d11570 req-b585eb4e-f9d1-491e-8663-45cfaa0daef4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080470 Oct 27 10:11:23.340014 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 459/921] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:23.410497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:23.422306 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cafc99d1-64f3-4cd1-9c5d-dd698b31a298 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1286 microversion: 2.1 time: 0.177811 Oct 27 10:11:23.423834 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 463/922] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:23 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1286 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:23.567914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:23.568932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:23.579362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:23.580171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:23.581526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:23.582499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:23.583154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:23.584354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:23.790614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:23.792318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:23.811157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:23.813096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:23.813774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:23.816002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:23.816952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:23.817480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:23.878904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:24.414676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.448515 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d09880a9-dd5e-424f-9521-aa960de8d838 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1379 microversion: 2.1 time: 0.886115 Oct 27 10:11:24.450833 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 460/923] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:23 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1379 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:24.462386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:24.466040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:24.480044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.481381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.482159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:24.486410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.487219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.487915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:24.619040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.628741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.633363 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2102d8ce-dbfa-4aa7-b4bb-b7c1a016b3b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.855351 Oct 27 10:11:24.649133 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 464/924] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:23 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:24.649526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.656555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.660345 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-847f24cf-186b-4df9-b941-4bba313e5316 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1344 microversion: 2.25 time: 0.203244 Oct 27 10:11:24.664784 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 461/925] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:24 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1344 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:24.666332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:24.666965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:24.673373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.673863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.674294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:24.674994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.675440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.675855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:24.682690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:24.683556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:24.695775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.697813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.698743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:24.702073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.705690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.706579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:24.861986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.870769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.870985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.872749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.878570 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fec1ab56-cac1-411e-acd6-f1269fd7eb8b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1531 microversion: 2.91 time: 0.228035 Oct 27 10:11:24.893044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=26 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:24.894972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe2e3559-9728-4b02-b96c-0b53de8de9be tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1292 microversion: 2.1 time: 0.228764 Oct 27 10:11:24.895140 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 465/926] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:24 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1531 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:24.896208 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 462/927] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:24 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1292 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:24.909875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:24.910783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:24.917878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.918636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.919279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:24.920200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.920956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.921537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.082461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lazy-loading 'services' on Instance uuid 6348df04-190c-4588-a3e2-40f1b1e0f753 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:11:25.135044 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-235bad4a-9c3f-48db-8bc2-737f8f4304bc tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1938 microversion: 2.91 time: 0.228772 Oct 27 10:11:25.167755 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 466/928] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:24 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1938 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:25.172522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:25.173084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:25.183797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.184365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.184808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.185531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.186557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.186557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.243564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lazy-loading 'flavor' on Instance uuid 6348df04-190c-4588-a3e2-40f1b1e0f753 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:11:25.482887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:25.486284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:25.510899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.511400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.511844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.512561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.513276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.513858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.557597 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b4ed8de-3e33-4362-bc65-403d5a3f275d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "POST /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753/action" status: 202 len: 0 microversion: 2.91 time: 0.389158 Oct 27 10:11:25.558230 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 463/929] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:11:25 2022] POST /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:11:25.577500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:25.578201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:25.586309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.587021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.587619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.588548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.589174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.589927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.701083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:25.715668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:25.718211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:25.725119 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d6076a37-2a56-4a91-a0eb-68b18e77f1cd tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.161721 Oct 27 10:11:25.725709 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 464/930] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:25 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:25.731107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:25.731721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:25.738062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.738521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.739201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.740265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.740899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.741458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.071142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:26.080773 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3d3f414-689b-4232-871e-52650de5edd4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1379 microversion: 2.1 time: 0.607139 Oct 27 10:11:26.093691 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 467/931] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:25 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1379 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:26.102632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:26.103700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:26.115265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.116137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.116840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.117769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.118417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.119065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.252256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:26.263365 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22a0d699-0b92-499b-977d-98ff00a13950 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.536329 Oct 27 10:11:26.280264 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 465/932] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:25 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:26.280264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:26.282222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:26.305012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.305524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.305970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.306695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.307149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.307577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.550927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:26.560551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:26.563377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:26.565194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f46987f-71c0-4552-a659-9495d1098125 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.470135 Oct 27 10:11:26.569206 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 468/933] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:26 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:26.576128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:26.576905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:26.586131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.586910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.587539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.588464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.589132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.589716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.629291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:26.653567 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b9321bf6-97b4-442b-9395-f83b7ce9e1ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.383179 Oct 27 10:11:26.656304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:11:26.657555 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 466/934] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:26 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:26.763969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:26.765164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:26.787677 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3c3ddff-0f9e-46cd-8301-c6739b7a34f4 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 204 len: 0 microversion: 2.1 time: 0.216457 Oct 27 10:11:26.789012 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 469/935] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:11:26 2022] DELETE /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:11:26.789608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.790104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.790533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.791926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.792378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.792828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.948609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:26.975280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:26.980648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:26.996244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1514402238", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "1224059415", "adminPass": "***", "networks": [{"uuid": "da8fce7d-e4f7-43ce-ba6d-5054f1b8720a"}], "security_groups": [{"name": "tempest-securitygroup--1333909223"}], "key_name": "tempest-keypair-2080193100", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:27.002496 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-251a3589-dca2-4737-9a9c-527ce81c41f5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.245636 Oct 27 10:11:27.017593 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 467/936] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:26 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:27.117220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:27.119790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:27.132858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.133622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.134351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.135217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.135842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.136427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.383983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] validate_networks() for [('da8fce7d-e4f7-43ce-ba6d-5054f1b8720a', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:11:27.707644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:27.729832 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd6b77cc-d71a-4ecc-bb97-393e405c2651 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1379 microversion: 2.1 time: 0.623490 Oct 27 10:11:27.732791 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 468/937] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:27 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1379 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:27.747961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:27.750129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:27.771791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.773459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.775374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.777701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.778500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.779187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:28.578348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:28.592707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ff7745a-74dc-43ee-b0e2-d582d95c2188 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.853945 Oct 27 10:11:28.596748 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 469/938] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:27 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:28.599199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:28.599924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:28.609962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:28.610600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:28.611140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:28.611987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:28.612928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:28.613097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.144751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:29.154926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:29.162558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:29.163730 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e734ab5-ddb5-4fd1-9f98-6797b3c718fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.569227 Oct 27 10:11:29.165466 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 470/939] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:28 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:29.174086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:29.177955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:29.201003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:29.201956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:29.202882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.203792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:29.204421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:29.205186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.243854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:11:29.244339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:11:29.245009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:11:29.245520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:11:29.246023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:11:29.261211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:29.261847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:29.262497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.263359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:29.264008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:29.264772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.291766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Getting quotas for project 53cec1ab41cb408bab6c71ee8345de63. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:29.298889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Getting quotas for user 9a92b84bbef9472fa37a1e09b438be26 and project 53cec1ab41cb408bab6c71ee8345de63. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:29.317203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:11:29.320155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:11:29.394693 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7cff200b-ce68-4a9e-a227-ea782f759de7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.405810 Oct 27 10:11:29.396504 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 470/940] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:11:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:11:29.401996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:29.403178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:29.412458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:29.413103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:29.413729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.414562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:29.415115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:29.415648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.586643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:29.606979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:29.613259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:29.628289 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9b06db40-a44b-4591-9f96-f856fee99bf8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.230552 Oct 27 10:11:29.650413 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 471/941] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:29 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:29.659780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:29.659780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:29.705760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:29.708625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:29.709681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.713457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:29.717150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:29.720147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.779904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:29.795831 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e3a79043-8648-48e3-9ce7-3369650e961e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.628781 Oct 27 10:11:29.796739 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 471/942] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:29 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:29.806883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81f4a6fb-9dfb-4357-8272-d2aae9a83582 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:29.807591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-81f4a6fb-9dfb-4357-8272-d2aae9a83582 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:30.128515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-81f4a6fb-9dfb-4357-8272-d2aae9a83582 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:30.138548 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81f4a6fb-9dfb-4357-8272-d2aae9a83582 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1265 microversion: 2.1 time: 0.340534 Oct 27 10:11:30.139565 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 472/943] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:29 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1265 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:30.160058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:30.161204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:30.173524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:30.173992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:30.177721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:30.178644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:30.181799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:30.182468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:30.823923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:30.887195 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52e1667f-576c-4926-b3d3-fa9ce1b34a61 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1379 microversion: 2.1 time: 1.247587 Oct 27 10:11:30.887832 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 472/944] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:29 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1379 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:30.893125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-92670b21-2539-42c0-b239-62f758e44f53 req-2c74b9fd-a085-4e78-9a7f-0f191cf4f82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ee331c-acfa-4bdb-abeb-8145043083a5", "name": "network-vif-deleted", "tag": "bdcb63e0-5ead-464c-99d6-20cb557a74a4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:30.910822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-92670b21-2539-42c0-b239-62f758e44f53 req-2c74b9fd-a085-4e78-9a7f-0f191cf4f82e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:30.911305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-92670b21-2539-42c0-b239-62f758e44f53 req-2c74b9fd-a085-4e78-9a7f-0f191cf4f82e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:30.911737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-92670b21-2539-42c0-b239-62f758e44f53 req-2c74b9fd-a085-4e78-9a7f-0f191cf4f82e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:30.926444 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-92670b21-2539-42c0-b239-62f758e44f53 req-2c74b9fd-a085-4e78-9a7f-0f191cf4f82e service nova] Creating event network-vif-deleted:bdcb63e0-5ead-464c-99d6-20cb557a74a4 for instance f4ee331c-acfa-4bdb-abeb-8145043083a5 on n-h2-854663-10 Oct 27 10:11:30.932219 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-92670b21-2539-42c0-b239-62f758e44f53 req-2c74b9fd-a085-4e78-9a7f-0f191cf4f82e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042754 Oct 27 10:11:30.933323 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 473/945] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:30.940246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:30.941158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:30.947824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:30.948466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:30.949111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:30.949984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:30.950587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:30.951164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.063234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:31.073023 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af771c9d-a679-440d-94e2-171a84d7424e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.931340 Oct 27 10:11:31.073612 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 473/946] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:30 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:31.084952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-422093f6-95aa-4b61-b179-ca5346e35f48 req-929cb583-c442-4e17-a82b-9cc42be8e52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db810b22-71e9-4b8c-bbaf-59b8443d408b", "tag": "3dd60d44-bd56-4d7b-b71c-ba708a3df480"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:31.091646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-422093f6-95aa-4b61-b179-ca5346e35f48 req-929cb583-c442-4e17-a82b-9cc42be8e52e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.091760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-422093f6-95aa-4b61-b179-ca5346e35f48 req-929cb583-c442-4e17-a82b-9cc42be8e52e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.092304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-422093f6-95aa-4b61-b179-ca5346e35f48 req-929cb583-c442-4e17-a82b-9cc42be8e52e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.097506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:31.113618 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-422093f6-95aa-4b61-b179-ca5346e35f48 req-929cb583-c442-4e17-a82b-9cc42be8e52e service nova] Creating event network-changed:3dd60d44-bd56-4d7b-b71c-ba708a3df480 for instance db810b22-71e9-4b8c-bbaf-59b8443d408b on n-h2-854663-10 Oct 27 10:11:31.123057 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-422093f6-95aa-4b61-b179-ca5346e35f48 req-929cb583-c442-4e17-a82b-9cc42be8e52e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048039 Oct 27 10:11:31.125811 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 474/947] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:31.131796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:31.133974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:31.141528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.142302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.142916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.143787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.144384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.145044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.283617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:31.312127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:31.318006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:31.345762 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a27b0ca-be7a-4a2c-8037-abb5101ded16 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.218493 Oct 27 10:11:31.367621 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 475/948] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:31 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:31.390514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:31.394442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:31.409154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.409918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.422275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.425063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.425792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.426487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.453834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:31.473228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:31.474706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:31.495266 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d77f56bf-a060-48d8-a998-5c9d402288a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.557604 Oct 27 10:11:31.495924 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 474/949] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:30 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:31.519794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:31.522330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:31.527000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:31.534219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.535491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.536223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.537265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.537942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.538664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.717814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:31.725423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:31.736503 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95ba2b66-068c-41b3-9ebc-31b9ccdb0ebc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1317 microversion: 2.1 time: 0.228262 Oct 27 10:11:31.737642 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 475/950] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:31 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:31.742942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5106781d-3ba3-4b5c-8341-a0228c915bb1 req-ee22adf9-f683-40bb-8caa-cfefe385008f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7", "name": "network-vif-plugged", "status": "completed", "tag": "4d13e56c-1fad-4227-983b-7b7a9cffcefd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:31.759893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5106781d-3ba3-4b5c-8341-a0228c915bb1 req-ee22adf9-f683-40bb-8caa-cfefe385008f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.760432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5106781d-3ba3-4b5c-8341-a0228c915bb1 req-ee22adf9-f683-40bb-8caa-cfefe385008f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.761034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5106781d-3ba3-4b5c-8341-a0228c915bb1 req-ee22adf9-f683-40bb-8caa-cfefe385008f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.787481 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5106781d-3ba3-4b5c-8341-a0228c915bb1 req-ee22adf9-f683-40bb-8caa-cfefe385008f service nova] Creating event network-vif-plugged:4d13e56c-1fad-4227-983b-7b7a9cffcefd for instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 on n-h2-854663-10 Oct 27 10:11:31.795331 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5106781d-3ba3-4b5c-8341-a0228c915bb1 req-ee22adf9-f683-40bb-8caa-cfefe385008f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056098 Oct 27 10:11:31.796678 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 476/951] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:31.915460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:31.916399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:31.923468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.924321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.925042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.926153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.926841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.927668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.297675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.306141 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dfe933e1-d97d-4bf8-bc15-3e5ea30e0651 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.929921 Oct 27 10:11:32.306720 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 476/952] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:31 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:32.311512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:32.312109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:32.318701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.318875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.319266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.319955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.320394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.320841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.328779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.337350 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1704f46a-f466-449b-810e-401fc5d4bc45 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1379 microversion: 2.1 time: 0.426524 Oct 27 10:11:32.337934 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 477/953] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:31 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1379 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:32.463317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.471010 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c278e207-1e84-42d0-9300-c3adade82042 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.163318 Oct 27 10:11:32.471583 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 477/954] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:32 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:32.476100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:32.476739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:32.482314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.482866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.483518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.484179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.484822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.485236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.525836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16e5c725-63d9-4ea0-ac55-f1bfe65e0de0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Action: 'create', calling method: .version_select at 0x7f6d5ba86c10>, body: {"keypair": {"name": "tempest-keypair-247979697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+MYurDQALaS05QcyRxdgOiWBAxjH7t2sw0R70ZwFdoEO95VK+gmGmC9ihqCl0jA09Lx0qFBuEnHy/SBQOBw/b18JGrqp+TFbKmPZsYFkQYlhK+2Rmm7taC6RI4ORRUPw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:32.541679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-16e5c725-63d9-4ea0-ac55-f1bfe65e0de0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Getting quotas for project 9f4455cea86546b08fb9a4cce57efedb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:32.547050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-16e5c725-63d9-4ea0-ac55-f1bfe65e0de0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Getting quotas for user 10ed2e5b74c14b579755e3c5cbe79689 and project 9f4455cea86546b08fb9a4cce57efedb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:32.548710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.556922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.558433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.564104 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7012aa2-2abd-4e53-b963-50920eb44e50 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.091467 Oct 27 10:11:32.576710 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 478/955] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:32 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:32.576710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:32.576710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:32.577191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.578024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.578672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.579593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.580202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.580844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.589673 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16e5c725-63d9-4ea0-ac55-f1bfe65e0de0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.250646 Oct 27 10:11:32.590572 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 478/956] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:11:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:32.763170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:32.764059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:32.772093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.772792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.773388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.774322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.774963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.775578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.815714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.824871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.826390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.827520 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6be2a53c-61e0-44e4-895b-294036a8ae54 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.261274 Oct 27 10:11:32.828313 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 479/957] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:32 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:32.871458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.880364 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e12244f-7519-4051-84ff-3c4a033c1390 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1325 microversion: 2.1 time: 0.121622 Oct 27 10:11:32.881070 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 479/958] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:32 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1325 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:33.185002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-153052c6-1f22-4535-9e94-6cddc77989b4 req-d68566bc-8542-4b3e-86c9-93d1ce88f2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029ff781-574b-48de-9033-cd8e69e64ec2", "tag": "9d537db4-55a5-4b36-81b4-2f467d976981"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:33.195911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-153052c6-1f22-4535-9e94-6cddc77989b4 req-d68566bc-8542-4b3e-86c9-93d1ce88f2a0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.196432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-153052c6-1f22-4535-9e94-6cddc77989b4 req-d68566bc-8542-4b3e-86c9-93d1ce88f2a0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.197006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-153052c6-1f22-4535-9e94-6cddc77989b4 req-d68566bc-8542-4b3e-86c9-93d1ce88f2a0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.209580 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-153052c6-1f22-4535-9e94-6cddc77989b4 req-d68566bc-8542-4b3e-86c9-93d1ce88f2a0 service nova] Creating event network-changed:9d537db4-55a5-4b36-81b4-2f467d976981 for instance 029ff781-574b-48de-9033-cd8e69e64ec2 on n-h2-854663-10 Oct 27 10:11:33.214446 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-153052c6-1f22-4535-9e94-6cddc77989b4 req-d68566bc-8542-4b3e-86c9-93d1ce88f2a0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033584 Oct 27 10:11:33.215276 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 480/959] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:33.330018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:33.330581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:33.337932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.338418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.338856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.339546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.339992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.340524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.361412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:33.362434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:33.369336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.369927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.370641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.371455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.372040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.372526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.534104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:33.542306 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-816a6335-eea4-4bae-b415-e926ae605970 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.216210 Oct 27 10:11:33.552725 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 480/960] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:33 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:33.558190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:33.559166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:33.563994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:33.567346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.568244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.569024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.569903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.570503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.571074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.572849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d09cb41-f601-4a13-9548-5b1b0a10c948 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1379 microversion: 2.1 time: 0.216922 Oct 27 10:11:33.573439 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 481/961] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:33 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1379 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:33.603169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:33.604042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:33.610624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.611420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.612074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.612554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.613036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.613647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.693611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:33.704544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:33.706320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:33.712175 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58f45d38-4600-4b4e-9d9e-6605fe0dfd23 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.113746 Oct 27 10:11:33.713003 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 482/962] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:33 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:11:33.743825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:33.751731 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a11e138e-af5a-4e62-9600-b17368e28314 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.199928 Oct 27 10:11:33.752345 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 481/963] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:33 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:33.853096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:33.853696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:33.855672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:33.861612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.862199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.862725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.863568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.864141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.864562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.906214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:33.906965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:33.916160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.916644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.917103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.917801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.918227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.918669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.989226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:33.997697 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18e3f89f-8f51-45fd-9020-99e282a7df57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1325 microversion: 2.1 time: 0.095584 Oct 27 10:11:33.998708 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 482/964] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:33 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1325 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:34.004337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-851013660", "imageRef": "92a754eb-56f3-4391-966f-2c2483aa2eea", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a5418324-210f-48c1-8f96-08cb8e91ed38"}], "security_groups": [{"name": "tempest-securitygroup--740091565"}], "key_name": "tempest-keypair-247979697", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:34.036155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:34.044192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:34.045697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:34.046875 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8ba82fa-ba45-4ec1-81bd-1f0acac42b1d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.197869 Oct 27 10:11:34.047414 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 483/965] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:33 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:34.113288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] validate_networks() for [('a5418324-210f-48c1-8f96-08cb8e91ed38', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:11:34.505308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:11:34.505921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:11:34.506358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:11:34.506950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:11:34.507547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:11:34.518868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.519351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.519784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.520505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.520983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.521402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.539512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Getting quotas for project 9f4455cea86546b08fb9a4cce57efedb. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:34.544261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Getting quotas for user 10ed2e5b74c14b579755e3c5cbe79689 and project 9f4455cea86546b08fb9a4cce57efedb. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:34.556031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:11:34.558454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92a754eb-56f3-4391-966f-2c2483aa2eea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:11:34.567443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:34.568213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:34.575993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.576514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.576980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.577670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.578111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.578525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.609268 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2c2b25e-1038-4748-bf36-a31f082a47ce tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.609340 Oct 27 10:11:34.609955 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 483/966] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:11:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:11:34.621119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:34.621743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:34.628611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.628976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.629413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.630160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.630610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.631092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.863981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:34.874027 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d36d0ad6-cbdb-4e8c-a2f7-e8bb28ddcfc3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.310330 Oct 27 10:11:34.874732 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 484/967] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:34 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:34.879469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42987e20-cb87-43a9-a5de-9f6f11c379ca tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:34.880077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-42987e20-cb87-43a9-a5de-9f6f11c379ca tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:34.900986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:34.913661 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac249fe4-5944-468d-aa28-c599f2d29f67 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1379 microversion: 2.1 time: 0.296168 Oct 27 10:11:34.914947 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 484/968] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:34 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1379 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:34.935199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:34.943501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:34.945663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-42987e20-cb87-43a9-a5de-9f6f11c379ca tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:34.951928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.952406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.952871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.953962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.954418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.954832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.962742 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-42987e20-cb87-43a9-a5de-9f6f11c379ca tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1244 microversion: 2.1 time: 0.086767 Oct 27 10:11:34.963742 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 485/969] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:34 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:34.972369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:34.973202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:34.979877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.980380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.980863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.981560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.982081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.982724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:35.038509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:35.049258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:35.050695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:35.056213 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24861ad5-1817-428e-afce-88bc3c07d830 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.140282 Oct 27 10:11:35.057824 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 485/970] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:34 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:35.063764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:35.064567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:35.076705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:35.077181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:35.077626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:35.078345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:35.078804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:35.079516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:35.164302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:35.175222 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-105c75b2-93fc-405d-8ee6-1f34a6984035 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1325 microversion: 2.1 time: 0.115701 Oct 27 10:11:35.175841 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 486/971] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:35 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1325 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:35.195267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:35.196297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:35.205381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:35.205867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:35.206304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:35.206997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:35.207437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:35.207853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:35.227596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:35.237645 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1d74914-d490-49e1-bf11-f9d15f465d3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.272085 Oct 27 10:11:35.238845 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 486/972] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:34 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:35.458509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:35.469916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:35.472152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:35.474155 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c903166f-1c57-4f17-9b25-ca2b6f5e5b68 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.287460 Oct 27 10:11:35.475103 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 487/973] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:35 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:35.902382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:35.902950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:35.911479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:35.912047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:35.912475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:35.913721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:35.914348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:35.914984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:35.960116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:35.960768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:35.968486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:35.969978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:35.970421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:35.971114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:35.971758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:35.972254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.146007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.154852 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-367b5f94-fec8-4723-82b1-0dee6b18b8b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.258163 Oct 27 10:11:36.155453 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 487/974] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:35 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:36.158552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.161237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:36.161860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:36.166788 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5256915d-86c5-4994-97d1-882f3c9d41f2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1379 microversion: 2.1 time: 0.226505 Oct 27 10:11:36.167392 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 488/975] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:35 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1379 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:36.168914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.169413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.169896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.170612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.171066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.171608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.173728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:36.174311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:36.181103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.181571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.182025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.182744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.183189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.183593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.248509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.256594 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-44675454-cec0-410c-ab7d-2892caffe80e tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1248 microversion: 2.1 time: 0.099205 Oct 27 10:11:36.257737 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 488/976] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:36 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1248 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:36.262498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:36.263126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:36.268578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.270563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.271032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.271532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.272324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.272870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.273284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.277650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.279607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.284916 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d4cc1e7-28cb-4dbe-86ea-78558483f6e7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.116268 Oct 27 10:11:36.285477 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 489/977] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:36 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:36.290022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:36.290639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:36.297218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.297539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.297993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.298707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.299166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.299574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.341175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.349930 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c0eeaaf7-7f54-41cb-ad1e-c71cf85699e6 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1325 microversion: 2.1 time: 0.091123 Oct 27 10:11:36.350524 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 489/978] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:36 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1325 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:36.442861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.450975 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dcfb94a0-673e-48e2-ab0a-4f31dec4a0db tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.164526 Oct 27 10:11:36.451592 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 490/979] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:36 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:36.502148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:36.502761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:36.509144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.509620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.510063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.510763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.511206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.511623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.658968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.671549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.673018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.674180 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f4ec630-0130-463d-99ec-8208bd1a4a20 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.176282 Oct 27 10:11:36.674757 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 490/980] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:36 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:37.180496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.183777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.190799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.190927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.191426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.191634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.191976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.192906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.193373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.193776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.200764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.201357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.201838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.202798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.203298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.203901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.395345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.400926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.403859 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e275e4eb-2aeb-47e2-9a10-969865abd7bd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.227750 Oct 27 10:11:37.404450 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 491/981] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:37.407635 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2e88ab9-7e48-4e71-9a88-a251ecc09271 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1529 microversion: 2.1 time: 0.221018 Oct 27 10:11:37.408201 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 491/982] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1529 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:37.409095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.409829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.413346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.413966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.415871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.416347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.416791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.417648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.418089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.418658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.419925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.420523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.421112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.421809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.422420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.422840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.505770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.507304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.513854 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1031b7dd-12ad-422d-957c-02a4ad79e077 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1248 microversion: 2.1 time: 0.108229 Oct 27 10:11:37.514668 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 492/983] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1248 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:37.516116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.517592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.519289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.520143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.523079 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43b5c9ce-4f47-4848-a616-fa12138f7a3b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.113700 Oct 27 10:11:37.524092 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 492/984] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:37.529196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.529933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.534327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.534815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.535240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.536145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.536415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.536611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.536922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.537150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.537354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.538322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.538769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.539183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.544204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:37.628842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.637502 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41d709ed-6e0f-4e3e-ba11-78710036b494 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1325 microversion: 2.1 time: 0.121810 Oct 27 10:11:37.638086 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 493/985] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1325 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:37.650665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.650665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.652817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.653313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.653680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.654628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.655343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.656020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.710356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.718919 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7bbb8537-0c27-4706-afc1-992dd8216b75 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1529 microversion: 2.1 time: 0.193696 Oct 27 10:11:37.726192 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 493/986] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1529 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:37.726192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.727183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.735470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.735965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.736869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.737785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.738233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.738650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.828339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.830814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:37.838552 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b0387d2-8f8c-4447-a68c-4979100ea83d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.199425 Oct 27 10:11:37.839300 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 494/987] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:37.844307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81a567de-9d08-4472-8a82-fa4dc727d44d tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.863128 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81a567de-9d08-4472-8a82-fa4dc727d44d tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/69b97d16-8178-4c4f-a34e-1009f47f531e" status: 202 len: 0 microversion: 2.1 time: 0.022679 Oct 27 10:11:37.863817 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 495/988] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:11:37 2022] DELETE /compute/v2.1/flavors/69b97d16-8178-4c4f-a34e-1009f47f531e => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:11:37.871899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cda97a86-ea3a-4b2a-a0a1-253112a3a295 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.893548 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cda97a86-ea3a-4b2a-a0a1-253112a3a295 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.025544 Oct 27 10:11:37.894557 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 496/989] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:37.897291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.906084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.907508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.908624 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff5851a5-36f4-489d-a13a-666156652735 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.187814 Oct 27 10:11:37.909203 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 494/990] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:37.913841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:37.916120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.922553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.923032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.923471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.924161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.924598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.925047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.017254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:38.023936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Old instance type tempest-test_resize_flavor_-616169045, new instance type m1.heat {{(pid=120720) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 10:11:38.031615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:11:38.032034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:11:38.032515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:11:38.032960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:11:38.033370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:11:38.151400 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0229bfbd-810d-4a88-89a0-724a04e9ba17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7/action" status: 202 len: 0 microversion: 2.1 time: 0.241085 Oct 27 10:11:38.152570 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 497/991] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:11:37 2022] POST /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:11:38.160567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:38.161273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:38.167994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.168557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.169083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.169833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.170353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.170781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.338681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:38.358014 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c39cf77-5bc2-4f1c-a4a3-2cbfc6e84e82 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.201161 Oct 27 10:11:38.359093 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 495/992] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:38 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:38.434325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:38.435119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:38.443432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.444437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.445077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.446056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.446765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.447464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.539054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:38.539694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:38.550980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.551483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.553093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.554909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.555381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.557084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.748262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:38.764377 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-935072c8-eaa5-489a-a1e7-5d9fa6c4add6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1240 microversion: 2.1 time: 0.229420 Oct 27 10:11:38.765330 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 496/993] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:38 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1240 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:38.778415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:38.780876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:38.789808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.790543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.792028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.793018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.794913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.796423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.985230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:38.991245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:39.006497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:39.008166 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c301c6ff-e810-47a2-be11-17e2c4eba27f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.577765 Oct 27 10:11:39.009181 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 498/994] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:38 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:39.012591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:39.016995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:39.031745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:39.039274 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac6906d4-d27a-464b-bc3e-d6270fb556d8 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.270295 Oct 27 10:11:39.052561 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 497/995] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:38 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:39.053621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:39.053621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:39.053621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:39.053621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:39.054146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:39.054146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:39.058780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:39.059580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:39.071877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:39.072374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:39.072845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:39.073565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:39.074016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:39.074442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:39.298924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:39.321157 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1da7e0f1-600a-48b0-8bca-dcaf4a2e73bf tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1323 microversion: 2.1 time: 0.310053 Oct 27 10:11:39.323004 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 499/996] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:39 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:39.330605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:39.331451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:39.339970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:39.340745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:39.341329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:39.342826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:39.343920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:39.344536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.044765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.054694 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8555dae6-f44e-46bf-967b-e15f53ae3cd3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 1.011100 Oct 27 10:11:40.055203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.066944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.068718 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 498/997] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:39 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:40.069574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.070930 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8ff6fb8-13a9-43bd-aca5-2aea5f063b32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.746802 Oct 27 10:11:40.071825 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 500/998] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:39 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:40.076599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:40.077226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:40.083596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.084290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.085419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.086278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.086876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.087442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.194342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1845416c-f350-43f6-b852-2fdee52ff4f1"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:40.196837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:40.203732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.204340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.204914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.205643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.206132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.206957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.285633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.296026 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-539f33cd-c1ee-4bbf-a7f5-b87111e59dc9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.226118 Oct 27 10:11:40.296595 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 499/999] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:40 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:40.311859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3812b351-8954-4283-8bda-9ea3356c8ecd req-58ca5b0a-12dd-4c2f-9d94-01c82430632f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db810b22-71e9-4b8c-bbaf-59b8443d408b", "name": "network-vif-plugged", "status": "completed", "tag": "3dd60d44-bd56-4d7b-b71c-ba708a3df480"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:40.322874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3812b351-8954-4283-8bda-9ea3356c8ecd req-58ca5b0a-12dd-4c2f-9d94-01c82430632f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.323571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3812b351-8954-4283-8bda-9ea3356c8ecd req-58ca5b0a-12dd-4c2f-9d94-01c82430632f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.324165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3812b351-8954-4283-8bda-9ea3356c8ecd req-58ca5b0a-12dd-4c2f-9d94-01c82430632f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.337274 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3812b351-8954-4283-8bda-9ea3356c8ecd req-58ca5b0a-12dd-4c2f-9d94-01c82430632f service nova] Creating event network-vif-plugged:3dd60d44-bd56-4d7b-b71c-ba708a3df480 for instance db810b22-71e9-4b8c-bbaf-59b8443d408b on n-h2-854663-10 Oct 27 10:11:40.342831 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3812b351-8954-4283-8bda-9ea3356c8ecd req-58ca5b0a-12dd-4c2f-9d94-01c82430632f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044892 Oct 27 10:11:40.347724 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 500/1000] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:40.353199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:40.353928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:40.360266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.360772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.361201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.361885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.362446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.363042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.435019 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] HTTP exception thrown: Volume 1845416c-f350-43f6-b852-2fdee52ff4f1 could not be found. Oct 27 10:11:40.457221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.465215 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80ef5860-ac5b-4e12-a1da-8aa45d16d775 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1304 microversion: 2.1 time: 0.116032 Oct 27 10:11:40.466163 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 501/1001] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:40 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:40.471383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:40.472241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:40.479433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.480353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.481330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.482352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Request method failure captured: Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments/23a274bf-5624-40a5-b87a-92ec7292df1a HTTP/1.1 Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 74 Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWljcenMRZ3z7PwkNWmKzJjI1btGb7JztrzuxAkNWJXx7R3fUuQ6HwRHM385ZJUzBCg2e4aVkApnIUh2TLjlV7yZctmHz5_it3c2NRSOayjZ86qRS92s3QTvFFl06zWAwAECfKUuT_0n11bJV5PYuPSGOU5bjmE5HmZ94_dJ--Kr15r8 Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 269e24d765cc4bac916a179d9c045d28 Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesAdminNegativeTest-681828882 Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:11:40.482518 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/269e24d765cc4bac916a179d9c045d28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/269e24d765cc4bac916a179d9c045d28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_269e24d765cc4bac916a179d9c045d28", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/269e24d765cc4bac916a179d9c045d28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesAdminNegativeTest-681828882 Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 269e24d765cc4bac916a179d9c045d28 Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-681828882 Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesAdminNegativeTest-681828882-project-admin Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 63144bbc9a1f46caaadcffd263e1d519 Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesAdminNegativeTest-681828882-project-admin Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: {"volumeAttachment": {"volumeId": "1845416c-f350-43f6-b852-2fdee52ff4f1"}} Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:11:40.484335 n-d-854663-10 devstack@n-api.service[120720]: exception: Volume 1845416c-f350-43f6-b852-2fdee52ff4f1 could not be found. Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': 'a159ce32-162c-4abe-a82d-98d52c1b4a1d', 'id': '23a274bf-5624-40a5-b87a-92ec7292df1a', 'body': {'volumeAttachment': {'volumeId': '1845416c-f350-43f6-b852-2fdee52ff4f1'}}} Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:11:40.485675 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1845416c-f350-43f6-b852-2fdee52ff4f1 could not be found. (HTTP 404) (Request-ID: req-59e63c02-6dab-470c-888d-93add3150182) Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:11:40.486813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1845416c-f350-43f6-b852-2fdee52ff4f1 could not be found. Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:11:40.488134 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 1845416c-f350-43f6-b852-2fdee52ff4f1 could not be found. Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1845416c-f350-43f6-b852-2fdee52ff4f1 could not be found. Oct 27 10:11:40.489770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:11:40.492214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Returning 400 to user: Volume 1845416c-f350-43f6-b852-2fdee52ff4f1 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:11:40.492214 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f72a62b6-826d-49cf-9a57-7fe9eabfad3c tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] 10.222.0.76 "PUT /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments/23a274bf-5624-40a5-b87a-92ec7292df1a" status: 400 len: 107 microversion: 2.1 time: 0.411436 Oct 27 10:11:40.492999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.493142 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 501/1002] 10.222.0.76 () {60 vars in 1433 bytes} [Thu Oct 27 10:11:40 2022] PUT /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments/23a274bf-5624-40a5-b87a-92ec7292df1a => generated 107 bytes in 413 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:11:40.493282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.493416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:40.493416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:40.502689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.503172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.503601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.504365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.505274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.505892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.596318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.604508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.605983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.610971 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c97cd0a-fb1e-4b4e-9814-cbd6534d948b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.124585 Oct 27 10:11:40.611505 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 502/1003] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:40 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:40.616291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:40.618541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:40.629104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.629581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.630674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.631379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.631860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.632270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.665553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.673532 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab6ba3f9-7014-4c8c-a8ae-d95a392061e8 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.206437 Oct 27 10:11:40.674143 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 502/1004] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:40 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:40.678882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:40.679365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:40.685367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.685917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.686407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.687103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.687551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.688085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.766336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.775410 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b1bf414-70bc-4938-978a-0849845329c8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.162579 Oct 27 10:11:40.776283 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 503/1005] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:40 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:40.816092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lazy-loading 'services' on Instance uuid a159ce32-162c-4abe-a82d-98d52c1b4a1d {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:11:40.939315 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22111dc1-5062-4eb9-bc33-151251633866 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments/23a274bf-5624-40a5-b87a-92ec7292df1a" status: 202 len: 0 microversion: 2.1 time: 0.263979 Oct 27 10:11:40.939930 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 503/1006] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:11:40 2022] DELETE /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments/23a274bf-5624-40a5-b87a-92ec7292df1a => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:11:40.948496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-395e843f-4fcd-4609-8665-e8a6cd1a6997 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:40.950776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-395e843f-4fcd-4609-8665-e8a6cd1a6997 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:40.964841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395e843f-4fcd-4609-8665-e8a6cd1a6997 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.965430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395e843f-4fcd-4609-8665-e8a6cd1a6997 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.965862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395e843f-4fcd-4609-8665-e8a6cd1a6997 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.966666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395e843f-4fcd-4609-8665-e8a6cd1a6997 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.967361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395e843f-4fcd-4609-8665-e8a6cd1a6997 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.967886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395e843f-4fcd-4609-8665-e8a6cd1a6997 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.997870 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-395e843f-4fcd-4609-8665-e8a6cd1a6997 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053316 Oct 27 10:11:40.998465 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 504/1007] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:40 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:41.085765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:41.086691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:41.095440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.096087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.096651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.097630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.098222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.098781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.100738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:41.102089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:41.106723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:41.113540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.114642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.115072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.115745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.117023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.119760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.617414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.625739 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f65746b-bd16-4c5a-9126-8ef93e533350 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1471 microversion: 2.1 time: 0.545837 Oct 27 10:11:41.626285 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 504/1008] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:41 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1471 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:41.631198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:41.631803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:41.637968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.638427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.638992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.639690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.640138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.640553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.721576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.730461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.731948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.733453 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4892743e-f74d-42f7-9e88-65e1ae75767c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.640132 Oct 27 10:11:41.734031 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 505/1009] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:41 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:41.738335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:41.738936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:41.745298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.745875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.746279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.746966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.747403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.748365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.854683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.863220 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0bf079aa-d142-4ee6-b403-f2a07d3d73a6 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1302 microversion: 2.1 time: 0.128172 Oct 27 10:11:41.864104 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 506/1010] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:41 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1302 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:41.868688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:41.869254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:41.875196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.875672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.876096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.876826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.877265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.877675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.922504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.930346 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-49d853f3-364c-40e8-93d7-fb027844dd8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.303072 Oct 27 10:11:41.930913 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 505/1011] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:41 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:41.935384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:41.936042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:41.941806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.942262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.942902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.943586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.944028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.944419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.977061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.986028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.987747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.992720 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df17c0e4-3ae6-44c6-996e-e67a9a8bfa28 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.127657 Oct 27 10:11:41.993468 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 507/1012] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:41 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:42.008472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:42.009154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:42.015733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.016218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.016637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.017372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.017822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.018247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.298983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:42.313280 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf40142f-17c3-40c7-b3f0-0a5a4e8cd022 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.381245 Oct 27 10:11:42.329031 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 506/1013] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:41 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:42.338973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16540b19-e0f1-4034-9b0b-df8cd4ba3fed tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:42.342077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16540b19-e0f1-4034-9b0b-df8cd4ba3fed tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:42.349879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16540b19-e0f1-4034-9b0b-df8cd4ba3fed tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.353356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16540b19-e0f1-4034-9b0b-df8cd4ba3fed tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.353994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16540b19-e0f1-4034-9b0b-df8cd4ba3fed tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.354873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16540b19-e0f1-4034-9b0b-df8cd4ba3fed tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.355467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16540b19-e0f1-4034-9b0b-df8cd4ba3fed tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.357094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16540b19-e0f1-4034-9b0b-df8cd4ba3fed tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.413794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:42.427286 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff060a67-2d6d-48a3-ba00-f31bb17d6427 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.432882 Oct 27 10:11:42.429167 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 508/1014] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:41 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:42.432093 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16540b19-e0f1-4034-9b0b-df8cd4ba3fed tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101831 Oct 27 10:11:42.438131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2d541404-8461-4f47-a34e-8da7c52a6637 req-5c384ab5-25b3-498e-8340-22204f896ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029ff781-574b-48de-9033-cd8e69e64ec2", "name": "network-vif-plugged", "status": "completed", "tag": "9d537db4-55a5-4b36-81b4-2f467d976981"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:42.439572 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 507/1015] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:42 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:42.462788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2d541404-8461-4f47-a34e-8da7c52a6637 req-5c384ab5-25b3-498e-8340-22204f896ba6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.466000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2d541404-8461-4f47-a34e-8da7c52a6637 req-5c384ab5-25b3-498e-8340-22204f896ba6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.466800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2d541404-8461-4f47-a34e-8da7c52a6637 req-5c384ab5-25b3-498e-8340-22204f896ba6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.487578 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2d541404-8461-4f47-a34e-8da7c52a6637 req-5c384ab5-25b3-498e-8340-22204f896ba6 service nova] Creating event network-vif-plugged:9d537db4-55a5-4b36-81b4-2f467d976981 for instance 029ff781-574b-48de-9033-cd8e69e64ec2 on n-h2-854663-10 Oct 27 10:11:42.504040 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2d541404-8461-4f47-a34e-8da7c52a6637 req-5c384ab5-25b3-498e-8340-22204f896ba6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072764 Oct 27 10:11:42.511830 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 509/1016] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:42.650331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:42.652035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:42.659381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.673503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.673956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.674714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.675147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.675670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.687713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e29668ab-6a18-4e14-8ecf-2c86ede449f2 req-ebc5bf74-ae30-4590-a78e-92f70d6a7376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7ed094-4322-4336-a483-9eac9a0746dd", "tag": "9f52bf0c-5358-459e-9c48-a1e5361e5dbf"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:42.706251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e29668ab-6a18-4e14-8ecf-2c86ede449f2 req-ebc5bf74-ae30-4590-a78e-92f70d6a7376 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.707025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e29668ab-6a18-4e14-8ecf-2c86ede449f2 req-ebc5bf74-ae30-4590-a78e-92f70d6a7376 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.707658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e29668ab-6a18-4e14-8ecf-2c86ede449f2 req-ebc5bf74-ae30-4590-a78e-92f70d6a7376 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.725842 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e29668ab-6a18-4e14-8ecf-2c86ede449f2 req-ebc5bf74-ae30-4590-a78e-92f70d6a7376 service nova] Creating event network-changed:9f52bf0c-5358-459e-9c48-a1e5361e5dbf for instance cd7ed094-4322-4336-a483-9eac9a0746dd on n-h2-854663-10 Oct 27 10:11:42.746975 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e29668ab-6a18-4e14-8ecf-2c86ede449f2 req-ebc5bf74-ae30-4590-a78e-92f70d6a7376 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063906 Oct 27 10:11:42.748155 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 510/1017] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:42.763978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:42.764983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:42.772272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.773218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.773835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.774759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.775422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.777259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.931102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:42.939167 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bde45292-f57c-4ce2-ae3f-7b8db0483add tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.292961 Oct 27 10:11:42.940084 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 508/1018] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:42 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:42.944976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:42.945831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:42.953812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.954543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.955491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.956204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.956675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.957101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.986321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:42.997055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:42.999173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:43.000445 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-707e9278-e1c1-4dfb-a8ce-31211673a63a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.245490 Oct 27 10:11:43.001767 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 511/1019] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:42 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:11:43.006792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:43.007671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:43.015671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.016741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.017759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.018675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.019330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.019934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.176379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:43.182608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:43.189376 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e369e28-a1d6-4e1d-90cb-b597577ee940 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.247905 Oct 27 10:11:43.190840 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 509/1020] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:42 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:43.196144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:43.197217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:43.207350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.208224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.209042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.209767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.210413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.210998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.226450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:43.235285 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eda01a71-be8f-46c1-8953-d01e66b74e8e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.232150 Oct 27 10:11:43.235788 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 512/1021] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:43 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:43.285781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:43.294517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:43.296499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:43.302649 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bca995f3-2d2d-4d2e-bff8-7178c121ff89 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.110452 Oct 27 10:11:43.305890 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 510/1022] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:43 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:43.345693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:43.346312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:43.352830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.353315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.353746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.354431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.354876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.355294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.445316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-23b74591-2883-49d8-82b7-51fafe06f68f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:43.448093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-23b74591-2883-49d8-82b7-51fafe06f68f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:43.457580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23b74591-2883-49d8-82b7-51fafe06f68f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.458397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23b74591-2883-49d8-82b7-51fafe06f68f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.459949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23b74591-2883-49d8-82b7-51fafe06f68f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.461897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23b74591-2883-49d8-82b7-51fafe06f68f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.462970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23b74591-2883-49d8-82b7-51fafe06f68f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.463987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23b74591-2883-49d8-82b7-51fafe06f68f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.543213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-23b74591-2883-49d8-82b7-51fafe06f68f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101922 Oct 27 10:11:43.547140 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 511/1023] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:43 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:43.554002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:43.557067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:43.565009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:43.565640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:43.568885 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1daf0a2-d743-4a77-8886-fae5995cdfbd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.227153 Oct 27 10:11:43.570324 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 513/1024] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:43 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:43.572383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.572991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.573556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.574442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.574912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.575566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.763179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:43.772917 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1d90788-e95f-4886-a5c0-4ac0a1eb0486 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.224474 Oct 27 10:11:43.773857 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 512/1025] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:43 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:43.968922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:43.969593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:43.977196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.977685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.978126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.979300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.979955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.980545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.031042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:44.032188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:44.039642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.041267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.041946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.042731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.043263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.043754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.300432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.305387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.310605 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fb80b2e-167a-4481-99bd-2a8411e3c783 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.346774 Oct 27 10:11:44.316263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.316793 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 514/1026] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:43 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:44.318239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.319610 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cabd858a-1e32-4510-9af9-ea169a3e0918 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.294554 Oct 27 10:11:44.320697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 513/1027] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:44 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:44.340730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:44.341765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:44.342297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:44.343979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:44.348835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.349581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.349979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.350441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.350573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.350875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.351572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.351934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.352044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.352418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.353006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.353651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.528464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:44.551348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:44.617111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.625763 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95f57e2e-1103-484a-a548-bec3be8ac0ff tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.307477 Oct 27 10:11:44.626982 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 515/1028] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:44 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:44.631799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:44.632832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:44.640366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.641290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.642037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.643094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.643755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.644385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.676006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.686270 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4bd2af33-a708-48fd-a85c-006051c2efbb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.364254 Oct 27 10:11:44.686882 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 514/1029] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:44 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:44.708892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f33112d8-ba4a-4cb3-8747-53b31019f236 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:44.713428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f33112d8-ba4a-4cb3-8747-53b31019f236 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:44.720414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33112d8-ba4a-4cb3-8747-53b31019f236 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.721792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33112d8-ba4a-4cb3-8747-53b31019f236 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.723111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33112d8-ba4a-4cb3-8747-53b31019f236 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.724141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33112d8-ba4a-4cb3-8747-53b31019f236 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.724790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33112d8-ba4a-4cb3-8747-53b31019f236 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.725387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33112d8-ba4a-4cb3-8747-53b31019f236 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.744234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.752777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.754207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.762891 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f33112d8-ba4a-4cb3-8747-53b31019f236 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059138 Oct 27 10:11:44.764483 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 515/1030] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:44 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:44.771482 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-303f2c40-4b96-48e9-bb6c-f5aaf880cc40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.143194 Oct 27 10:11:44.774412 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 516/1031] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:44 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:44.777822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:44.779598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:44.787016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.787715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.788314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.789199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.789796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.792215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.797300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:44.797922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:44.814330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.814796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.822089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.823070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.823678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.824266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.959426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:45.099841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:45.110225 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b1abe30-7375-4a53-a5df-51d2b1bc4b69 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.317168 Oct 27 10:11:45.116172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:45.119953 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 517/1032] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:44 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:45.129006 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6ef19c5-b210-45bc-86c0-35ccaa8ef3ef tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.358920 Oct 27 10:11:45.137562 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 516/1033] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:44 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:45.333940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:45.334346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:45.369215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:45.369974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:45.384597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:45.393445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:45.396278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:45.397242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:45.397854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:45.398752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:45.399376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:45.400016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:45.405504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:45.406554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:45.408601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:45.411800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:45.800553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:45.810993 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-071229dc-446a-448b-959e-82f899d16afd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.481283 Oct 27 10:11:45.829149 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 518/1034] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:45 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:45.838255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6f4100b6-e77b-41aa-a092-584c323579c1 req-679be40e-7928-40ef-a3b3-d494723da3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03eeed8-34c3-4fcb-b086-570b834451c3", "name": "network-vif-unplugged", "status": "completed", "tag": "47a0bb7b-ed01-4e2b-88f6-d97b5c72da33"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:45.866933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6f4100b6-e77b-41aa-a092-584c323579c1 req-679be40e-7928-40ef-a3b3-d494723da3a8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:45.877475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6f4100b6-e77b-41aa-a092-584c323579c1 req-679be40e-7928-40ef-a3b3-d494723da3a8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:45.878188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6f4100b6-e77b-41aa-a092-584c323579c1 req-679be40e-7928-40ef-a3b3-d494723da3a8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:45.896562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:45.906803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:45.912441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:45.914895 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6f4100b6-e77b-41aa-a092-584c323579c1 req-679be40e-7928-40ef-a3b3-d494723da3a8 service nova] Creating event network-vif-unplugged:47a0bb7b-ed01-4e2b-88f6-d97b5c72da33 for instance c03eeed8-34c3-4fcb-b086-570b834451c3 on n-h2-854663-10 Oct 27 10:11:45.916304 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dae35809-e6c3-4003-81ab-642156633589 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.563095 Oct 27 10:11:45.939543 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 517/1035] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:45 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:45.944844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:45.946821 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6f4100b6-e77b-41aa-a092-584c323579c1 req-679be40e-7928-40ef-a3b3-d494723da3a8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116206 Oct 27 10:11:45.947677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:45.948874 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 519/1036] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:45.960568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:45.972800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:45.974085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:45.974794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:45.977200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:45.978145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:45.978788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:45.981440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:45.989304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:45.993615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:45.996153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:45.997143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.006538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.007314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.270774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:46.273639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:46.279435 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e34ef457-b7fc-4516-b8f2-1578ad7f03eb tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.338237 Oct 27 10:11:46.292688 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 518/1037] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:45 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:46.292688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfd75230-58f1-4daf-985e-22faaf30d4ae tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:46.296158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dfd75230-58f1-4daf-985e-22faaf30d4ae tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:46.296617 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92e27d50-d6bf-4fcd-857c-90e23ed965df tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.344887 Oct 27 10:11:46.297396 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 520/1038] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:45 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:46.307499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:46.308112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:46.324869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.325368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.325828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.326546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.332481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfd75230-58f1-4daf-985e-22faaf30d4ae tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.333012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfd75230-58f1-4daf-985e-22faaf30d4ae tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.333448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfd75230-58f1-4daf-985e-22faaf30d4ae tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.334158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfd75230-58f1-4daf-985e-22faaf30d4ae tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.334337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.334614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfd75230-58f1-4daf-985e-22faaf30d4ae tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.334814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.335034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfd75230-58f1-4daf-985e-22faaf30d4ae tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.448817 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dfd75230-58f1-4daf-985e-22faaf30d4ae tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167634 Oct 27 10:11:46.449507 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 519/1039] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:46 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:46.450718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:46.465367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:46.466320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:46.466755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:46.468314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:46.487596 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1a46dee-43fb-4e64-904b-1eceeb539f75 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.189114 Oct 27 10:11:46.500686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 521/1040] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:46 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:46.500686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:46.500686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:46.502068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.503007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.508701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.508894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.508894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.508894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.508894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.509217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.514772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.514969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.515875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.516547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.781963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:46.795931 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c2735f9-401c-4adb-b6ce-973b27e30d9b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.339954 Oct 27 10:11:46.812433 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 520/1041] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:46 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:46.841762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:46.844055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:46.844706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:46.851752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.852282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.852744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.853610 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6de4137c-5baa-464d-99f2-88b147737888 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.364226 Oct 27 10:11:46.853735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.854080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.854506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.858173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 522/1042] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:46 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:46.959552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:46.960814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:46.971475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.972411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.973781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:46.974749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:46.975487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:46.976118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.103011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:47.120346 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-64326580-f920-42e7-b8f4-c3b4a0b5724f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.281394 Oct 27 10:11:47.121169 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 521/1043] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:46 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:47.167917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:47.180973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:47.180973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:47.182413 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ed6fe3b-cffb-404a-81ae-af5bd4be22d1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.234288 Oct 27 10:11:47.183304 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 523/1044] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:46 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:47.303480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:47.304079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:47.315406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.315882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.316332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.317069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.317501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.319984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.325020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:47.327994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:47.334790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.335556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.336110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.337020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.337915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.339084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.602515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:47.614097 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-614a8dac-148d-4f6e-88f8-f3474b0a5a17 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.292897 Oct 27 10:11:47.633484 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 524/1045] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:47 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:47.642662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af30324a-5e90-474c-a991-885b509b8ebc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:47.649199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af30324a-5e90-474c-a991-885b509b8ebc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:47.656403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af30324a-5e90-474c-a991-885b509b8ebc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.657369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af30324a-5e90-474c-a991-885b509b8ebc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.658201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af30324a-5e90-474c-a991-885b509b8ebc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.659339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af30324a-5e90-474c-a991-885b509b8ebc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.660195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af30324a-5e90-474c-a991-885b509b8ebc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.660820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af30324a-5e90-474c-a991-885b509b8ebc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.716039 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af30324a-5e90-474c-a991-885b509b8ebc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082265 Oct 27 10:11:47.716754 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 525/1046] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:47 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:47.721345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:47.722075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:47.723982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:47.729007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.730269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.730916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.732199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.733021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.733647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.740010 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81cf82d6-f409-4f81-843c-c929a2ceb6a1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.440106 Oct 27 10:11:47.740832 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 522/1047] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:47 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:47.814687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:47.819632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:47.820251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:47.825046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:47.826286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.826771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.827200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.827611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:47.827894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.828527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.829135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.836589 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c3cb5034-d25d-4bd4-987c-70c4a4143c4d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.118594 Oct 27 10:11:47.837662 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 526/1048] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:47 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:47.879634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:47.880356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:47.887135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.888391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.888391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:47.889481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:47.890030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:47.890545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.057138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.065862 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ba064c3-5553-4760-a232-28916626aea1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.250201 Oct 27 10:11:48.066307 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 523/1049] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:47 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:48.072834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1c47e2c4-3abb-4c3b-827b-28cbc2f5e9c2 req-07b2f5d9-5017-4f1d-885c-509e5da82c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03eeed8-34c3-4fcb-b086-570b834451c3", "name": "network-vif-plugged", "status": "completed", "tag": "47a0bb7b-ed01-4e2b-88f6-d97b5c72da33"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:48.082872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1c47e2c4-3abb-4c3b-827b-28cbc2f5e9c2 req-07b2f5d9-5017-4f1d-885c-509e5da82c2a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.083638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1c47e2c4-3abb-4c3b-827b-28cbc2f5e9c2 req-07b2f5d9-5017-4f1d-885c-509e5da82c2a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.084065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1c47e2c4-3abb-4c3b-827b-28cbc2f5e9c2 req-07b2f5d9-5017-4f1d-885c-509e5da82c2a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.096360 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1c47e2c4-3abb-4c3b-827b-28cbc2f5e9c2 req-07b2f5d9-5017-4f1d-885c-509e5da82c2a service nova] Creating event network-vif-plugged:47a0bb7b-ed01-4e2b-88f6-d97b5c72da33 for instance c03eeed8-34c3-4fcb-b086-570b834451c3 on n-h2-854663-10 Oct 27 10:11:48.101655 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1c47e2c4-3abb-4c3b-827b-28cbc2f5e9c2 req-07b2f5d9-5017-4f1d-885c-509e5da82c2a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034204 Oct 27 10:11:48.102788 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 524/1050] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:48.103671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.112515 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50547266-afdb-4b5b-8963-3d08f475f36c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.237074 Oct 27 10:11:48.113504 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 527/1051] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:47 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:48.144586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:48.145341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:48.151918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.152400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.152896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.153588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.154066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.154657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.209968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:48.210479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:48.218116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.218609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.219052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.219764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.220231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.220752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.607621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.616376 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8795ef6-c497-4f33-854b-ca590452f2af tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.476548 Oct 27 10:11:48.616966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 525/1052] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:48 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:48.632709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.642719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.644152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.644541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:48.645252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:48.645384 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-210b0681-2f11-4807-bd7b-b6c2d645ad0a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.441147 Oct 27 10:11:48.657534 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 528/1053] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:48 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:48.663025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.663614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.664124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.668101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.668607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.669156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.729816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8581fa9e-c6ce-472b-85d6-abd630713114 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:48.732514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8581fa9e-c6ce-472b-85d6-abd630713114 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:48.745335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8581fa9e-c6ce-472b-85d6-abd630713114 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.748342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8581fa9e-c6ce-472b-85d6-abd630713114 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.748342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8581fa9e-c6ce-472b-85d6-abd630713114 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.753271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8581fa9e-c6ce-472b-85d6-abd630713114 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.753913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8581fa9e-c6ce-472b-85d6-abd630713114 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.754547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8581fa9e-c6ce-472b-85d6-abd630713114 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.787774 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8581fa9e-c6ce-472b-85d6-abd630713114 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062225 Oct 27 10:11:48.792928 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 529/1054] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:48 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:11:48.797915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:48.798608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:48.804633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.805236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.805732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.806487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.807005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.807489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.830358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.839299 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f389167-2538-4f9c-a60f-3f909b0764b3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.199576 Oct 27 10:11:48.858870 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 526/1055] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:48 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:48.865703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:48.866572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:48.874080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.874843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.875438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.876311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:48.876946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:48.877540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:48.882833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:48.955718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.972444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.974424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:48.983183 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e572f6e2-f9a4-4d31-bef8-5b5185badfe6 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.121477 Oct 27 10:11:48.983869 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 527/1056] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:48 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:49.038537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:49.057925 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b9c782d-3819-4a24-a6e2-bdc2ce1c8ffa tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.263808 Oct 27 10:11:49.069025 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 530/1057] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:48 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:49.090575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:49.091604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:49.095320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:49.099929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.100495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.101014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.101781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.102287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.102768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.135852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:49.136646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:49.146997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.147499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.147935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.148652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.149129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.149551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.153005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:49.289012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:49.298015 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f304dfd-42be-4dd8-8ba6-ca67d3dc1ac8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.211716 Oct 27 10:11:49.298622 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 528/1058] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:49 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:49.363301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:49.371922 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9501db5f-af96-41ab-ba23-7c45f83b4049 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.240166 Oct 27 10:11:49.373290 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 531/1059] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:49 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:49.642735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:49.643356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:49.650569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.651391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.651845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.652753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.653204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.653619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.671882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:49.672742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:49.683433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.684062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.685653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.686632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.690863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.691421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.864286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:49.873180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:49.874693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:49.876061 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3efe1177-74b3-43fe-a474-ace75f133e25 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.208504 Oct 27 10:11:49.889417 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 532/1060] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:49 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:49.889654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92918440-0051-4b1c-ae04-50d62828b9dc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:49.892694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92918440-0051-4b1c-ae04-50d62828b9dc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:49.906231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92918440-0051-4b1c-ae04-50d62828b9dc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.906485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92918440-0051-4b1c-ae04-50d62828b9dc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.906909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92918440-0051-4b1c-ae04-50d62828b9dc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.907914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92918440-0051-4b1c-ae04-50d62828b9dc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.908184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92918440-0051-4b1c-ae04-50d62828b9dc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.908489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92918440-0051-4b1c-ae04-50d62828b9dc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.913973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:49.923080 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-469284b1-4bc7-4667-a700-311ff34412d3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.284376 Oct 27 10:11:49.923675 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 529/1061] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:49 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:49.928879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:49.929744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:49.936449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.937271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.937892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.938760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:49.939366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:49.940045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:49.969936 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92918440-0051-4b1c-ae04-50d62828b9dc tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092011 Oct 27 10:11:49.976779 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 533/1062] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:49 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:50.018142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:50.020456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:50.040427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.041146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.041291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.042181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.042640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.043062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.125819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:50.137289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:50.140052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:50.156761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:50.161667 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be001488-e34d-4acc-a478-96bba6623e83 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.147477 Oct 27 10:11:50.162270 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 534/1063] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:50 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:50.165088 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-53b0f8c5-5614-4fe2-98b3-44b55b40c080 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.240339 Oct 27 10:11:50.165858 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 530/1064] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:49 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:50.173559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:50.174547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:50.186625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.187127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.187550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.188258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.188729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.189163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.320770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:50.322164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:50.333277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.333770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.334357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.335069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.335513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.335929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.336591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:50.347588 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f008116-1cbd-4d15-a4a3-e527956500c9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.183624 Oct 27 10:11:50.349541 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 535/1065] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:50 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:50.395330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:50.396149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:50.402874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.403480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.404210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.405045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.405595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.406090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.537538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:50.547346 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9993673a-a2f5-449d-86cf-01d304b9a0fc tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.230449 Oct 27 10:11:50.548296 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 531/1066] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:50 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:50.569246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:50.578115 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d50ad80-909e-4731-97dd-59193799e46c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.186568 Oct 27 10:11:50.578967 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 536/1067] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:50 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:50.905857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:50.906732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:50.913122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.913607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.914041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.914740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.915185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.915603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.952897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:50.953532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:50.960370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.961405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.961405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:50.961945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:50.962389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:50.962798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.126598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.137171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.138988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.140363 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2eec04ef-3a85-4d8a-a80e-fc7c4d9eea32 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.238921 Oct 27 10:11:51.142248 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 532/1068] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:50 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:51.147686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1f9ff1da-3e73-40de-a1db-e94496dd4d3f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:51.150351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1f9ff1da-3e73-40de-a1db-e94496dd4d3f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:51.152109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.159931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f9ff1da-3e73-40de-a1db-e94496dd4d3f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.160736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f9ff1da-3e73-40de-a1db-e94496dd4d3f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.161351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f9ff1da-3e73-40de-a1db-e94496dd4d3f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.162050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f9ff1da-3e73-40de-a1db-e94496dd4d3f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.162496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f9ff1da-3e73-40de-a1db-e94496dd4d3f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.162948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f9ff1da-3e73-40de-a1db-e94496dd4d3f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.163921 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb7edd60-ae78-4435-b9d6-29d9a3555e77 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.214233 Oct 27 10:11:51.169256 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 537/1069] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:50 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:51.192771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:51.193568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:51.194237 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1f9ff1da-3e73-40de-a1db-e94496dd4d3f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050428 Oct 27 10:11:51.194814 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 533/1070] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:51 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:51.199940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:51.200551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:51.204697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.205194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.205629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.206338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.206787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.207207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.207476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.207955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.208385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.209098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.209553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.210148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.308032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.317172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.318792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.323850 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26abc734-b29c-4302-831a-166494fc7876 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.135162 Oct 27 10:11:51.324410 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 538/1071] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:51 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:11:51.370294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.370860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:51.371473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:51.377891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.378343 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d8e07b3-dd25-44fc-a94a-f464f530bfae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.182498 Oct 27 10:11:51.378470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.378783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.378919 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 534/1072] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:51 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:51.380423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.380959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.381386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.522003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.536043 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7651f5b9-7446-410c-93e9-01ab6c09f310 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.168727 Oct 27 10:11:51.536644 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 539/1073] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:51 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:51.571100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:51.571840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:51.578429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.578911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.579342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.580028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.580476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.580914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.609595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:51.610204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:51.616493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.617011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.617441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.618140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:51.618594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:51.619011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:51.764808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.773669 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60f8fd4b-e9b4-442e-8fab-b669044146f1 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.206495 Oct 27 10:11:51.774274 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 535/1074] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:51 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:51.793371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:51.806014 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab055f1f-6005-4d50-8a6f-5f1bee4f4b39 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.200819 Oct 27 10:11:51.806848 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 540/1075] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:51 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:52.170814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:52.171437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:52.178823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.179316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.179741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.180426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.180922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.181350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.187562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:52.188168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:52.195114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.195592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.196015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.196728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.197265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.197691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.440091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:52.448937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:52.450654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:52.451870 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7cc70429-4076-4685-ba4f-a8b03c7067ed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.286220 Oct 27 10:11:52.455130 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 536/1076] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:52 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:52.456453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:52.457506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-594f6d02-e9a2-4767-9fe4-a29d93ce6a7f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:52.460082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-594f6d02-e9a2-4767-9fe4-a29d93ce6a7f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:52.466527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-594f6d02-e9a2-4767-9fe4-a29d93ce6a7f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.467078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-594f6d02-e9a2-4767-9fe4-a29d93ce6a7f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.467525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-594f6d02-e9a2-4767-9fe4-a29d93ce6a7f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.468299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-594f6d02-e9a2-4767-9fe4-a29d93ce6a7f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.468785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-594f6d02-e9a2-4767-9fe4-a29d93ce6a7f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.469214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-594f6d02-e9a2-4767-9fe4-a29d93ce6a7f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.472748 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0302e0ad-a5c4-467e-9292-65c76dd535f4 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.288983 Oct 27 10:11:52.474229 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 541/1077] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:52 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:52.478371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:52.479057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:52.485407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.485966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.486495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.487255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.487762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.488258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.515110 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-594f6d02-e9a2-4767-9fe4-a29d93ce6a7f tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061315 Oct 27 10:11:52.515657 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 537/1078] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:52 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:52.520516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:52.521160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:52.527378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.527855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.528282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.529048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.529667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.530090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.553383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:52.562193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:52.563677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:52.568921 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-acfa209d-7a9f-43ee-aa23-70dfbeca000d tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.094493 Oct 27 10:11:52.569503 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 542/1079] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:52 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:52.573978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:52.574589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:52.580733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.581246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.581683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.582382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.582830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.583248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.717519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:52.725664 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec24c876-032c-478a-8781-e784385b5a7d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.209034 Oct 27 10:11:52.726236 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 538/1080] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:52 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:52.743940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:52.752183 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8350df82-a8cd-4234-b972-941ddc5e2d93 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.181724 Oct 27 10:11:52.752787 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 543/1081] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:52 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:52.798019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:52.798625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:52.805206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.805684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.806110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.806790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.807234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.807648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.833871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:52.834595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:52.842538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.842714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.843285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:52.844070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:52.844582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:52.845127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.100329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:53.112247 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2df74bef-9852-4407-aa66-1b353a36c85a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.317698 Oct 27 10:11:53.113363 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 539/1082] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:52 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:53.129293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:53.137085 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d037e936-2837-4f33-b6b0-1678caf9fb2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1360 microversion: 2.1 time: 0.309328 Oct 27 10:11:53.137843 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 544/1083] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:52 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1360 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:53.476705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:53.477369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:53.485551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.486089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.486512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.487263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.487707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.488127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.501936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:53.502612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:53.510124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.510519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.510969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.511899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.512366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.512813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.834075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:53.839192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:53.842319 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a47aec1e-596d-4b0f-bc8f-cc58ee511d56 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.345005 Oct 27 10:11:53.847395 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 545/1084] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:53 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:53.848861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:53.850553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:53.851946 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c02eec9b-88fb-4be6-8ab8-ab26d9e7b9d0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1412 microversion: 2.25 time: 0.379363 Oct 27 10:11:53.852127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d35d49f-4dbe-4c52-851b-dd0a7afaf5b1 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:53.854625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d35d49f-4dbe-4c52-851b-dd0a7afaf5b1 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:53.858721 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 540/1085] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:53 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1412 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:53.861518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d35d49f-4dbe-4c52-851b-dd0a7afaf5b1 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.862179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d35d49f-4dbe-4c52-851b-dd0a7afaf5b1 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.862755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d35d49f-4dbe-4c52-851b-dd0a7afaf5b1 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.863611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d35d49f-4dbe-4c52-851b-dd0a7afaf5b1 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.864039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:53.864386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d35d49f-4dbe-4c52-851b-dd0a7afaf5b1 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.864979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:53.865291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d35d49f-4dbe-4c52-851b-dd0a7afaf5b1 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.872787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.873297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.873729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.874431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.874909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.875329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.895231 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d35d49f-4dbe-4c52-851b-dd0a7afaf5b1 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046976 Oct 27 10:11:53.895806 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 546/1086] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:11:53 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:11:53.900849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f90972e2-6709-41b3-b010-a520abe1c6e5 req-ea2d9789-622f-48ac-bab0-63ddb8f93bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95558ee4-40e1-4fff-a334-890711c72fe1", "tag": "d07ac299-6fe3-4076-b485-2752928e0818"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:53.910658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f90972e2-6709-41b3-b010-a520abe1c6e5 req-ea2d9789-622f-48ac-bab0-63ddb8f93bc2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.911132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f90972e2-6709-41b3-b010-a520abe1c6e5 req-ea2d9789-622f-48ac-bab0-63ddb8f93bc2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.911548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f90972e2-6709-41b3-b010-a520abe1c6e5 req-ea2d9789-622f-48ac-bab0-63ddb8f93bc2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.923221 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f90972e2-6709-41b3-b010-a520abe1c6e5 req-ea2d9789-622f-48ac-bab0-63ddb8f93bc2 service nova] Creating event network-changed:d07ac299-6fe3-4076-b485-2752928e0818 for instance 95558ee4-40e1-4fff-a334-890711c72fe1 on n-h2-854663-10 Oct 27 10:11:53.928563 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f90972e2-6709-41b3-b010-a520abe1c6e5 req-ea2d9789-622f-48ac-bab0-63ddb8f93bc2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031668 Oct 27 10:11:53.929212 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 547/1087] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:53.935441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:53.936128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:53.938120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:53.944054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.944223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:53.944545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.944993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.945648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.946087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.946500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.955032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:53.956490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:53.961563 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c62f6bf0-fe94-4274-909b-1be34f0c26ee tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.101736 Oct 27 10:11:53.961812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:53.962562 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 541/1088] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:53 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:53.968305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:53.968978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:53.974979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.975632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.981113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:53.981987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:53.982462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:53.983049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.166651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:54.170600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:54.175528 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36fb1520-0fb7-483a-9302-6ff005761cba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.244990 Oct 27 10:11:54.176243 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 548/1089] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:53 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:54.179062 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52fbf838-1150-43e8-a9e6-76638da2b208 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.215371 Oct 27 10:11:54.179869 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 542/1090] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:53 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:54.192349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1486967114", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "7233b255-11be-4680-880e-1263043546b9"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:54.192505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:54.192505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:54.196054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.196533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.197010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.197712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.198404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.198984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.238444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] validate_networks() for [('7233b255-11be-4680-880e-1263043546b9', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:11:54.416970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:54.420705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:54.427004 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fcff5efd-0053-4081-9736-78848fbcdd79 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.241533 Oct 27 10:11:54.428199 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 543/1091] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:54 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:54.435510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:54.436747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:54.444221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.444849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.445277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.446088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.447147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.447660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.724716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:54.733625 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ec18d9e-4a54-4d38-9ac0-09257fe44b41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1544 microversion: 2.1 time: 0.303939 Oct 27 10:11:54.734514 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 544/1092] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:54 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1544 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:54.757423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e9124c0-b498-48d6-a1ae-04a3695cbfbe tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:54.757909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e9124c0-b498-48d6-a1ae-04a3695cbfbe tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:54.764463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9124c0-b498-48d6-a1ae-04a3695cbfbe tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.764978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9124c0-b498-48d6-a1ae-04a3695cbfbe tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.765413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9124c0-b498-48d6-a1ae-04a3695cbfbe tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.766114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9124c0-b498-48d6-a1ae-04a3695cbfbe tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.766567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9124c0-b498-48d6-a1ae-04a3695cbfbe tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.766994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e9124c0-b498-48d6-a1ae-04a3695cbfbe tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.848019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:11:54.848516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:11:54.848921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:11:54.849321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:11:54.849723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:11:54.859148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.859664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.860167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.861181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.861790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.862219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.862491 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e9124c0-b498-48d6-a1ae-04a3695cbfbe tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109305 Oct 27 10:11:54.863109 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 545/1093] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:11:54 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:54.868161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:54.868161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:54.882161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Getting quotas for project 75d00e63cbd24dbc8caef82092921e5a. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:54.886726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.887453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.888001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.888726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:54.889162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:54.889578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:54.894307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Getting quotas for user 45e4b1cad46f43c1a1aac0e2ba5425ae and project 75d00e63cbd24dbc8caef82092921e5a. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:54.911969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:11:54.919115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:11:54.983747 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7459e80d-8ac4-4ef9-8d2e-06b9e32e3620 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806283 Oct 27 10:11:54.991439 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 549/1094] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:11:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:11:54.996636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:54.997526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:55.005760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.006311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.007234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.008105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.008732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.009347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.105002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.117178 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ddb2df6-4603-4c52-8d23-f093927f9a62 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.252903 Oct 27 10:11:55.134102 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 546/1095] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:54 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:55.139442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c13d711f-f27a-4d24-abe9-02b3038856c8 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:55.140214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c13d711f-f27a-4d24-abe9-02b3038856c8 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:55.214026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c13d711f-f27a-4d24-abe9-02b3038856c8 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.215788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.227374 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c13d711f-f27a-4d24-abe9-02b3038856c8 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1218 microversion: 2.1 time: 0.091376 Oct 27 10:11:55.240694 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 547/1096] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:55 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:55.240889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.240889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.240889 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca60b661-48f0-4760-ac68-91c4c1a0b9b0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1608 microversion: 2.25 time: 0.242080 Oct 27 10:11:55.241182 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 550/1097] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:54 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1608 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:55.241264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:55.241264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:55.241417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:55.241417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:55.245737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.245737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.245737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.245737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.246110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.246370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.246638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.246827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.247319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.248057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.248547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.248966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.355122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.375446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.377077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.383199 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b9de8908-1610-4718-ace1-7e511f28b244 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.153306 Oct 27 10:11:55.393654 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 548/1098] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:55 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:55.408139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:55.409077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:55.422908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.423508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.423941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.424729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.425815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.426243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.432181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.442136 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d73fd131-0e05-4c02-a446-423cd93fc320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.204323 Oct 27 10:11:55.442136 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 551/1099] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:55 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:55.446729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ef3edbe-5ecc-4950-8e42-6d733fc3bae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:55.447219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ef3edbe-5ecc-4950-8e42-6d733fc3bae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:55.453833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef3edbe-5ecc-4950-8e42-6d733fc3bae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.454311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef3edbe-5ecc-4950-8e42-6d733fc3bae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.454735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef3edbe-5ecc-4950-8e42-6d733fc3bae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.455765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef3edbe-5ecc-4950-8e42-6d733fc3bae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.456366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef3edbe-5ecc-4950-8e42-6d733fc3bae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.456808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef3edbe-5ecc-4950-8e42-6d733fc3bae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.884327 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ef3edbe-5ecc-4950-8e42-6d733fc3bae4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.442052 Oct 27 10:11:55.895403 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 552/1100] 10.222.0.76 () {60 vars in 1316 bytes} [Thu Oct 27 10:11:55 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-interface => generated 284 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:11:55.901746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:55.902746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:55.910771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.911257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.911893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.912797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:55.916812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:55.917420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:55.955987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:55.963638 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3224fa3c-6422-4641-b5d2-52f1cf780a48 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.560165 Oct 27 10:11:55.964416 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 549/1101] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:55 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:56.057531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:56.066410 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5bcdb3b-1bef-43a1-89cf-b8fba4ca7b6f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.169942 Oct 27 10:11:56.066994 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 553/1102] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:55 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:56.141056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:56.141663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:56.148001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.148488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.148950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.149633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.150077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.150811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.254504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:56.256179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:56.264874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.266314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.267031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.268077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.268869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.269568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.331914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:56.341873 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd0d1db6-7136-43b3-bc16-080d2a85413d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.204931 Oct 27 10:11:56.352693 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 550/1103] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:56 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:56.386532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:56.397592 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bddab49c-96f0-403e-9122-42726a749051 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1278 microversion: 2.1 time: 0.147644 Oct 27 10:11:56.398579 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 554/1104] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:56 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:56.414029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:56.414634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:56.421554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.422300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.422901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.423776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.424417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.425011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.472030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:56.473914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:56.486960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.489424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.491859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.492990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.494436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.495032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.516640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:56.528224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:56.530347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:56.543004 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-513265d2-3c01-43a0-b4a1-ac7e363a6328 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.131998 Oct 27 10:11:56.544103 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 551/1105] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:56 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:56.588605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3e1f0fd8-f324-4b6f-8610-4592a458063c req-efffc81c-9ca7-409b-b104-e7f4ccde3e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db810b22-71e9-4b8c-bbaf-59b8443d408b", "tag": "3dd60d44-bd56-4d7b-b71c-ba708a3df480"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:56.598908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3e1f0fd8-f324-4b6f-8610-4592a458063c req-efffc81c-9ca7-409b-b104-e7f4ccde3e02 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.599384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3e1f0fd8-f324-4b6f-8610-4592a458063c req-efffc81c-9ca7-409b-b104-e7f4ccde3e02 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.599813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3e1f0fd8-f324-4b6f-8610-4592a458063c req-efffc81c-9ca7-409b-b104-e7f4ccde3e02 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.612697 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3e1f0fd8-f324-4b6f-8610-4592a458063c req-efffc81c-9ca7-409b-b104-e7f4ccde3e02 service nova] Creating event network-changed:3dd60d44-bd56-4d7b-b71c-ba708a3df480 for instance db810b22-71e9-4b8c-bbaf-59b8443d408b on n-h2-854663-10 Oct 27 10:11:56.618022 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3e1f0fd8-f324-4b6f-8610-4592a458063c req-efffc81c-9ca7-409b-b104-e7f4ccde3e02 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035238 Oct 27 10:11:56.618933 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 552/1106] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:11:56.681235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:56.689588 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5aee657-0b79-4972-bf43-615608c3665c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.228485 Oct 27 10:11:56.698256 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 555/1107] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:56 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:56.988351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:56.989473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:56.995777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.996261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.996692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:56.997442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:56.998184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:56.998838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.095924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:57.097670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:57.109386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.110202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.110939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.111856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.116545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.120003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.211665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:57.220401 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1d054f89-8cd1-49d2-8c74-766a9aa6430f tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.236348 Oct 27 10:11:57.221177 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 553/1108] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:56 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:57.293564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:57.302818 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56d88808-3a18-44e0-8a85-5318a69d0633 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.215721 Oct 27 10:11:57.303656 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 556/1109] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:57 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:57.366457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:57.367247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:57.374789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.375415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.376094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.377122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.377805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.379039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.424116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:57.424883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:57.431120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.431738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.432312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.433136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.433690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.434213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.510263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:57.521060 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9fb513c8-0ac2-4bf9-b7bf-cb2108263798 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1276 microversion: 2.1 time: 0.102858 Oct 27 10:11:57.521732 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 557/1110] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:57 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:57.572834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:57.573695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:57.582099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:57.586186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.587185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.589214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.590018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.590265 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ddfc40b3-275f-4773-b25e-7b52f6e538fa tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.228734 Oct 27 10:11:57.590646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.591646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.594793 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 554/1111] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:57 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:57.662292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:57.671129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:57.672590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:57.677608 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f4931a5-ac46-40e9-a0f6-75e6bef6f53e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.110178 Oct 27 10:11:57.678173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 558/1112] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:57 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:11:57.713559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:57.714438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:57.721410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.721887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.722308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.722992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:57.723415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:57.723844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:57.872553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:57.883852 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-11c74803-b23f-4a7d-bf5d-61ce973a2d2e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.174697 Oct 27 10:11:57.899657 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 555/1113] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:57 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:58.243589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:58.244792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:58.251487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.252308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.253042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.253952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.254673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.255311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.326606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:58.327156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:58.333394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.337764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.338184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.338906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.341769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.342506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.449311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:58.459779 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01829e40-12ea-4700-b009-1039bb5d4434 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.220120 Oct 27 10:11:58.460931 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 559/1114] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:58 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:58.513391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:58.525112 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78a41588-4130-4438-b2cc-5d8f393bdad8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.202835 Oct 27 10:11:58.526792 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 556/1115] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:58 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:58.545662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:58.546517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:58.553835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.554319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.554942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.555667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.556992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.557776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.618696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:58.619320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:58.630624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.631416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.632033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.633075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.633758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.634172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.768577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:58.777274 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8da21f96-10e1-4b97-b2d0-3b775ca9d509 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1318 microversion: 2.1 time: 0.235998 Oct 27 10:11:58.778519 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 560/1116] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:58 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:58.783647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2e2206d7-b6c7-4697-aab6-1a1af9a157bf req-00398ec0-c089-4239-800a-705c005be6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029ff781-574b-48de-9033-cd8e69e64ec2", "tag": "9d537db4-55a5-4b36-81b4-2f467d976981"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:58.800938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2e2206d7-b6c7-4697-aab6-1a1af9a157bf req-00398ec0-c089-4239-800a-705c005be6e9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.801811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2e2206d7-b6c7-4697-aab6-1a1af9a157bf req-00398ec0-c089-4239-800a-705c005be6e9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.801811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2e2206d7-b6c7-4697-aab6-1a1af9a157bf req-00398ec0-c089-4239-800a-705c005be6e9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.813600 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2e2206d7-b6c7-4697-aab6-1a1af9a157bf req-00398ec0-c089-4239-800a-705c005be6e9 service nova] Creating event network-changed:9d537db4-55a5-4b36-81b4-2f467d976981 for instance 029ff781-574b-48de-9033-cd8e69e64ec2 on n-h2-854663-10 Oct 27 10:11:58.818615 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2e2206d7-b6c7-4697-aab6-1a1af9a157bf req-00398ec0-c089-4239-800a-705c005be6e9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038468 Oct 27 10:11:58.819564 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 561/1117] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:58.825415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:58.827773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:58.828480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:58.837382 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fbf973eb-55ab-4c12-8475-7b136dcfa002 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.223402 Oct 27 10:11:58.842069 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 557/1118] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:58 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:58.843424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.843952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.844388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.846961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.846961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.846961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.911483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:58.912326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:58.915818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:58.919313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.919991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.920827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.922028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:58.922480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:58.923055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:58.925486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:58.927481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:58.932745 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6210bbaa-b115-47ff-808a-bdd9517ba660 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.111964 Oct 27 10:11:58.945324 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 562/1119] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:11:58 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:11:59.070209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:59.078438 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15d836dc-7ade-46bd-8311-3f5a3de92221 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.173115 Oct 27 10:11:59.079007 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 558/1120] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:58 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:59.484618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:59.485284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:59.491741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:59.492228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:59.492679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:59.493383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:59.493840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:59.494262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:59.549145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:59.549709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:59.556934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:59.557411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:59.557842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:59.558535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:59.558980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:59.559396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:59.682332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:59.691952 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d0a3553f-f5e9-462b-b48c-837a07090a32 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.211308 Oct 27 10:11:59.692538 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 563/1121] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:59 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:59.718787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:59.727018 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-506aee2a-ebdf-45ed-a784-a31bd0c81460 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.181780 Oct 27 10:11:59.727571 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 559/1122] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:59 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:59.806287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:59.807341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:59.814884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:59.815362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:59.815800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:59.816490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:59.816977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:59.817404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:59.865129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:59.865739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:59.872378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:59.872947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:59.873377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:59.874083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:59.874530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:59.874958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.001402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:00.009746 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1083736c-fe15-4d04-9202-e3ac27535978 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1318 microversion: 2.1 time: 0.210017 Oct 27 10:12:00.010325 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 564/1123] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:59 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:00.016011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:00.016609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:00.022711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:00.023180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:00.023624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.024295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:00.024816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:00.025235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.038254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:00.046284 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-68f232f8-79cb-4e40-89ef-323d2a79cc8e tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.185229 Oct 27 10:12:00.046865 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 560/1124] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:59 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:00.091425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:00.101931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:00.104057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:00.104201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:00.104958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:00.110832 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec8273cc-cead-4a6f-b24d-da00d1aeff25 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.098994 Oct 27 10:12:00.111562 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 565/1125] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:00 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:00.113065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:00.113563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:00.114001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.114699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:00.115154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:00.115578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.257472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:00.267003 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-99558469-9d8b-4442-974e-3c4081ea4b54 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.169170 Oct 27 10:12:00.267576 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 561/1126] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:00 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:00.717269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:00.717850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:00.727443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:00.728232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:00.728963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.730069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:00.730766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:00.731430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.751697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:00.752319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:00.759534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:00.760023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:00.760459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.761192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:00.761649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:00.762075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.783456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:00.877951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:00.883243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:00.889813 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec212ae3-4725-4d77-ac4f-5aeaf0f9a493 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.177520 Oct 27 10:12:00.890842 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 566/1127] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:00 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:00.895917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d62bb44e-fa5f-44f9-a115-ed576be8a287 req-c0d2165a-965e-46db-a31e-bc4b1014fc0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe9f124f-910c-4ac8-a6f0-b06b26d1a853", "tag": "aaa4080b-e03f-4c41-8c2e-e431ec84b04a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:00.908171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d62bb44e-fa5f-44f9-a115-ed576be8a287 req-c0d2165a-965e-46db-a31e-bc4b1014fc0e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:00.908649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d62bb44e-fa5f-44f9-a115-ed576be8a287 req-c0d2165a-965e-46db-a31e-bc4b1014fc0e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:00.909102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d62bb44e-fa5f-44f9-a115-ed576be8a287 req-c0d2165a-965e-46db-a31e-bc4b1014fc0e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:00.921904 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d62bb44e-fa5f-44f9-a115-ed576be8a287 req-c0d2165a-965e-46db-a31e-bc4b1014fc0e service nova] Creating event network-changed:aaa4080b-e03f-4c41-8c2e-e431ec84b04a for instance fe9f124f-910c-4ac8-a6f0-b06b26d1a853 on n-h1-854663-10 Oct 27 10:12:00.927468 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d62bb44e-fa5f-44f9-a115-ed576be8a287 req-c0d2165a-965e-46db-a31e-bc4b1014fc0e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035390 Oct 27 10:12:00.928138 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 567/1128] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:01.036598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:01.037341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:01.046064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.046906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.047709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:01.049174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.049501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.050179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:01.186490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:01.195615 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-facf0595-bfa5-449f-94f1-a82f79a7d470 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.448094 Oct 27 10:12:01.196193 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 562/1129] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:00 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:01.201888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:01.202733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:01.209195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.209906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.213211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:01.215278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.215842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.216324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:01.238140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:01.246520 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d9e388a-072d-48cc-bb1d-c108dbc7f666 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1318 microversion: 2.1 time: 0.215731 Oct 27 10:12:01.247444 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 568/1130] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:01 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:01.254349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:01.254349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:01.259679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.260108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.260549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:01.261421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.261880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.262303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:01.355811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:01.369665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:01.371268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:01.381225 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-85170152-ca6a-4a5f-9cf5-5b60c1a2117f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1537 microversion: 2.91 time: 0.132328 Oct 27 10:12:01.382032 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 569/1131] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:01 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1537 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:01.384219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:01.388610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:01.389264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:01.393713 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88c33abf-9f00-4cf1-8f5a-e0ad91a141b9 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.196265 Oct 27 10:12:01.395658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.396140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.396574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:01.397325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.408685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.408685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:01.409700 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 563/1132] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:01 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:01.544171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:01.556536 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-781ca525-af8c-4f52-a433-843080e9431e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.173194 Oct 27 10:12:01.557431 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 570/1133] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:01 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:01.917874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:01.919150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:01.926352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.926836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.927278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:01.927986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:01.928434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:01.928908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.075329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:02.083639 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5aa91cdc-4af8-43f4-8204-82c40c789e65 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.172362 Oct 27 10:12:02.084213 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 564/1134] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:01 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:02.221954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:02.222570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:02.243484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.243990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.244424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.247807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.248231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.248680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.270674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:02.271478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:02.284092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.285384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.286939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.287742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.290758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.291223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.685436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:02.705077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:02.708692 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99adbcb7-662d-4f76-a7d0-993b55fbfb88 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.490511 Oct 27 10:12:02.711638 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 571/1135] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:02 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:02.723138 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8358176e-2ae4-4cbc-adbb-13e944140490 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1318 microversion: 2.1 time: 0.457111 Oct 27 10:12:02.724021 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 565/1136] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:02 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:02.728298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:02.729434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:02.732428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:02.733000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:02.741201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.742062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.742221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.743109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.743480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.743896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.748651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.749052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.749498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.750203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.750653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.751080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.823861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:02.833212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:02.834771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:02.840655 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67fc6897-2bd1-4d45-8e93-cba086371ff1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1558 microversion: 2.91 time: 0.127634 Oct 27 10:12:02.848750 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 572/1137] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:02 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1558 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:02.848750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:02.848750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:02.853455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.853949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.854500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.855210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:02.856097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:02.856097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:02.991634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:03.004250 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-378fb381-5a17-4709-8447-412d460cad27 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.279419 Oct 27 10:12:03.005752 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 566/1138] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:02 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:03.053771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:03.062646 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ff7520a-8240-46d7-b29e-b91d865f024e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.220020 Oct 27 10:12:03.063234 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 573/1139] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:02 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:03.108020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:03.108641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:03.114823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:03.115274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:03.115690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:03.116642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:03.117198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:03.117632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:03.163316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d61756e8-abbb-4fb8-838b-0facb3a4d997 req-701a449d-6784-48ff-ac6e-71042e9663c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe9f124f-910c-4ac8-a6f0-b06b26d1a853", "name": "network-vif-plugged", "status": "completed", "tag": "aaa4080b-e03f-4c41-8c2e-e431ec84b04a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:03.174073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d61756e8-abbb-4fb8-838b-0facb3a4d997 req-701a449d-6784-48ff-ac6e-71042e9663c8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:03.174560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d61756e8-abbb-4fb8-838b-0facb3a4d997 req-701a449d-6784-48ff-ac6e-71042e9663c8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:03.174993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d61756e8-abbb-4fb8-838b-0facb3a4d997 req-701a449d-6784-48ff-ac6e-71042e9663c8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:03.188536 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d61756e8-abbb-4fb8-838b-0facb3a4d997 req-701a449d-6784-48ff-ac6e-71042e9663c8 service nova] Creating event network-vif-plugged:aaa4080b-e03f-4c41-8c2e-e431ec84b04a for instance fe9f124f-910c-4ac8-a6f0-b06b26d1a853 on n-h1-854663-10 Oct 27 10:12:03.193717 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d61756e8-abbb-4fb8-838b-0facb3a4d997 req-701a449d-6784-48ff-ac6e-71042e9663c8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034263 Oct 27 10:12:03.194542 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 574/1140] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:03.261261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:03.269442 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-054aea7d-924d-41c3-9fe2-1f2c3378ae16 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.165388 Oct 27 10:12:03.270281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 567/1141] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:03 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:03.741516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:03.742490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:03.750442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:03.751042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:03.751205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:03.751525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:03.751958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:03.752629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:03.753161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:03.753586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:03.757137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:03.757598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:03.758031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:03.758740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:03.759187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:03.759598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:03.949974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:03.953395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:03.958681 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9e2e993-32a7-4712-934e-8ecd204d0c7b tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.225362 Oct 27 10:12:03.959327 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 575/1142] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:03 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:03.961774 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab0b7124-2c04-4b77-8fd2-decb3ca8f8a0 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1318 microversion: 2.1 time: 0.216166 Oct 27 10:12:03.962417 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 568/1143] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:03 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:03.964682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:03.965374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:03.971864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:03.972418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:03.972952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:03.973706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:03.974227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:03.974829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.029562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:04.030723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:04.037334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.037818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.038256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.038956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.039404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.039965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.046067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:04.054768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:04.056352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:04.061911 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-618fd73a-da68-43a9-a538-61a8cb304570 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1558 microversion: 2.91 time: 0.101576 Oct 27 10:12:04.062561 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 576/1144] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:03 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1558 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:04.085612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:04.086214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:04.092953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.093448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.093858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.094551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.094990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.095403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.230604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:04.238884 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-89e5a8cd-9dec-431b-9c5c-ba7cb5cc4db1 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.214093 Oct 27 10:12:04.239489 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 569/1145] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:04 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:04.260296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:04.268380 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11ad02e4-e51a-40f7-a081-b5d7d6df87e3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.186661 Oct 27 10:12:04.269027 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 577/1146] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:04 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:04.294282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:04.295206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:04.304464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.305210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.305872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.306581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.307034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.307431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.678920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:04.686850 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9d85a714-9c29-47dc-9aa8-82d448809314 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.396985 Oct 27 10:12:04.687418 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 570/1147] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:04 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:04.984912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:04.985495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:04.985950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:04.986647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:04.988954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:04.989639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:04.994841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.995356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.995806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.996524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.996808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.997087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.997227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.997600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.997712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:04.998409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:04.998883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:04.999309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:05.197821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:05.204185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:05.210725 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e325f38-f364-43cb-9a15-594c597c37b9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1507 microversion: 2.1 time: 0.228944 Oct 27 10:12:05.216573 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36c039df-5552-4541-99cb-f7250bdb90c3 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.236533 Oct 27 10:12:05.217179 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 578/1148] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:04 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:05.221961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:05.222739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:05.228959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:05.229146 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 571/1149] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:04 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:05.229817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:05.230419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:05.231611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:05.232388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:05.232528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:05.261571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:05.262170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:05.264507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:05.269710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:05.270549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:05.271134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:05.272008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:05.272607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:05.273197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:05.305509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:05.315770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:05.317439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:05.323454 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b584ece-ebda-4021-9433-7b63b75deee1 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1558 microversion: 2.91 time: 0.105037 Oct 27 10:12:05.324185 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 579/1150] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:05 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1558 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:05.330107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:05.331061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:05.337788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:05.338449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:05.338984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:05.339820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:05.340375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:05.341170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:05.481368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:05.490204 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d2ea58da-ba39-45d6-a10b-322ca75986ad tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.232268 Oct 27 10:12:05.490733 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 572/1151] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:05 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:05.548360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:05.556462 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d328f9aa-b90f-4e69-b37d-195f13cdeff1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.231106 Oct 27 10:12:05.557073 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 580/1152] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:05 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:05.709168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:05.709836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:05.723205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:05.724118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:05.724812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:05.725407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:05.727101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:05.727475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:05.872508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:05.880828 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-525505f9-38d2-49e8-9584-41a2deeff94a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.175536 Oct 27 10:12:05.881407 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 573/1153] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:05 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:06.240059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:06.240855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:06.251350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.252103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.253060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.253906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.254358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.255378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.355011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:06.356321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:06.362812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:06.365209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.365876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.366630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.367519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.368901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.369339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.408560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:06.425231 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-073e0cea-b688-4f63-8610-b2c1f494d76c tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.189307 Oct 27 10:12:06.436869 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 581/1154] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:06 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:06.473991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:06.484025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:06.485516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:06.492559 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3b2fb011-fbc0-47a3-a3cf-059e80cebe27 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1558 microversion: 2.91 time: 0.141443 Oct 27 10:12:06.493252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 574/1155] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:06 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1558 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:12:06.514690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:06.515202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:06.522121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.523015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.523465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.524199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.524735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.525457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.580168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:06.580809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:06.588173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.588692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.589312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.590025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.590549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.591034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.722299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:06.734467 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-020ea086-967d-4966-bfa6-d97525659f40 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1477 microversion: 2.1 time: 0.223549 Oct 27 10:12:06.735250 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 582/1156] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:06 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1477 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:06.757663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:06.766462 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2557822a-1da8-4031-b5f9-21850595e1b0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1538 microversion: 2.1 time: 0.190678 Oct 27 10:12:06.766991 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 575/1157] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:06 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1538 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:06.824434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e6d79a55-2268-46cb-ab83-b8beddb9280e"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:06.827124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:06.833548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.834034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.834468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.835159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.835608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.836029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.905955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:06.906590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:06.906754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] HTTP exception thrown: Volume 8b32158a-40f0-4bdd-92f7-2ea69a738927 could not be found. Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Request method failure captured: Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853/os-volume_attachments/8b32158a-40f0-4bdd-92f7-2ea69a738927 HTTP/1.1 Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 74 Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWljcenMRZ3z7PwkNWmKzJjI1btGb7JztrzuxAkNWJXx7R3fUuQ6HwRHM385ZJUzBCg2e4aVkApnIUh2TLjlV7yZctmHz5_it3c2NRSOayjZ86qRS92s3QTvFFl06zWAwAECfKUuT_0n11bJV5PYuPSGOU5bjmE5HmZ94_dJ--Kr15r8 Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 269e24d765cc4bac916a179d9c045d28 Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesAdminNegativeTest-681828882 Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:12:06.911141 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/269e24d765cc4bac916a179d9c045d28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/269e24d765cc4bac916a179d9c045d28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_269e24d765cc4bac916a179d9c045d28", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/269e24d765cc4bac916a179d9c045d28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesAdminNegativeTest-681828882 Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 269e24d765cc4bac916a179d9c045d28 Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-681828882 Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesAdminNegativeTest-681828882-project-admin Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 63144bbc9a1f46caaadcffd263e1d519 Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesAdminNegativeTest-681828882-project-admin Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: {"volumeAttachment": {"volumeId": "e6d79a55-2268-46cb-ab83-b8beddb9280e"}} Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:12:06.912607 n-d-854663-10 devstack@n-api.service[120720]: exception: Volume 8b32158a-40f0-4bdd-92f7-2ea69a738927 could not be found. Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': 'fe9f124f-910c-4ac8-a6f0-b06b26d1a853', 'id': '8b32158a-40f0-4bdd-92f7-2ea69a738927', 'body': {'volumeAttachment': {'volumeId': 'e6d79a55-2268-46cb-ab83-b8beddb9280e'}}} Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:12:06.913470 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b32158a-40f0-4bdd-92f7-2ea69a738927 could not be found. (HTTP 404) (Request-ID: req-b392d295-0021-44db-a795-6c398e6bb16e) Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:12:06.914482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b32158a-40f0-4bdd-92f7-2ea69a738927 could not be found. Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:06.915621 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b32158a-40f0-4bdd-92f7-2ea69a738927 could not be found. Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b32158a-40f0-4bdd-92f7-2ea69a738927 could not be found. Oct 27 10:12:06.918030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:06.920720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] Returning 404 to user: Volume 8b32158a-40f0-4bdd-92f7-2ea69a738927 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:06.920888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.921043 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-beb4db35-98b0-414c-92dd-09ef175ff395 tempest-VolumesAdminNegativeTest-681828882 tempest-VolumesAdminNegativeTest-681828882-project-admin] 10.222.0.76 "PUT /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853/os-volume_attachments/8b32158a-40f0-4bdd-92f7-2ea69a738927" status: 404 len: 109 microversion: 2.1 time: 0.090035 Oct 27 10:12:06.921936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.922119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.922957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:06.923422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:06.923846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:06.926509 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 583/1158] 10.222.0.76 () {60 vars in 1433 bytes} [Thu Oct 27 10:12:06 2022] PUT /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853/os-volume_attachments/8b32158a-40f0-4bdd-92f7-2ea69a738927 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:12:07.298886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:07.314964 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a943a33-89d1-469b-a5e0-3aab92df3a62 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.413121 Oct 27 10:12:07.315686 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 576/1159] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:06 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:07.449583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:07.450550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:07.452483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:07.460533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:07.461136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:07.461577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:07.462299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:07.462746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:07.463403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:07.521166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:07.522417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:07.532123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:07.532919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:07.533518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:07.534648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:07.535254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:07.536700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:07.976653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:07.985758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:08.002396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:08.025686 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a51d373b-6d24-435c-ba6e-f8bf161ee00f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.508471 Oct 27 10:12:08.026851 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 577/1160] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:07 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:08.049819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:08.050369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:08.057597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:08.058270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:08.058932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:08.060065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:08.060776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:08.061557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:08.108863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:08.127250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e113277e-43b7-48be-b41a-d46a7c20590a tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.682559 Oct 27 10:12:08.131257 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 584/1161] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:07 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:08.160301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:08.160943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:08.177381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:08.178331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:08.178944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:08.179795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:08.180459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:08.181065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:08.210600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:08.386695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:08.406917 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a509b3d7-ee82-46eb-a744-472417349c7d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1462 microversion: 2.1 time: 0.378958 Oct 27 10:12:08.407518 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 578/1162] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:08 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1462 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:08.439561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-74c2d1c7-2b5c-49b6-9623-10592dccaa7a req-19082ff7-8e8a-4aa0-8562-a02a5fd37d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95558ee4-40e1-4fff-a334-890711c72fe1", "name": "network-vif-plugged", "status": "completed", "tag": "d07ac299-6fe3-4076-b485-2752928e0818"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:08.451400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-74c2d1c7-2b5c-49b6-9623-10592dccaa7a req-19082ff7-8e8a-4aa0-8562-a02a5fd37d7d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:08.452158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-74c2d1c7-2b5c-49b6-9623-10592dccaa7a req-19082ff7-8e8a-4aa0-8562-a02a5fd37d7d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:08.452791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-74c2d1c7-2b5c-49b6-9623-10592dccaa7a req-19082ff7-8e8a-4aa0-8562-a02a5fd37d7d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:08.457155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:08.473956 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-74c2d1c7-2b5c-49b6-9623-10592dccaa7a req-19082ff7-8e8a-4aa0-8562-a02a5fd37d7d service nova] Creating event network-vif-plugged:d07ac299-6fe3-4076-b485-2752928e0818 for instance 95558ee4-40e1-4fff-a334-890711c72fe1 on n-h2-854663-10 Oct 27 10:12:08.480879 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-74c2d1c7-2b5c-49b6-9623-10592dccaa7a req-19082ff7-8e8a-4aa0-8562-a02a5fd37d7d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071922 Oct 27 10:12:08.485477 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 579/1163] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:08.491348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:08.492248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:08.499378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:08.500278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:08.500922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:08.501791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:08.502397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:08.503643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:08.899592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:08.920400 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7c83766-51ec-4b92-9387-d362cd89b8ed tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.764396 Oct 27 10:12:08.921298 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 585/1164] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:08 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:08.950025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b84d0699-1db9-4fd7-94d9-30f6c135b658 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:08.951138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:08.954450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b84d0699-1db9-4fd7-94d9-30f6c135b658 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:08.962313 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-324dcc03-ecc0-4440-a634-f9303aa1cbad tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.475355 Oct 27 10:12:08.965990 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 580/1165] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:08 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:08.977254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b84d0699-1db9-4fd7-94d9-30f6c135b658 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:08.977742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b84d0699-1db9-4fd7-94d9-30f6c135b658 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:08.978179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b84d0699-1db9-4fd7-94d9-30f6c135b658 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:08.978886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b84d0699-1db9-4fd7-94d9-30f6c135b658 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:08.979329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b84d0699-1db9-4fd7-94d9-30f6c135b658 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:08.979750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b84d0699-1db9-4fd7-94d9-30f6c135b658 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.062094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:09.063189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:09.079812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.080682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.081700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.082723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.083412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.084240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.134902 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b84d0699-1db9-4fd7-94d9-30f6c135b658 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action" status: 202 len: 0 microversion: 2.1 time: 0.161755 Oct 27 10:12:09.142717 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 586/1166] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:12:08 2022] POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:12:09.154844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:09.155717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:09.172412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.173340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.175099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.175989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.177188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.178583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.221151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:09.235729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:09.238059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:09.244327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7aa1f9f7-08d2-4112-b98a-81a1792c7670 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.190609 Oct 27 10:12:09.245811 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 581/1167] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:09 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:09.267030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:09.267828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:09.276653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.277517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.278247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.279195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.279764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.280238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.280362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.280870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.281560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.283734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lazy-loading 'fault' on Instance uuid c03eeed8-34c3-4fcb-b086-570b834451c3 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:09.519717 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7cb3f31e-63f1-4a65-8dbe-c3862eabba31 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1598 microversion: 2.1 time: 0.371698 Oct 27 10:12:09.520574 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 587/1168] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:09 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1598 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:09.543156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22791110-ecdc-4db5-a014-f4984a2ce34d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:09.545604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22791110-ecdc-4db5-a014-f4984a2ce34d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:09.552739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22791110-ecdc-4db5-a014-f4984a2ce34d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.553532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22791110-ecdc-4db5-a014-f4984a2ce34d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.554130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22791110-ecdc-4db5-a014-f4984a2ce34d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.555060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22791110-ecdc-4db5-a014-f4984a2ce34d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.555515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22791110-ecdc-4db5-a014-f4984a2ce34d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.556588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22791110-ecdc-4db5-a014-f4984a2ce34d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.593189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:09.627868 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9abecc0c-5698-466c-aacb-02a0fbb63f57 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.379766 Oct 27 10:12:09.629851 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 582/1169] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:09 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:09.665813 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22791110-ecdc-4db5-a014-f4984a2ce34d tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action" status: 202 len: 0 microversion: 2.1 time: 0.126360 Oct 27 10:12:09.666527 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 588/1170] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:12:09 2022] POST /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:12:09.674909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c2c36b61-6517-4452-90d3-92deaf779fb4 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:09.675951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c2c36b61-6517-4452-90d3-92deaf779fb4 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:09.684488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c36b61-6517-4452-90d3-92deaf779fb4 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.685011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c36b61-6517-4452-90d3-92deaf779fb4 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.685441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c36b61-6517-4452-90d3-92deaf779fb4 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.692461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c36b61-6517-4452-90d3-92deaf779fb4 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.693013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c36b61-6517-4452-90d3-92deaf779fb4 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.696423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c36b61-6517-4452-90d3-92deaf779fb4 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.915811 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c2c36b61-6517-4452-90d3-92deaf779fb4 tempest-ServersAdminTestJSON-704448620 tempest-ServersAdminTestJSON-704448620-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1615 microversion: 2.1 time: 0.244787 Oct 27 10:12:09.917251 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 583/1171] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:09 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1615 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:09.949267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:09.950684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:09.955665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:09.956751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:09.963560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.964130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.964752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.965443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.966183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.967999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.968154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.968632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.971520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:09.976099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:09.987183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:09.988805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.085982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:12:10.191692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:10.205119 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-63bfcca5-476d-470c-839e-6573c741396f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.255039 Oct 27 10:12:10.241368 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 584/1172] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:09 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:10.247209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:10.247827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:10.262789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.262789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.262789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.262789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.265518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.265938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.297297 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15bc8773-dba2-44d9-8993-e285e5a9ac8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 204 len: 0 microversion: 2.1 time: 0.356546 Oct 27 10:12:10.297956 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 589/1173] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:12:09 2022] DELETE /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:12:10.324828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:10.325560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:10.342724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.343493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.344110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.345008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.345458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.346033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.457823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:10.461891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:10.466963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:10.468412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:10.474143 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94a2c36f-dc05-4b9f-a829-ea79073f21e4 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.162799 Oct 27 10:12:10.475264 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 590/1174] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:10 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:10.485335 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6afc3a6-f314-4287-8584-edc86a453cc1 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.232209 Oct 27 10:12:10.488641 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 585/1175] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:10 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:10.491883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:10.495612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:10.498786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:10.501269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:10.507640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.509560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.512407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.512868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.513803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.514466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.515554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.516060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.516696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.521957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.523468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.524068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.561616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:12:10.695378 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87023fc8-beaa-48a3-9286-45739d60dbe3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "DELETE /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 204 len: 0 microversion: 2.1 time: 0.204992 Oct 27 10:12:10.696729 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 586/1176] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:12:10 2022] DELETE /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:12:10.705967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:10.714243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:10.714949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:10.720764 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54978080-1452-47ac-b566-f27bc44d4d64 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1470 microversion: 2.1 time: 0.244275 Oct 27 10:12:10.736537 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 591/1177] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:10 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:10.741605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:10.741983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:10.752396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.752916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.753344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.754047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.754493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.754910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.760784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.761280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.761713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:10.762637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:10.763157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:10.763626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:11.028187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:11.038256 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f051e1d-ff07-45bd-8601-03d704a54257 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1513 microversion: 2.1 time: 0.300658 Oct 27 10:12:11.038688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:11.061229 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-352070b8-649c-4685-8174-c0d138514b54 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.358124 Oct 27 10:12:11.061781 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 592/1178] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:10 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1513 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:11.083036 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 587/1179] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:10 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:11.236133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:11.237174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:11.245390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:11.246224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:11.246793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:11.249815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:11.249815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:11.249815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:11.433102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:11.442142 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b529d488-2aff-40b5-aaed-acabc040bc16 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.210182 Oct 27 10:12:11.442923 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 593/1180] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:11 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:11.502613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:11.503978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:11.510597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:11.511325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:11.511795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:11.512354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:11.512815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:11.513130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:11.513392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:11.513822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:11.520393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:11.521095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:11.521728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:11.522625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:11.523251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:11.524386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:11.605644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:11.614664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:11.623096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:11.629034 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5349490d-a9b0-4fa4-ab50-1f03d48b2883 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.130345 Oct 27 10:12:11.643958 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 588/1181] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:11 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:11.725170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:11.738215 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03447c30-d42c-45f8-8ec9-0009f74d855b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.229027 Oct 27 10:12:11.744575 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 594/1182] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:11 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:11.749840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:11.750435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:11.761002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:11.761609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:11.762192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:11.763045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:11.763600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:11.764095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:11.917880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:11.928956 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-436e8d05-bacd-4b06-9d3d-fefcd71c7e8f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1470 microversion: 2.1 time: 0.183660 Oct 27 10:12:11.929544 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 589/1183] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:11 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:12.067454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:12.068521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:12.075893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.076492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.077030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.077822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.078345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.078842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.088617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:12.090888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:12.097777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.098316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.098757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.100090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.100622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.101085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.317276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:12.332162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:12.344651 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed916b8f-fab9-47d5-be14-290c57d2c986 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1513 microversion: 2.1 time: 0.282460 Oct 27 10:12:12.345481 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 595/1184] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:12 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:12.348360 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-63c6eb26-6e0c-44e4-b145-705ef184ed03 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.263682 Oct 27 10:12:12.349318 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 590/1185] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:12 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:12.457724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1005ce9e-6f76-484b-a7e2-599093aa416f req-36364e84-174c-46c7-88a8-026e8995de0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7ed094-4322-4336-a483-9eac9a0746dd", "name": "network-vif-plugged", "status": "completed", "tag": "9f52bf0c-5358-459e-9c48-a1e5361e5dbf"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:12.468053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:12.472299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:12.494800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.495424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.495953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.497529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1005ce9e-6f76-484b-a7e2-599093aa416f req-36364e84-174c-46c7-88a8-026e8995de0f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.498580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.499084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.499667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1005ce9e-6f76-484b-a7e2-599093aa416f req-36364e84-174c-46c7-88a8-026e8995de0f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.500317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.500881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1005ce9e-6f76-484b-a7e2-599093aa416f req-36364e84-174c-46c7-88a8-026e8995de0f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.539305 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1005ce9e-6f76-484b-a7e2-599093aa416f req-36364e84-174c-46c7-88a8-026e8995de0f service nova] Creating event network-vif-plugged:9f52bf0c-5358-459e-9c48-a1e5361e5dbf for instance cd7ed094-4322-4336-a483-9eac9a0746dd on n-h2-854663-10 Oct 27 10:12:12.558879 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1005ce9e-6f76-484b-a7e2-599093aa416f req-36364e84-174c-46c7-88a8-026e8995de0f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105832 Oct 27 10:12:12.563951 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 596/1186] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:12.670425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:12.671507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:12.679034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.680805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.681443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.682458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.683102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.683795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.760400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:12.904391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:12.924023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:12.926616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:12.936567 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99004009-b40b-48fd-9123-5a1057584cd5 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.278355 Oct 27 10:12:12.956899 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 597/1187] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:12 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:12.968588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:12.977071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:12.989187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.989938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.990829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:12.992385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:12.993118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:12.993707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.193236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:13.205691 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c64155a1-a2d7-4ba8-85ad-ccb989e473e9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.744029 Oct 27 10:12:13.206845 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 591/1188] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:12 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:13.212575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:13.213500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:13.221211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.221926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.222518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.223523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.224132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.224771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.401580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:13.407534 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7557fba-e8a3-40d7-95ad-aef3573d5207 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1369 microversion: 2.1 time: 0.448851 Oct 27 10:12:13.425452 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 598/1189] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:12 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1369 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:13.429896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-22a06b8d-64de-49d5-8b9e-afe229b2e48b req-205fb614-a541-48a2-af51-ace7050ae564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe9f124f-910c-4ac8-a6f0-b06b26d1a853", "name": "network-vif-deleted", "tag": "aaa4080b-e03f-4c41-8c2e-e431ec84b04a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:13.441642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-22a06b8d-64de-49d5-8b9e-afe229b2e48b req-205fb614-a541-48a2-af51-ace7050ae564 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.442223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-22a06b8d-64de-49d5-8b9e-afe229b2e48b req-205fb614-a541-48a2-af51-ace7050ae564 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.442724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-22a06b8d-64de-49d5-8b9e-afe229b2e48b req-205fb614-a541-48a2-af51-ace7050ae564 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.459989 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-22a06b8d-64de-49d5-8b9e-afe229b2e48b req-205fb614-a541-48a2-af51-ace7050ae564 service nova] Creating event network-vif-deleted:aaa4080b-e03f-4c41-8c2e-e431ec84b04a for instance fe9f124f-910c-4ac8-a6f0-b06b26d1a853 on n-h1-854663-10 Oct 27 10:12:13.465738 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-22a06b8d-64de-49d5-8b9e-afe229b2e48b req-205fb614-a541-48a2-af51-ace7050ae564 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039357 Oct 27 10:12:13.468230 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 599/1190] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:13.481789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:13.483226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:13.483940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:13.492394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.493157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.493467 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b2870460-4a07-4e17-9c84-acf9c00ee94d tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1470 microversion: 2.1 time: 0.285023 Oct 27 10:12:13.494416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.495142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.495576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.495995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.510050 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 592/1191] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:13 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1470 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:13.517516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:13.518233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:13.548563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.551876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.552501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.553408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.554154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.554689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.555892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.556535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.557215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.558046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lazy-loading 'fault' on Instance uuid fe9f124f-910c-4ac8-a6f0-b06b26d1a853 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:13.697440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:13.713132 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4de72ac5-6bf3-421a-9175-79c0bbed5cf7 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 200 len: 1308 microversion: 2.1 time: 0.241065 Oct 27 10:12:13.713723 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 600/1192] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:13 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:13.802657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6823942e-3b55-4868-abb2-dfe8d0690809 req-511b80ee-6fea-4617-acbd-7844500906ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2196499d-7e04-436d-958d-2b28ec88e019", "name": "network-vif-deleted", "tag": "d1cf58cf-c5f0-468c-a2eb-124be532ebd7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:13.817191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6823942e-3b55-4868-abb2-dfe8d0690809 req-511b80ee-6fea-4617-acbd-7844500906ed service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.818740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6823942e-3b55-4868-abb2-dfe8d0690809 req-511b80ee-6fea-4617-acbd-7844500906ed service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.820524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6823942e-3b55-4868-abb2-dfe8d0690809 req-511b80ee-6fea-4617-acbd-7844500906ed service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.852431 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6823942e-3b55-4868-abb2-dfe8d0690809 req-511b80ee-6fea-4617-acbd-7844500906ed service nova] Creating event network-vif-deleted:d1cf58cf-c5f0-468c-a2eb-124be532ebd7 for instance 2196499d-7e04-436d-958d-2b28ec88e019 on n-h2-854663-10 Oct 27 10:12:13.853068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:13.863292 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-220dc12e-8b84-4938-8222-911171107984 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.351061 Oct 27 10:12:13.864391 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 593/1193] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:13 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:13.866807 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6823942e-3b55-4868-abb2-dfe8d0690809 req-511b80ee-6fea-4617-acbd-7844500906ed service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068601 Oct 27 10:12:13.872111 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 601/1194] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:13.972132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:13.973137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:13.986568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.987300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.988058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:13.989016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:13.989630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:13.990217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.082187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:14.086591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:14.094817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:14.096538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:14.107853 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c40f5d85-afb1-4050-9ae8-66db70af2060 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.139755 Oct 27 10:12:14.129003 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 594/1195] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:13 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:14.232134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:14.232863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:14.243710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.244197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.244626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.245350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.245803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.246619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.398801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:14.408942 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c423dea-14fa-4ffc-b977-fcfe5714dc36 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.181128 Oct 27 10:12:14.425174 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 602/1196] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:14 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:14.431098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:14.431783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:14.438395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.439107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.439978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.441617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.442529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.443198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.519400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:14.520039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:14.526925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.527910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.528319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.529336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.529835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.530259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.624135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:14.633622 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d522d64-402a-4357-8f21-c58b2f11493d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1556 microversion: 2.1 time: 0.206636 Oct 27 10:12:14.645322 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 595/1197] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:14 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:14.661399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c094801-2cf5-4906-a1ce-d56117180dd9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:14.662152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c094801-2cf5-4906-a1ce-d56117180dd9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:14.670382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c094801-2cf5-4906-a1ce-d56117180dd9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.671197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c094801-2cf5-4906-a1ce-d56117180dd9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.671871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c094801-2cf5-4906-a1ce-d56117180dd9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.672998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c094801-2cf5-4906-a1ce-d56117180dd9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.673909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c094801-2cf5-4906-a1ce-d56117180dd9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.674554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c094801-2cf5-4906-a1ce-d56117180dd9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.823822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:14.840086 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f550ffb-0552-4535-ae4d-684f677866c3 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1428 microversion: 2.1 time: 0.324779 Oct 27 10:12:14.856949 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 603/1198] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:14 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1428 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:14.864618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:14.865688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: fe9f124f-910c-4ac8-a6f0-b06b26d1a853] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:14.872049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.872532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.874907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.874907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.874907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.874907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.881835 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c094801-2cf5-4906-a1ce-d56117180dd9 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222157 Oct 27 10:12:14.890118 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 596/1199] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:12:14 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-interface => generated 285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:14.890118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:14.890118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:14.910855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] HTTP exception thrown: Instance fe9f124f-910c-4ac8-a6f0-b06b26d1a853 could not be found. Oct 27 10:12:14.914353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.914846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.915888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.916600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:14.917077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:14.917492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Request method failure captured: Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 HTTP/1.1 Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWljBIdZTRAHUhAblgCuEpRliLRVx0KqkB2Y4IgcKF3ldEp_n0-WVExh1iNdtryT_3VI8KfkdInx6V_YP_BKT-D5y-lgrYazjDjFGTG5A7RLmHhI6sI9k77QZBzEb5ZLIvrhcwRS_dTVX_m6U3JssxIzqbznBBtQggK467A0iH8kL_7Q Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 75d00e63cbd24dbc8caef82092921e5a Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesAdminNegativeTest-1242913835 Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:12:14.919743 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/75d00e63cbd24dbc8caef82092921e5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/75d00e63cbd24dbc8caef82092921e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_75d00e63cbd24dbc8caef82092921e5a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/75d00e63cbd24dbc8caef82092921e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesAdminNegativeTest-1242913835 Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 75d00e63cbd24dbc8caef82092921e5a Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1242913835 Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesAdminNegativeTest-1242913835-project Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 45e4b1cad46f43c1a1aac0e2ba5425ae Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesAdminNegativeTest-1242913835-project Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance fe9f124f-910c-4ac8-a6f0-b06b26d1a853 could not be found. Oct 27 10:12:14.921167 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'fe9f124f-910c-4ac8-a6f0-b06b26d1a853'} Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe9f124f-910c-4ac8-a6f0-b06b26d1a853 could not be found. Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:14.921931 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe9f124f-910c-4ac8-a6f0-b06b26d1a853 could not be found. Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe9f124f-910c-4ac8-a6f0-b06b26d1a853 could not be found. Oct 27 10:12:14.923299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:14.924469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Returning 404 to user: Instance fe9f124f-910c-4ac8-a6f0-b06b26d1a853 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:14.924469 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4bbfdc8c-779c-4b23-9236-c9a56eb986b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853" status: 404 len: 111 microversion: 2.1 time: 0.061841 Oct 27 10:12:14.935192 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 604/1200] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:14 2022] GET /compute/v2.1/servers/fe9f124f-910c-4ac8-a6f0-b06b26d1a853 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:12:15.143646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:15.144253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:15.156270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:15.157145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:15.158104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:15.159089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:15.160590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:15.162748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:15.183056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:15.192316 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-736392c4-b828-40cf-8409-048d840d3a36 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.308078 Oct 27 10:12:15.194067 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 597/1201] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:14 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:15.295356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:15.306030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:15.308020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:15.318172 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f760e58-9911-495b-bc86-de6ebf9493d7 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.182576 Oct 27 10:12:15.319228 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 605/1202] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:15 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:12:15.433991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:15.434772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:15.452556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:15.453083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:15.453694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:15.454739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:15.455372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:15.455949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:15.696184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:15.707576 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d34929f8-7360-400a-8bf8-3d282c1bb143 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.277341 Oct 27 10:12:15.708683 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 598/1203] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:15 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:15.871140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:15.873111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:15.898073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:15.898586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:15.899034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:15.904800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:15.905377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:15.905820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:15.954278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:15.955019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:15.955798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:15.956519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lazy-loading 'fault' on Instance uuid 2196499d-7e04-436d-958d-2b28ec88e019 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:16.026727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:16.040277 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ada37e21-2a7a-41cb-93fc-45f1d08c3dab tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 200 len: 1304 microversion: 2.1 time: 0.176758 Oct 27 10:12:16.041442 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 606/1204] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:15 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:16.221900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:16.222606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:16.235017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:16.240025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:16.240620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:16.241666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:16.242236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:16.242777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:16.350999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:16.351664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:16.360941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:16.362933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:16.364144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:16.365330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:16.368290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:16.368879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:16.503620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:16.532755 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a467a289-4975-41a0-8237-e8ff0e633d38 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.314485 Oct 27 10:12:16.535618 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 599/1205] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:16 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:16.541940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-07b83f0c-8d8b-4798-b172-3c5ad65cd445 req-8057ae54-a2ba-4342-adb6-7051b486a5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95558ee4-40e1-4fff-a334-890711c72fe1", "tag": "d07ac299-6fe3-4076-b485-2752928e0818"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:16.555557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-07b83f0c-8d8b-4798-b172-3c5ad65cd445 req-8057ae54-a2ba-4342-adb6-7051b486a5a3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:16.556474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-07b83f0c-8d8b-4798-b172-3c5ad65cd445 req-8057ae54-a2ba-4342-adb6-7051b486a5a3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:16.557441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-07b83f0c-8d8b-4798-b172-3c5ad65cd445 req-8057ae54-a2ba-4342-adb6-7051b486a5a3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:16.575096 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-07b83f0c-8d8b-4798-b172-3c5ad65cd445 req-8057ae54-a2ba-4342-adb6-7051b486a5a3 service nova] Creating event network-changed:d07ac299-6fe3-4076-b485-2752928e0818 for instance 95558ee4-40e1-4fff-a334-890711c72fe1 on n-h2-854663-10 Oct 27 10:12:16.581985 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-07b83f0c-8d8b-4798-b172-3c5ad65cd445 req-8057ae54-a2ba-4342-adb6-7051b486a5a3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044780 Oct 27 10:12:16.587270 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 600/1206] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:16.658868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:16.681809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:16.683743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:16.725489 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fde6d613-5bd0-4a26-afb4-d58fbb98f6d0 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.378356 Oct 27 10:12:16.726351 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 607/1207] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:16 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:12:16.736453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:16.737414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:16.758344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:16.759207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:16.759807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:16.760777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:16.761385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:16.762163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:16.991028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:17.002136 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-99fea3bd-0a11-4ed7-aef4-d098cf7d0ccd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.271730 Oct 27 10:12:17.009817 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 601/1208] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:16 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:17.065353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:17.067985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: 2196499d-7e04-436d-958d-2b28ec88e019] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:17.081123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:17.086923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:17.087727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:17.088727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:17.089363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:17.090149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:17.130597 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] HTTP exception thrown: Instance 2196499d-7e04-436d-958d-2b28ec88e019 could not be found. Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Request method failure captured: Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 HTTP/1.1 Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWljEUhsP0OaX7Sv_k7NIx0oco3gvUrziO31B80_rC3WwEU_3XzgnyCs_Xg5BaYTZk0cszQwwANWsoZh7zz6BamWWoCIWBmBFbgkOViv__CrZL6iUDrHHY25aVXHAUt2V1x0pjIObOHXnz9qoPFSsnEmwo2X_Aqu-w9r8MpSsla2u63E Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 8830099ef30d4bb28259b6763cb4f3b4 Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersAdminTestJSON-966843145 Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:12:17.132206 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8830099ef30d4bb28259b6763cb4f3b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8830099ef30d4bb28259b6763cb4f3b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8830099ef30d4bb28259b6763cb4f3b4", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8830099ef30d4bb28259b6763cb4f3b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersAdminTestJSON-966843145 Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 8830099ef30d4bb28259b6763cb4f3b4 Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersAdminTestJSON-966843145 Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersAdminTestJSON-966843145-project Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: a65debf5e54e4030a0ab162671bd03a5 Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersAdminTestJSON-966843145-project Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 2196499d-7e04-436d-958d-2b28ec88e019 could not be found. Oct 27 10:12:17.133614 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '2196499d-7e04-436d-958d-2b28ec88e019'} Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2196499d-7e04-436d-958d-2b28ec88e019 could not be found. Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:17.134344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2196499d-7e04-436d-958d-2b28ec88e019 could not be found. Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2196499d-7e04-436d-958d-2b28ec88e019 could not be found. Oct 27 10:12:17.135533 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:17.136570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Returning 404 to user: Instance 2196499d-7e04-436d-958d-2b28ec88e019 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:17.136570 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3dacaa1-1d60-4399-98e4-889fe9187434 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019" status: 404 len: 111 microversion: 2.1 time: 0.073278 Oct 27 10:12:17.136570 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 608/1209] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:17 2022] GET /compute/v2.1/servers/2196499d-7e04-436d-958d-2b28ec88e019 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:12:17.142911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:17.143414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:17.151890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:17.152536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:17.158267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:17.159057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:17.160777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:17.161416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:17.208418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:12:17.558680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:17.559363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:17.561683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fca03168-f2cb-40ec-8bc8-22e1b39c85ac tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 204 len: 0 microversion: 2.1 time: 0.422428 Oct 27 10:12:17.575071 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 602/1210] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:12:17 2022] DELETE /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:12:17.575281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:17.575281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:17.583398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:17.584274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:17.584819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:17.586703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:17.587682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:17.599854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:17.621823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:17.624324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:17.624925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:17.625770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:17.627637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:17.629748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:17.943646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:17.957497 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2dd4bef8-cf33-441f-a9e8-666695ec250d tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.402698 Oct 27 10:12:17.964301 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 609/1211] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:17 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:17.970325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:17.973879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:17.994946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:17.996542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:17.997399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:17.999251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:18.001213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:18.001821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:18.036163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:18.050419 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a3f922b-8817-4f69-8ed6-07d565e9834f tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1470 microversion: 2.1 time: 0.471842 Oct 27 10:12:18.053184 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 603/1212] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:17 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1470 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:18.079914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:18.083062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:18.105054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:18.109515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:18.111918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:18.112889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:18.114968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:18.115561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:18.149450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:18.161471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:18.164462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:18.171891 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c70f069a-2829-4492-a093-0960b2055f5b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.205294 Oct 27 10:12:18.176607 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 610/1213] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:17 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:18.450228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:18.461077 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-48ff4037-bcff-4226-a5e4-a525cb6505bf tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.406597 Oct 27 10:12:18.462750 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 604/1214] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:18 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:18.991266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:18.992037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:19.011342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.012069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.012603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.013439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.013993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.014519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.077564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:19.078802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:19.106908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.108453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.109216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.110938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.115702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.116402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.252488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:19.272174 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16ae1b09-dc4f-4fb4-a134-53e730aa720f tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1391 microversion: 2.1 time: 0.282288 Oct 27 10:12:19.296168 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 611/1215] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:18 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1391 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:19.310467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:19.311232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:19.320038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.321581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.322832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.324316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.325018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.326976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.341410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:19.350509 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46001e17-a8d6-4078-b5af-e4272db92380 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1470 microversion: 2.1 time: 0.277019 Oct 27 10:12:19.351693 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 605/1216] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:19 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1470 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:19.456227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:19.457138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:19.464808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.465804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:19.466190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.466861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.467808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.468480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.469157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.479787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:19.481996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:19.493184 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f49faf2b-15fc-4e64-9340-8eaa28322666 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.195630 Oct 27 10:12:19.503599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:12:19.509639 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 612/1217] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:19 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:19.514711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:19.515330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:19.542504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.543092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.543618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.544322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.544794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.545389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.644972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58ea64fc-674e-48cd-a99c-5a8830af7949 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 204 len: 0 microversion: 2.1 time: 0.192336 Oct 27 10:12:19.651095 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 606/1218] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:12:19 2022] DELETE /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:12:19.659463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:19.660400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:19.669674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.670331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.670876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.672279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:19.673143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:19.673762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:19.751786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:19.765697 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f4f4ec2-d420-4554-8c15-12f15e70161a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.253952 Oct 27 10:12:19.780686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 613/1219] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:19 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:19.894275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:19.906765 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ca0b4df-0757-4a53-bac7-0456aa50b4b3 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1681 microversion: 2.1 time: 0.253868 Oct 27 10:12:19.924547 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 607/1220] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:19 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:20.304740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:20.306914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:20.322576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.323502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.324512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.325745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.326432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.327095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.380056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:20.387026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:20.402247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.403760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.404222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.404993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.405453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.405875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.593738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:20.603372 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c4e4375-80e8-4d00-9ad3-651ebde0c778 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1470 microversion: 2.1 time: 0.228637 Oct 27 10:12:20.612082 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 608/1221] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:20 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:20.619002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:20.619618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:20.628287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.628799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.629237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.629950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.630399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.630820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.639915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:20.643745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:20.654687 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f670dc68-a4ec-4370-8c91-352b24d95881 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1591 microversion: 2.1 time: 0.354887 Oct 27 10:12:20.655713 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 614/1222] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:20 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1591 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:20.679508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43dbfec9-252f-4823-892e-ca92a5843b16 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:20.680178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43dbfec9-252f-4823-892e-ca92a5843b16 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:20.688053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dbfec9-252f-4823-892e-ca92a5843b16 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.688741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dbfec9-252f-4823-892e-ca92a5843b16 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.689289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dbfec9-252f-4823-892e-ca92a5843b16 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.690129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dbfec9-252f-4823-892e-ca92a5843b16 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.690700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dbfec9-252f-4823-892e-ca92a5843b16 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.691212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dbfec9-252f-4823-892e-ca92a5843b16 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.711353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:20.721742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:20.723368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:20.725504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:20.729946 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22547da7-f774-476e-a43f-a4a1ee1cce93 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.115741 Oct 27 10:12:20.744957 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 609/1223] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:20 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:20.787356 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43dbfec9-252f-4823-892e-ca92a5843b16 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112018 Oct 27 10:12:20.790812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:20.791486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:20.799246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.799754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.800191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.800939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.801392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.801815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.805328 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 615/1224] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:12:20 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:12:20.933952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:20.934832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:20.945730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.947180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.947682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.948450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:20.949048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:20.949530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:20.969086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:20.974403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:20.987465 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae271e68-84de-4e74-bc97-fc7701bab31c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.201256 Oct 27 10:12:21.018489 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 610/1225] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:20 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:21.119035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:21.127323 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82473451-f35c-4ea9-af49-be4f7beb7566 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1681 microversion: 2.1 time: 0.199090 Oct 27 10:12:21.133553 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 616/1226] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:20 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:21.627808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:21.628592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:21.635984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:21.636509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:21.636954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:21.637674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:21.638129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:21.638591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:21.759599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:21.761196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:21.769194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:21.769778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:21.770327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:21.771100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:21.771618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:21.772327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:21.783835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:21.792427 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f16b13ce-febb-4b7f-afea-9b8ee1621af7 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1470 microversion: 2.1 time: 0.168448 Oct 27 10:12:21.793231 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 611/1227] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:21 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:21.845844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:21.854443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:21.855985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:21.861325 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d0258869-fc19-41be-b402-d93827fcec40 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.105701 Oct 27 10:12:21.861874 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 617/1228] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:21 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:22.016479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:22.017017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:22.023410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.023896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.024326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.025401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.025854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.026261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.156917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:22.157536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:22.161269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:22.164327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.165412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.165854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.166582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.167163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.168078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.169862 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b65e99be-0bce-4d88-9a78-9bd9a41b5320 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.157604 Oct 27 10:12:22.170913 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 612/1229] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:22 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:22.188740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:22.189651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:22.196255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.196825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.197270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.197985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.198462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.199040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.374778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:22.383713 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffa283ee-e131-4a54-9300-231df3a652ad tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1681 microversion: 2.1 time: 0.230705 Oct 27 10:12:22.396697 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 618/1230] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:22 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:22.397096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:22.397221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8ba30c66-b5c6-4191-a000-0ace4257845f req-d38be13f-bb2c-40f4-be89-8d568f0aabfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7ed094-4322-4336-a483-9eac9a0746dd", "tag": "9f52bf0c-5358-459e-9c48-a1e5361e5dbf"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:22.408526 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0633f6af-f1ad-4fe6-a6da-915fe7020cf8 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1591 microversion: 2.1 time: 0.225820 Oct 27 10:12:22.409332 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 613/1231] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:22 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1591 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:22.416715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ba30c66-b5c6-4191-a000-0ace4257845f req-d38be13f-bb2c-40f4-be89-8d568f0aabfd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.417529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ba30c66-b5c6-4191-a000-0ace4257845f req-d38be13f-bb2c-40f4-be89-8d568f0aabfd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.418630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ba30c66-b5c6-4191-a000-0ace4257845f req-d38be13f-bb2c-40f4-be89-8d568f0aabfd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.431637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8ba30c66-b5c6-4191-a000-0ace4257845f req-d38be13f-bb2c-40f4-be89-8d568f0aabfd service nova] Creating event network-changed:9f52bf0c-5358-459e-9c48-a1e5361e5dbf for instance cd7ed094-4322-4336-a483-9eac9a0746dd on n-h2-854663-10 Oct 27 10:12:22.437048 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8ba30c66-b5c6-4191-a000-0ace4257845f req-d38be13f-bb2c-40f4-be89-8d568f0aabfd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051557 Oct 27 10:12:22.437645 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 619/1232] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:22.816152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:22.816806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:22.824276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.824812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.825234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.825949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.826405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.826825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.890966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:22.892987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:22.902437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.903264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.903705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.904420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:22.904903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:22.905322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:22.978198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:22.987595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:22.989063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:22.992280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:22.995466 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddd6d30b-54e8-463d-bddc-db666219a928 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.108948 Oct 27 10:12:22.996459 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 620/1233] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:22 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:12:23.001743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:23.011626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80cc30e3-0f75-4629-8a60-fa83c6afa4df tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1470 microversion: 2.1 time: 0.199721 Oct 27 10:12:23.012753 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 614/1234] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:22 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:23.108268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3f8a0622-ee79-4aa5-a9c2-fc372201cb54 req-091ce1ac-c9a7-4747-b5aa-5c873f95eb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89e4759-6f67-4c74-a3e6-6110b6f5125f", "name": "network-vif-unplugged", "status": "completed", "tag": "45983a74-7ba2-4509-8be1-0bea03112348"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:23.120280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3f8a0622-ee79-4aa5-a9c2-fc372201cb54 req-091ce1ac-c9a7-4747-b5aa-5c873f95eb2b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:23.120961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3f8a0622-ee79-4aa5-a9c2-fc372201cb54 req-091ce1ac-c9a7-4747-b5aa-5c873f95eb2b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:23.121493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3f8a0622-ee79-4aa5-a9c2-fc372201cb54 req-091ce1ac-c9a7-4747-b5aa-5c873f95eb2b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:23.133916 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3f8a0622-ee79-4aa5-a9c2-fc372201cb54 req-091ce1ac-c9a7-4747-b5aa-5c873f95eb2b service nova] Creating event network-vif-unplugged:45983a74-7ba2-4509-8be1-0bea03112348 for instance a89e4759-6f67-4c74-a3e6-6110b6f5125f on n-h2-854663-10 Oct 27 10:12:23.138950 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3f8a0622-ee79-4aa5-a9c2-fc372201cb54 req-091ce1ac-c9a7-4747-b5aa-5c873f95eb2b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034616 Oct 27 10:12:23.139578 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 621/1235] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:23.195318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:23.196481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:23.203343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:23.204052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:23.204394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:23.206517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:23.206517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:23.206517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:23.410800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:23.411513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:23.419590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:23.420077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:23.420502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:23.421400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:23.421849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:23.422266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:23.683779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:23.692550 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c2a5c27-9b0b-4540-af06-9af3348c4aba tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1543 microversion: 2.1 time: 0.501641 Oct 27 10:12:23.693438 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 615/1236] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:23 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1543 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:23.875627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:23.883966 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be4730f4-8b20-412d-9c4f-4ffc8fb07828 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1681 microversion: 2.1 time: 0.477830 Oct 27 10:12:23.884803 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 622/1237] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:23 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1681 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:24.024333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:24.025291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:24.035521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:24.036285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:24.044131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:24.044617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:24.047285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:24.047791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:24.048426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:24.049136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:24.049834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:24.050268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:24.050931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:24.051383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:24.051802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:24.055045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:24.262607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:24.263280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:24.275110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea59d227-3a54-47d5-b3eb-0fe355c80ba0 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1428 microversion: 2.1 time: 0.243184 Oct 27 10:12:24.279710 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 623/1238] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:24 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1428 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:24.285332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d6355ca1-5ac3-4fe7-9160-06fb997cff22 req-8667a395-3cbd-4d41-9759-1c4db21a43d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89e4759-6f67-4c74-a3e6-6110b6f5125f", "name": "network-vif-deleted", "tag": "45983a74-7ba2-4509-8be1-0bea03112348"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:24.292706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:24.295061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:24.302484 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4689f5ce-86d7-4f24-8bb7-7722ad86353c tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1553 microversion: 2.91 time: 0.282048 Oct 27 10:12:24.303337 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 616/1239] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:24 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:24.307093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d6355ca1-5ac3-4fe7-9160-06fb997cff22 req-8667a395-3cbd-4d41-9759-1c4db21a43d2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:24.307782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d6355ca1-5ac3-4fe7-9160-06fb997cff22 req-8667a395-3cbd-4d41-9759-1c4db21a43d2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:24.308698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d6355ca1-5ac3-4fe7-9160-06fb997cff22 req-8667a395-3cbd-4d41-9759-1c4db21a43d2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:24.325357 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d6355ca1-5ac3-4fe7-9160-06fb997cff22 req-8667a395-3cbd-4d41-9759-1c4db21a43d2 service nova] Creating event network-vif-deleted:45983a74-7ba2-4509-8be1-0bea03112348 for instance a89e4759-6f67-4c74-a3e6-6110b6f5125f on n-h2-854663-10 Oct 27 10:12:24.331161 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d6355ca1-5ac3-4fe7-9160-06fb997cff22 req-8667a395-3cbd-4d41-9759-1c4db21a43d2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049415 Oct 27 10:12:24.331854 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 624/1240] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:24.715767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:24.716889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:24.730358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:24.733361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:24.734002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:24.738518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:24.741618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:24.742250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:24.877953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a795e11b-c0e1-4114-ae8d-8d8d55486b3b req-af05b8e1-6347-4b4b-a207-1f004b7b940f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a159ce32-162c-4abe-a82d-98d52c1b4a1d", "name": "network-vif-deleted", "tag": "ae097714-3d62-4de8-b685-b4fd4c106f2c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:24.904685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a795e11b-c0e1-4114-ae8d-8d8d55486b3b req-af05b8e1-6347-4b4b-a207-1f004b7b940f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:24.905728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a795e11b-c0e1-4114-ae8d-8d8d55486b3b req-af05b8e1-6347-4b4b-a207-1f004b7b940f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:24.906329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a795e11b-c0e1-4114-ae8d-8d8d55486b3b req-af05b8e1-6347-4b4b-a207-1f004b7b940f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:24.937860 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a795e11b-c0e1-4114-ae8d-8d8d55486b3b req-af05b8e1-6347-4b4b-a207-1f004b7b940f service nova] Creating event network-vif-deleted:ae097714-3d62-4de8-b685-b4fd4c106f2c for instance a159ce32-162c-4abe-a82d-98d52c1b4a1d on n-h2-854663-10 Oct 27 10:12:24.948940 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a795e11b-c0e1-4114-ae8d-8d8d55486b3b req-af05b8e1-6347-4b4b-a207-1f004b7b940f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081762 Oct 27 10:12:24.950380 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 625/1241] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:12:24.978275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:24.981116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:25.000184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:25.000955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:25.001606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:25.002736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:25.003205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:25.003630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:25.139278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:25.146673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:25.155238 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a57d23e-3cd4-44d6-96c9-e9d815ddbb2b tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1327 microversion: 2.1 time: 0.203101 Oct 27 10:12:25.155827 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 626/1242] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:24 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1327 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:25.156600 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6412bcb1-eef7-4464-8cfe-0a3204d743b9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1542 microversion: 2.1 time: 0.444561 Oct 27 10:12:25.157376 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 617/1243] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:24 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1542 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:25.298848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:25.299571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:25.305922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:25.306373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:25.306799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:25.307483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:25.307924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:25.308458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:25.336132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:25.336798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:25.340325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:25.340873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:25.341245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:25.341711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lazy-loading 'fault' on Instance uuid a89e4759-6f67-4c74-a3e6-6110b6f5125f {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:25.343432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:25.344101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:25.344825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:25.345802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:25.346321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:25.346778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:25.401061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:25.412756 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a40b959-004b-4704-ae35-a5f3d7b7defb tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1304 microversion: 2.1 time: 0.114746 Oct 27 10:12:25.413747 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 627/1244] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:25 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:25.430257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:25.438798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:25.440238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:25.445341 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4043c105-7b50-4dc8-a2b8-b14b7ff08785 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1535 microversion: 2.91 time: 0.113501 Oct 27 10:12:25.445920 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 618/1245] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:25 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1535 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:12:26.178008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:26.179183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:26.181308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:26.182093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:26.186714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.187212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.187707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.188362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.188866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.189255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.189428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.189799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.190242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.190945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.191395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.191829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.225830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.226311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.226776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.227156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lazy-loading 'fault' on Instance uuid a159ce32-162c-4abe-a82d-98d52c1b4a1d {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:26.286789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:26.294966 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-445d47f5-07fc-44dc-835a-fd13418279e5 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1332 microversion: 2.1 time: 0.120720 Oct 27 10:12:26.295526 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 628/1246] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:26 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:26.351644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:26.364096 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-136d263f-dd0f-454a-a2af-ea3cebef034f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1542 microversion: 2.1 time: 0.187025 Oct 27 10:12:26.364930 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 619/1247] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:26 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1542 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:26.435796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:26.436324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:26.442923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.443437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.443857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.444553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.445051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.445470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.473798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:26.474405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:26.477061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.477515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.477977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.478439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lazy-loading 'fault' on Instance uuid a89e4759-6f67-4c74-a3e6-6110b6f5125f {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:26.480923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.481410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.481848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.482559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:26.483011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:26.483431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:26.533474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:26.541306 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45451046-0489-470a-8362-7b9c6ca0a9bd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 200 len: 1304 microversion: 2.1 time: 0.109605 Oct 27 10:12:26.541885 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 629/1248] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:26 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:26.553768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:26.562703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:26.564129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:26.569245 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38d8833d-f8e1-4216-a21e-9e8c592e9ee9 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1535 microversion: 2.91 time: 0.099411 Oct 27 10:12:26.569815 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 620/1249] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:26 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1535 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:27.112994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-393dd25d-c175-4757-870b-667a2b2cb34b req-173e3d67-0a62-4ee6-b8d7-706792ec1697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7", "name": "network-vif-unplugged", "status": "completed", "tag": "4d13e56c-1fad-4227-983b-7b7a9cffcefd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:27.123358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-393dd25d-c175-4757-870b-667a2b2cb34b req-173e3d67-0a62-4ee6-b8d7-706792ec1697 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.123824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-393dd25d-c175-4757-870b-667a2b2cb34b req-173e3d67-0a62-4ee6-b8d7-706792ec1697 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.124259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-393dd25d-c175-4757-870b-667a2b2cb34b req-173e3d67-0a62-4ee6-b8d7-706792ec1697 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.137514 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-393dd25d-c175-4757-870b-667a2b2cb34b req-173e3d67-0a62-4ee6-b8d7-706792ec1697 service nova] Creating event network-vif-unplugged:4d13e56c-1fad-4227-983b-7b7a9cffcefd for instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 on n-h2-854663-10 Oct 27 10:12:27.143389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-393dd25d-c175-4757-870b-667a2b2cb34b req-173e3d67-0a62-4ee6-b8d7-706792ec1697 service nova] Instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:12:27.149896 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-393dd25d-c175-4757-870b-667a2b2cb34b req-173e3d67-0a62-4ee6-b8d7-706792ec1697 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040342 Oct 27 10:12:27.150700 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 630/1250] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:27.318321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:27.318938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:27.326811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.327370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.327899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.328597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.329063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.329480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.377262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.377826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.378431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.378871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lazy-loading 'fault' on Instance uuid a159ce32-162c-4abe-a82d-98d52c1b4a1d {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:27.391478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:27.393118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:27.400992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.401861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.402747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.403586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.404450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.405138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.438650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:27.446644 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c7de3a1-9c4e-49a8-999a-6555ab891574 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1332 microversion: 2.1 time: 0.132249 Oct 27 10:12:27.447252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 621/1251] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:27 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:27.547907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:27.559416 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ec77827-e1b3-41f8-b697-b05119aef85d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1474 microversion: 2.1 time: 0.173464 Oct 27 10:12:27.560445 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 631/1252] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:27 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1474 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:27.563764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:27.564378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: a89e4759-6f67-4c74-a3e6-6110b6f5125f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:27.570590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.571070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.571528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.572201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.572643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.573089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.587729 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] HTTP exception thrown: Instance a89e4759-6f67-4c74-a3e6-6110b6f5125f could not be found. Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Request method failure captured: Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f HTTP/1.1 Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWljEUhsP0OaX7Sv_k7NIx0oco3gvUrziO31B80_rC3WwEU_3XzgnyCs_Xg5BaYTZk0cszQwwANWsoZh7zz6BamWWoCIWBmBFbgkOViv__CrZL6iUDrHHY25aVXHAUt2V1x0pjIObOHXnz9qoPFSsnEmwo2X_Aqu-w9r8MpSsla2u63E Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 8830099ef30d4bb28259b6763cb4f3b4 Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersAdminTestJSON-966843145 Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:12:27.589599 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8830099ef30d4bb28259b6763cb4f3b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8830099ef30d4bb28259b6763cb4f3b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8830099ef30d4bb28259b6763cb4f3b4", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8830099ef30d4bb28259b6763cb4f3b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersAdminTestJSON-966843145 Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 8830099ef30d4bb28259b6763cb4f3b4 Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersAdminTestJSON-966843145 Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersAdminTestJSON-966843145-project Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: a65debf5e54e4030a0ab162671bd03a5 Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersAdminTestJSON-966843145-project Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance a89e4759-6f67-4c74-a3e6-6110b6f5125f could not be found. Oct 27 10:12:27.591235 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'a89e4759-6f67-4c74-a3e6-6110b6f5125f'} Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89e4759-6f67-4c74-a3e6-6110b6f5125f could not be found. Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:27.592010 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89e4759-6f67-4c74-a3e6-6110b6f5125f could not be found. Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89e4759-6f67-4c74-a3e6-6110b6f5125f could not be found. Oct 27 10:12:27.593502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:27.595125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Returning 404 to user: Instance a89e4759-6f67-4c74-a3e6-6110b6f5125f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:27.595125 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-518b0e5f-5460-4b27-85a6-db1e8682fd3c tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f" status: 404 len: 111 microversion: 2.1 time: 0.031381 Oct 27 10:12:27.595125 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 622/1253] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:27 2022] GET /compute/v2.1/servers/a89e4759-6f67-4c74-a3e6-6110b6f5125f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:12:27.598568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:27.599119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:27.599275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:27.599639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:27.606031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.606306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.606512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.606793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.606911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.607219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.607615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.608062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.608483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.608889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.609356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.609771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.637954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:12:27.682298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:27.690966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:27.692589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:27.697945 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1f17ab1-e1c1-47e3-9c9e-12ceb5bc8317 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1538 microversion: 2.91 time: 0.103575 Oct 27 10:12:27.698569 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 632/1254] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:27 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1538 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:27.717424 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9fc24988-aa20-4b49-b468-00f435f3e4dc tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 204 len: 0 microversion: 2.1 time: 0.121487 Oct 27 10:12:27.717990 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 623/1255] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:12:27 2022] DELETE /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:12:27.726397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:27.726808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:27.727433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:27.729033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:27.733980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.734482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.734910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.735498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.735648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.736002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.736136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.736453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.736567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.737219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.737673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.738099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.755469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:27.781709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-854663-10". {{(pid=120719) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 10:12:27.846781 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-267ac99a-2803-491a-8f3f-e9862955cb82 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753/action" status: 202 len: 0 microversion: 2.91 time: 0.124285 Oct 27 10:12:27.847852 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 624/1256] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:12:27 2022] POST /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:12:27.855693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:27.856762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:27.863011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.863501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.863946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.865258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:27.865720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:27.866148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:27.876901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:27.885193 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7dc78dca-e2bc-41a9-9c11-8686ca32da5a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1468 microversion: 2.1 time: 0.162771 Oct 27 10:12:27.885998 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 633/1257] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:27 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:27.935183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:27.944926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:27.946403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:27.952353 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c02475ff-a051-454a-9958-f76c5359d27e tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1546 microversion: 2.91 time: 0.100396 Oct 27 10:12:27.952952 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 625/1258] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:27 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1546 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:12:28.468990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:28.469629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:28.479525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:28.480003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:28.480436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:28.481243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:28.481906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:28.482460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:28.518386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:28.518847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:28.519309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:28.519730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lazy-loading 'fault' on Instance uuid a159ce32-162c-4abe-a82d-98d52c1b4a1d {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:28.563236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:28.565592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:28.572250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98c7cb47-4851-40ce-aa39-f236e006cc65 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1332 microversion: 2.1 time: 0.107215 Oct 27 10:12:28.573047 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 634/1259] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:28 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:28.586095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:28.586715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:28.594248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:28.594677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:28.595129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:28.595842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:28.596289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:28.596736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:28.734997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:28.742846 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3e82b745-e3ec-4d32-9a5c-3075a6476f51 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1474 microversion: 2.1 time: 0.160757 Oct 27 10:12:28.743414 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 626/1260] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:28 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1474 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:28.913454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:28.914292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:28.922249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:28.922730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:28.923191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:28.923878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:28.924324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:28.924767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:28.991696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:28.992365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:28.999298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:28.999880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:29.000499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:29.001441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:29.001965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:29.002433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:29.083499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:29.090011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:29.092593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:29.094025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:29.099652 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-779d7f9d-bbf4-42ae-867b-6ade362472db tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.123985 Oct 27 10:12:29.100232 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 627/1261] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:28 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:29.100396 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db21df92-7c82-4d63-a5d7-dd04a14631e2 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1468 microversion: 2.1 time: 0.193510 Oct 27 10:12:29.101081 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 635/1262] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:28 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1468 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:29.595728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:29.597141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:29.618551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:29.620018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:29.621046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:29.626657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:29.628452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:29.629548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:29.684620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:29.685923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:29.687806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:29.688990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lazy-loading 'fault' on Instance uuid a159ce32-162c-4abe-a82d-98d52c1b4a1d {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:29.745730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:29.758910 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-edcc9558-d2b4-4af5-af51-7d29f9c3c821 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1332 microversion: 2.1 time: 0.164591 Oct 27 10:12:29.767202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:29.768522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:29.777412 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 628/1263] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:29 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1332 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:29.782456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:29.782963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:29.783408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:29.784133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:29.784590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:29.785115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:29.956532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:29.965182 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c41967c3-ab4e-41de-a4e2-854eb002fff5 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1474 microversion: 2.1 time: 0.202453 Oct 27 10:12:29.982877 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 636/1264] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:29 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1474 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:30.130120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:30.135536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:30.136410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:30.137236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:30.146672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:30.147095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:30.147739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:30.148496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:30.149720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:30.150319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:30.150889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:30.152961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:30.153823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:30.156070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:30.157354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:30.158575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:30.279161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:30.287783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:30.289250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:30.294341 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea3459db-060e-4023-b22c-8e83f2a2ce72 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.170255 Oct 27 10:12:30.295109 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 637/1265] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:30 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:30.361849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:30.370996 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-244f89dc-4948-49d1-9504-bc485f5ad6dd tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1468 microversion: 2.1 time: 0.250961 Oct 27 10:12:30.371653 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 629/1266] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:30 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1468 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:30.784936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:30.785522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:30.793022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:30.793507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:30.793923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:30.794638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:30.795088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:30.795477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:30.830457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:30.830963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:30.831397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:30.831879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lazy-loading 'fault' on Instance uuid a159ce32-162c-4abe-a82d-98d52c1b4a1d {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:30.875312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:30.883711 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bfd8f052-8e4f-4b10-8b89-2bd88d91afb9 tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1332 microversion: 2.1 time: 0.104286 Oct 27 10:12:30.884481 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 638/1267] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:30 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:30.991019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:30.992328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:31.001268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:31.001987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:31.002634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:31.003521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:31.004636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:31.005237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:31.185461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:31.213287 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc8b4704-f64c-49e9-97c8-f4cd0583e1aa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1474 microversion: 2.1 time: 0.227388 Oct 27 10:12:31.221566 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 630/1268] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:30 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1474 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:31.331469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:31.333610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:31.341511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:31.341999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:31.342534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:31.343859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:31.344326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:31.344944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:31.396237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:31.396892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:31.407910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:31.409417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:31.409869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:31.410596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:31.411049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:31.411473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:31.495428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:31.505344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:31.507016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:31.513409 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0fcd582-1897-40f0-8ab4-d203907c54ec tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.189225 Oct 27 10:12:31.528144 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 639/1269] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:31 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:31.734925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:31.751863 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-29ad3351-fdf5-4a6c-94ff-009d8e914010 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1468 microversion: 2.1 time: 0.359621 Oct 27 10:12:31.754895 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 631/1270] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:31 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:31.911683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:31.912259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:31.925835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:31.926759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:31.927444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:31.928460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:31.929103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:31.929758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:31.990701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:31.991510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:31.992101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:31.992806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lazy-loading 'fault' on Instance uuid a159ce32-162c-4abe-a82d-98d52c1b4a1d {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:32.074973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4b1cad46f43c1a1aac0e2ba5425ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d00e63cbd24dbc8caef82092921e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:32.107035 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e60476bc-083e-4779-999d-a187132967cd tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 200 len: 1332 microversion: 2.1 time: 0.187466 Oct 27 10:12:32.123275 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 640/1271] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:31 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 1332 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:32.237953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:32.247239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:32.253564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.254525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.256068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.257233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.258960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.259686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.267513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-345c011c-4f3a-4518-b7ed-6b4c98b619b5 req-72aa27ef-1dc7-407d-a063-2940d0690e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03eeed8-34c3-4fcb-b086-570b834451c3", "name": "network-vif-deleted", "tag": "47a0bb7b-ed01-4e2b-88f6-d97b5c72da33"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:32.301317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-345c011c-4f3a-4518-b7ed-6b4c98b619b5 req-72aa27ef-1dc7-407d-a063-2940d0690e70 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.303291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-345c011c-4f3a-4518-b7ed-6b4c98b619b5 req-72aa27ef-1dc7-407d-a063-2940d0690e70 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.309036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-345c011c-4f3a-4518-b7ed-6b4c98b619b5 req-72aa27ef-1dc7-407d-a063-2940d0690e70 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.341177 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-345c011c-4f3a-4518-b7ed-6b4c98b619b5 req-72aa27ef-1dc7-407d-a063-2940d0690e70 service nova] Creating event network-vif-deleted:47a0bb7b-ed01-4e2b-88f6-d97b5c72da33 for instance c03eeed8-34c3-4fcb-b086-570b834451c3 on n-h2-854663-10 Oct 27 10:12:32.354614 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-345c011c-4f3a-4518-b7ed-6b4c98b619b5 req-72aa27ef-1dc7-407d-a063-2940d0690e70 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091697 Oct 27 10:12:32.355322 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 641/1272] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:12:32.549682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:32.550416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:32.557266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.557770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.558203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.558910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.559398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.559790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.600849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:32.613656 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f32f42cc-f8f2-4535-a332-acb795ba6f22 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1471 microversion: 2.1 time: 0.382003 Oct 27 10:12:32.626219 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 632/1273] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:32 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:32.641201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:32.643006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:32.651342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.652194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.652885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.653796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.654442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:32.654617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.655002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.663172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:32.664783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:32.670459 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-326aed9c-caf3-4ae1-8ee7-43d737bb2d73 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1544 microversion: 2.91 time: 0.126175 Oct 27 10:12:32.671232 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 642/1274] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:32 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1544 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:12:32.709007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.710001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.710001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.711312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.711312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.711551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.745760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for project 895a8ef842a242469ffa508e1cf9f378. Resources: {'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:12:32.752812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for user ae3b45c026064d6c946f50a4d9d32c2f and project 895a8ef842a242469ffa508e1cf9f378. Resources: {'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:12:32.781551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:32.782230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:32.788493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.789021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.789463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.790176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.790626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.791048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.841929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.842503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.843114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.844143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lazy-loading 'fault' on Instance uuid c03eeed8-34c3-4fcb-b086-570b834451c3 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:32.910984 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3e86ecf0-1510-433f-91c1-4892c8f810c7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7/action" status: 202 len: 0 microversion: 2.1 time: 0.274544 Oct 27 10:12:32.912593 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 633/1275] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:12:32 2022] POST /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:12:32.919677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:32.922417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:32.923212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:32.930105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.930722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.931192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.931977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:32.932504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:32.933143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:32.946995 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71c701d2-def5-497d-aaab-1a32246a9c03 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1303 microversion: 2.1 time: 0.169323 Oct 27 10:12:32.949508 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 643/1276] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:32 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:33.132932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:33.133985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] [instance: a159ce32-162c-4abe-a82d-98d52c1b4a1d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:33.155580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:33.156225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:33.156688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:33.162782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:33.163334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:33.163785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:33.183456 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] HTTP exception thrown: Instance a159ce32-162c-4abe-a82d-98d52c1b4a1d could not be found. Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Request method failure captured: Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d HTTP/1.1 Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWljBIdZTRAHUhAblgCuEpRliLRVx0KqkB2Y4IgcKF3ldEp_n0-WVExh1iNdtryT_3VI8KfkdInx6V_YP_BKT-D5y-lgrYazjDjFGTG5A7RLmHhI6sI9k77QZBzEb5ZLIvrhcwRS_dTVX_m6U3JssxIzqbznBBtQggK467A0iH8kL_7Q Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 75d00e63cbd24dbc8caef82092921e5a Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesAdminNegativeTest-1242913835 Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:12:33.185503 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/75d00e63cbd24dbc8caef82092921e5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/75d00e63cbd24dbc8caef82092921e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_75d00e63cbd24dbc8caef82092921e5a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/75d00e63cbd24dbc8caef82092921e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesAdminNegativeTest-1242913835 Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 75d00e63cbd24dbc8caef82092921e5a Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1242913835 Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesAdminNegativeTest-1242913835-project Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 45e4b1cad46f43c1a1aac0e2ba5425ae Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesAdminNegativeTest-1242913835-project Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance a159ce32-162c-4abe-a82d-98d52c1b4a1d could not be found. Oct 27 10:12:33.187515 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a159ce32-162c-4abe-a82d-98d52c1b4a1d'} Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a159ce32-162c-4abe-a82d-98d52c1b4a1d could not be found. Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:33.188424 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a159ce32-162c-4abe-a82d-98d52c1b4a1d could not be found. Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a159ce32-162c-4abe-a82d-98d52c1b4a1d could not be found. Oct 27 10:12:33.189910 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:33.192198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Returning 404 to user: Instance a159ce32-162c-4abe-a82d-98d52c1b4a1d could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:33.193278 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-996673e2-ec87-4125-afeb-791b20736c9a tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d" status: 404 len: 111 microversion: 2.1 time: 0.066665 Oct 27 10:12:33.194390 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 644/1277] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:33 2022] GET /compute/v2.1/servers/a159ce32-162c-4abe-a82d-98d52c1b4a1d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:12:33.209928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf172248-6049-4fec-ad31-0acc09493a0d tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] Calling method '.version_select at 0x7f6d5b683f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:33.282240 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf172248-6049-4fec-ad31-0acc09493a0d tempest-VolumesAdminNegativeTest-1242913835 tempest-VolumesAdminNegativeTest-1242913835-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029523177" status: 202 len: 0 microversion: 2.1 time: 0.080196 Oct 27 10:12:33.282939 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 645/1278] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:12:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029523177 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:12:33.338283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:33.362773 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5b723563-96ad-462c-86c0-ac69ad461fbc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1470 microversion: 2.1 time: 0.445390 Oct 27 10:12:33.367041 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 634/1279] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:32 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1470 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:33.396361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1df6fddf-e7bc-487d-abde-c9876500b5b6 req-3718a6b1-cbd1-4022-92d7-34f4c476ab8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7", "name": "network-vif-plugged", "status": "completed", "tag": "4d13e56c-1fad-4227-983b-7b7a9cffcefd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:33.422169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1df6fddf-e7bc-487d-abde-c9876500b5b6 req-3718a6b1-cbd1-4022-92d7-34f4c476ab8f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:33.422643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1df6fddf-e7bc-487d-abde-c9876500b5b6 req-3718a6b1-cbd1-4022-92d7-34f4c476ab8f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:33.423029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1df6fddf-e7bc-487d-abde-c9876500b5b6 req-3718a6b1-cbd1-4022-92d7-34f4c476ab8f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:33.435535 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1df6fddf-e7bc-487d-abde-c9876500b5b6 req-3718a6b1-cbd1-4022-92d7-34f4c476ab8f service nova] Creating event network-vif-plugged:4d13e56c-1fad-4227-983b-7b7a9cffcefd for instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 on n-h2-854663-10 Oct 27 10:12:33.442418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-1df6fddf-e7bc-487d-abde-c9876500b5b6 req-3718a6b1-cbd1-4022-92d7-34f4c476ab8f service nova] Instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:12:33.460034 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1df6fddf-e7bc-487d-abde-c9876500b5b6 req-3718a6b1-cbd1-4022-92d7-34f4c476ab8f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082483 Oct 27 10:12:33.460645 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 646/1280] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:33.699237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:33.699849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:33.708194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:33.709089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:33.709747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:33.710671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:33.711342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:33.711980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:33.810830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:33.825779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:33.827341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:33.845758 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3fa52e7a-6012-4bb0-9c14-f5a964ece44f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1484 microversion: 2.91 time: 0.151106 Oct 27 10:12:33.848715 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 635/1281] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:33 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1484 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:33.975890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:33.977349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:33.990387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:33.991135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:33.992574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:33.993534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:33.998021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:33.998928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:34.074938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:34.075440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:34.075888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:34.076357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lazy-loading 'fault' on Instance uuid c03eeed8-34c3-4fcb-b086-570b834451c3 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:34.157423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65debf5e54e4030a0ab162671bd03a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830099ef30d4bb28259b6763cb4f3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:34.167670 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4a6914c-3a62-4b1b-9743-7dd31f994b6a tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 200 len: 1303 microversion: 2.1 time: 0.195893 Oct 27 10:12:34.178606 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 647/1282] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:33 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:34.394648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:34.395913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:34.417346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:34.418330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:34.418952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:34.419776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:34.427683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:34.428443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:34.454033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:34.635595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:34.645727 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afaa58c6-18e5-434f-8518-ebad8ec49734 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1470 microversion: 2.1 time: 0.255273 Oct 27 10:12:34.659325 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 636/1283] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:34 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:34.875541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:34.876112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:34.882664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:34.883424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:34.884134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:34.885034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:34.885655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:34.886274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:34.961061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:34.971690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:34.973173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:34.979292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c6cf5f9-4987-461b-a8de-b4f8183129fc tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1484 microversion: 2.91 time: 0.107751 Oct 27 10:12:34.980418 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 648/1284] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:34 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1484 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:35.190380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:35.191154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] [instance: c03eeed8-34c3-4fcb-b086-570b834451c3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:35.202681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:35.204640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:35.205679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:35.206497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:35.207158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:35.207960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:35.236523 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] HTTP exception thrown: Instance c03eeed8-34c3-4fcb-b086-570b834451c3 could not be found. Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Request method failure captured: Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 HTTP/1.1 Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWljEUhsP0OaX7Sv_k7NIx0oco3gvUrziO31B80_rC3WwEU_3XzgnyCs_Xg5BaYTZk0cszQwwANWsoZh7zz6BamWWoCIWBmBFbgkOViv__CrZL6iUDrHHY25aVXHAUt2V1x0pjIObOHXnz9qoPFSsnEmwo2X_Aqu-w9r8MpSsla2u63E Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 8830099ef30d4bb28259b6763cb4f3b4 Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersAdminTestJSON-966843145 Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:12:35.238869 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8830099ef30d4bb28259b6763cb4f3b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8830099ef30d4bb28259b6763cb4f3b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8830099ef30d4bb28259b6763cb4f3b4", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8830099ef30d4bb28259b6763cb4f3b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersAdminTestJSON-966843145 Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 8830099ef30d4bb28259b6763cb4f3b4 Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersAdminTestJSON-966843145 Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersAdminTestJSON-966843145-project Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: a65debf5e54e4030a0ab162671bd03a5 Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersAdminTestJSON-966843145-project Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance c03eeed8-34c3-4fcb-b086-570b834451c3 could not be found. Oct 27 10:12:35.241169 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'c03eeed8-34c3-4fcb-b086-570b834451c3'} Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03eeed8-34c3-4fcb-b086-570b834451c3 could not be found. Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:35.242232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03eeed8-34c3-4fcb-b086-570b834451c3 could not be found. Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03eeed8-34c3-4fcb-b086-570b834451c3 could not be found. Oct 27 10:12:35.244044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:35.245480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] Returning 404 to user: Instance c03eeed8-34c3-4fcb-b086-570b834451c3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:35.245634 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-75975324-33f5-4d7d-ade2-c176b4e31f85 tempest-ServersAdminTestJSON-966843145 tempest-ServersAdminTestJSON-966843145-project] 10.222.0.76 "GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3" status: 404 len: 111 microversion: 2.1 time: 0.057273 Oct 27 10:12:35.246807 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 637/1285] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:35 2022] GET /compute/v2.1/servers/c03eeed8-34c3-4fcb-b086-570b834451c3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:12:35.675518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:35.676136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:35.686563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:35.689008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:35.689649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:35.692694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:35.693919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:35.696480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:36.022736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:36.027766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:36.033589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:36.057058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:36.057986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:36.058597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:36.059561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:36.060176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:36.060830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:36.415903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:36.432779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:36.434787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:36.452130 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91cd43eb-c411-4f3a-bed7-23aa30814b03 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1484 microversion: 2.91 time: 0.441746 Oct 27 10:12:36.452781 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 638/1286] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:36 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1484 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:36.504472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:36.533393 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00070023-9b80-4096-9844-3c2241b45455 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1470 microversion: 2.1 time: 0.861501 Oct 27 10:12:36.540132 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 649/1287] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:35 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1470 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:37.493532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:37.494395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:37.512235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:37.516141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:37.516901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:37.519791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:37.522658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:37.524982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:37.595267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:37.600278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:37.640729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:37.646821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:37.648343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:37.654011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:37.655559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:37.658640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:37.746225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:37.772179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:37.773923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:37.792458 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c269b6a-024e-44b8-bb25-272e4e2795a2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1484 microversion: 2.91 time: 0.304383 Oct 27 10:12:37.793596 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 639/1288] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:37 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1484 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:38.091831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:38.100502 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab681b14-d77b-48c4-a405-74a1ca6db4dc tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1536 microversion: 2.1 time: 0.536386 Oct 27 10:12:38.117477 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 650/1289] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:37 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1536 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:38.825925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:38.827396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:38.838314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:38.838807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:38.839246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:38.839958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:38.840408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:38.840863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:38.937878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:38.951069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:38.954466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:38.963526 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa92632f-c5a5-4dc1-8b0f-fee580121611 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1484 microversion: 2.91 time: 0.142849 Oct 27 10:12:38.964124 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 640/1290] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:38 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1484 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:39.125901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:39.127766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:39.143611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:39.144704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:39.145772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:39.146917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:39.147584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:39.148343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:39.338006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a52c4311-f7f0-4089-aa5a-77386cdf4c20 req-8ca5cf4e-42f8-42c6-9b6e-224c29430e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7", "name": "network-vif-unplugged", "status": "completed", "tag": "4d13e56c-1fad-4227-983b-7b7a9cffcefd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:39.361718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a52c4311-f7f0-4089-aa5a-77386cdf4c20 req-8ca5cf4e-42f8-42c6-9b6e-224c29430e07 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:39.362427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a52c4311-f7f0-4089-aa5a-77386cdf4c20 req-8ca5cf4e-42f8-42c6-9b6e-224c29430e07 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:39.363662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a52c4311-f7f0-4089-aa5a-77386cdf4c20 req-8ca5cf4e-42f8-42c6-9b6e-224c29430e07 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:39.400718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:39.403346 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a52c4311-f7f0-4089-aa5a-77386cdf4c20 req-8ca5cf4e-42f8-42c6-9b6e-224c29430e07 service nova] Creating event network-vif-unplugged:4d13e56c-1fad-4227-983b-7b7a9cffcefd for instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 on n-h2-854663-10 Oct 27 10:12:39.417585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-a52c4311-f7f0-4089-aa5a-77386cdf4c20 req-8ca5cf4e-42f8-42c6-9b6e-224c29430e07 service nova] Instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:12:39.425896 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a52c4311-f7f0-4089-aa5a-77386cdf4c20 req-8ca5cf4e-42f8-42c6-9b6e-224c29430e07 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096842 Oct 27 10:12:39.426950 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 641/1291] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:12:39.438170 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47dd07cc-1bb6-48d3-84f8-8ea68003921e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1536 microversion: 2.1 time: 0.316955 Oct 27 10:12:39.438776 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 651/1292] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:39 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1536 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:39.993115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:39.993809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:40.001158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:40.001649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:40.002085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:40.002790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:40.003247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:40.003670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:40.081859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:40.093720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:40.095668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:40.101917 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77a04ca8-1597-4327-91fa-10ebc05511c2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1484 microversion: 2.91 time: 0.114121 Oct 27 10:12:40.102993 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 642/1293] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:39 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1484 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:40.133631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1796122122", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:40.186030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:12:40.461867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:40.462524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:40.469255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:40.469744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:40.470180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:40.470877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:40.471330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:40.471798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:40.525046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:12:40.525457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:12:40.526211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:12:40.526625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:12:40.527037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:12:40.536559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:40.537091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:40.537535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:40.538268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:40.538723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:40.539147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:40.556880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Getting quotas for project 0276614f35594fd8b000a760187a7fea. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:12:40.562574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Getting quotas for user 1a2f73716eb14bd8ac0695fc37640e03 and project 0276614f35594fd8b000a760187a7fea. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:12:40.564326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:40.578508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:12:40.580849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:12:40.629918 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8faf1b3d-acf9-45be-a731-29f718f61989 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624372 Oct 27 10:12:40.636773 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 652/1294] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:12:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:12:40.641741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f372b17-b5b7-4a5b-be5a-6d957aa2af7b tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:40.642359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f372b17-b5b7-4a5b-be5a-6d957aa2af7b tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:40.740804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f372b17-b5b7-4a5b-be5a-6d957aa2af7b tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:40.758332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f372b17-b5b7-4a5b-be5a-6d957aa2af7b tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1222 microversion: 2.1 time: 0.120028 Oct 27 10:12:40.760847 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 653/1295] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:40 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:40.771660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:40.785857 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-61ef08be-4efd-4e2b-a8ab-5f918d25e9a7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1536 microversion: 2.1 time: 0.327272 Oct 27 10:12:40.787631 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 643/1296] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:40 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1536 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:41.130414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:41.131447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:41.161297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:41.166199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:41.166709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:41.167562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:41.172205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:41.172591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:41.208997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:41.451241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:41.464936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:41.466450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:41.483536 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bdb70db9-bbd1-44b4-b4f9-d557defd7bd2 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1484 microversion: 2.91 time: 0.358415 Oct 27 10:12:41.484431 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 654/1297] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:41 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1484 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:41.786580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:41.789096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:41.803764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:41.807971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:41.808762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:41.809910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:41.810683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:41.811354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:41.811984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:41.813081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:41.819951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:41.820953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:41.821898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:41.822872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:41.823516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:41.824128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:42.208507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:42.226085 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ec15696-7eb7-44d1-bf08-9e4c18f3fa86 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1274 microversion: 2.1 time: 0.439215 Oct 27 10:12:42.227499 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 644/1298] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:41 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1274 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:42.297122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:42.327913 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95d6365b-5025-4cd9-999b-4c3ca11f3922 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1529 microversion: 2.1 time: 0.520229 Oct 27 10:12:42.333636 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 655/1299] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:41 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1529 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:42.371030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:42.371737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:42.378825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:42.379557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:42.380262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:42.381182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:42.381792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:42.382375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:42.513722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:42.514442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:42.521352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:42.522299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:42.524246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:42.525271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:42.525893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:42.526485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:42.574715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:42.583742 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e3df5f55-ab86-4339-9030-4114b2667275 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1529 microversion: 2.1 time: 0.217407 Oct 27 10:12:42.589042 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 645/1300] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:42 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1529 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:42.610665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17d99ee6-d821-48f9-ae5b-a3091173c243 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:42.620551 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-17d99ee6-d821-48f9-ae5b-a3091173c243 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] HTTP exception thrown: Flavor 69b97d16-8178-4c4f-a34e-1009f47f531e could not be found. Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17d99ee6-d821-48f9-ae5b-a3091173c243 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Request method failure captured: Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/flavors/69b97d16-8178-4c4f-a34e-1009f47f531e HTTP/1.1 Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliUkLoMqYyp4Zx10RAZqbwq2pWpNC0D0YyIdTv0Svb4NNS2_sH5n6L843zTf-NX8MS0hr0dEie64K3jFbTHvttZ8yOyehUo4I7sLWy38EOI7At5OL3MKxYA9M5EzF2WgNkvF3VgYYydsPUZFMRNkWEEoToZWTtwGzk8MFKA7lB6qwc Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ee7144e356384886be4823540b47851b Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-MigrationsAdminTest-739870457 Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:12:42.629951 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ee7144e356384886be4823540b47851b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ee7144e356384886be4823540b47851b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ee7144e356384886be4823540b47851b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ee7144e356384886be4823540b47851b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-MigrationsAdminTest-739870457 Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ee7144e356384886be4823540b47851b Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-MigrationsAdminTest-739870457 Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-MigrationsAdminTest-739870457-project-admin Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d5e1914552af4a1eadf82dd0b120bd4f Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-MigrationsAdminTest-739870457-project-admin Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: exception: Flavor 69b97d16-8178-4c4f-a34e-1009f47f531e could not be found. Oct 27 10:12:42.631650 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '69b97d16-8178-4c4f-a34e-1009f47f531e'} Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 69b97d16-8178-4c4f-a34e-1009f47f531e could not be found. Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:42.632613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 69b97d16-8178-4c4f-a34e-1009f47f531e could not be found. Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 69b97d16-8178-4c4f-a34e-1009f47f531e could not be found. Oct 27 10:12:42.634167 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:42.635667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:42.639424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17d99ee6-d821-48f9-ae5b-a3091173c243 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Returning 404 to user: Flavor 69b97d16-8178-4c4f-a34e-1009f47f531e could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:42.640625 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17d99ee6-d821-48f9-ae5b-a3091173c243 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/69b97d16-8178-4c4f-a34e-1009f47f531e" status: 404 len: 109 microversion: 2.1 time: 0.034466 Oct 27 10:12:42.641388 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 646/1301] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:12:42 2022] DELETE /compute/v2.1/flavors/69b97d16-8178-4c4f-a34e-1009f47f531e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:12:42.647815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:42.649765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dba40c9d9b7347c2a04da70533b1aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c9f82698a1461d921f6d7d97f587da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:42.656305 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-edda63a3-8838-4418-bffc-d5c0a1e11103 tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1471 microversion: 2.91 time: 0.146545 Oct 27 10:12:42.663532 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 656/1302] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:42 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:42.692587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4340a69e-bb01-4a3b-8e45-6a3866e0ad00 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:42.693239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4340a69e-bb01-4a3b-8e45-6a3866e0ad00 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:42.704992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4340a69e-bb01-4a3b-8e45-6a3866e0ad00 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:42.705913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4340a69e-bb01-4a3b-8e45-6a3866e0ad00 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:42.707737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4340a69e-bb01-4a3b-8e45-6a3866e0ad00 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:42.708748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4340a69e-bb01-4a3b-8e45-6a3866e0ad00 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:42.709633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4340a69e-bb01-4a3b-8e45-6a3866e0ad00 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:42.713538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4340a69e-bb01-4a3b-8e45-6a3866e0ad00 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:42.738928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:42.860730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1114168773", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:42.865021 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4340a69e-bb01-4a3b-8e45-6a3866e0ad00 tempest-UnshelveToHostMultiNodesTest-1599746258 tempest-UnshelveToHostMultiNodesTest-1599746258-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 200 len: 1852 microversion: 2.91 time: 0.176172 Oct 27 10:12:42.866493 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 647/1303] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:42 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 1852 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:42.941671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:42.942204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:42.951627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:42.952347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:42.952971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:42.953883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:42.954496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:42.955464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:42.981766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:12:42.988652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:12:43.003787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.004207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.004697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.098720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lazy-loading 'flavor' on Instance uuid 6348df04-190c-4588-a3e2-40f1b1e0f753 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:43.115017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lazy-loading 'system_metadata' on Instance uuid 6348df04-190c-4588-a3e2-40f1b1e0f753 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:43.183640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lazy-loading 'metadata' on Instance uuid 6348df04-190c-4588-a3e2-40f1b1e0f753 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:43.426072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:12:43.427265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:12:43.430184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:12:43.431432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:12:43.432173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:12:43.456445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.459932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.462166 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.scheduler.client.report [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Deleted allocations for instance 6348df04-190c-4588-a3e2-40f1b1e0f753 Oct 27 10:12:43.462537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.465928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.467328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.467959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.494839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c2b4cfae-a190-4d65-ba6d-3b11318a903f tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 204 len: 0 microversion: 2.91 time: 0.560543 Oct 27 10:12:43.495977 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 648/1304] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:12:42 2022] DELETE /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:12:43.500502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for project 895a8ef842a242469ffa508e1cf9f378. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:12:43.503627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:43.504307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:43.508130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Getting quotas for user ae3b45c026064d6c946f50a4d9d32c2f and project 895a8ef842a242469ffa508e1cf9f378. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:12:43.511463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.511967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.512541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.513349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.513910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.514481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.528625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:12:43.531840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:12:43.591120 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a714e20-9bf5-47af-9b7c-aebda04c5a50 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734956 Oct 27 10:12:43.592403 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 657/1305] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:12:43.600802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29c1f4f2-e455-4b5d-8754-3a85dac32c27 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:43.602010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29c1f4f2-e455-4b5d-8754-3a85dac32c27 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:43.624159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c1f4f2-e455-4b5d-8754-3a85dac32c27 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.636829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c1f4f2-e455-4b5d-8754-3a85dac32c27 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.637286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c1f4f2-e455-4b5d-8754-3a85dac32c27 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.642345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c1f4f2-e455-4b5d-8754-3a85dac32c27 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.642829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c1f4f2-e455-4b5d-8754-3a85dac32c27 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.645253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c1f4f2-e455-4b5d-8754-3a85dac32c27 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.653710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:43.662811 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e695410-22cf-46f3-92b9-b5b57983afe7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1280 microversion: 2.1 time: 0.165430 Oct 27 10:12:43.666798 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 649/1306] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:43 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:43.682561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:43.684693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] [instance: 6348df04-190c-4588-a3e2-40f1b1e0f753] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:43.695905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.702698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.703301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.704158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.705206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.705206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.730897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] HTTP exception thrown: Instance 6348df04-190c-4588-a3e2-40f1b1e0f753 could not be found. Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Request method failure captured: Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 HTTP/1.1 Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWljtfjZt_SGgte0QdrNH2Gd6qlY8-xF0KuTRK-EiDgwCgXtphnl77rW0cFAr8eYVtZt6EET7DpXpfh0nC1tQ-AmEOusBSzcpgHExDvkaVahyOR-WQwbRQmLXwkaEqNzyxQpEl-bcwMSPvmh6eFAf7-hrxcNViuQTnEas4opaNKsasxo Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.91 Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: b7c9f82698a1461d921f6d7d97f587da Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1941685612 Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:12:43.733444 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b7c9f82698a1461d921f6d7d97f587da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b7c9f82698a1461d921f6d7d97f587da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b7c9f82698a1461d921f6d7d97f587da", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b7c9f82698a1461d921f6d7d97f587da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1941685612 Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: b7c9f82698a1461d921f6d7d97f587da Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1941685612 Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-UnshelveToHostMultiNodesTest-1941685612-project Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: dba40c9d9b7347c2a04da70533b1aba7 Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1941685612-project Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 6348df04-190c-4588-a3e2-40f1b1e0f753 could not be found. Oct 27 10:12:43.735113 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '6348df04-190c-4588-a3e2-40f1b1e0f753'} Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6348df04-190c-4588-a3e2-40f1b1e0f753 could not be found. Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:43.736043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6348df04-190c-4588-a3e2-40f1b1e0f753 could not be found. Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6348df04-190c-4588-a3e2-40f1b1e0f753 could not be found. Oct 27 10:12:43.737475 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:43.738827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] Returning 404 to user: Instance 6348df04-190c-4588-a3e2-40f1b1e0f753 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:43.738827 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-29b8b3fd-7997-4134-a42b-33c37083d92b tempest-UnshelveToHostMultiNodesTest-1941685612 tempest-UnshelveToHostMultiNodesTest-1941685612-project] 10.222.0.76 "GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753" status: 404 len: 111 microversion: 2.91 time: 0.066811 Oct 27 10:12:43.738827 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 650/1307] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:43 2022] GET /compute/v2.1/servers/6348df04-190c-4588-a3e2-40f1b1e0f753 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:12:43.744155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ad2df96-f12a-45cc-b32a-ee8e0de73e65 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:43.744919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ad2df96-f12a-45cc-b32a-ee8e0de73e65 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:43.851097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ad2df96-f12a-45cc-b32a-ee8e0de73e65 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:43.869422 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29c1f4f2-e455-4b5d-8754-3a85dac32c27 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1816 microversion: 2.1 time: 0.273732 Oct 27 10:12:43.880625 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 658/1308] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:43 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1816 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:43.905710 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ad2df96-f12a-45cc-b32a-ee8e0de73e65 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1213 microversion: 2.1 time: 0.167712 Oct 27 10:12:43.908389 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 651/1309] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:43 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1213 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:43.920976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6cc0584-afcb-4ce1-9a8b-192fea320ad0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:43.931740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6cc0584-afcb-4ce1-9a8b-192fea320ad0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.932914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6cc0584-afcb-4ce1-9a8b-192fea320ad0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.936207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6cc0584-afcb-4ce1-9a8b-192fea320ad0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.938283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6cc0584-afcb-4ce1-9a8b-192fea320ad0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:43.940292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6cc0584-afcb-4ce1-9a8b-192fea320ad0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:43.941385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6cc0584-afcb-4ce1-9a8b-192fea320ad0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:43.982573 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6cc0584-afcb-4ce1-9a8b-192fea320ad0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.076349 Oct 27 10:12:43.997406 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 659/1310] 10.222.0.76 () {58 vars in 1176 bytes} [Thu Oct 27 10:12:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:44.071072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-eea5820e-a281-4b87-a682-746d0766b8fe req-23c7d69f-ea5e-474b-b5af-21e75bfe41c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7", "name": "network-vif-plugged", "status": "completed", "tag": "4d13e56c-1fad-4227-983b-7b7a9cffcefd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:44.090976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-eea5820e-a281-4b87-a682-746d0766b8fe req-23c7d69f-ea5e-474b-b5af-21e75bfe41c8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:44.091492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-eea5820e-a281-4b87-a682-746d0766b8fe req-23c7d69f-ea5e-474b-b5af-21e75bfe41c8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:44.092313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-eea5820e-a281-4b87-a682-746d0766b8fe req-23c7d69f-ea5e-474b-b5af-21e75bfe41c8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:44.122787 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-eea5820e-a281-4b87-a682-746d0766b8fe req-23c7d69f-ea5e-474b-b5af-21e75bfe41c8 service nova] Creating event network-vif-plugged:4d13e56c-1fad-4227-983b-7b7a9cffcefd for instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 on n-h2-854663-10 Oct 27 10:12:44.135237 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-eea5820e-a281-4b87-a682-746d0766b8fe req-23c7d69f-ea5e-474b-b5af-21e75bfe41c8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068486 Oct 27 10:12:44.138863 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 652/1311] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:44.692940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:44.693633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:44.704828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:44.705873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:44.706472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:44.707348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:44.707949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:44.709161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:44.937229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:44.938116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:44.958744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:44.959261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:44.959742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:44.960776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:44.961636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:44.962224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:44.980430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:45.022980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:45.038057 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4d2111e-359c-4232-b6c7-b4328fcd91e7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1322 microversion: 2.1 time: 0.349714 Oct 27 10:12:45.038741 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 660/1312] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:44 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:45.093675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:45.116099 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0b1d1cf2-b79c-482c-a104-31499a066cfb tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1265 microversion: 2.1 time: 0.183838 Oct 27 10:12:45.118186 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 653/1313] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:44 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:46.064011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:46.066539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:46.081915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:46.082403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:46.082844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:46.083538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:46.086101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:46.086708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:46.141846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:46.144434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:46.153723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:46.155277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:46.155961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:46.157230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:46.157882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:46.158736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:46.255104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:46.265123 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-168a203c-1439-4ae7-a22f-333bc81cea78 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1271 microversion: 2.1 time: 0.129383 Oct 27 10:12:46.275534 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 654/1314] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:46 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:46.296084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:46.308163 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36e54c4c-09e3-4d15-a954-2857395cb0ac tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1322 microversion: 2.1 time: 0.248390 Oct 27 10:12:46.309214 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 661/1315] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:46 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:46.508082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c4912ace-02bb-4d5f-a93e-192b8a4d63c9 req-b636aa90-56e9-478a-9ceb-610cc7653a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5efb897f-74a9-45d2-85ec-59125686de70", "tag": "2fd7f8fa-e564-4a62-a96d-b390514b7717"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:46.527821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c4912ace-02bb-4d5f-a93e-192b8a4d63c9 req-b636aa90-56e9-478a-9ceb-610cc7653a48 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:46.529248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c4912ace-02bb-4d5f-a93e-192b8a4d63c9 req-b636aa90-56e9-478a-9ceb-610cc7653a48 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:46.529984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c4912ace-02bb-4d5f-a93e-192b8a4d63c9 req-b636aa90-56e9-478a-9ceb-610cc7653a48 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:46.559754 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c4912ace-02bb-4d5f-a93e-192b8a4d63c9 req-b636aa90-56e9-478a-9ceb-610cc7653a48 service nova] Creating event network-changed:2fd7f8fa-e564-4a62-a96d-b390514b7717 for instance 5efb897f-74a9-45d2-85ec-59125686de70 on n-h1-854663-10 Oct 27 10:12:46.572635 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c4912ace-02bb-4d5f-a93e-192b8a4d63c9 req-b636aa90-56e9-478a-9ceb-610cc7653a48 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068867 Oct 27 10:12:46.573457 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 655/1316] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:46.954677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c2e2492-92e5-40e3-81d0-8d036470d22b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28817a79-4f88-4b77-8e50-b6a6ec91c221", "device": "/dev/xvdb"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:46.957706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c2e2492-92e5-40e3-81d0-8d036470d22b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:46.965586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2e2492-92e5-40e3-81d0-8d036470d22b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:46.966300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2e2492-92e5-40e3-81d0-8d036470d22b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:46.967368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2e2492-92e5-40e3-81d0-8d036470d22b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:46.968539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2e2492-92e5-40e3-81d0-8d036470d22b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:46.969201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2e2492-92e5-40e3-81d0-8d036470d22b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:46.969784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2e2492-92e5-40e3-81d0-8d036470d22b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:47.291851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:47.293189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:47.308650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:47.311221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:47.311967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:47.313043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:47.315179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:47.316041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:47.361534 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c2e2492-92e5-40e3-81d0-8d036470d22b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "POST /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412683 Oct 27 10:12:47.364031 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 662/1317] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:12:46 2022] POST /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:47.379560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:47.383042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:47.401587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:47.405390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:47.406098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:47.407772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:47.409568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:47.413342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:47.707262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:47.752537 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7ca032f4-7c93-49c7-b30c-e4c61410e989 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1313 microversion: 2.1 time: 0.447828 Oct 27 10:12:47.753800 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 656/1318] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:47 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:47.870540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:47.881399 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ed2ea56-94d1-4347-aad8-7363327a83c7 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1322 microversion: 2.1 time: 0.515715 Oct 27 10:12:47.893738 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 663/1319] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:47 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:48.696739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:48.697295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:48.704333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:48.713426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:48.713959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:48.714722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:48.715176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:48.715598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:48.888331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1349469168", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:48.956803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:12:48.965070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 029ff781-574b-48de-9033-cd8e69e64ec2 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:12:48.990402 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15abd953-21cf-427c-ac8b-6e35b7261775 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 2348 microversion: 2.25 time: 0.298914 Oct 27 10:12:48.991009 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 657/1320] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:12:48 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 2348 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:12:49.021815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:49.022424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:49.046498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:49.047002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:49.047443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:49.048168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:49.048623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:49.049121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:49.385474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:49.395656 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d2758fb7-aae9-4462-9d7b-a33902f02349 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1313 microversion: 2.1 time: 0.377636 Oct 27 10:12:49.397013 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 658/1321] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:48 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:49.402398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:49.403381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:49.410013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:49.410725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:49.411323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:49.412187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:49.412857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:49.413497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:49.480774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:12:49.481344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:12:49.482175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:12:49.482705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:12:49.483403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:12:49.503075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:49.505185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:49.508004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:49.509055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:49.510770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:49.511339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:49.560100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Getting quotas for project 2d40db77806e420bb85acf838e83f4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:12:49.568123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Getting quotas for user 3009d5c2b8874d30a33dd6dee68a59f4 and project 2d40db77806e420bb85acf838e83f4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:12:49.605738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:12:49.610151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:12:49.714111 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7194e23-5c96-4f3a-9bf3-a77022934390 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989801 Oct 27 10:12:49.715769 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 664/1322] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:12:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:12:49.724745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-478e6c92-1838-4e79-b287-43f697fd8508 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:49.737949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478e6c92-1838-4e79-b287-43f697fd8508 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:49.738664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478e6c92-1838-4e79-b287-43f697fd8508 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:49.739285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478e6c92-1838-4e79-b287-43f697fd8508 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:49.742554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478e6c92-1838-4e79-b287-43f697fd8508 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:49.744353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478e6c92-1838-4e79-b287-43f697fd8508 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:49.745173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478e6c92-1838-4e79-b287-43f697fd8508 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:49.767537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:49.778268 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-349aa488-d8c9-4b83-8000-888085306c25 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1322 microversion: 2.1 time: 0.377740 Oct 27 10:12:49.795621 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 659/1323] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:49 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:49.806014 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-478e6c92-1838-4e79-b287-43f697fd8508 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.088529 Oct 27 10:12:49.807266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7fff536-9f58-4a1c-9830-9a3f516d8f93 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:49.807880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7fff536-9f58-4a1c-9830-9a3f516d8f93 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:49.808221 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 665/1324] 10.222.0.76 () {60 vars in 1217 bytes} [Thu Oct 27 10:12:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:12:49.952821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7fff536-9f58-4a1c-9830-9a3f516d8f93 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:49.960257 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7fff536-9f58-4a1c-9830-9a3f516d8f93 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1214 microversion: 2.1 time: 0.163494 Oct 27 10:12:49.960869 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 660/1325] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:49 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:50.421168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:50.421782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:50.431647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:50.432135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:50.438554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:50.439327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:50.439804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:50.440237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:50.533878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3174e2f6-797d-458f-92a7-8e3a27d98a4a req-d451364a-ba89-4d9c-8431-26060a2f3fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2259f471-9ce2-4ad1-91a3-6bf122ab46ca", "tag": "1a4efe5d-7145-4c38-99cb-5f5f90f71dcc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:50.568062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3174e2f6-797d-458f-92a7-8e3a27d98a4a req-d451364a-ba89-4d9c-8431-26060a2f3fa1 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:50.568894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3174e2f6-797d-458f-92a7-8e3a27d98a4a req-d451364a-ba89-4d9c-8431-26060a2f3fa1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:50.575276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3174e2f6-797d-458f-92a7-8e3a27d98a4a req-d451364a-ba89-4d9c-8431-26060a2f3fa1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:50.594820 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3174e2f6-797d-458f-92a7-8e3a27d98a4a req-d451364a-ba89-4d9c-8431-26060a2f3fa1 service nova] Creating event network-changed:1a4efe5d-7145-4c38-99cb-5f5f90f71dcc for instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca on n-h1-854663-10 Oct 27 10:12:50.601414 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3174e2f6-797d-458f-92a7-8e3a27d98a4a req-d451364a-ba89-4d9c-8431-26060a2f3fa1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071103 Oct 27 10:12:50.602645 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 661/1326] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:50.695994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:50.710949 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-601a6a35-51e1-48f3-a343-78f91686e971 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1313 microversion: 2.1 time: 0.294449 Oct 27 10:12:50.711845 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 666/1327] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:50 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:50.806544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:50.808132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:50.823666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:50.824159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:50.824596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:50.825479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:50.826202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:50.830612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:50.989261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:50.989895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:51.035478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:51.035990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:51.036438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:51.048971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:51.049710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:51.050171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:51.113261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:51.123640 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-107020bf-f36a-432f-95bc-31f5cb7cc54f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1322 microversion: 2.1 time: 0.321786 Oct 27 10:12:51.126496 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 662/1328] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:50 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:51.185280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:51.194367 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-783f5bbf-b7c8-4946-9bfb-3625f6b15ff7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1266 microversion: 2.1 time: 0.209954 Oct 27 10:12:51.199180 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 667/1329] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:50 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:51.676641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6aad2e34-a3ca-47cf-9b78-99a676506230 req-02709973-4661-4e09-b9e0-211c3145227c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5efb897f-74a9-45d2-85ec-59125686de70", "name": "network-vif-plugged", "status": "completed", "tag": "2fd7f8fa-e564-4a62-a96d-b390514b7717"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:51.698839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6aad2e34-a3ca-47cf-9b78-99a676506230 req-02709973-4661-4e09-b9e0-211c3145227c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:51.699485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6aad2e34-a3ca-47cf-9b78-99a676506230 req-02709973-4661-4e09-b9e0-211c3145227c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:51.700013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6aad2e34-a3ca-47cf-9b78-99a676506230 req-02709973-4661-4e09-b9e0-211c3145227c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:51.720567 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6aad2e34-a3ca-47cf-9b78-99a676506230 req-02709973-4661-4e09-b9e0-211c3145227c service nova] Creating event network-vif-plugged:2fd7f8fa-e564-4a62-a96d-b390514b7717 for instance 5efb897f-74a9-45d2-85ec-59125686de70 on n-h1-854663-10 Oct 27 10:12:51.735382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:51.736148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:51.764308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:51.766626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:51.767154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:51.768006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:51.768526 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6aad2e34-a3ca-47cf-9b78-99a676506230 req-02709973-4661-4e09-b9e0-211c3145227c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094213 Oct 27 10:12:51.777049 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 663/1330] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:51.777949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:51.778584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:52.153561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:52.155076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:52.178899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:52.179390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:52.179826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:52.180541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:52.183914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:52.184385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:52.251153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:52.260790 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39ae95db-7854-4ffb-af45-e3200cef3782 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1313 microversion: 2.1 time: 0.528935 Oct 27 10:12:52.263229 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 668/1331] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:51 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:52.276033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:52.279791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:52.286832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:52.287343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:52.287773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:52.288466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:52.288933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:52.289525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:52.427595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:52.452183 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-792d99cf-6ed4-4e97-84fc-a7a92408dc25 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1272 microversion: 2.1 time: 0.179512 Oct 27 10:12:52.455306 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 669/1332] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:52 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:52.520445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:52.533841 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-40f8881a-8758-4d8d-bb4c-7ba5726fcdaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1322 microversion: 2.1 time: 0.385894 Oct 27 10:12:52.537148 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 664/1333] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:52 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:52.542360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eca65919-727c-4e5e-ab74-5da873153c5f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0c3e322-3073-4653-8684-b035f9f0d4fa", "device": "/dev/xvdb"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:52.545744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eca65919-727c-4e5e-ab74-5da873153c5f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:52.553584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eca65919-727c-4e5e-ab74-5da873153c5f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:52.554182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eca65919-727c-4e5e-ab74-5da873153c5f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:52.554744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eca65919-727c-4e5e-ab74-5da873153c5f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:52.555587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eca65919-727c-4e5e-ab74-5da873153c5f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:52.556121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eca65919-727c-4e5e-ab74-5da873153c5f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:52.556543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eca65919-727c-4e5e-ab74-5da873153c5f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:52.953944 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eca65919-727c-4e5e-ab74-5da873153c5f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "POST /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.415985 Oct 27 10:12:52.956612 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 670/1334] 10.222.0.76 () {62 vars in 1364 bytes} [Thu Oct 27 10:12:52 2022] POST /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:12:53.287731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:53.288356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:53.298857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:53.299350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:53.299792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:53.300502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:53.307477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:53.308108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:53.481285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:53.482457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:53.506229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:53.508527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:53.510422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:53.511617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:53.515243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:53.515977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:53.568212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:53.597223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:53.609807 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-48bb450d-4a2d-42dd-b87c-fdd7032c99ca tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1313 microversion: 2.1 time: 0.326738 Oct 27 10:12:53.611027 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 665/1335] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:53 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:53.629064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:53.630122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:53.638712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:53.641457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:53.653532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:53.655275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:53.656003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:53.656717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:53.901217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:53.915379 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28a95221-d00b-4cd1-b88a-943c2ac7193f tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1314 microversion: 2.1 time: 0.439562 Oct 27 10:12:53.923440 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 671/1336] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:53 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:54.289626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:54.303702 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb18471d-d071-42b3-865a-59da8562b6b4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1322 microversion: 2.1 time: 0.691262 Oct 27 10:12:54.304426 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 666/1337] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:53 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:54.636139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:54.636825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:54.649117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:54.650006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:54.650602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:54.651476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:54.652146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:54.652748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:54.927548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:54.932779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e7a96f3d-c40a-4565-b6b2-948314232af7 req-497a058c-96a3-4cc1-b6a7-ca0f84f638b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deab0cfe-7479-4448-9d97-103b3f4f1536", "tag": "7f7bfff3-20e9-42b2-aa9e-456fbe0b846e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:54.942407 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a80d4ca-2e2e-4e7a-b082-543eb80ef3c8 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1313 microversion: 2.1 time: 0.310477 Oct 27 10:12:54.958809 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 672/1338] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:54 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:54.964261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e7a96f3d-c40a-4565-b6b2-948314232af7 req-497a058c-96a3-4cc1-b6a7-ca0f84f638b7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:54.966528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e7a96f3d-c40a-4565-b6b2-948314232af7 req-497a058c-96a3-4cc1-b6a7-ca0f84f638b7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:54.966975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e7a96f3d-c40a-4565-b6b2-948314232af7 req-497a058c-96a3-4cc1-b6a7-ca0f84f638b7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:54.979762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:54.991730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:55.018455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:55.018998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:55.019612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:55.020322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:55.020805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:55.021267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:55.040635 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e7a96f3d-c40a-4565-b6b2-948314232af7 req-497a058c-96a3-4cc1-b6a7-ca0f84f638b7 service nova] Creating event network-changed:7f7bfff3-20e9-42b2-aa9e-456fbe0b846e for instance deab0cfe-7479-4448-9d97-103b3f4f1536 on n-h1-854663-10 Oct 27 10:12:55.067372 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e7a96f3d-c40a-4565-b6b2-948314232af7 req-497a058c-96a3-4cc1-b6a7-ca0f84f638b7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148299 Oct 27 10:12:55.089111 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 667/1339] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:12:55.331097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:55.332602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:55.345667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:55.351012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:55.354346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:55.355418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:55.358846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:55.359756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:55.490911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:55.505264 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8fac1ff4-7fc1-4768-9b72-3f560db5e24d tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1314 microversion: 2.1 time: 0.538967 Oct 27 10:12:55.506527 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 673/1340] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:54 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:55.665506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:55.675129 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-febf4dc0-f2e7-4ce4-84c9-09c7449b29fd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1471 microversion: 2.1 time: 0.351719 Oct 27 10:12:55.676766 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 668/1341] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:55 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:55.972239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee6efeb5-6459-4505-9d26-15b02a307dd2 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:55.973622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee6efeb5-6459-4505-9d26-15b02a307dd2 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] [instance: ad91d0d2-0c3d-44c3-9f1f-d908968b845f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:55.984325 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ee6efeb5-6459-4505-9d26-15b02a307dd2 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] HTTP exception thrown: Instance ad91d0d2-0c3d-44c3-9f1f-d908968b845f could not be found. Oct 27 10:12:55.984968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:55.985593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee6efeb5-6459-4505-9d26-15b02a307dd2 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Request method failure captured: Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/ad91d0d2-0c3d-44c3-9f1f-d908968b845f/action HTTP/1.1 Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 15 Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlmXaW11x-3tIHoN14g5RkQ9-NQ_ZraPzPYnXLWe2vo7HrY412IllD9OWjZizpCiakPgqxoAsPCr4J6FauAJKeWeAEeZa_UK6RJQLBtSFzrWF7ot0hyuFqsKxzpVD9azko6SHxUrjxYoSmRQ_KVqzrw0wXOR5vUpqM9QHXH-GKwRGMw Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:12:55.986942 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e560ebc1283e473fa35d972ac906d773", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c50cae04023d4c7b8acf7e5ebc744b5b Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: {"migrate": {}} Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:12:55.988366 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance ad91d0d2-0c3d-44c3-9f1f-d908968b845f could not be found. Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ad91d0d2-0c3d-44c3-9f1f-d908968b845f', 'body': {'migrate': {}}} Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad91d0d2-0c3d-44c3-9f1f-d908968b845f could not be found. Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:55.989833 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad91d0d2-0c3d-44c3-9f1f-d908968b845f could not be found. Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad91d0d2-0c3d-44c3-9f1f-d908968b845f could not be found. Oct 27 10:12:55.991343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:55.994451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee6efeb5-6459-4505-9d26-15b02a307dd2 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Returning 404 to user: Instance ad91d0d2-0c3d-44c3-9f1f-d908968b845f could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:55.995571 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee6efeb5-6459-4505-9d26-15b02a307dd2 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/ad91d0d2-0c3d-44c3-9f1f-d908968b845f/action" status: 404 len: 111 microversion: 2.1 time: 0.295364 Oct 27 10:12:56.007599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:56.007599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:56.007599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:56.007599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:56.007943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:56.008207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:56.009380 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 674/1342] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:12:55 2022] POST /compute/v2.1/servers/ad91d0d2-0c3d-44c3-9f1f-d908968b845f/action => generated 111 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:12:56.125320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-459907658", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:56.186985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:12:56.691023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:56.725131 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58b4f43a-4423-4b12-a5b4-98bd7f205426 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1313 microversion: 2.1 time: 0.746245 Oct 27 10:12:56.729905 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 669/1343] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:55 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1313 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:56.749165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:56.749800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:56.760514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:56.761448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:56.762102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:56.763230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:56.763862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:56.764462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:56.832024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:12:56.832467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:12:56.833039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:12:56.833516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:12:56.833997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:12:56.844559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:56.850169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:56.850925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:56.852062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:56.852799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:56.853505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:56.919826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Getting quotas for project 0276614f35594fd8b000a760187a7fea. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:12:56.926242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Getting quotas for user 1a2f73716eb14bd8ac0695fc37640e03 and project 0276614f35594fd8b000a760187a7fea. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:12:56.938857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:56.940308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:12:56.942988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:12:57.020266 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ab8db9f-5d66-4993-b6e7-3a11e459fe7f tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899231 Oct 27 10:12:57.027933 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 675/1344] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:12:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:12:57.034862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c97e1f43-6776-480a-a3b9-12b25d58a48d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:57.035576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c97e1f43-6776-480a-a3b9-12b25d58a48d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:57.056080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:57.065489 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76e6369e-8cac-4775-8f6b-4da77a7ba951 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1314 microversion: 2.1 time: 0.331300 Oct 27 10:12:57.070971 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 670/1345] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:56 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:57.190273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c97e1f43-6776-480a-a3b9-12b25d58a48d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:57.198441 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c97e1f43-6776-480a-a3b9-12b25d58a48d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1221 microversion: 2.1 time: 0.168833 Oct 27 10:12:57.199037 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 676/1346] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:57 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1221 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:57.514668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3a909e04-7b04-4e8c-86a6-f417f77a9f17 req-c217919b-1f74-4e91-ad48-ce8ed702cec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2259f471-9ce2-4ad1-91a3-6bf122ab46ca", "name": "network-vif-plugged", "status": "completed", "tag": "1a4efe5d-7145-4c38-99cb-5f5f90f71dcc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:57.540937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3a909e04-7b04-4e8c-86a6-f417f77a9f17 req-c217919b-1f74-4e91-ad48-ce8ed702cec6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:57.542057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3a909e04-7b04-4e8c-86a6-f417f77a9f17 req-c217919b-1f74-4e91-ad48-ce8ed702cec6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:57.543222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3a909e04-7b04-4e8c-86a6-f417f77a9f17 req-c217919b-1f74-4e91-ad48-ce8ed702cec6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:57.594170 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3a909e04-7b04-4e8c-86a6-f417f77a9f17 req-c217919b-1f74-4e91-ad48-ce8ed702cec6 service nova] Creating event network-vif-plugged:1a4efe5d-7145-4c38-99cb-5f5f90f71dcc for instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca on n-h1-854663-10 Oct 27 10:12:57.608321 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3a909e04-7b04-4e8c-86a6-f417f77a9f17 req-c217919b-1f74-4e91-ad48-ce8ed702cec6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103290 Oct 27 10:12:57.609634 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 671/1347] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:57.756868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:57.757510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:57.772218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:57.772956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:57.773722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:57.774446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:57.774904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:57.775329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:58.093663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:58.095010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:58.112342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:58.112535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:58.113556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:58.114163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:58.115254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:58.115863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:58.117248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:58.125194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b8f3ff9d-f9ba-47a1-a273-f8190116d618 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1313 microversion: 2.1 time: 0.376482 Oct 27 10:12:58.128881 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 677/1348] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:57 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:58.229924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:58.229924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:58.243469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:58.243957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:58.244586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:58.245758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:58.246700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:58.248041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:58.396281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:58.405584 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4946c1d1-e0a0-4c4e-a29a-78377e3eddbd tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1217 microversion: 2.1 time: 0.183487 Oct 27 10:12:58.413474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:58.419612 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 678/1349] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:58 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1217 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:12:58.423574 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-182c49f3-d19e-40c3-a9fc-ad3e78675184 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1314 microversion: 2.1 time: 0.334224 Oct 27 10:12:58.425657 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 672/1350] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:58 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:58.633904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9af3301f-b4de-4b88-a0ac-b6b395249a65 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] Calling method '.version_select at 0x7f6d5baba040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:58.752517 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9af3301f-b4de-4b88-a0ac-b6b395249a65 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] 10.222.0.76 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.182630 Oct 27 10:12:58.755115 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 679/1351] 10.222.0.76 () {58 vars in 1149 bytes} [Thu Oct 27 10:12:58 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:12:58.768280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e67c392-d03a-4fa2-a43a-7d7f3dd90b82 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] Action: 'create', calling method: .version_select at 0x7f6d63974280>, body: {"pool": "non_exist_pool"} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:58.919170 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0e67c392-d03a-4fa2-a43a-7d7f3dd90b82 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] HTTP exception thrown: Floating IP pool not found. Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e67c392-d03a-4fa2-a43a-7d7f3dd90b82 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] Request method failure captured: Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 26 Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlmqqcJe6NVOz563ZhXjpvla7rX98wrJfJfKQnovSJh5SEDCJOVjLejzTZgZfyvSZPNz60iMY8FQcUoKiHNPX6int3bx6yS1RfgAdoNjFg5q1lxWkUSZjslfHYmQNBtVNz27Yq8jMQ1xA52qrigy9fymDEMKN1UbwaDxeB_gB9mPSto Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 25349a13e12d4f2ab294a93360ac66ee Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2063320232 Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:12:58.941723 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25349a13e12d4f2ab294a93360ac66ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/25349a13e12d4f2ab294a93360ac66ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_25349a13e12d4f2ab294a93360ac66ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25349a13e12d4f2ab294a93360ac66ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2063320232 Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 25349a13e12d4f2ab294a93360ac66ee Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2063320232 Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FloatingIPsNegativeTestJSON-2063320232-project Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: e401ff1e63df42568168fccfff0d5e6c Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2063320232-project Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: {"pool": "non_exist_pool"} Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: exception: Floating IP pool not found. Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 27 10:12:58.943400 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:58.944479 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e67c392-d03a-4fa2-a43a-7d7f3dd90b82 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] Returning 404 to user: Floating IP pool not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:58.945820 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e67c392-d03a-4fa2-a43a-7d7f3dd90b82 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.179146 Oct 27 10:12:58.946715 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 673/1352] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:12:58 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:12:58.955837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e92beab-b6ba-41d5-ba8d-41818cdb37c3 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] Calling method '.version_select at 0x7f6d5baf3670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:59.035120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-0e92beab-b6ba-41d5-ba8d-41818cdb37c3 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1e8f59d0-a8e5-4575-8ea0-63f854270617 could not be found", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:12:59.035891 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0e92beab-b6ba-41d5-ba8d-41818cdb37c3 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] HTTP exception thrown: Floating IP not found for ID 1e8f59d0-a8e5-4575-8ea0-63f854270617 Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e92beab-b6ba-41d5-ba8d-41818cdb37c3 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] Request method failure captured: Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-floating-ips/1e8f59d0-a8e5-4575-8ea0-63f854270617 HTTP/1.1 Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlmqqcJe6NVOz563ZhXjpvla7rX98wrJfJfKQnovSJh5SEDCJOVjLejzTZgZfyvSZPNz60iMY8FQcUoKiHNPX6int3bx6yS1RfgAdoNjFg5q1lxWkUSZjslfHYmQNBtVNz27Yq8jMQ1xA52qrigy9fymDEMKN1UbwaDxeB_gB9mPSto Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 25349a13e12d4f2ab294a93360ac66ee Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2063320232 Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:12:59.049724 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25349a13e12d4f2ab294a93360ac66ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/25349a13e12d4f2ab294a93360ac66ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_25349a13e12d4f2ab294a93360ac66ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25349a13e12d4f2ab294a93360ac66ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2063320232 Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 25349a13e12d4f2ab294a93360ac66ee Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2063320232 Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsNegativeTestJSON-2063320232-project Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: e401ff1e63df42568168fccfff0d5e6c Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2063320232-project Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: exception: Floating IP not found for ID 1e8f59d0-a8e5-4575-8ea0-63f854270617 Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1e8f59d0-a8e5-4575-8ea0-63f854270617'} Oct 27 10:12:59.051168 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:12:59.051972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1e8f59d0-a8e5-4575-8ea0-63f854270617 could not be found Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-770867cb-6b2b-4a15-a201-cfde99a227ea'] Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1e8f59d0-a8e5-4575-8ea0-63f854270617. Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:59.053809 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1e8f59d0-a8e5-4575-8ea0-63f854270617 Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:12:59.056030 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:12:59.058364 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1e8f59d0-a8e5-4575-8ea0-63f854270617 Oct 27 10:12:59.058364 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:12:59.058364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e92beab-b6ba-41d5-ba8d-41818cdb37c3 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] Returning 404 to user: Floating IP not found for ID 1e8f59d0-a8e5-4575-8ea0-63f854270617 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:12:59.058364 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e92beab-b6ba-41d5-ba8d-41818cdb37c3 tempest-FloatingIPsNegativeTestJSON-2063320232 tempest-FloatingIPsNegativeTestJSON-2063320232-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/1e8f59d0-a8e5-4575-8ea0-63f854270617" status: 404 len: 111 microversion: 2.1 time: 0.101416 Oct 27 10:12:59.058364 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 680/1353] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:12:58 2022] DELETE /compute/v2.1/os-floating-ips/1e8f59d0-a8e5-4575-8ea0-63f854270617 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:12:59.154522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:59.156015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:59.169316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:59.170800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:59.172206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:59.174704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:59.175445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:59.176348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:59.339437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:59.353347 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b796fd4-dead-4936-b15a-91c6c07d39ae tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1313 microversion: 2.1 time: 0.205366 Oct 27 10:12:59.354370 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 674/1354] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:59 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:59.433588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:59.434477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:59.449921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:59.450919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:59.461415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:59.463669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:59.464493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:59.465475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:59.466658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:59.467406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:59.468115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:59.468865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:59.469519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:59.471523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:59.478284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:59.479261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:59.497045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:59.723204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:59.737463 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-784feaac-03ef-4dd4-9ac9-41716eb0dcd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1281 microversion: 2.1 time: 0.308440 Oct 27 10:12:59.757449 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 681/1355] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:59 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1281 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:59.858518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:59.874525 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8cb8d6c3-1afc-4b8b-a117-db1d4445a904 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1314 microversion: 2.1 time: 0.428360 Oct 27 10:12:59.887753 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 675/1356] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:59 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:00.379498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:00.384429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:00.401314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:00.402022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:00.402654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:00.405596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:00.406070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:00.406508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:00.765787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:00.766436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:00.772010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:00.784314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:00.785126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:00.785273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:00.789727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:00.791103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:00.791732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.214144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:01.237089 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a20d75b-b2ef-402c-82c4-8b835a29f66d tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1321 microversion: 2.1 time: 0.475118 Oct 27 10:13:01.238870 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 676/1357] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:00 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:01.249322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:01.253122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:01.259381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:01.274804 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1ec5bb3-fa02-4e1a-acce-3f8a323625c1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1463 microversion: 2.1 time: 0.901401 Oct 27 10:13:01.275774 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 682/1358] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:00 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1463 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:01.280805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:01.284552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.285449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.285981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.286769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.287292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.288378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.294350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aca0cad6-87f0-46e6-ad3e-1e6c1041b313 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:01.295497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aca0cad6-87f0-46e6-ad3e-1e6c1041b313 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:01.302838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca0cad6-87f0-46e6-ad3e-1e6c1041b313 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.303671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca0cad6-87f0-46e6-ad3e-1e6c1041b313 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.304312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca0cad6-87f0-46e6-ad3e-1e6c1041b313 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.305266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca0cad6-87f0-46e6-ad3e-1e6c1041b313 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.305925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca0cad6-87f0-46e6-ad3e-1e6c1041b313 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.308022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca0cad6-87f0-46e6-ad3e-1e6c1041b313 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.678186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:01.690050 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c371bb2-364c-4814-bc54-43280c07ace7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1314 microversion: 2.1 time: 0.448525 Oct 27 10:13:01.690264 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aca0cad6-87f0-46e6-ad3e-1e6c1041b313 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1862 microversion: 2.1 time: 0.412043 Oct 27 10:13:01.690642 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 677/1359] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:01 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:01.691371 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 683/1360] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:01 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1862 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:01.715300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854663-10", "block_migration": true, "disk_over_commit": false}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:01.718842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-23e045bb-948b-4bb4-88f7-b1d5a344250a tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:01.719487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-23e045bb-948b-4bb4-88f7-b1d5a344250a tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:01.722455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:01.731433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.732324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.733032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.733993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.734814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.734931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23e045bb-948b-4bb4-88f7-b1d5a344250a tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.735366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23e045bb-948b-4bb4-88f7-b1d5a344250a tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.735806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23e045bb-948b-4bb4-88f7-b1d5a344250a tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.736493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.736887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23e045bb-948b-4bb4-88f7-b1d5a344250a tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.737334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23e045bb-948b-4bb4-88f7-b1d5a344250a tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.737757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23e045bb-948b-4bb4-88f7-b1d5a344250a tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.775167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lazy-loading 'flavor' on Instance uuid db810b22-71e9-4b8c-bbaf-59b8443d408b {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:13:01.795224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Going to try to live migrate instance to n-h1-854663-10 {{(pid=120720) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:13:01.956036 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-23e045bb-948b-4bb4-88f7-b1d5a344250a tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1616 microversion: 2.1 time: 0.244200 Oct 27 10:13:01.956633 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 678/1361] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:01 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1616 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:01.980898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:01.981595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:01.992718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.993186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.993616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:01.994494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:01.994939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:01.995355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:02.052466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd5e1914552af4a1eadf82dd0b120bd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7144e356384886be4823540b47851b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:02.057186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] flavor_id is None. Assuming migration. {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 10:13:02.057744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 10:13:02.507367 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6d4dd961-30d4-4e94-83fd-9467fb9d5da7 tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca/action" status: 202 len: 0 microversion: 2.1 time: 0.530760 Oct 27 10:13:02.514333 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 679/1362] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:13:01 2022] POST /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:02.528707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:02.529655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:02.568845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:02.570357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:02.572622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:02.575155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:02.576018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:02.579249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:03.100267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:03.116322 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b7558db-d6d0-4863-bd81-e3af0fdaabd9 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1321 microversion: 2.1 time: 0.597595 Oct 27 10:13:03.134127 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 680/1363] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:02 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:03.148982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-674708b6-00dd-44eb-85b9-c21b9525877c req-1ac1e7eb-e1e5-4848-873d-77a5b706a100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deab0cfe-7479-4448-9d97-103b3f4f1536", "name": "network-vif-plugged", "status": "completed", "tag": "7f7bfff3-20e9-42b2-aa9e-456fbe0b846e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:03.173752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-674708b6-00dd-44eb-85b9-c21b9525877c req-1ac1e7eb-e1e5-4848-873d-77a5b706a100 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:03.175281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-674708b6-00dd-44eb-85b9-c21b9525877c req-1ac1e7eb-e1e5-4848-873d-77a5b706a100 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:03.176172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-674708b6-00dd-44eb-85b9-c21b9525877c req-1ac1e7eb-e1e5-4848-873d-77a5b706a100 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:03.208594 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-674708b6-00dd-44eb-85b9-c21b9525877c req-1ac1e7eb-e1e5-4848-873d-77a5b706a100 service nova] Creating event network-vif-plugged:7f7bfff3-20e9-42b2-aa9e-456fbe0b846e for instance deab0cfe-7479-4448-9d97-103b3f4f1536 on n-h1-854663-10 Oct 27 10:13:03.227390 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-674708b6-00dd-44eb-85b9-c21b9525877c req-1ac1e7eb-e1e5-4848-873d-77a5b706a100 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079258 Oct 27 10:13:03.231562 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 681/1364] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:03.239199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:03.241065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:03.249078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:03.249977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:03.250595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:03.251482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:03.252109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:03.252809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:03.586954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:03.600200 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c8a6fd57-22ad-4078-837d-2a0d27bfebb7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1472 microversion: 2.1 time: 0.363742 Oct 27 10:13:03.601204 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 682/1365] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:03 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:03.606484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e5561ed8-2cf4-40f5-8106-f390b469530f req-6de9574c-6c66-4bf7-98a1-da4d8751f6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195ef5bc-754e-49d9-a6ac-ec9d6549e065", "tag": "afa72335-9133-44b2-bf85-a9ec47a970ef"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:03.616797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e5561ed8-2cf4-40f5-8106-f390b469530f req-6de9574c-6c66-4bf7-98a1-da4d8751f6d8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:03.617505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e5561ed8-2cf4-40f5-8106-f390b469530f req-6de9574c-6c66-4bf7-98a1-da4d8751f6d8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:03.618254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e5561ed8-2cf4-40f5-8106-f390b469530f req-6de9574c-6c66-4bf7-98a1-da4d8751f6d8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:03.636630 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e5561ed8-2cf4-40f5-8106-f390b469530f req-6de9574c-6c66-4bf7-98a1-da4d8751f6d8 service nova] Creating event network-changed:afa72335-9133-44b2-bf85-a9ec47a970ef for instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 on n-h1-854663-10 Oct 27 10:13:03.642161 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e5561ed8-2cf4-40f5-8106-f390b469530f req-6de9574c-6c66-4bf7-98a1-da4d8751f6d8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039550 Oct 27 10:13:03.646376 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 683/1366] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:03.652992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:03.653188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:03.659736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:03.660200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:03.660626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:03.661343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:03.661781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:03.662196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:03.915785 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-449ca4cf-1a1b-4dfe-8ebe-78f937d99035 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/action" status: 202 len: 0 microversion: 2.1 time: 2.205580 Oct 27 10:13:03.916365 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 684/1367] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:13:01 2022] POST /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/action => generated 0 bytes in 2207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:03.927520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:03.928147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:03.940994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:03.941963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:03.942698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:03.943751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:03.944432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:03.945070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:03.970804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:03.984841 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05aff0f3-e984-4e9f-a07c-81a911b17a2b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1314 microversion: 2.1 time: 0.332746 Oct 27 10:13:03.985487 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 684/1368] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:03 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:04.143468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:04.144433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:04.153404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:04.154333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:04.155668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:04.156502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:04.157487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:04.158567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:04.674345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:04.699643 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dfc18910-8ff7-45f4-92ce-793449d96b17 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.777612 Oct 27 10:13:04.717058 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 685/1369] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:03 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:04.732466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:04.733350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:04.751237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:04.751733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:04.752171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:04.752913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:04.756505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:04.756992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:04.840708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:04.864361 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2d34ca9-1354-4ac8-a46d-ff4263c9c3d4 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1321 microversion: 2.1 time: 0.727521 Oct 27 10:13:04.866750 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 685/1370] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:04 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1321 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:05.009748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:05.010408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:05.017856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:05.018449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:05.019238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:05.020147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:05.020812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:05.021394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:05.061182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:05.072112 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d1d3c97-20f4-4be2-8a45-dc6f7bb5011c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1472 microversion: 2.1 time: 0.354404 Oct 27 10:13:05.073168 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 686/1371] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:04 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:05.285197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:05.296369 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c543925-07ff-4cdd-ae81-820a05218dd4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1314 microversion: 2.1 time: 0.290621 Oct 27 10:13:05.296973 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 686/1372] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:05 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:05.725177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:05.726163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:05.737713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:05.741881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:05.742376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:05.743110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:05.743571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:05.747975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:05.890555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:05.890555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:05.898450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:05.898962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:05.899405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:05.900135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:05.900588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:05.901046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.158774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:06.168317 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8486911-4225-4175-8880-c8755af458b7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.447146 Oct 27 10:13:06.169598 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 687/1373] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:05 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:06.174603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:06.175491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:06.190553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:06.191305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:06.191983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.192997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:06.193716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:06.194322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.246617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:06.256909 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41600ad1-c0c9-4888-a784-b4e5bfff3447 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1321 microversion: 2.1 time: 0.372931 Oct 27 10:13:06.274863 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 687/1374] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:05 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:06.323958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:06.325596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:06.348404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:06.348404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:06.349185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.350326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:06.351025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:06.351492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.554745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:06.569199 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de11bff3-4a9e-4bd2-9c4e-1e839a194850 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1472 microversion: 2.1 time: 0.398250 Oct 27 10:13:06.574456 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 688/1375] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:06 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:06.626145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bebb29d6-2b4c-436b-9246-8e680ba4c611 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "151515c6-0fea-4a27-ad1b-9a15da4a8b95"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:06.629689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bebb29d6-2b4c-436b-9246-8e680ba4c611 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:06.637331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bebb29d6-2b4c-436b-9246-8e680ba4c611 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:06.638004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bebb29d6-2b4c-436b-9246-8e680ba4c611 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:06.638446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bebb29d6-2b4c-436b-9246-8e680ba4c611 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.639171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bebb29d6-2b4c-436b-9246-8e680ba4c611 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:06.639626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bebb29d6-2b4c-436b-9246-8e680ba4c611 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:06.640058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bebb29d6-2b4c-436b-9246-8e680ba4c611 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.662471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:06.678676 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92cc3716-720e-4bc6-a74b-55bcc3ee6360 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1462 microversion: 2.1 time: 0.362374 Oct 27 10:13:06.684824 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 688/1376] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:06 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1462 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:06.908149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:06.915078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4fe12a00-25ed-4283-8a76-9ea9d4cef501 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Calling method '.version_select at 0x7f6d5b3a3b80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:06.931269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe12a00-25ed-4283-8a76-9ea9d4cef501 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:06.931982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe12a00-25ed-4283-8a76-9ea9d4cef501 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:06.932408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe12a00-25ed-4283-8a76-9ea9d4cef501 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.949506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe12a00-25ed-4283-8a76-9ea9d4cef501 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:06.950229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe12a00-25ed-4283-8a76-9ea9d4cef501 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:06.950683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe12a00-25ed-4283-8a76-9ea9d4cef501 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.968842 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4fe12a00-25ed-4283-8a76-9ea9d4cef501 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] 10.222.0.76 "GET /compute/v2.1/os-simple-tenant-usage/2d40db77806e420bb85acf838e83f4e7?start=2022-10-26T10%3A13%3A06.695843&end=2022-10-28T10%3A13%3A06.695843" status: 200 len: 695 microversion: 2.1 time: 0.269208 Oct 27 10:13:06.969434 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 689/1377] 10.222.0.76 () {58 vars in 1412 bytes} [Thu Oct 27 10:13:06 2022] GET /compute/v2.1/os-simple-tenant-usage/2d40db77806e420bb85acf838e83f4e7?start=2022-10-26T10%3A13%3A06.695843&end=2022-10-28T10%3A13%3A06.695843 => generated 695 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:13:06.985462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-85a4f247-7c2f-4b98-b6cf-be5512bf3ca4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '.version_select at 0x7f6d638924c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:06.994970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85a4f247-7c2f-4b98-b6cf-be5512bf3ca4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:06.995449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85a4f247-7c2f-4b98-b6cf-be5512bf3ca4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:06.996074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85a4f247-7c2f-4b98-b6cf-be5512bf3ca4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.008899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85a4f247-7c2f-4b98-b6cf-be5512bf3ca4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.009377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85a4f247-7c2f-4b98-b6cf-be5512bf3ca4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.009867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85a4f247-7c2f-4b98-b6cf-be5512bf3ca4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.021323 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-85a4f247-7c2f-4b98-b6cf-be5512bf3ca4 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/os-simple-tenant-usage/2d40db77806e420bb85acf838e83f4e7?start=2022-10-26T10%3A13%3A06.695843&end=2022-10-28T10%3A13%3A06.695843" status: 200 len: 695 microversion: 2.1 time: 0.040444 Oct 27 10:13:07.024738 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 690/1378] 10.222.0.76 () {58 vars in 1412 bytes} [Thu Oct 27 10:13:06 2022] GET /compute/v2.1/os-simple-tenant-usage/2d40db77806e420bb85acf838e83f4e7?start=2022-10-26T10%3A13%3A06.695843&end=2022-10-28T10%3A13%3A06.695843 => generated 695 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:13:07.040567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86aed91f-36dc-4cc0-998e-fc9be95ea458 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Calling method '.version_select at 0x7f6d5b3d4ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:07.051899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86aed91f-36dc-4cc0-998e-fc9be95ea458 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.052700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86aed91f-36dc-4cc0-998e-fc9be95ea458 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.053136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86aed91f-36dc-4cc0-998e-fc9be95ea458 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.069726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86aed91f-36dc-4cc0-998e-fc9be95ea458 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.070203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86aed91f-36dc-4cc0-998e-fc9be95ea458 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.070644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86aed91f-36dc-4cc0-998e-fc9be95ea458 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.135167 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86aed91f-36dc-4cc0-998e-fc9be95ea458 tempest-TenantUsagesTestJSON-840316541 tempest-TenantUsagesTestJSON-840316541-project-admin] 10.222.0.76 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T10%3A13%3A06.695843&end=2022-10-28T10%3A13%3A06.695843&detailed=1" status: 200 len: 13803 microversion: 2.1 time: 0.098428 Oct 27 10:13:07.136187 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 691/1379] 10.222.0.76 () {58 vars in 1335 bytes} [Thu Oct 27 10:13:07 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T10%3A13%3A06.695843&end=2022-10-28T10%3A13%3A06.695843&detailed=1 => generated 13803 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:13:07.168695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:07.169243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:07.175845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.176409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.177008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.177714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.178305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.178781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.198166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=28 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:07.220565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:13:07.259225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:07.299526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:07.366354 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96d05c7c-e5d6-4c20-aebf-dfdd855a1450 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "DELETE /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 204 len: 0 microversion: 2.1 time: 0.203911 Oct 27 10:13:07.369073 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 692/1380] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:07 2022] DELETE /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:13:07.382358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:07.384751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:07.401349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.401944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.402407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.403193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.403647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.404069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.566608 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bebb29d6-2b4c-436b-9246-8e680ba4c611 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "POST /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946015 Oct 27 10:13:07.567973 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 689/1381] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:13:06 2022] POST /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:13:07.574726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:07.576209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:07.585713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.586811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.587559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.588566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.589269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.589920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.831189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:07.846005 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be3cb171-4e88-4f8f-a31a-d2796b34d65a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.475329 Oct 27 10:13:07.853148 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 693/1382] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:07 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:07.871645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:07.872345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:07.889674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.890257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.890995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.891742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.892490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.892921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.947611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:07.956294 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-131e687b-7a36-4999-8261-d2d3b0a2be65 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1321 microversion: 2.1 time: 0.386715 Oct 27 10:13:07.957271 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 690/1383] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:07 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:07.973825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:07.974869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:07.985068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.985804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.986482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.988325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.989043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.990346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.031480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:13:08.144408 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba0017e1-c44f-4e6e-9a4e-57694285d165 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 204 len: 0 microversion: 2.1 time: 0.185373 Oct 27 10:13:08.148967 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 691/1384] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:07 2022] DELETE /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:13:08.155872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:08.156927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:08.165770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.167474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.168716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.169798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.170426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.171789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.188470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:08.197595 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e04cbfe-52dd-4e86-9263-40dfb9a03817 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1468 microversion: 2.1 time: 0.343066 Oct 27 10:13:08.202356 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 694/1385] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:07 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1468 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:08.216083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:08.217112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:08.232651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.234417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.235092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.236626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.238560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.239209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.499326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 029ff781-574b-48de-9033-cd8e69e64ec2 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:13:08.522688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3988e03-8122-4c4f-be40-88f5859e4944 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 2426 microversion: 2.25 time: 0.317549 Oct 27 10:13:08.545423 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 695/1386] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:08 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 2426 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:08.551341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-39fa4cfe-4bde-43ce-9425-6f69e0bdf634 req-2edb171c-acfd-4a48-a2b3-16bc4ec03140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195ef5bc-754e-49d9-a6ac-ec9d6549e065", "name": "network-vif-plugged", "status": "completed", "tag": "afa72335-9133-44b2-bf85-a9ec47a970ef"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:08.551560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:08.561717 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-142144d0-9fc1-47f5-b284-8adce166b4d3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.413380 Oct 27 10:13:08.562446 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 692/1387] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:08 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:08.563726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-39fa4cfe-4bde-43ce-9425-6f69e0bdf634 req-2edb171c-acfd-4a48-a2b3-16bc4ec03140 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.564378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-39fa4cfe-4bde-43ce-9425-6f69e0bdf634 req-2edb171c-acfd-4a48-a2b3-16bc4ec03140 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.565085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-39fa4cfe-4bde-43ce-9425-6f69e0bdf634 req-2edb171c-acfd-4a48-a2b3-16bc4ec03140 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.567693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:08.568419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:08.574763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.575397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.576100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.577549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.578147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.578681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.591416 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-39fa4cfe-4bde-43ce-9425-6f69e0bdf634 req-2edb171c-acfd-4a48-a2b3-16bc4ec03140 service nova] Creating event network-vif-plugged:afa72335-9133-44b2-bf85-a9ec47a970ef for instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 on n-h1-854663-10 Oct 27 10:13:08.600186 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-39fa4cfe-4bde-43ce-9425-6f69e0bdf634 req-2edb171c-acfd-4a48-a2b3-16bc4ec03140 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052411 Oct 27 10:13:08.600839 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 696/1388] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:08.623608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854663-10", "block_migration": "auto"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:08.626178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:08.640725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.641222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.641663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.648528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.649052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.649497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.697138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'flavor' on Instance uuid 029ff781-574b-48de-9033-cd8e69e64ec2 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:13:08.714125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Going to try to live migrate instance to n-h1-854663-10 {{(pid=120719) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:13:08.750808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:08.760910 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb3b44b3-833d-4918-affd-145d9fb1bcc7 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1716 microversion: 2.1 time: 0.197259 Oct 27 10:13:08.761890 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 693/1389] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:08 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1716 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:08.878601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:08.879355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:08.891709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.893502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.894085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.895931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.898803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.899673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:09.312801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:09.324855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62f0baf8-6f18-469b-a272-2af6ff0001da tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.450462 Oct 27 10:13:09.341581 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 694/1390] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:08 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:09.352712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:09.353872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:09.363779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:09.364592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:09.365216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:09.366302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:09.367024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:09.367609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:09.787215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:09.799329 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9398952-ec39-41bd-82c4-8b70d998221e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1321 microversion: 2.1 time: 0.456219 Oct 27 10:13:09.800025 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 695/1391] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:09 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:09.818631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:09.819402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:09.828482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:09.829291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:09.831437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:09.832981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:09.835755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:09.836338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:10.681021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009d5c2b8874d30a33dd6dee68a59f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d40db77806e420bb85acf838e83f4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:10.697730 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-098f210d-f423-49fa-84d8-ed8772eb236b tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 200 len: 1468 microversion: 2.1 time: 0.883119 Oct 27 10:13:10.698792 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 696/1392] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:09 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 1468 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:10.703521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:10.708044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:10.733911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:10.734761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:10.736914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:10.738052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:10.738674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:10.739299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:11.388296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:11.400275 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb307336-11b2-426c-921b-fb13e92b2537 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.700609 Oct 27 10:13:11.404848 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 697/1393] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:10 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:11.416757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:11.420382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:11.438721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:11.439361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:11.439896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:11.440752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:11.441321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:11.441840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:11.858461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:11.869897 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c76e75b-17f7-4dee-8081-52706959e736 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1716 microversion: 2.1 time: 0.463600 Oct 27 10:13:11.885476 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 698/1394] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:11 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1716 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:11.890545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:11.891163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:11.911039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:11.911751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:11.912341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:11.913295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:11.913933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:11.916314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:12.168886 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-90f661a8-1397-4816-9421-46973a295bf0 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/action" status: 202 len: 0 microversion: 2.25 time: 3.552362 Oct 27 10:13:12.173130 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 697/1395] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:13:08 2022] POST /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/action => generated 0 bytes in 3572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:13:12.190338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:12.196869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:12.241623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:12.244378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:12.245119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:12.249957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:12.250696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:12.253821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:12.624807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:12.647475 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3b4d09d-b122-48e6-a7a7-04a08a865e9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.749380 Oct 27 10:13:12.648468 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 699/1396] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:11 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:12.654667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1d5b83e1-0ea8-4d1f-bdb7-c02d22241b6f req-62538be0-997b-4dee-9687-fcbb815714c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deab0cfe-7479-4448-9d97-103b3f4f1536", "name": "network-vif-deleted", "tag": "7f7bfff3-20e9-42b2-aa9e-456fbe0b846e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:12.665573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1d5b83e1-0ea8-4d1f-bdb7-c02d22241b6f req-62538be0-997b-4dee-9687-fcbb815714c0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:12.666265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1d5b83e1-0ea8-4d1f-bdb7-c02d22241b6f req-62538be0-997b-4dee-9687-fcbb815714c0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:12.666997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1d5b83e1-0ea8-4d1f-bdb7-c02d22241b6f req-62538be0-997b-4dee-9687-fcbb815714c0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:12.681621 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1d5b83e1-0ea8-4d1f-bdb7-c02d22241b6f req-62538be0-997b-4dee-9687-fcbb815714c0 service nova] Creating event network-vif-deleted:7f7bfff3-20e9-42b2-aa9e-456fbe0b846e for instance deab0cfe-7479-4448-9d97-103b3f4f1536 on n-h1-854663-10 Oct 27 10:13:12.690115 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1d5b83e1-0ea8-4d1f-bdb7-c02d22241b6f req-62538be0-997b-4dee-9687-fcbb815714c0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040108 Oct 27 10:13:12.691876 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 700/1397] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:12.707070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:12.707839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] [instance: deab0cfe-7479-4448-9d97-103b3f4f1536] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:12.720543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:12.721827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:12.722454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:12.723346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:12.724360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:12.724961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:12.741516 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] HTTP exception thrown: Instance deab0cfe-7479-4448-9d97-103b3f4f1536 could not be found. Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Request method failure captured: Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 HTTP/1.1 Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlmf0_PSGQpX3Ks996C7fT5nxN77UYDxd1NXr5V9p0EoeKOkdvcU6fQL7thkjrIRCpivWJNg1-D4aSuEHDCQqV550CgmZ9N5ym5mkPfkHlmEYao5nX9ASouLoz7Yp9ltV-QSAumdh5G4SgefVkRatkFVgYf1TAw3c5CK_om-MEiMkaE Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2d40db77806e420bb85acf838e83f4e7 Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TenantUsagesTestJSON-116751254 Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:12.743750 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2d40db77806e420bb85acf838e83f4e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2d40db77806e420bb85acf838e83f4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2d40db77806e420bb85acf838e83f4e7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2d40db77806e420bb85acf838e83f4e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TenantUsagesTestJSON-116751254 Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2d40db77806e420bb85acf838e83f4e7 Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TenantUsagesTestJSON-116751254 Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TenantUsagesTestJSON-116751254-project Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3009d5c2b8874d30a33dd6dee68a59f4 Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TenantUsagesTestJSON-116751254-project Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance deab0cfe-7479-4448-9d97-103b3f4f1536 could not be found. Oct 27 10:13:12.745385 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'deab0cfe-7479-4448-9d97-103b3f4f1536'} Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deab0cfe-7479-4448-9d97-103b3f4f1536 could not be found. Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:12.746696 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deab0cfe-7479-4448-9d97-103b3f4f1536 could not be found. Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deab0cfe-7479-4448-9d97-103b3f4f1536 could not be found. Oct 27 10:13:12.748092 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:12.751964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] Returning 404 to user: Instance deab0cfe-7479-4448-9d97-103b3f4f1536 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:12.753443 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6fd1b22-e72b-4199-85c1-0bb5c4d975e7 tempest-TenantUsagesTestJSON-116751254 tempest-TenantUsagesTestJSON-116751254-project] 10.222.0.76 "GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536" status: 404 len: 111 microversion: 2.1 time: 0.060544 Oct 27 10:13:12.754157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 701/1398] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:12 2022] GET /compute/v2.1/servers/deab0cfe-7479-4448-9d97-103b3f4f1536 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:12.759597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:12.760957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:12.769940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:12.770999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:12.771906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:12.773817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:12.774427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:12.775002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:12.815556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:12.836170 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6655a668-53f5-4704-b0e6-779425041d99 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1470 microversion: 2.1 time: 0.657710 Oct 27 10:13:12.837592 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 698/1399] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:12 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1470 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:13.227860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:13.240800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:13.244677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:13.249920 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9764bf6-8cca-4812-908e-5d4dd10aa022 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.494612 Oct 27 10:13:13.266137 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 702/1400] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:12 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:13.280359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:13.282364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:13.297869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.299997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.300626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.301560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.302726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.303491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.351452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-03a10c0c-da40-4787-9b51-3819cdcbe2e0 req-540c137a-32df-451b-88a2-ef132435eeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7ed094-4322-4336-a483-9eac9a0746dd", "name": "network-vif-deleted", "tag": "9f52bf0c-5358-459e-9c48-a1e5361e5dbf"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:13.383408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-03a10c0c-da40-4787-9b51-3819cdcbe2e0 req-540c137a-32df-451b-88a2-ef132435eeb8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.383976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-03a10c0c-da40-4787-9b51-3819cdcbe2e0 req-540c137a-32df-451b-88a2-ef132435eeb8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.384412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-03a10c0c-da40-4787-9b51-3819cdcbe2e0 req-540c137a-32df-451b-88a2-ef132435eeb8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.418263 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-03a10c0c-da40-4787-9b51-3819cdcbe2e0 req-540c137a-32df-451b-88a2-ef132435eeb8 service nova] Creating event network-vif-deleted:9f52bf0c-5358-459e-9c48-a1e5361e5dbf for instance cd7ed094-4322-4336-a483-9eac9a0746dd on n-h2-854663-10 Oct 27 10:13:13.427425 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-03a10c0c-da40-4787-9b51-3819cdcbe2e0 req-540c137a-32df-451b-88a2-ef132435eeb8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.588264 Oct 27 10:13:13.429021 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 699/1401] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:13.435208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:13.436084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:13.443116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.444269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.445093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.446096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.446698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.447263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.490626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lazy-loading 'flavor' on Instance uuid 195ef5bc-754e-49d9-a6ac-ec9d6549e065 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:13:13.561332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:13.594116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab5fcb97-71c1-41b2-8cb5-8da01abe3934 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.326506 Oct 27 10:13:13.597496 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 703/1402] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:13 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:13.623033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:13.628101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:13.638192 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15658669-0886-4f5c-90db-29479e6684bb tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065/action" status: 202 len: 0 microversion: 2.1 time: 0.207444 Oct 27 10:13:13.640529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 700/1403] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:13:13 2022] POST /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:13.641414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.643033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.644393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.646435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.648429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.649727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.679071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f8922a7-850a-4cf5-95a6-7e5aeec97407 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:13.683014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f8922a7-850a-4cf5-95a6-7e5aeec97407 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:13.702898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8922a7-850a-4cf5-95a6-7e5aeec97407 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.706841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8922a7-850a-4cf5-95a6-7e5aeec97407 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.707653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8922a7-850a-4cf5-95a6-7e5aeec97407 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.708703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8922a7-850a-4cf5-95a6-7e5aeec97407 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.710839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8922a7-850a-4cf5-95a6-7e5aeec97407 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.720721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8922a7-850a-4cf5-95a6-7e5aeec97407 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.725479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.726184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.726895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.727525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lazy-loading 'fault' on Instance uuid cd7ed094-4322-4336-a483-9eac9a0746dd {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:13:13.897135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92b84bbef9472fa37a1e09b438be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cec1ab41cb408bab6c71ee8345de63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:13.912331 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4898315-4d38-4485-a529-2dd712438af2 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 200 len: 1355 microversion: 2.1 time: 0.313475 Oct 27 10:13:13.913332 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 704/1404] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:13 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 1355 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:13.918280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:13.920561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:13.940549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.940949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.941383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.943311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.943311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.943311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.947853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:14.261378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:14.294166 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01425071-ec93-4bb7-b714-fabf181cd975 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.377085 Oct 27 10:13:14.298308 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 705/1405] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:13 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:14.314845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:14.317085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:14.346837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:14.347939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:14.348615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:14.349618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:14.351436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:14.353439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:14.508437 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f8922a7-850a-4cf5-95a6-7e5aeec97407 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1631 microversion: 2.1 time: 0.851379 Oct 27 10:13:14.517425 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 701/1406] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:13 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1631 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:14.621627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:14.622939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:14.639605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:14.641250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:14.643720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:14.644938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:14.645823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:14.649789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:14.898416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:14.912719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:14.914681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:14.916534 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c25738e-29b2-443f-b8a1-21cbf9945898 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.616566 Oct 27 10:13:14.917760 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 706/1407] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:14 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:14.949160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:14.950300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:14.964954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:14.966149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:14.966861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:14.968705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:14.969998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:14.973047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:14.983559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:14.995707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2761597f-c1b2-4dc5-a4ba-d3bba649eba7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.379562 Oct 27 10:13:15.009423 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 702/1408] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:14 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:15.025836 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] HTTP exception thrown: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Request method failure captured: Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd HTTP/1.1 Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWljR0xl8mGJVowjg-FfwyILXLE9Ibq0cR5TaBBOuzrZVLFmaVPCo2zG9GTQSNmJXUE487bBvvQRySKh_6FwZn9WPXWMg4H4OchDQXIxxVtQ2bmcEAqs-5w_WimGJVye0DJfwzIaiRvNfI7xOqtg8GHyRPl9hl_Gmf5DdkPfxNmpaT9A Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:15.028281 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53cec1ab41cb408bab6c71ee8345de63", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9a92b84bbef9472fa37a1e09b438be26 Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:15.029829 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'cd7ed094-4322-4336-a483-9eac9a0746dd'} Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:15.030632 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:15.031813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.034933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Returning 404 to user: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:15.036138 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96cd66aa-b99b-4f0d-b54e-85a7844adea9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 404 len: 111 microversion: 2.1 time: 0.091307 Oct 27 10:13:15.037609 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 707/1409] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:14 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:15.046782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:15.047548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:15.060228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.061004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.061908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.062790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.065023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.065630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.082321 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] HTTP exception thrown: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Request method failure captured: Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 HTTP/1.1 Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWljR0xl8mGJVowjg-FfwyILXLE9Ibq0cR5TaBBOuzrZVLFmaVPCo2zG9GTQSNmJXUE487bBvvQRySKh_6FwZn9WPXWMg4H4OchDQXIxxVtQ2bmcEAqs-5w_WimGJVye0DJfwzIaiRvNfI7xOqtg8GHyRPl9hl_Gmf5DdkPfxNmpaT9A Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:13:15.084413 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53cec1ab41cb408bab6c71ee8345de63", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9a92b84bbef9472fa37a1e09b438be26 Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.085772 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f4ee331c-acfa-4bdb-abeb-8145043083a5'} Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:15.086709 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.087946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.091472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Returning 404 to user: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:15.092612 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5524e016-b41b-49fa-9357-39e042beeeb9 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 404 len: 111 microversion: 2.1 time: 0.050712 Oct 27 10:13:15.093790 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 703/1410] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:15 2022] DELETE /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:15.102596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:15.103633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:15.118424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.119305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.120130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.121215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.122190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.123682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.140100 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] HTTP exception thrown: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Request method failure captured: Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 HTTP/1.1 Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWljR0xl8mGJVowjg-FfwyILXLE9Ibq0cR5TaBBOuzrZVLFmaVPCo2zG9GTQSNmJXUE487bBvvQRySKh_6FwZn9WPXWMg4H4OchDQXIxxVtQ2bmcEAqs-5w_WimGJVye0DJfwzIaiRvNfI7xOqtg8GHyRPl9hl_Gmf5DdkPfxNmpaT9A Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:15.142060 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53cec1ab41cb408bab6c71ee8345de63", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9a92b84bbef9472fa37a1e09b438be26 Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.143560 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'f4ee331c-acfa-4bdb-abeb-8145043083a5'} Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:15.144346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:15.145647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:15.149276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Returning 404 to user: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:15.150433 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fa42de4-8968-4030-8b91-d1fa53ce011e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 404 len: 111 microversion: 2.1 time: 0.052523 Oct 27 10:13:15.151216 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 708/1411] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:15 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:15.164337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a58a721-06fa-4bf2-8627-c6db912ddc5e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '.version_select at 0x7f6d63974b80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:15.215712 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a58a721-06fa-4bf2-8627-c6db912ddc5e tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080193100" status: 202 len: 0 microversion: 2.1 time: 0.059421 Oct 27 10:13:15.216648 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 704/1412] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080193100 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:15.322125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:15.322815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:15.337811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.338160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.338599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.339779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.339779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.340344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.542272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b19d3178-acc7-40ef-bbb3-7128854bfb61 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:15.543687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b19d3178-acc7-40ef-bbb3-7128854bfb61 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:15.557002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b19d3178-acc7-40ef-bbb3-7128854bfb61 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.560311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b19d3178-acc7-40ef-bbb3-7128854bfb61 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.560965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b19d3178-acc7-40ef-bbb3-7128854bfb61 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.564399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b19d3178-acc7-40ef-bbb3-7128854bfb61 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.565109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b19d3178-acc7-40ef-bbb3-7128854bfb61 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.568104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b19d3178-acc7-40ef-bbb3-7128854bfb61 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.860635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:15.872725 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-685ccf4d-51cc-4a00-993a-76553292c861 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.555480 Oct 27 10:13:15.889638 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 709/1413] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:15 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:15.951198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:15.952014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:15.964374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.964544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.981483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.984643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.985205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.985650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:16.402140 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b19d3178-acc7-40ef-bbb3-7128854bfb61 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1614 microversion: 2.1 time: 0.860953 Oct 27 10:13:16.408739 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 705/1414] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:15 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1614 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:16.420564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:16.422234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:16.431418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:16.432137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:16.432824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:16.434287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:16.434991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:16.435616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:16.504605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:16.536674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:16.540459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:16.541747 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36a5e4e2-858b-4fbb-be4e-3a5f8f8bd5ee tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.595886 Oct 27 10:13:16.545005 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 710/1415] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:15 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:13:16.552310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:16.557438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:16.577842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:16.578372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:16.578799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:16.579521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:16.579966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:16.580384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:16.760401 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] HTTP exception thrown: Cannot 'migrate' instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 while it is in vm_state suspended Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Request method failure captured: Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065/action HTTP/1.1 Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 15 Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlmXaW11x-3tIHoN14g5RkQ9-NQ_ZraPzPYnXLWe2vo7HrY412IllD9OWjZizpCiakPgqxoAsPCr4J6FauAJKeWeAEeZa_UK6RJQLBtSFzrWF7ot0hyuFqsKxzpVD9azko6SHxUrjxYoSmRQ_KVqzrw0wXOR5vUpqM9QHXH-GKwRGMw Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:13:16.765791 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e560ebc1283e473fa35d972ac906d773", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c50cae04023d4c7b8acf7e5ebc744b5b Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: {"migrate": {}} Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:16.767147 n-d-854663-10 devstack@n-api.service[120720]: exception: Cannot 'migrate' instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 while it is in vm_state suspended Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '195ef5bc-754e-49d9-a6ac-ec9d6549e065', 'body': {'migrate': {}}} Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 in vm_state suspended. Cannot resize while the instance is in this state. Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.767983 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 while it is in vm_state suspended Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:16.769237 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:16.771428 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:16.771428 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:16.771428 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 while it is in vm_state suspended Oct 27 10:13:16.771428 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.771428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Returning 409 to user: Cannot 'migrate' instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 while it is in vm_state suspended {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:16.771428 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8f25434-7f88-4f99-b865-bd634cc1781c tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065/action" status: 409 len: 148 microversion: 2.1 time: 0.221007 Oct 27 10:13:16.772968 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 711/1416] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:13:16 2022] POST /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065/action => generated 148 bytes in 227 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:13:16.783332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c10707c1-4808-46c1-9ea8-7e97930b5601 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c10707c1-4808-46c1-9ea8-7e97930b5601 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Request method failure captured: Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70/action HTTP/1.1 Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 39 Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlmXaW11x-3tIHoN14g5RkQ9-NQ_ZraPzPYnXLWe2vo7HrY412IllD9OWjZizpCiakPgqxoAsPCr4J6FauAJKeWeAEeZa_UK6RJQLBtSFzrWF7ot0hyuFqsKxzpVD9azko6SHxUrjxYoSmRQ_KVqzrw0wXOR5vUpqM9QHXH-GKwRGMw Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:13:16.788561 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e560ebc1283e473fa35d972ac906d773", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c50cae04023d4c7b8acf7e5ebc744b5b Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: {"os-resetState": {"state": "invalid"}} Oct 27 10:13:16.790297 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '5efb897f-74a9-45d2-85ec-59125686de70', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:16.791212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:13:16.792938 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 10:13:16.794560 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:16.796121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c10707c1-4808-46c1-9ea8-7e97930b5601 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:16.798939 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c10707c1-4808-46c1-9ea8-7e97930b5601 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70/action" status: 400 len: 144 microversion: 2.1 time: 0.018027 Oct 27 10:13:16.805150 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 712/1417] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:13:16 2022] POST /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70/action => generated 144 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:13:16.987874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:17.014707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-017fd0d6-b416-4eac-abce-68f8232c8d3b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.602473 Oct 27 10:13:17.015347 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 706/1418] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:16 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:17.028326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2cc0c954-f6fd-4aec-8e11-757b13673ee3 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2cc0c954-f6fd-4aec-8e11-757b13673ee3 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Request method failure captured: Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70/action HTTP/1.1 Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 31 Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlmXaW11x-3tIHoN14g5RkQ9-NQ_ZraPzPYnXLWe2vo7HrY412IllD9OWjZizpCiakPgqxoAsPCr4J6FauAJKeWeAEeZa_UK6RJQLBtSFzrWF7ot0hyuFqsKxzpVD9azko6SHxUrjxYoSmRQ_KVqzrw0wXOR5vUpqM9QHXH-GKwRGMw Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 10:13:17.037210 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e560ebc1283e473fa35d972ac906d773", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: c50cae04023d4c7b8acf7e5ebc744b5b Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: {"os-resetState": {"state": 1}} Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:13:17.038684 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '5efb897f-74a9-45d2-85ec-59125686de70', 'body': {'os-resetState': {'state': 1}}} Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 1 Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:17.039458 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 10:13:17.040878 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.043609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2cc0c954-f6fd-4aec-8e11-757b13673ee3 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:17.043609 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2cc0c954-f6fd-4aec-8e11-757b13673ee3 tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70/action" status: 400 len: 120 microversion: 2.1 time: 0.023964 Oct 27 10:13:17.043609 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 707/1419] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:13:17 2022] POST /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70/action => generated 120 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:13:17.051637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.054062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:17.055373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40e18133-466e-4bac-9e4d-b283d540036c tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Calling method '.version_select at 0x7f6d5baf3280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.065401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:17.072376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:17.073039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:17.073610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:17.074821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:17.075351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:17.075835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:17.101291 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-40e18133-466e-4bac-9e4d-b283d540036c tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] HTTP exception thrown: Image not found. Oct 27 10:13:17.121805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40e18133-466e-4bac-9e4d-b283d540036c tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Request method failure captured: Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/images/0f294772-866e-40a3-ae43-a2190c422948/metadata/os_distro HTTP/1.1 Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlm8r3sIeBE_jWyIKqun_Axca4INrh8QA55jefWOFDNsvUKnj8bulHKHDKxhe2tMzpnxQVYgBxuTpjuI3DIOF0QQPbLIv_r-dO4ukJFfjEii9UBoWCYUDqZZYUV1sgpGzMgd87CluWbWxPXegcLNG69K7BSbRSdspVaPTntE-4rkMgo Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:17.151766 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f4f5a7a739b14f3fb494af2f7be51b55", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9fdee22b381a43ce9c45c7e5f9a304ac Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'image_id': '0f294772-866e-40a3-ae43-a2190c422948', 'id': 'os_distro'} Oct 27 10:13:17.153804 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:17.154802 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0f294772-866e-40a3-ae43-a2190c422948 Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:17.157653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f294772-866e-40a3-ae43-a2190c422948 could not be found. Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:13:17.160772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:13:17.164048 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.169221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40e18133-466e-4bac-9e4d-b283d540036c tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:17.169731 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40e18133-466e-4bac-9e4d-b283d540036c tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] 10.222.0.76 "DELETE /compute/v2.1/images/0f294772-866e-40a3-ae43-a2190c422948/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.360805 Oct 27 10:13:17.170533 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 713/1420] 10.222.0.76 () {58 vars in 1293 bytes} [Thu Oct 27 10:13:16 2022] DELETE /compute/v2.1/images/0f294772-866e-40a3-ae43-a2190c422948/metadata/os_distro => generated 62 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:13:17.177202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dbc84871-37e6-4354-86cb-c35c173de502 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.209499 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dbc84871-37e6-4354-86cb-c35c173de502 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/177036954" status: 202 len: 0 microversion: 2.1 time: 0.037045 Oct 27 10:13:17.213908 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 714/1421] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:13:17 2022] DELETE /compute/v2.1/flavors/177036954 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:17.223519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a87fc02-90e5-4d64-8700-f5159389c27d tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:17.228310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a87fc02-90e5-4d64-8700-f5159389c27d tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Failed to fetch instance by id 999 {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 10:13:17.229476 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3a87fc02-90e5-4d64-8700-f5159389c27d tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a87fc02-90e5-4d64-8700-f5159389c27d tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Request method failure captured: Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 37 Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlmXaW11x-3tIHoN14g5RkQ9-NQ_ZraPzPYnXLWe2vo7HrY412IllD9OWjZizpCiakPgqxoAsPCr4J6FauAJKeWeAEeZa_UK6RJQLBtSFzrWF7ot0hyuFqsKxzpVD9azko6SHxUrjxYoSmRQ_KVqzrw0wXOR5vUpqM9QHXH-GKwRGMw Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:13:17.239280 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e560ebc1283e473fa35d972ac906d773", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e560ebc1283e473fa35d972ac906d773"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: e560ebc1283e473fa35d972ac906d773 Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-463952845 Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c50cae04023d4c7b8acf7e5ebc744b5b Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersAdminNegativeTestJSON-463952845-project-admin Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: {"os-resetState": {"state": "error"}} Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:17.240865 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 999 could not be found. Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:17.241677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 27 10:13:17.242924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.245355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a87fc02-90e5-4d64-8700-f5159389c27d tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:17.246591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a87fc02-90e5-4d64-8700-f5159389c27d tempest-ServersAdminNegativeTestJSON-463952845 tempest-ServersAdminNegativeTestJSON-463952845-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.030547 Oct 27 10:13:17.252851 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 715/1422] 10.222.0.76 () {60 vars in 1179 bytes} [Thu Oct 27 10:13:17 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:13:17.265702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30b725cb-61a7-42c2-958f-cc1e8947f4e9 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Calling method '.version_select at 0x7f6d5be83040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.302103 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-30b725cb-61a7-42c2-958f-cc1e8947f4e9 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] HTTP exception thrown: Image not found. Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30b725cb-61a7-42c2-958f-cc1e8947f4e9 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Request method failure captured: Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/images/066a00f9-7f18-47e8-9b36-fd72fbc6438a/metadata/os_version HTTP/1.1 Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlm8r3sIeBE_jWyIKqun_Axca4INrh8QA55jefWOFDNsvUKnj8bulHKHDKxhe2tMzpnxQVYgBxuTpjuI3DIOF0QQPbLIv_r-dO4ukJFfjEii9UBoWCYUDqZZYUV1sgpGzMgd87CluWbWxPXegcLNG69K7BSbRSdspVaPTntE-4rkMgo Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:17.305112 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f4f5a7a739b14f3fb494af2f7be51b55", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9fdee22b381a43ce9c45c7e5f9a304ac Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'image_id': '066a00f9-7f18-47e8-9b36-fd72fbc6438a', 'id': 'os_version'} Oct 27 10:13:17.306462 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:17.307243 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 066a00f9-7f18-47e8-9b36-fd72fbc6438a Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:17.308326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 066a00f9-7f18-47e8-9b36-fd72fbc6438a could not be found. Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:13:17.311183 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.313712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30b725cb-61a7-42c2-958f-cc1e8947f4e9 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:17.316192 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30b725cb-61a7-42c2-958f-cc1e8947f4e9 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] 10.222.0.76 "GET /compute/v2.1/images/066a00f9-7f18-47e8-9b36-fd72fbc6438a/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.055335 Oct 27 10:13:17.319110 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 716/1423] 10.222.0.76 () {58 vars in 1293 bytes} [Thu Oct 27 10:13:17 2022] GET /compute/v2.1/images/066a00f9-7f18-47e8-9b36-fd72fbc6438a/metadata/os_version => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:13:17.328137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1a70b86-45ed-4de2-a6ac-9ae2677fdeba tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.356292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1a70b86-45ed-4de2-a6ac-9ae2677fdeba tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.034793 Oct 27 10:13:17.357302 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 717/1424] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:13:17 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:17.362071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.362559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:17.368949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:17.369660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:17.371448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:17.372281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:17.372862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:17.373308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:17.384814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:17.404542 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8738d8ef-89e4-4bc4-9192-8748e0e29d15 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.362208 Oct 27 10:13:17.407049 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 708/1425] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:17 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:17.416410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:13:17.418295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1fb53c0b-d5f2-488b-8d79-2a3a85b6c9e8 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Calling method '.version_select at 0x7f6d638929d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.453528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-1fb53c0b-d5f2-488b-8d79-2a3a85b6c9e8 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] HTTP exception thrown: Image not found. Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1fb53c0b-d5f2-488b-8d79-2a3a85b6c9e8 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Request method failure captured: Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/images/da50ff60-1ddc-43ab-aedd-60831d0332b1/metadata HTTP/1.1 Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlm8r3sIeBE_jWyIKqun_Axca4INrh8QA55jefWOFDNsvUKnj8bulHKHDKxhe2tMzpnxQVYgBxuTpjuI3DIOF0QQPbLIv_r-dO4ukJFfjEii9UBoWCYUDqZZYUV1sgpGzMgd87CluWbWxPXegcLNG69K7BSbRSdspVaPTntE-4rkMgo Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:13:17.464171 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f4f5a7a739b14f3fb494af2f7be51b55", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9fdee22b381a43ce9c45c7e5f9a304ac Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'image_id': 'da50ff60-1ddc-43ab-aedd-60831d0332b1'} Oct 27 10:13:17.465962 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:17.467106 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID da50ff60-1ddc-43ab-aedd-60831d0332b1 Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:17.468745 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da50ff60-1ddc-43ab-aedd-60831d0332b1 could not be found. Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:13:17.470225 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:13:17.471584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.475895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1fb53c0b-d5f2-488b-8d79-2a3a85b6c9e8 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:17.479566 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1fb53c0b-d5f2-488b-8d79-2a3a85b6c9e8 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] 10.222.0.76 "GET /compute/v2.1/images/da50ff60-1ddc-43ab-aedd-60831d0332b1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.068332 Oct 27 10:13:17.480829 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 709/1426] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:13:17 2022] GET /compute/v2.1/images/da50ff60-1ddc-43ab-aedd-60831d0332b1/metadata => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:13:17.496154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a839f7e-60f7-4337-af46-1fb38b1d839f tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.543121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:17.557224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4a839f7e-60f7-4337-af46-1fb38b1d839f tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1224059415" status: 202 len: 0 microversion: 2.1 time: 0.070793 Oct 27 10:13:17.558647 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63c02861-7311-4be3-ac39-691bba3bc9f8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "DELETE /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 204 len: 0 microversion: 2.1 time: 0.199202 Oct 27 10:13:17.559739 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 718/1427] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:17 2022] DELETE /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:13:17.567156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7977e133-4344-42b8-a09b-282295186228 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Action: 'update_all', calling method: .version_select at 0x7f6d5bcd6280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:17.568238 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 710/1428] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:13:17 2022] DELETE /compute/v2.1/flavors/1224059415 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:17.573808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.575646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:17.601045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:17.602034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:17.602677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:17.602814 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-7977e133-4344-42b8-a09b-282295186228 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] HTTP exception thrown: Image not found. Oct 27 10:13:17.603674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:17.604280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:17.604890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7977e133-4344-42b8-a09b-282295186228 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Request method failure captured: Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/images/a158d948-1dfe-412f-9756-cfa660560813/metadata HTTP/1.1 Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 57 Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlm8r3sIeBE_jWyIKqun_Axca4INrh8QA55jefWOFDNsvUKnj8bulHKHDKxhe2tMzpnxQVYgBxuTpjuI3DIOF0QQPbLIv_r-dO4ukJFfjEii9UBoWCYUDqZZYUV1sgpGzMgd87CluWbWxPXegcLNG69K7BSbRSdspVaPTntE-4rkMgo Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:17.605589 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f4f5a7a739b14f3fb494af2f7be51b55", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9fdee22b381a43ce9c45c7e5f9a304ac Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:13:17.607353 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'image_id': 'a158d948-1dfe-412f-9756-cfa660560813', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:17.608387 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a158d948-1dfe-412f-9756-cfa660560813 Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:17.609737 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a158d948-1dfe-412f-9756-cfa660560813 could not be found. Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:17.611666 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:13:17.614065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:17.617718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7977e133-4344-42b8-a09b-282295186228 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:17.617718 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7977e133-4344-42b8-a09b-282295186228 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] 10.222.0.76 "PUT /compute/v2.1/images/a158d948-1dfe-412f-9756-cfa660560813/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049621 Oct 27 10:13:17.617718 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 719/1429] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:13:17 2022] PUT /compute/v2.1/images/a158d948-1dfe-412f-9756-cfa660560813/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:13:17.628129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:17.628899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:17.637828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:17.638480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:17.639003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:17.640704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:17.641220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:17.641650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:18.127553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:18.135612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:18.143453 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-75b573e4-3b9c-4daf-b45a-7f07b4c6e4e5 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1467 microversion: 2.1 time: 0.573763 Oct 27 10:13:18.149373 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 711/1430] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:17 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1467 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:18.155854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-992eb0dd-014c-4f5a-b9e2-4d270ff03517 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:18.169172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:18.170638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:18.172059 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b2ddf91-c998-4bf3-ba99-2594b63fb960 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.554626 Oct 27 10:13:18.188512 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-992eb0dd-014c-4f5a-b9e2-4d270ff03517 tempest-ServersWithSpecificFlavorTestJSON-1779746541 tempest-ServersWithSpecificFlavorTestJSON-1779746541-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037513 Oct 27 10:13:18.189645 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 712/1431] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:13:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:18.189884 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 720/1432] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:17 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:18.194626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3c56506-aa02-43ed-b440-26087a2bb1c0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Action: 'update', calling method: .version_select at 0x7f6d6380f550>, body: {"meta": {"os_distro": "alt"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:18.218622 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e3c56506-aa02-43ed-b440-26087a2bb1c0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] HTTP exception thrown: Image not found. Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3c56506-aa02-43ed-b440-26087a2bb1c0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Request method failure captured: Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: request: PUT /compute/v2.1/images/13bc78b4-215e-4941-839b-54cd084fb4d5/metadata/os_distro HTTP/1.1 Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 30 Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlm8r3sIeBE_jWyIKqun_Axca4INrh8QA55jefWOFDNsvUKnj8bulHKHDKxhe2tMzpnxQVYgBxuTpjuI3DIOF0QQPbLIv_r-dO4ukJFfjEii9UBoWCYUDqZZYUV1sgpGzMgd87CluWbWxPXegcLNG69K7BSbRSdspVaPTntE-4rkMgo Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:13:18.221511 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f4f5a7a739b14f3fb494af2f7be51b55", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9fdee22b381a43ce9c45c7e5f9a304ac Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: {"meta": {"os_distro": "alt"}} Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:13:18.222886 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'image_id': '13bc78b4-215e-4941-839b-54cd084fb4d5', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:18.223751 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 13bc78b4-215e-4941-839b-54cd084fb4d5 Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:18.224881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13bc78b4-215e-4941-839b-54cd084fb4d5 could not be found. Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:18.232186 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:13:18.236912 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.242647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3c56506-aa02-43ed-b440-26087a2bb1c0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:18.242647 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e3c56506-aa02-43ed-b440-26087a2bb1c0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] 10.222.0.76 "PUT /compute/v2.1/images/13bc78b4-215e-4941-839b-54cd084fb4d5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.035923 Oct 27 10:13:18.242647 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 713/1433] 10.222.0.76 () {60 vars in 1310 bytes} [Thu Oct 27 10:13:18 2022] PUT /compute/v2.1/images/13bc78b4-215e-4941-839b-54cd084fb4d5/metadata/os_distro => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:13:18.242647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:18.242647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:18.249482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:18.249983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:18.250675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:18.251406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:18.251864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:18.252392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:18.321356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1340171709", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "1fba9ee2-2550-449d-afc8-587684297198"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:18.441792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] validate_networks() for [('1fba9ee2-2550-449d-afc8-587684297198', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:13:18.572917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:18.582153 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-160e111c-2d27-4914-92fe-80c077a06c0c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.349937 Oct 27 10:13:18.582735 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 714/1434] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:18 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:18.597020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:18.597610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:18.612337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:18.622287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:18.623219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:18.624083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:18.624556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:18.625009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:18.657346 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] HTTP exception thrown: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Request method failure captured: Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd HTTP/1.1 Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWljR0xl8mGJVowjg-FfwyILXLE9Ibq0cR5TaBBOuzrZVLFmaVPCo2zG9GTQSNmJXUE487bBvvQRySKh_6FwZn9WPXWMg4H4OchDQXIxxVtQ2bmcEAqs-5w_WimGJVye0DJfwzIaiRvNfI7xOqtg8GHyRPl9hl_Gmf5DdkPfxNmpaT9A Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:13:18.661045 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53cec1ab41cb408bab6c71ee8345de63", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9a92b84bbef9472fa37a1e09b438be26 Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:18.662693 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'cd7ed094-4322-4336-a483-9eac9a0746dd'} Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:18.663542 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:18.664955 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.670596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Returning 404 to user: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:18.676595 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c094a090-7089-4956-829b-e301daf4de74 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 404 len: 111 microversion: 2.1 time: 0.090629 Oct 27 10:13:18.681971 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 715/1435] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:18 2022] DELETE /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:18.696962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9dc66819-4360-4403-8ddf-f8d6c4d0f1b0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Action: 'create', calling method: .version_select at 0x7f6d5ba439d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:18.739264 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9dc66819-4360-4403-8ddf-f8d6c4d0f1b0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] HTTP exception thrown: Image not found. Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9dc66819-4360-4403-8ddf-f8d6c4d0f1b0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Request method failure captured: Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/images/1b28dbc8-fd33-4d4f-8dce-fcc6991b769b/metadata HTTP/1.1 Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 57 Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlm8r3sIeBE_jWyIKqun_Axca4INrh8QA55jefWOFDNsvUKnj8bulHKHDKxhe2tMzpnxQVYgBxuTpjuI3DIOF0QQPbLIv_r-dO4ukJFfjEii9UBoWCYUDqZZYUV1sgpGzMgd87CluWbWxPXegcLNG69K7BSbRSdspVaPTntE-4rkMgo Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:13:18.743611 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f4f5a7a739b14f3fb494af2f7be51b55", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f4f5a7a739b14f3fb494af2f7be51b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f4f5a7a739b14f3fb494af2f7be51b55 Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-997480867 Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9fdee22b381a43ce9c45c7e5f9a304ac Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-997480867-project Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:13:18.745268 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'image_id': '1b28dbc8-fd33-4d4f-8dce-fcc6991b769b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:18.746621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1b28dbc8-fd33-4d4f-8dce-fcc6991b769b Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:13:18.748030 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b28dbc8-fd33-4d4f-8dce-fcc6991b769b could not be found. Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:18.749460 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:13:18.751068 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:18.755252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9dc66819-4360-4403-8ddf-f8d6c4d0f1b0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:18.755252 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9dc66819-4360-4403-8ddf-f8d6c4d0f1b0 tempest-ImagesMetadataNegativeTestJSON-997480867 tempest-ImagesMetadataNegativeTestJSON-997480867-project] 10.222.0.76 "POST /compute/v2.1/images/1b28dbc8-fd33-4d4f-8dce-fcc6991b769b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.070309 Oct 27 10:13:18.755252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 716/1436] 10.222.0.76 () {60 vars in 1281 bytes} [Thu Oct 27 10:13:18 2022] POST /compute/v2.1/images/1b28dbc8-fd33-4d4f-8dce-fcc6991b769b/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:13:18.773781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:18.776366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:18.791475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:18.797110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:18.797771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:18.800054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:18.803046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:18.803693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.219310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:13:19.219858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:13:19.220199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:13:19.220610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:13:19.221076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:13:19.241864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.242622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.244372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.245384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.247796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.248810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.295396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Getting quotas for project 6480c8676efb4a329d9f70493e89983b. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:19.306492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Getting quotas for user 5d0567190ddb4d719d7e90216b6a9cea and project 6480c8676efb4a329d9f70493e89983b. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:19.333400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:13:19.335748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:13:19.422124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:19.436762 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-32b851fe-22b4-4ad1-9165-d440faa2bd26 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.671997 Oct 27 10:13:19.449336 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 717/1437] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:18 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:19.468639 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3b44c8e-ba96-4652-8f7a-4e2c1279437a tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.277542 Oct 27 10:13:19.468997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:19.469844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: cd7ed094-4322-4336-a483-9eac9a0746dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:19.481524 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 721/1438] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:13:19.493292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:19.495266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.495972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.496559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:19.498500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.499406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.501099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.502111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.510586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.526138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.527774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.528884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.529679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.530812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.547772 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] HTTP exception thrown: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Request method failure captured: Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd HTTP/1.1 Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWljR0xl8mGJVowjg-FfwyILXLE9Ibq0cR5TaBBOuzrZVLFmaVPCo2zG9GTQSNmJXUE487bBvvQRySKh_6FwZn9WPXWMg4H4OchDQXIxxVtQ2bmcEAqs-5w_WimGJVye0DJfwzIaiRvNfI7xOqtg8GHyRPl9hl_Gmf5DdkPfxNmpaT9A Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:13:19.556057 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53cec1ab41cb408bab6c71ee8345de63", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9a92b84bbef9472fa37a1e09b438be26 Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:19.557804 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'cd7ed094-4322-4336-a483-9eac9a0746dd'} Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:19.558706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. Oct 27 10:13:19.560143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:19.563067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Returning 404 to user: Instance cd7ed094-4322-4336-a483-9eac9a0746dd could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:19.564218 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-de882d42-bcb0-4026-8efe-d4dbf05127ce tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd" status: 404 len: 111 microversion: 2.1 time: 0.102367 Oct 27 10:13:19.565371 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 718/1439] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:19 2022] GET /compute/v2.1/servers/cd7ed094-4322-4336-a483-9eac9a0746dd => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:19.570538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:19.571527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:19.578913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.579744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.580415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.581474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.584175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.584736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.018677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:20.044096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:20.050035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:20.051929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:20.057281 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82f127db-6968-4c3b-b09f-cffa970c5ea7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.489697 Oct 27 10:13:20.057281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 719/1440] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:19 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:20.057709 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61e4b093-ad3e-4f5d-a178-349063174e6c tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1467 microversion: 2.1 time: 0.574590 Oct 27 10:13:20.058465 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 722/1441] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:19 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1467 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:20.065435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:20.066130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:20.070516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-377ce689-27e0-4005-b187-65c43f91c640 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:20.072326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-377ce689-27e0-4005-b187-65c43f91c640 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:20.096206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.097877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.098637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.101611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.103360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.104041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.145710 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] HTTP exception thrown: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Request method failure captured: Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 HTTP/1.1 Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWljR0xl8mGJVowjg-FfwyILXLE9Ibq0cR5TaBBOuzrZVLFmaVPCo2zG9GTQSNmJXUE487bBvvQRySKh_6FwZn9WPXWMg4H4OchDQXIxxVtQ2bmcEAqs-5w_WimGJVye0DJfwzIaiRvNfI7xOqtg8GHyRPl9hl_Gmf5DdkPfxNmpaT9A Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:20.153147 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53cec1ab41cb408bab6c71ee8345de63", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9a92b84bbef9472fa37a1e09b438be26 Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.154869 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'f4ee331c-acfa-4bdb-abeb-8145043083a5'} Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:20.155647 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.157959 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.160564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Returning 404 to user: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:20.160564 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-702143a5-78b0-45e3-8379-34480fac1303 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 404 len: 111 microversion: 2.1 time: 0.095234 Oct 27 10:13:20.160564 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 723/1442] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:20 2022] DELETE /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:20.176313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-377ce689-27e0-4005-b187-65c43f91c640 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:20.185890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-377ce689-27e0-4005-b187-65c43f91c640 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1216 microversion: 2.1 time: 0.125989 Oct 27 10:13:20.190918 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 720/1443] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:20 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:20.235015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:20.238880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] [instance: f4ee331c-acfa-4bdb-abeb-8145043083a5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:20.274926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.281242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.281788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.282575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.283058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.291641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.371168 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] HTTP exception thrown: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Request method failure captured: Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 HTTP/1.1 Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWljR0xl8mGJVowjg-FfwyILXLE9Ibq0cR5TaBBOuzrZVLFmaVPCo2zG9GTQSNmJXUE487bBvvQRySKh_6FwZn9WPXWMg4H4OchDQXIxxVtQ2bmcEAqs-5w_WimGJVye0DJfwzIaiRvNfI7xOqtg8GHyRPl9hl_Gmf5DdkPfxNmpaT9A Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:13:20.376028 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53cec1ab41cb408bab6c71ee8345de63", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53cec1ab41cb408bab6c71ee8345de63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 53cec1ab41cb408bab6c71ee8345de63 Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019 Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9a92b84bbef9472fa37a1e09b438be26 Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285596019-project Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.377436 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f4ee331c-acfa-4bdb-abeb-8145043083a5'} Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:20.378244 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. Oct 27 10:13:20.379417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:20.389101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] Returning 404 to user: Instance f4ee331c-acfa-4bdb-abeb-8145043083a5 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:20.390363 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0e4b968-a5bf-4a31-92af-d483bc23dd63 tempest-ServersWithSpecificFlavorTestJSON-285596019 tempest-ServersWithSpecificFlavorTestJSON-285596019-project] 10.222.0.76 "GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5" status: 404 len: 111 microversion: 2.1 time: 0.180638 Oct 27 10:13:20.395497 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 721/1444] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:20 2022] GET /compute/v2.1/servers/f4ee331c-acfa-4bdb-abeb-8145043083a5 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:20.462427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:20.463062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:20.480845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:20.483401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.483901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.484345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.493476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.499379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.500530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.512401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:20.513067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:20.524603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.525214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.536575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.538023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.541245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.543651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.247169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:21.251549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:21.263316 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b7debee-9e38-4ed3-bc52-19046daf8bf1 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 1.098697 Oct 27 10:13:21.264562 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 724/1445] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:20 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:21.281148 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7e17e25-1df9-4dd1-a5c5-d5742e33fb05 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.823617 Oct 27 10:13:21.284026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:21.285554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:21.289325 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 722/1446] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:20 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:21.306619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:21.307585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:21.311020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.311536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.312910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.313655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.314116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.314545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.317867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.318861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.320333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.321320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.322182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.322890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.395754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.396784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.398003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.398681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lazy-loading 'fault' on Instance uuid 195ef5bc-754e-49d9-a6ac-ec9d6549e065 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:13:21.455571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:21.468332 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c118c1e-d1ca-425c-b258-25cc9778e1fc tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 200 len: 1311 microversion: 2.1 time: 0.176257 Oct 27 10:13:21.475325 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 723/1447] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:21 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:21.489679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a3eadc71-5269-471d-a9d5-b86611d6e414 req-1a7c729e-deac-4c9a-b287-0ae7aed130dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195ef5bc-754e-49d9-a6ac-ec9d6549e065", "name": "network-vif-deleted", "tag": "afa72335-9133-44b2-bf85-a9ec47a970ef"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:21.524716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a3eadc71-5269-471d-a9d5-b86611d6e414 req-1a7c729e-deac-4c9a-b287-0ae7aed130dc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.525187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a3eadc71-5269-471d-a9d5-b86611d6e414 req-1a7c729e-deac-4c9a-b287-0ae7aed130dc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.525624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a3eadc71-5269-471d-a9d5-b86611d6e414 req-1a7c729e-deac-4c9a-b287-0ae7aed130dc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.565244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:21.565781 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a3eadc71-5269-471d-a9d5-b86611d6e414 req-1a7c729e-deac-4c9a-b287-0ae7aed130dc service nova] Creating event network-vif-deleted:afa72335-9133-44b2-bf85-a9ec47a970ef for instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 on n-h1-854663-10 Oct 27 10:13:21.576466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:21.576989 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a3eadc71-5269-471d-a9d5-b86611d6e414 req-1a7c729e-deac-4c9a-b287-0ae7aed130dc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092125 Oct 27 10:13:21.577965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:21.578627 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 724/1448] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:21.581887 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39354267-17c4-49de-85ce-e210838b8701 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.316138 Oct 27 10:13:21.583936 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 725/1449] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:21 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:21.605823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:21.609076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:21.630025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.630980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.632474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.633358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.647002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.649294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.755855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:21.808445 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c8efa01-fb76-48c7-a3c3-0d2edbc766c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1268 microversion: 2.1 time: 0.227550 Oct 27 10:13:21.830665 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 725/1450] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:21 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:22.072243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1db3d6a-4d9f-4c24-a5d7-1b58d270d237 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Action: 'create', calling method: .version_select at 0x7f6d5ba45940>, body: {"keypair": {"name": "tempest-keypair-1431871303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdN4ObOa83vlJnTyyLCr/n6+xApGPi95eS38x3rjvGgP5W2T9vcQAxcm1+Wy/aRWDA+a9CBIUWM3vTiRWtW+DIAhtxeFcYnMeHNdK0I62eTuUWBVKt6UZKvdaMO+3GGsQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:22.104585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d1db3d6a-4d9f-4c24-a5d7-1b58d270d237 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:22.114731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d1db3d6a-4d9f-4c24-a5d7-1b58d270d237 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for user 771aca69808a4a8a9c88ebe1007d5d50 and project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:22.170542 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1db3d6a-4d9f-4c24-a5d7-1b58d270d237 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.377507 Oct 27 10:13:22.171398 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 726/1451] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:13:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:22.184957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-27375721-e9cc-45d9-b2cb-9b30e9c153d8 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Calling method '.version_select at 0x7f6d6386b8b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:22.226314 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-27375721-e9cc-45d9-b2cb-9b30e9c153d8 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "GET /compute/v2.1/os-keypairs/tempest-keypair-1431871303" status: 200 len: 497 microversion: 2.1 time: 0.037766 Oct 27 10:13:22.227875 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 726/1452] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:13:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1431871303 => generated 497 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:22.240298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-663653ca-0f6f-453c-8347-be9d6319ba37 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Calling method '.version_select at 0x7f6d5bfb0af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:22.294025 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-663653ca-0f6f-453c-8347-be9d6319ba37 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431871303" status: 202 len: 0 microversion: 2.1 time: 0.057583 Oct 27 10:13:22.294695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:22.296121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:22.298664 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 727/1453] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:13:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431871303 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:22.320875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c8aed2b-a02e-44d0-844c-8648520fca74 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Action: 'create', calling method: .version_select at 0x7f6d5b72be50>, body: {"keypair": {"name": "tempest-keypair-842556589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvluy2QHvD5X+Ma5Zpepc+VCwbTFP+zF0MC09UeuRfW/AIjTIFimnhg0bbw8f83UgPm/pedsagu6ENOmhf1qT+ShIv8SY6sy07kPR66S/dhTZ+abPQ+rwK39EVUTtWK4g=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:22.348275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:22.348920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:22.350492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:22.355576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:22.357184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:22.358927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:22.388374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-3c8aed2b-a02e-44d0-844c-8648520fca74 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:22.406882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-3c8aed2b-a02e-44d0-844c-8648520fca74 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for user 771aca69808a4a8a9c88ebe1007d5d50 and project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:22.491221 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c8aed2b-a02e-44d0-844c-8648520fca74 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183348 Oct 27 10:13:22.498054 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 728/1454] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:13:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:22.503716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:22.504686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:22.511598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:22.512877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:22.513566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:22.514526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:22.515192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:22.515844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:22.861498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:22.862129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:22.888555 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67f43c6e-95ec-4abf-875f-61c341af6d7e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.600784 Oct 27 10:13:22.889175 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 727/1455] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:22 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:22.895097 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb22876c-4b45-41fd-afa4-314c2fffc2fb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.393370 Oct 27 10:13:22.913646 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 729/1456] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:22 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:22.927543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3f2e048-82f9-45a3-aea1-6c9a132fc66f tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Calling method '.version_select at 0x7f6d600b6e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:22.929281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:22.930068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 195ef5bc-754e-49d9-a6ac-ec9d6549e065] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:22.945397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:22.945902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:22.949027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:22.949856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:22.950325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:22.952316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:22.975790 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3f2e048-82f9-45a3-aea1-6c9a132fc66f tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842556589" status: 202 len: 0 microversion: 2.1 time: 0.060833 Oct 27 10:13:22.976758 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 730/1457] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:13:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842556589 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:22.983039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:22.983761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:22.985303 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] HTTP exception thrown: Instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 could not be found. Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Request method failure captured: Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 HTTP/1.1 Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlmWFu7dYKoQizIocixTsxdzPEViETSt3Ri7aYujMyFPD7W3GOWIu4wic1zYabOfsRb3T2mN6GVso4cycQJNmCvIqKhM_s-IatgUy-R03T1bStMOJ4C662WHVYq7w62Dvp_yS-C9MPrIOR5creGd4dN-3TdOHxh3pOmwlUEv4d59EaE Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0276614f35594fd8b000a760187a7fea Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1478384505 Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:13:22.989552 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0276614f35594fd8b000a760187a7fea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0276614f35594fd8b000a760187a7fea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0276614f35594fd8b000a760187a7fea", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0276614f35594fd8b000a760187a7fea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1478384505 Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0276614f35594fd8b000a760187a7fea Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1478384505 Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersAdminNegativeTestJSON-1478384505-project Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1a2f73716eb14bd8ac0695fc37640e03 Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1478384505-project Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 could not be found. Oct 27 10:13:22.991228 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '195ef5bc-754e-49d9-a6ac-ec9d6549e065'} Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 could not be found. Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:22.992196 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 could not be found. Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 could not be found. Oct 27 10:13:22.993884 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:22.995206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Returning 404 to user: Instance 195ef5bc-754e-49d9-a6ac-ec9d6549e065 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:22.995206 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e9e6aa6-ed66-446f-94cb-40725b682c8e tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065" status: 404 len: 111 microversion: 2.1 time: 0.096421 Oct 27 10:13:22.996066 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 728/1458] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:22 2022] GET /compute/v2.1/servers/195ef5bc-754e-49d9-a6ac-ec9d6549e065 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:22.999705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.001928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.002899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.005339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.006013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.006442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.008579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.009232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:23.026181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.027407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.027797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.032119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.032627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.033080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.244958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:23.258170 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92e8fd69-8539-46b7-95dc-8b7f2e41d8ae tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1274 microversion: 2.1 time: 0.259370 Oct 27 10:13:23.259428 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 729/1459] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:22 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:23.268327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1e8cd2e-b1e7-45d6-9921-88238c7d5514 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Action: 'create', calling method: .version_select at 0x7f6d637f5b80>, body: {"keypair": {"name": "tempest-keypair-2017481715", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:23.288798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-b1e8cd2e-b1e7-45d6-9921-88238c7d5514 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:23.297392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-b1e8cd2e-b1e7-45d6-9921-88238c7d5514 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for user 771aca69808a4a8a9c88ebe1007d5d50 and project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:23.341362 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1e8cd2e-b1e7-45d6-9921-88238c7d5514 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.077027 Oct 27 10:13:23.349031 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 730/1460] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:13:23 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:23.354871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.356571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:23.366212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.367103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.367747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.369863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.370622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.372593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.381249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:23.393727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:23.406203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:23.407449 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2138cb58-41a9-4e69-9cd0-cf62c78b955b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.429740 Oct 27 10:13:23.408009 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 731/1461] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:22 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:23.429290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:13:23.438254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-beb4ae1a-85ab-4c86-9075-ad6da73a73e1 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Calling method '.version_select at 0x7f6d5b6839d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.485955 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-beb4ae1a-85ab-4c86-9075-ad6da73a73e1 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017481715" status: 202 len: 0 microversion: 2.1 time: 0.060759 Oct 27 10:13:23.486547 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 732/1462] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017481715 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:23.503587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b906bc75-1d03-4ba5-b012-10f50a6f5495 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Action: 'create', calling method: .version_select at 0x7f6d5bd621f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2114101072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPze4tPjf0Sfht5eqgC5xaDAXrh8w8V/bzmSYtNImvokqLOdpQ4v5XdRjGeeD51W2d3t7kPcwFRF+dOUox9GTHG2Yw369FmpdQJIgjKSZ637FdqS5NgGsDQ8KaO4XaPA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:23.551604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b906bc75-1d03-4ba5-b012-10f50a6f5495 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:23.560686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b906bc75-1d03-4ba5-b012-10f50a6f5495 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for user 771aca69808a4a8a9c88ebe1007d5d50 and project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:23.611273 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-877b9ecc-c877-4a18-9465-6c6c539aafaa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 204 len: 0 microversion: 2.1 time: 0.253890 Oct 27 10:13:23.615845 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 731/1463] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:23 2022] DELETE /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:13:23.616230 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b906bc75-1d03-4ba5-b012-10f50a6f5495 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.121893 Oct 27 10:13:23.627719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.628744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:23.633573 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 733/1464] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:13:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:13:23.638159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.638778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.640457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.641418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.641893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6dd5a504-d322-44e1-8297-ecbaf18183e8 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Action: 'create', calling method: .version_select at 0x7f6d5bbe8940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1091940981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnoC/wCDYJJx8RYQEE/pj8W99ZaSPTkxZ/UoJJhSNl0V9T0vYIgVjAI0x5Lxs/IXbI+EWFLRLi0XP5eNET+MVO92ovfUhDMcrc23NqeJ8BE2N2IMZrVvX8YYr5oeh+tiA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:23.642199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.642728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.661580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-6dd5a504-d322-44e1-8297-ecbaf18183e8 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:23.670517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-6dd5a504-d322-44e1-8297-ecbaf18183e8 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for user 771aca69808a4a8a9c88ebe1007d5d50 and project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:23.702053 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6dd5a504-d322-44e1-8297-ecbaf18183e8 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.066381 Oct 27 10:13:23.711271 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 734/1465] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:13:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:23.719472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7481e33a-7a50-4c38-94dc-31864fb08d04 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Action: 'create', calling method: .version_select at 0x7f6d5bafad30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1138644209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrubA+Mo9FD713FNy9LPkeaW34ILLw9AfpMBevEEWy/tRhJCMxZDYksDtJGBdXExSeQlxe0P5b3Ye/9CjppZEeUvPx1YBxjtCRaSZdofonVKX/rCbYuCUu+oIGNalxLGA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:23.742828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7481e33a-7a50-4c38-94dc-31864fb08d04 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:23.750722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7481e33a-7a50-4c38-94dc-31864fb08d04 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Getting quotas for user 771aca69808a4a8a9c88ebe1007d5d50 and project d1b9293f533a4193826274fa3b4fa1b9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:23.755884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:23.789221 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7481e33a-7a50-4c38-94dc-31864fb08d04 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.076615 Oct 27 10:13:23.790044 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 735/1466] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:13:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:23.801334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60cfccb6-27cb-40d6-bd6e-ef364e514ff2 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Calling method '.version_select at 0x7f6d60381b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.805336 n-d-854663-10 devstack@n-api.service[120720]: WARNING oslo_db.sqlalchemy.utils [None req-60cfccb6-27cb-40d6-bd6e-ef364e514ff2 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 10:13:23.814401 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60cfccb6-27cb-40d6-bd6e-ef364e514ff2 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.017141 Oct 27 10:13:23.815227 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 736/1467] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:13:23 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:23.826362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5ecf13f-e781-4118-956b-525cb5f0f95e tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Calling method '.version_select at 0x7f6d5b450700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.854459 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5ecf13f-e781-4118-956b-525cb5f0f95e tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1138644209" status: 202 len: 0 microversion: 2.1 time: 0.032288 Oct 27 10:13:23.857028 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 737/1468] 10.222.0.76 () {58 vars in 1278 bytes} [Thu Oct 27 10:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1138644209 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:23.868393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc46038e-b466-485e-afc4-7f1a2724621c tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Calling method '.version_select at 0x7f6d60381dc0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.896615 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cc46038e-b466-485e-afc4-7f1a2724621c tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1091940981" status: 202 len: 0 microversion: 2.1 time: 0.035814 Oct 27 10:13:23.902047 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 738/1469] 10.222.0.76 () {58 vars in 1278 bytes} [Thu Oct 27 10:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1091940981 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:23.910857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5391414a-26ae-412c-97c1-5e989f8408d8 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] Calling method '.version_select at 0x7f6d5bd62af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.949756 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5391414a-26ae-412c-97c1-5e989f8408d8 tempest-KeyPairsV2TestJSON-1711287777 tempest-KeyPairsV2TestJSON-1711287777-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2114101072" status: 202 len: 0 microversion: 2.1 time: 0.043024 Oct 27 10:13:23.955430 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 739/1470] 10.222.0.76 () {58 vars in 1278 bytes} [Thu Oct 27 10:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2114101072 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:23.963785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.965100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:23.974519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.975367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.976329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.977336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.978248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.979361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:24.081758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:24.092142 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f040e73-a17f-4884-9af4-e42dc8031609 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1477 microversion: 2.1 time: 0.474055 Oct 27 10:13:24.108356 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 732/1471] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:23 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1477 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:24.114415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:24.115392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:24.122890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:24.123551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:24.124082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:24.125958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:24.126520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:24.129555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:24.600846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:24.617990 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ed962a6-2238-4e18-9fec-3c575189ca80 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.660125 Oct 27 10:13:24.621996 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 740/1472] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:23 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:24.630210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:24.631941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:24.648493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:24.649444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:24.651403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:24.654934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:24.656745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:24.657501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:24.687853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:24.698892 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eeec29a1-897f-4b97-a41c-cd517a834533 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.588664 Oct 27 10:13:24.704812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 733/1473] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:24 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:24.732155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:24.733747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:24.741280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:24.742237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:24.742842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:24.744163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:24.745139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:24.746044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:24.775466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:25.111997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:25.125190 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16e70371-761e-437a-a04d-28974b419696 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1316 microversion: 2.1 time: 0.501626 Oct 27 10:13:25.142010 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 741/1474] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:24 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:25.148509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:25.149422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:25.156204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:25.157269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:25.157797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:25.158667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:25.159240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:25.159903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:25.165449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:25.168492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:25.178395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:25.180161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:25.181590 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-267f9a92-c543-43ff-bcae-5d6a0dca3d6b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.475321 Oct 27 10:13:25.182341 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 734/1475] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:24 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:25.487594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:25.508571 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b2c61ff-24cd-4576-8440-9d9882656d17 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1477 microversion: 2.1 time: 0.364741 Oct 27 10:13:25.524135 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 742/1476] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:25 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1477 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:25.656100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:25.657039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:25.668242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0aae63e4-99f9-4742-bda5-a74ece928e13 req-2a2a90fc-bb02-4fe5-b648-08fa45b5e405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3389e1-7dee-4c6b-bb0b-7c6715cf154b", "tag": "211bc681-d6db-460d-9652-9f7ac4551091"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:25.670184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:25.670680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:25.671116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:25.673990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:25.674473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:25.675488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:25.711842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0aae63e4-99f9-4742-bda5-a74ece928e13 req-2a2a90fc-bb02-4fe5-b648-08fa45b5e405 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:25.713071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0aae63e4-99f9-4742-bda5-a74ece928e13 req-2a2a90fc-bb02-4fe5-b648-08fa45b5e405 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:25.714268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0aae63e4-99f9-4742-bda5-a74ece928e13 req-2a2a90fc-bb02-4fe5-b648-08fa45b5e405 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:25.750295 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0aae63e4-99f9-4742-bda5-a74ece928e13 req-2a2a90fc-bb02-4fe5-b648-08fa45b5e405 service nova] Creating event network-changed:211bc681-d6db-460d-9652-9f7ac4551091 for instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b on n-h2-854663-10 Oct 27 10:13:25.758502 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0aae63e4-99f9-4742-bda5-a74ece928e13 req-2a2a90fc-bb02-4fe5-b648-08fa45b5e405 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093947 Oct 27 10:13:25.761826 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 743/1477] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:25.784389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:25.785195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:25.837736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:25.838811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:25.839679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:25.840776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:25.843136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:25.850143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:26.111671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:26.119308 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d02ccc6-11e8-432a-91b2-6d7233c846bd tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.475090 Oct 27 10:13:26.120513 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 735/1478] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:25 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:26.151403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:26.152418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:26.158819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:26.159582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:26.160023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:26.160769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:26.161221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:26.161679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:26.256953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:26.270133 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66c43217-1347-426b-b455-44e32b1da114 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.504371 Oct 27 10:13:26.271673 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 744/1479] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:25 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:26.278566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:26.279539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:26.302703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:26.307126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:26.309492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:26.310887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:26.311515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:26.312116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:26.546886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:26.558742 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dde7c895-98e8-43b9-89b7-d5c6f65e8f25 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1316 microversion: 2.1 time: 0.413109 Oct 27 10:13:26.560969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 736/1480] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:26 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:26.567749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:26.568812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:26.576756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:26.577658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:26.578510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:26.579872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:26.580556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:26.581779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:26.634847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:26.647138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:26.649970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:26.651866 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4fb7da8-92c7-4359-8fea-a634d8c32f6e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.377775 Oct 27 10:13:26.664982 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 745/1481] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:26 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:26.812020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:26.821654 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-050ba23d-d3eb-46cc-90f5-ad01c327e8aa tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1477 microversion: 2.1 time: 0.258467 Oct 27 10:13:26.822500 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 737/1482] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:26 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:27.142957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:27.143571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:27.151408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.152204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.152725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:27.153670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.154122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.154598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:27.299846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:27.300647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:27.318958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.319454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.319887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:27.320652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.324327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.324792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:27.641482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:27.657001 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3505297d-700b-4444-b368-dc80932c082e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.517931 Oct 27 10:13:27.678515 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 746/1483] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:27 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:27.685391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:27.686335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:27.693155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.693893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.694486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:27.695364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.695970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.696392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:27.762011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:27.770534 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c9d862dd-4ca7-4ec5-9a02-f7766ce1d318 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.475044 Oct 27 10:13:27.785467 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 738/1484] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:27 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:27.792357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:27.793148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:27.801233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.801973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.802381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:27.803777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.804237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.804879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.085980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:28.094194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2500f5aa-542c-4493-83aa-244fdc5fc2ef tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1316 microversion: 2.1 time: 0.414415 Oct 27 10:13:28.110372 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 747/1485] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:27 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:28.117719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:28.118761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:28.126271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.127214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.128056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.129004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.129815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.130444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.158944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:28.168647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:28.170190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:28.171403 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-474939d0-8414-40f7-b098-24bff725a976 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.385038 Oct 27 10:13:28.171981 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 739/1486] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:27 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:28.189722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-57013931-ff8c-460b-a122-a1729eaa6ce9 req-57004c6e-fb76-4645-8081-2b94c6ee464f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db810b22-71e9-4b8c-bbaf-59b8443d408b", "name": "network-vif-unplugged", "status": "completed", "tag": "3dd60d44-bd56-4d7b-b71c-ba708a3df480"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:28.199902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-57013931-ff8c-460b-a122-a1729eaa6ce9 req-57004c6e-fb76-4645-8081-2b94c6ee464f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.200679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-57013931-ff8c-460b-a122-a1729eaa6ce9 req-57004c6e-fb76-4645-8081-2b94c6ee464f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.201115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-57013931-ff8c-460b-a122-a1729eaa6ce9 req-57004c6e-fb76-4645-8081-2b94c6ee464f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.216773 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-57013931-ff8c-460b-a122-a1729eaa6ce9 req-57004c6e-fb76-4645-8081-2b94c6ee464f service nova] Creating event network-vif-unplugged:3dd60d44-bd56-4d7b-b71c-ba708a3df480 for instance db810b22-71e9-4b8c-bbaf-59b8443d408b on n-h2-854663-10 Oct 27 10:13:28.234616 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-57013931-ff8c-460b-a122-a1729eaa6ce9 req-57004c6e-fb76-4645-8081-2b94c6ee464f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048410 Oct 27 10:13:28.236100 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 740/1487] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:28.443853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-90c8c5df-acf9-402e-875e-b36167e27c8c req-d2c0b94d-487b-4555-8d5b-8aca23e2197b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5efb897f-74a9-45d2-85ec-59125686de70", "name": "network-vif-deleted", "tag": "2fd7f8fa-e564-4a62-a96d-b390514b7717"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:28.463079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-90c8c5df-acf9-402e-875e-b36167e27c8c req-d2c0b94d-487b-4555-8d5b-8aca23e2197b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.463527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-90c8c5df-acf9-402e-875e-b36167e27c8c req-d2c0b94d-487b-4555-8d5b-8aca23e2197b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.464025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-90c8c5df-acf9-402e-875e-b36167e27c8c req-d2c0b94d-487b-4555-8d5b-8aca23e2197b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.483133 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-90c8c5df-acf9-402e-875e-b36167e27c8c req-d2c0b94d-487b-4555-8d5b-8aca23e2197b service nova] Creating event network-vif-deleted:2fd7f8fa-e564-4a62-a96d-b390514b7717 for instance 5efb897f-74a9-45d2-85ec-59125686de70 on n-h1-854663-10 Oct 27 10:13:28.512090 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-90c8c5df-acf9-402e-875e-b36167e27c8c req-d2c0b94d-487b-4555-8d5b-8aca23e2197b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061369 Oct 27 10:13:28.513549 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 741/1488] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:28.557922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2f73716eb14bd8ac0695fc37640e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0276614f35594fd8b000a760187a7fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:28.568122 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee977fa2-08f6-4f93-be5f-4a7788759cd8 tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 200 len: 1477 microversion: 2.1 time: 0.455796 Oct 27 10:13:28.585834 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 748/1489] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:28 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 1477 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:28.693244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:28.694034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:28.709357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.710961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.712563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.713385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.713852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.714385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.799827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:28.801679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:28.821608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.824562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.826380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.828812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.831190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.831827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:29.149166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:29.164115 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5beab045-8d32-4619-9f5a-5df8fb775ed9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.475554 Oct 27 10:13:29.167681 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 742/1490] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:28 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:29.175965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa59f83d-09e2-4627-89a7-9e93fcfa9a3c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:29.179501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa59f83d-09e2-4627-89a7-9e93fcfa9a3c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:29.198662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa59f83d-09e2-4627-89a7-9e93fcfa9a3c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:29.199171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa59f83d-09e2-4627-89a7-9e93fcfa9a3c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:29.199673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa59f83d-09e2-4627-89a7-9e93fcfa9a3c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:29.200426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa59f83d-09e2-4627-89a7-9e93fcfa9a3c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:29.200906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa59f83d-09e2-4627-89a7-9e93fcfa9a3c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:29.202021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa59f83d-09e2-4627-89a7-9e93fcfa9a3c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:29.267334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:29.282798 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa59f83d-09e2-4627-89a7-9e93fcfa9a3c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113051 Oct 27 10:13:29.283398 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 743/1491] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:13:29 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:29.296773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:29.297396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:29.319656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:29.320449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:29.322577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:29.324040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:29.325077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:29.326553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:29.329212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:29.350438 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d93e7ed2-cc31-4872-b7f6-d44bb3ff0add tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.555647 Oct 27 10:13:29.358425 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 749/1492] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:28 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:29.374826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:29.377715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:29.397054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:29.401662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:29.403585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:29.404920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:29.406662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:29.408736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:29.862628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:29.875329 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b90f560a-c109-44ba-93d5-ec0ffc375293 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1316 microversion: 2.1 time: 0.582393 Oct 27 10:13:29.877420 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 744/1493] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:29 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:29.901719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:29.903146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:29.910456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:29.911976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:29.912574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:29.913564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:29.914193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:29.914815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.050687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:30.065868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:30.067333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:30.068602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4362c08d-88c4-4120-b2bd-87c2e0b51a24 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.707728 Oct 27 10:13:30.069213 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 750/1494] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:29 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:30.088179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lazy-loading 'services' on Instance uuid 95558ee4-40e1-4fff-a334-890711c72fe1 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:13:30.097364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:30.097364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] [instance: 5efb897f-74a9-45d2-85ec-59125686de70] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:30.104209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.104810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.105256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.106086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.106544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.107797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.126678 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] HTTP exception thrown: Instance 5efb897f-74a9-45d2-85ec-59125686de70 could not be found. Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Request method failure captured: Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 HTTP/1.1 Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlmWFu7dYKoQizIocixTsxdzPEViETSt3Ri7aYujMyFPD7W3GOWIu4wic1zYabOfsRb3T2mN6GVso4cycQJNmCvIqKhM_s-IatgUy-R03T1bStMOJ4C662WHVYq7w62Dvp_yS-C9MPrIOR5creGd4dN-3TdOHxh3pOmwlUEv4d59EaE Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0276614f35594fd8b000a760187a7fea Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1478384505 Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:30.129607 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0276614f35594fd8b000a760187a7fea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0276614f35594fd8b000a760187a7fea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0276614f35594fd8b000a760187a7fea", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0276614f35594fd8b000a760187a7fea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1478384505 Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0276614f35594fd8b000a760187a7fea Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1478384505 Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersAdminNegativeTestJSON-1478384505-project Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 1a2f73716eb14bd8ac0695fc37640e03 Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1478384505-project Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 5efb897f-74a9-45d2-85ec-59125686de70 could not be found. Oct 27 10:13:30.132348 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '5efb897f-74a9-45d2-85ec-59125686de70'} Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5efb897f-74a9-45d2-85ec-59125686de70 could not be found. Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:30.133191 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5efb897f-74a9-45d2-85ec-59125686de70 could not be found. Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5efb897f-74a9-45d2-85ec-59125686de70 could not be found. Oct 27 10:13:30.136711 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:30.139931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] Returning 404 to user: Instance 5efb897f-74a9-45d2-85ec-59125686de70 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:30.139931 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-728e663a-2cc6-44ea-a574-498ae32a2e9a tempest-ServersAdminNegativeTestJSON-1478384505 tempest-ServersAdminNegativeTestJSON-1478384505-project] 10.222.0.76 "GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70" status: 404 len: 111 microversion: 2.1 time: 0.045533 Oct 27 10:13:30.139931 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 751/1495] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:30 2022] GET /compute/v2.1/servers/5efb897f-74a9-45d2-85ec-59125686de70 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:30.195812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:30.196418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:30.208857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.209633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.210247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.212595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.217699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.218159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.283730 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35b122e0-e392-4e3e-a318-0f4ec3d10bc8 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "DELETE /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments/151515c6-0fea-4a27-ad1b-9a15da4a8b95" status: 202 len: 0 microversion: 2.1 time: 0.387682 Oct 27 10:13:30.298707 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 745/1496] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:13:29 2022] DELETE /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments/151515c6-0fea-4a27-ad1b-9a15da4a8b95 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:30.338782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-fdf45ec6-c41a-47c9-b1b5-b7d9a233d73b req-e7e8fe96-70ca-4b0c-acc1-047c4d35f7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db810b22-71e9-4b8c-bbaf-59b8443d408b", "tag": "3dd60d44-bd56-4d7b-b71c-ba708a3df480"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:30.376222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fdf45ec6-c41a-47c9-b1b5-b7d9a233d73b req-e7e8fe96-70ca-4b0c-acc1-047c4d35f7c3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.376724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fdf45ec6-c41a-47c9-b1b5-b7d9a233d73b req-e7e8fe96-70ca-4b0c-acc1-047c4d35f7c3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.381065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fdf45ec6-c41a-47c9-b1b5-b7d9a233d73b req-e7e8fe96-70ca-4b0c-acc1-047c4d35f7c3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.411148 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-fdf45ec6-c41a-47c9-b1b5-b7d9a233d73b req-e7e8fe96-70ca-4b0c-acc1-047c4d35f7c3 service nova] Creating event network-changed:3dd60d44-bd56-4d7b-b71c-ba708a3df480 for instance db810b22-71e9-4b8c-bbaf-59b8443d408b on n-h2-854663-10 Oct 27 10:13:30.443224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-fdf45ec6-c41a-47c9-b1b5-b7d9a233d73b req-e7e8fe96-70ca-4b0c-acc1-047c4d35f7c3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139984 Oct 27 10:13:30.446987 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 746/1497] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:30.463688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:30.467155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:30.477296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.478123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.478744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.480015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.480839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.481480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.741526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:30.756913 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47b818b3-afa3-4a51-8e7d-2bf006be31b6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.565233 Oct 27 10:13:30.760345 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 752/1498] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:30 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:30.899964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:30.900629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:30.916022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.916623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.917371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.918230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.918754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.920391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:31.244279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:31.259624 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0fffd4a8-2d1e-4b38-919c-cd400487aea7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.809699 Oct 27 10:13:31.260234 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 747/1499] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:30 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:31.301492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:31.302231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:31.317115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:31.317910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:31.319343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:31.320382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:31.321072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:31.322323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:31.478610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:31.496770 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aabc9ee9-f24a-4d7f-85a8-4888d63cf57d tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1316 microversion: 2.1 time: 0.601120 Oct 27 10:13:31.497629 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 753/1500] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:30 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:31.784188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:31.785197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:31.797286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:31.799740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:31.808276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:31.809609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:31.810209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:31.810690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:32.439131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:32.452634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:32.461517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:32.462813 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-64fa8eb5-44b4-4607-9d28-1c6cd2ef19c0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 1.187385 Oct 27 10:13:32.468045 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 748/1501] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:31 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:32.480651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:32.481332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:32.501636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:32.502315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:32.508467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:32.509562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:32.510048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:32.510485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:32.762879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:32.777509 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3e67674-455e-4fd3-abe8-95b167250ac4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.997705 Oct 27 10:13:32.780372 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 754/1502] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:31 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:32.798495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:32.799720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:32.810615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:32.812763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:32.813615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:32.815293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:32.817947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:32.818721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:33.167154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:33.183394 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a59e2528-11d3-46fa-944a-bd1a86f0ae37 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.710429 Oct 27 10:13:33.184644 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 749/1503] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:32 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:33.274148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:33.289475 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5887df94-ba72-478d-9eb4-e67a3d21315c tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1316 microversion: 2.1 time: 0.507416 Oct 27 10:13:33.290596 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 755/1504] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:32 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:33.499974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:33.501450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:33.519549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:33.527727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:33.532512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:33.534681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:33.535789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:33.537490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:33.538935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:33.761621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=26 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:34.063286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:34.083138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-623ae02e-0a42-4f7d-9320-ad514ae953f1 req-67778b4a-c214-4384-883b-325a29cddee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3389e1-7dee-4c6b-bb0b-7c6715cf154b", "name": "network-vif-plugged", "status": "completed", "tag": "211bc681-d6db-460d-9652-9f7ac4551091"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:34.085533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:34.088062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:34.093313 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10392071-a75a-4307-bd67-9844428dc1b3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.601021 Oct 27 10:13:34.096090 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 750/1505] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:33 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:34.101770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:34.103299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:34.119459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:34.120336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:34.120626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-623ae02e-0a42-4f7d-9320-ad514ae953f1 req-67778b4a-c214-4384-883b-325a29cddee8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:34.121460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:34.122344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-623ae02e-0a42-4f7d-9320-ad514ae953f1 req-67778b4a-c214-4384-883b-325a29cddee8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:34.122697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:34.122818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-623ae02e-0a42-4f7d-9320-ad514ae953f1 req-67778b4a-c214-4384-883b-325a29cddee8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:34.123398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:34.123970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:34.152207 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-623ae02e-0a42-4f7d-9320-ad514ae953f1 req-67778b4a-c214-4384-883b-325a29cddee8 service nova] Creating event network-vif-plugged:211bc681-d6db-460d-9652-9f7ac4551091 for instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b on n-h2-854663-10 Oct 27 10:13:34.163041 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-623ae02e-0a42-4f7d-9320-ad514ae953f1 req-67778b4a-c214-4384-883b-325a29cddee8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.419442 Oct 27 10:13:34.165778 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 756/1506] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:34.217718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:34.218452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:34.239423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:34.242810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:34.243748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:34.244914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:34.247085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:34.247756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:34.995714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:35.013894 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-189238a0-b784-46bb-abc0-b7fe9de9b5b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.908222 Oct 27 10:13:35.014838 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 751/1507] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:34 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:35.029850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:35.030518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:35.054917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:35.057258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:35.058587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:35.061724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:35.062560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:35.063174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:35.104144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:35.271677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:35.295197 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7de7ec6b-7a62-4041-b3b2-ae9364f3ed52 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 1.087863 Oct 27 10:13:35.314879 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 757/1508] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:34 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:35.319997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:35.320925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:35.329416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:35.330156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:35.330796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:35.332039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:35.332684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:35.333329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:35.574648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:35.596062 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31bfeee2-411f-417d-bfa5-50c894c719fe tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1316 microversion: 2.1 time: 0.579617 Oct 27 10:13:35.598327 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 752/1509] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:35 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:35.798678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:35.810937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:35.815051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:35.819264 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8afd9e6f-dedf-4e90-89c0-b2e25bd2d77c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.503244 Oct 27 10:13:35.853346 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 758/1510] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:35 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:36.047716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:36.048486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:36.062226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.064125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.065343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:36.066927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.069237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.070615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:36.272539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:36.289302 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e3ab77e0-c6d7-40d5-b4c9-9e648dfefeea tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.242511 Oct 27 10:13:36.290311 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 753/1511] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:36 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:36.324383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:36.325049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:36.336004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.337342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.337937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:36.339345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.339986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.340577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:36.606861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:36.622929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:36.623552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:36.623673 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-055707e5-91a5-4e5c-8119-682a1ec6ea51 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.305922 Oct 27 10:13:36.624561 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 759/1512] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:36 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:36.640426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.640947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.641379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:36.642273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.644164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.644602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:36.861159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:36.861770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:36.891412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.892375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.894516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:36.896443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.897253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.897688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.035515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:37.049773 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e25a9022-f8f9-4d83-a0ff-a5fecf7a075f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1503 microversion: 2.1 time: 0.432411 Oct 27 10:13:37.053355 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 754/1513] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:36 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:37.094179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:37.094963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:37.119070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.119914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.121447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.126006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.126512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.126963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.205070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:13:37.366518 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-399d7d03-00ff-4c02-8820-01c4070aee21 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 204 len: 0 microversion: 2.1 time: 0.281781 Oct 27 10:13:37.367791 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 755/1514] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:37 2022] DELETE /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:13:37.375329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:37.376959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:37.384548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.385531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.386304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.387233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.388480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.389200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.477228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:37.480770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:37.496064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:37.498126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:37.499337 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57d6e89f-841e-4047-af1d-6349f5c12704 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.642458 Oct 27 10:13:37.500315 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 760/1515] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:36 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:13:37.514064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:37.514849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:37.531257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.532170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.532894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.533912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.534556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.535391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.814675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:37.828872 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc52bace-2516-410b-82b6-bde47e0e570b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 0.455729 Oct 27 10:13:37.841075 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 756/1516] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:37 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:37.842682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:37.843601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:37.865134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.866016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.867132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.868201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.871044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.871700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:38.013969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:38.029556 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3969b505-14fc-4927-8896-8ac4a766ed79 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1509 microversion: 2.1 time: 0.527969 Oct 27 10:13:38.030172 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 761/1517] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:37 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1509 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:38.289374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:38.318813 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83392142-98eb-4f4a-8ed4-98b91c0e8852 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.487005 Oct 27 10:13:38.319431 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 757/1518] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:37 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:38.529740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:38.530495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:38.549655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:38.550472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:38.551125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:38.552394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:38.553237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:38.553958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:38.858111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:38.858741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:38.882053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:38.882576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:38.883022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:38.883755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:38.884209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:38.884631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:38.938427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:38.961982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:38.967919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:38.973088 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d164e646-676f-4706-99db-15042e6ae953 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.448037 Oct 27 10:13:38.996886 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 762/1519] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:38 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:39.054609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:39.055244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:39.070114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:39.070609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:39.076521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:39.079171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:39.079679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:39.080234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.867980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:40.899282 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-faf87d72-c146-43ba-917d-32991065835f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1509 microversion: 2.1 time: 1.849740 Oct 27 10:13:40.899897 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 763/1520] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:39 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1509 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:40.927762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:40.931070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:40.938413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:40.938911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:40.939348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.940064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:40.940529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:40.941545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:41.296189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:41.307245 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a219c669-a49c-495d-a350-5d95b97ef3b4 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1477 microversion: 2.1 time: 2.452586 Oct 27 10:13:41.313533 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 758/1521] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:38 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1477 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:41.338572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f218bea8-146c-447f-a1cd-6b324477ae4d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:41.344589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f218bea8-146c-447f-a1cd-6b324477ae4d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:41.366271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f218bea8-146c-447f-a1cd-6b324477ae4d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:41.367487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f218bea8-146c-447f-a1cd-6b324477ae4d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:41.368711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f218bea8-146c-447f-a1cd-6b324477ae4d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:41.371112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f218bea8-146c-447f-a1cd-6b324477ae4d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:41.373316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f218bea8-146c-447f-a1cd-6b324477ae4d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:41.374099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f218bea8-146c-447f-a1cd-6b324477ae4d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:41.455802 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f218bea8-146c-447f-a1cd-6b324477ae4d tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128492 Oct 27 10:13:41.462806 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 759/1522] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:13:41 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:13:41.472606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:41.477127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:41.479587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:41.493289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:41.494110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:41.494851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:41.495759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:41.499219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:41.499897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:41.529002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:41.556394 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30d03854-0d0c-407a-9e37-6c9c747b8f2f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.631926 Oct 27 10:13:41.577476 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 764/1523] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:40 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:41.905899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9439b9a-b88c-40a9-a458-ddbed65b4dd8 tempest-FlavorsV261TestJSON-1381275063 tempest-FlavorsV261TestJSON-1381275063-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-46468311", "id": 841333277, "os-flavor-access:is_public": "True"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:41.960959 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9439b9a-b88c-40a9-a458-ddbed65b4dd8 tempest-FlavorsV261TestJSON-1381275063 tempest-FlavorsV261TestJSON-1381275063-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 463 microversion: 2.61 time: 0.382097 Oct 27 10:13:41.962203 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 765/1524] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:13:41 2022] POST /compute/v2.1/flavors => generated 463 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:13:41.976772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-bb3d1b9b-2dda-4f69-b1ec-b175cd34ee6c req-9cdd4891-bcda-40ca-b56c-4f0410d2dfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2259f471-9ce2-4ad1-91a3-6bf122ab46ca", "name": "network-vif-unplugged", "status": "completed", "tag": "1a4efe5d-7145-4c38-99cb-5f5f90f71dcc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:42.017442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bb3d1b9b-2dda-4f69-b1ec-b175cd34ee6c req-9cdd4891-bcda-40ca-b56c-4f0410d2dfc8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.020382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bb3d1b9b-2dda-4f69-b1ec-b175cd34ee6c req-9cdd4891-bcda-40ca-b56c-4f0410d2dfc8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.021029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bb3d1b9b-2dda-4f69-b1ec-b175cd34ee6c req-9cdd4891-bcda-40ca-b56c-4f0410d2dfc8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.056066 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-bb3d1b9b-2dda-4f69-b1ec-b175cd34ee6c req-9cdd4891-bcda-40ca-b56c-4f0410d2dfc8 service nova] Creating event network-vif-unplugged:1a4efe5d-7145-4c38-99cb-5f5f90f71dcc for instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca on n-h2-854663-10 Oct 27 10:13:42.087675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-bb3d1b9b-2dda-4f69-b1ec-b175cd34ee6c req-9cdd4891-bcda-40ca-b56c-4f0410d2dfc8 service nova] Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:13:42.129546 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-bb3d1b9b-2dda-4f69-b1ec-b175cd34ee6c req-9cdd4891-bcda-40ca-b56c-4f0410d2dfc8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165504 Oct 27 10:13:42.131637 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 766/1525] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:42.145926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a866e463-4093-4b75-a193-6701f186883c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:42.165417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a866e463-4093-4b75-a193-6701f186883c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:42.183424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a866e463-4093-4b75-a193-6701f186883c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.183900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a866e463-4093-4b75-a193-6701f186883c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.187554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a866e463-4093-4b75-a193-6701f186883c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.192246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a866e463-4093-4b75-a193-6701f186883c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.192915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a866e463-4093-4b75-a193-6701f186883c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.193582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a866e463-4093-4b75-a193-6701f186883c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.266457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a866e463-4093-4b75-a193-6701f186883c tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132493 Oct 27 10:13:42.269986 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 767/1526] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:13:42 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:13:42.283161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e2e2aa96-9c0e-4b39-bd1d-b825a06b320e req-81ce9264-5664-46b6-8403-16e40bee1c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3389e1-7dee-4c6b-bb0b-7c6715cf154b", "name": "network-vif-deleted", "tag": "211bc681-d6db-460d-9652-9f7ac4551091"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:42.294927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:42.324586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e2e2aa96-9c0e-4b39-bd1d-b825a06b320e req-81ce9264-5664-46b6-8403-16e40bee1c37 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.325115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e2e2aa96-9c0e-4b39-bd1d-b825a06b320e req-81ce9264-5664-46b6-8403-16e40bee1c37 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.325542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e2e2aa96-9c0e-4b39-bd1d-b825a06b320e req-81ce9264-5664-46b6-8403-16e40bee1c37 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.327187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:42.347330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:42.356219 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd80e34f-4c17-4673-8190-a9b2ae31c9e3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.885840 Oct 27 10:13:42.356895 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 760/1527] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:41 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:42.366170 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e2e2aa96-9c0e-4b39-bd1d-b825a06b320e req-81ce9264-5664-46b6-8403-16e40bee1c37 service nova] Creating event network-vif-deleted:211bc681-d6db-460d-9652-9f7ac4551091 for instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b on n-h2-854663-10 Oct 27 10:13:42.373344 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e2e2aa96-9c0e-4b39-bd1d-b825a06b320e req-81ce9264-5664-46b6-8403-16e40bee1c37 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093929 Oct 27 10:13:42.374714 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 768/1528] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:42.390760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:42.395230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:42.414695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.415244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.415684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.416469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.417465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.418082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.521561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.522676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.523306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.524048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lazy-loading 'fault' on Instance uuid 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:13:42.753048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0567190ddb4d719d7e90216b6a9cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6480c8676efb4a329d9f70493e89983b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:42.757289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bbcecc50-bbae-47a4-8e34-7221fd54a7db tempest-FlavorsV261TestJSON-636022662 tempest-FlavorsV261TestJSON-636022662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:42.771989 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-974c47ec-64e3-4b77-883e-f3569098fddc tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 200 len: 1306 microversion: 2.1 time: 0.403685 Oct 27 10:13:42.773452 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 761/1529] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:42 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 1306 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:42.781238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:42.782065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:42.790406 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bbcecc50-bbae-47a4-8e34-7221fd54a7db tempest-FlavorsV261TestJSON-636022662 tempest-FlavorsV261TestJSON-636022662-project] 10.222.0.76 "GET /compute/v2.1/flavors/841333277" status: 200 len: 463 microversion: 2.61 time: 0.411599 Oct 27 10:13:42.791026 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 769/1530] 10.222.0.76 () {60 vars in 1196 bytes} [Thu Oct 27 10:13:42 2022] GET /compute/v2.1/flavors/841333277 => generated 463 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:13:42.791214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.792100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.792794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.794462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.795189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.795760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.824297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:42.829286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:42.854347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.854833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.855268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.860335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.862153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.864980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.919210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:13:43.121288 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40c6d72b-501d-4b6d-ba04-14d7e013530a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "DELETE /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 204 len: 0 microversion: 2.1 time: 0.312847 Oct 27 10:13:43.125121 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 770/1531] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:42 2022] DELETE /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:13:43.148564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:43.149536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:43.164056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:43.164544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:43.165232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:43.165955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:43.166433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:43.166851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:43.192174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:43.207894 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1b87cde-3ba5-42b1-84a9-4c1171e0b1ec tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1476 microversion: 2.1 time: 0.433066 Oct 27 10:13:43.211931 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 762/1532] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:42 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1476 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:43.221784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-446835b7-3361-4c51-a734-2daa766e4197 tempest-FlavorsV261TestJSON-1381275063 tempest-FlavorsV261TestJSON-1381275063-project-admin] Action: 'update', calling method: .version_select at 0x7f6d61418b80>, body: {"flavor": {"description": "new"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:43.373413 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-446835b7-3361-4c51-a734-2daa766e4197 tempest-FlavorsV261TestJSON-1381275063 tempest-FlavorsV261TestJSON-1381275063-project-admin] 10.222.0.76 "PUT /compute/v2.1/flavors/841333277" status: 200 len: 464 microversion: 2.61 time: 0.129843 Oct 27 10:13:43.376018 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 763/1533] 10.222.0.76 () {62 vars in 1216 bytes} [Thu Oct 27 10:13:43 2022] PUT /compute/v2.1/flavors/841333277 => generated 464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:13:43.405859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:43.406544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:43.445027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:43.445558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:43.446942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:43.450794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:43.451502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:43.452120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:43.656016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:43.671996 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32c47413-a7e5-493d-a59b-9eeaa5d19611 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.545537 Oct 27 10:13:43.672595 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 771/1534] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:43 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:43.683540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20ea6c4b-bed1-4f84-bd02-d6f4e3ed0b56 tempest-FlavorsV261TestJSON-636022662 tempest-FlavorsV261TestJSON-636022662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:43.769592 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20ea6c4b-bed1-4f84-bd02-d6f4e3ed0b56 tempest-FlavorsV261TestJSON-636022662 tempest-FlavorsV261TestJSON-636022662-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 6245 microversion: 2.61 time: 0.094244 Oct 27 10:13:43.770873 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 772/1535] 10.222.0.76 () {60 vars in 1187 bytes} [Thu Oct 27 10:13:43 2022] GET /compute/v2.1/flavors/detail => generated 6245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:43.782970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:43.783589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:43.790512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:43.791352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:43.792052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:43.793074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:43.793677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:43.794277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:43.922635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:43.931476 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d6a6759c-41ca-4e04-b1ef-f10a5418899b tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1680 microversion: 2.1 time: 0.554332 Oct 27 10:13:43.932143 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 764/1536] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:43 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1680 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:43.953093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-650396810", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "e8337c3d-204a-45c1-9929-90cd4de43eea"}, {"uuid": "113cb92a-7041-449d-9bd7-a720858a0fed"}, {"uuid": "e8337c3d-204a-45c1-9929-90cd4de43eea"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:44.017846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] validate_networks() for [('e8337c3d-204a-45c1-9929-90cd4de43eea', None, None, None, None, None), ('113cb92a-7041-449d-9bd7-a720858a0fed', None, None, None, None, None), ('e8337c3d-204a-45c1-9929-90cd4de43eea', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:13:44.080865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:44.105057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:44.107403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:44.109081 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b50e3a7d-7fb2-42d4-ae88-91b0bcf62ca8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.333873 Oct 27 10:13:44.110935 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 773/1537] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:43 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:44.115876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ea0f067-7901-47a2-b8f6-f6bed8195d6e tempest-FlavorsV261TestJSON-636022662 tempest-FlavorsV261TestJSON-636022662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:44.173868 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ea0f067-7901-47a2-b8f6-f6bed8195d6e tempest-FlavorsV261TestJSON-636022662 tempest-FlavorsV261TestJSON-636022662-project] 10.222.0.76 "GET /compute/v2.1/flavors" status: 200 len: 3152 microversion: 2.61 time: 0.061632 Oct 27 10:13:44.175720 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 774/1538] 10.222.0.76 () {60 vars in 1166 bytes} [Thu Oct 27 10:13:44 2022] GET /compute/v2.1/flavors => generated 3152 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:44.189200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:44.193306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:44.211615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.214307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.216174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.217107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.219346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.221609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.250352 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] HTTP exception thrown: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Request method failure captured: Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b HTTP/1.1 Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlm9qju9gdQfgnyy7wZxPcSeU_geWChLMPgr9s-mbwzdXr4yu1-WMD3HuGLTfb6L_lGkU1NvYTwlsqUy-gxCcF8tOBF_Xq4mKnRFmGOOxMla2b0p8HQuURQU8odTbntBxAyVTJBfyF6yXrDiha6FlTlpunMB1VpKmU8fAxl-n7B7x0I Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:44.252425 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6480c8676efb4a329d9f70493e89983b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d0567190ddb4d719d7e90216b6a9cea Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.254085 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '7e3389e1-7dee-4c6b-bb0b-7c6715cf154b'} Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:44.255171 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.256617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.258234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Returning 404 to user: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:44.259565 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7878a5a2-31c6-47e0-864f-25da45c96ec0 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 404 len: 111 microversion: 2.1 time: 0.082509 Oct 27 10:13:44.264915 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 775/1539] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:44 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:44.270744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ac6845e-f452-4011-9522-1feae0bc0a4e tempest-FlavorsV261TestJSON-1381275063 tempest-FlavorsV261TestJSON-1381275063-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:44.284768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:44.292205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ac6845e-f452-4011-9522-1feae0bc0a4e tempest-FlavorsV261TestJSON-1381275063 tempest-FlavorsV261TestJSON-1381275063-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/841333277" status: 202 len: 0 microversion: 2.61 time: 0.025512 Oct 27 10:13:44.293449 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 776/1540] 10.222.0.76 () {60 vars in 1199 bytes} [Thu Oct 27 10:13:44 2022] DELETE /compute/v2.1/flavors/841333277 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:13:44.300452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:44.301467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:44.313671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.314540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.315205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.316707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.318202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.318931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.565295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:44.574934 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b3a075d-1277-4ea6-a382-664c64faad8f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1476 microversion: 2.1 time: 0.280250 Oct 27 10:13:44.575555 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 777/1541] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:44 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1476 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:44.583463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1338880200", "metadata": {"image_type": "test"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:44.586282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:44.598762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.600566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.601209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.602080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.602684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.603294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.632764 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] HTTP exception thrown: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Request method failure captured: Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b/action HTTP/1.1 Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 112 Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlm9qju9gdQfgnyy7wZxPcSeU_geWChLMPgr9s-mbwzdXr4yu1-WMD3HuGLTfb6L_lGkU1NvYTwlsqUy-gxCcF8tOBF_Xq4mKnRFmGOOxMla2b0p8HQuURQU8odTbntBxAyVTJBfyF6yXrDiha6FlTlpunMB1VpKmU8fAxl-n7B7x0I Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:44.635717 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6480c8676efb4a329d9f70493e89983b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d0567190ddb4d719d7e90216b6a9cea Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1338880200", "metadata": {"image_type": "test"}}} Oct 27 10:13:44.637126 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '7e3389e1-7dee-4c6b-bb0b-7c6715cf154b', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1338880200', 'metadata': {'image_type': 'test'}}}} Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:44.637869 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:44.639035 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:44.642178 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:44.642178 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:44.642178 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:44.642178 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:44.642178 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.647238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Returning 404 to user: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:44.648810 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eae4e1db-1af5-43bc-8c17-d6c4118e652f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "POST /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b/action" status: 404 len: 111 microversion: 2.1 time: 0.069604 Oct 27 10:13:44.650482 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 778/1542] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Oct 27 10:13:44 2022] POST /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:44.666651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fdb2288-941d-4288-a20b-a56b29bdf2a9 tempest-FlavorsV261TestJSON-1381275063 tempest-FlavorsV261TestJSON-1381275063-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:44.701952 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fdb2288-941d-4288-a20b-a56b29bdf2a9 tempest-FlavorsV261TestJSON-1381275063 tempest-FlavorsV261TestJSON-1381275063-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.048701 Oct 27 10:13:44.715262 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 779/1543] 10.222.0.76 () {60 vars in 1187 bytes} [Thu Oct 27 10:13:44 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:44.730081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-dc3a7ff7-9d8a-410e-9e49-f205656fe67d req-f76536b4-f2e9-4bcf-b967-0222666ea15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2259f471-9ce2-4ad1-91a3-6bf122ab46ca", "tag": "1a4efe5d-7145-4c38-99cb-5f5f90f71dcc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:44.743948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dc3a7ff7-9d8a-410e-9e49-f205656fe67d req-f76536b4-f2e9-4bcf-b967-0222666ea15a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.748965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dc3a7ff7-9d8a-410e-9e49-f205656fe67d req-f76536b4-f2e9-4bcf-b967-0222666ea15a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.749965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dc3a7ff7-9d8a-410e-9e49-f205656fe67d req-f76536b4-f2e9-4bcf-b967-0222666ea15a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.766503 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-dc3a7ff7-9d8a-410e-9e49-f205656fe67d req-f76536b4-f2e9-4bcf-b967-0222666ea15a service nova] Creating event network-changed:1a4efe5d-7145-4c38-99cb-5f5f90f71dcc for instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca on n-h2-854663-10 Oct 27 10:13:44.773801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-dc3a7ff7-9d8a-410e-9e49-f205656fe67d req-f76536b4-f2e9-4bcf-b967-0222666ea15a service nova] Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:13:44.786984 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-dc3a7ff7-9d8a-410e-9e49-f205656fe67d req-f76536b4-f2e9-4bcf-b967-0222666ea15a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070009 Oct 27 10:13:44.788418 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 780/1544] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:44.796219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41294031-f4d9-4b8e-a5cc-2938b230b90f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-59597030", "metadata": {"image_type": "test"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:44.806579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41294031-f4d9-4b8e-a5cc-2938b230b90f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Failed to fetch instance by id tempest-invalid-297069947 {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 10:13:44.814040 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-41294031-f4d9-4b8e-a5cc-2938b230b90f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] HTTP exception thrown: Instance tempest-invalid-297069947 could not be found. Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41294031-f4d9-4b8e-a5cc-2938b230b90f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Request method failure captured: Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/tempest-invalid-297069947/action HTTP/1.1 Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 110 Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlm9qju9gdQfgnyy7wZxPcSeU_geWChLMPgr9s-mbwzdXr4yu1-WMD3HuGLTfb6L_lGkU1NvYTwlsqUy-gxCcF8tOBF_Xq4mKnRFmGOOxMla2b0p8HQuURQU8odTbntBxAyVTJBfyF6yXrDiha6FlTlpunMB1VpKmU8fAxl-n7B7x0I Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:44.816188 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6480c8676efb4a329d9f70493e89983b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d0567190ddb4d719d7e90216b6a9cea Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-59597030", "metadata": {"image_type": "test"}}} Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:44.817699 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance tempest-invalid-297069947 could not be found. Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'tempest-invalid-297069947', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-59597030', 'metadata': {'image_type': 'test'}}}} Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-297069947 could not be found. Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:44.818648 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-297069947 could not be found. Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-297069947 could not be found. Oct 27 10:13:44.819974 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:44.825836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41294031-f4d9-4b8e-a5cc-2938b230b90f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Returning 404 to user: Instance tempest-invalid-297069947 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:44.827625 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41294031-f4d9-4b8e-a5cc-2938b230b90f tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "POST /compute/v2.1/servers/tempest-invalid-297069947/action" status: 404 len: 100 microversion: 2.1 time: 0.037675 Oct 27 10:13:44.828849 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 781/1545] 10.222.0.76 () {60 vars in 1246 bytes} [Thu Oct 27 10:13:44 2022] POST /compute/v2.1/servers/tempest-invalid-297069947/action => generated 100 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:44.838425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:44.839614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:44.856228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.857140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.857808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.858823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.859512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.860246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:45.435262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:45.445270 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7e4ce83-c482-49af-91b1-d2c4f177d260 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.614866 Oct 27 10:13:45.445855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 782/1546] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:44 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:45.458972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e762fe63-2f64-44cc-926f-86e1a88a6639 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1049692370"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:45.461746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e762fe63-2f64-44cc-926f-86e1a88a6639 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 10:13:45.462278 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-e762fe63-2f64-44cc-926f-86e1a88a6639 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e762fe63-2f64-44cc-926f-86e1a88a6639 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Request method failure captured: Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 57 Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlm9qju9gdQfgnyy7wZxPcSeU_geWChLMPgr9s-mbwzdXr4yu1-WMD3HuGLTfb6L_lGkU1NvYTwlsqUy-gxCcF8tOBF_Xq4mKnRFmGOOxMla2b0p8HQuURQU8odTbntBxAyVTJBfyF6yXrDiha6FlTlpunMB1VpKmU8fAxl-n7B7x0I Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:45.463969 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6480c8676efb4a329d9f70493e89983b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d0567190ddb4d719d7e90216b6a9cea Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: {"createImage": {"name": "tempest-test-snap-1049692370"}} Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:45.466002 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1049692370'}}} Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:45.466800 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:45.474482 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:45.475845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e762fe63-2f64-44cc-926f-86e1a88a6639 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:45.475845 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e762fe63-2f64-44cc-926f-86e1a88a6639 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010519 Oct 27 10:13:45.475845 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 783/1547] 10.222.0.76 () {60 vars in 1275 bytes} [Thu Oct 27 10:13:45 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:45.480885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:45.481504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:45.500182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:45.500697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:45.501123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:45.501818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:45.502262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:45.502677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:46.092736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:46.116501 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-881cd779-fe74-4e07-a195-5460b737c215 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1680 microversion: 2.1 time: 0.639724 Oct 27 10:13:46.117133 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 784/1548] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:45 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1680 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:46.130199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:46.131177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:46.139425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:46.140248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:46.141031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:46.142295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:46.143090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:46.143741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:47.189194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:47.206359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:47.208192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:47.209729 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a21d9c7-d4a8-4e8c-afc5-072b87bc3549 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 1.083465 Oct 27 10:13:47.210576 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 785/1549] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:46 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:47.215612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9170b5f-61e4-47b2-94b7-d079f3b3f6c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-807414251"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:47.218807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f9170b5f-61e4-47b2-94b7-d079f3b3f6c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 10:13:47.219582 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f9170b5f-61e4-47b2-94b7-d079f3b3f6c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9170b5f-61e4-47b2-94b7-d079f3b3f6c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Request method failure captured: Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 56 Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlm9qju9gdQfgnyy7wZxPcSeU_geWChLMPgr9s-mbwzdXr4yu1-WMD3HuGLTfb6L_lGkU1NvYTwlsqUy-gxCcF8tOBF_Xq4mKnRFmGOOxMla2b0p8HQuURQU8odTbntBxAyVTJBfyF6yXrDiha6FlTlpunMB1VpKmU8fAxl-n7B7x0I Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:47.221988 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6480c8676efb4a329d9f70493e89983b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d0567190ddb4d719d7e90216b6a9cea Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: {"createImage": {"name": "tempest-test-snap-807414251"}} Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:47.223509 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-807414251'}}} Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:47.226316 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 10:13:47.227639 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:47.231883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9170b5f-61e4-47b2-94b7-d079f3b3f6c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:47.233398 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9170b5f-61e4-47b2-94b7-d079f3b3f6c3 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.021324 Oct 27 10:13:47.240836 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 786/1550] 10.222.0.76 () {60 vars in 1281 bytes} [Thu Oct 27 10:13:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:47.249447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:47.250082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:47.259172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:47.260085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:47.261020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:47.262327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:47.263057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:47.263699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:47.305443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:47.874986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:13:47.877166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:13:47.877917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:13:47.878589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:13:47.879162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:13:47.894787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:47.914990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:47.920360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:47.921616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:47.924336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:47.927786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:48.009910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Getting quotas for project cdba716768804fa1b1e939964ccf25cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:48.031565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Getting quotas for user 7dbf1513514a45479dd04815d34889b6 and project cdba716768804fa1b1e939964ccf25cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:48.065977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:13:48.068932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:13:48.143540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:48.149465 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cccdce1d-937f-44fb-b99a-a86249d0544b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.204657 Oct 27 10:13:48.154218 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 765/1551] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:13:48.156892 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6bd7639-776a-4238-bb5a-507c661b3e4b tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1474 microversion: 2.1 time: 0.914319 Oct 27 10:13:48.157466 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 787/1552] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:47 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1474 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:48.169800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:48.170566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:48.181104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:48.187553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:48.188042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:48.188479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:48.188984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:48.189213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:48.190014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:48.190118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:48.222183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:48.223509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:48.224687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:48.225711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:48.226695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:48.228432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:48.695528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ed2e5b74c14b579755e3c5cbe79689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4455cea86546b08fb9a4cce57efedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:48.711309 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b1a3b25-e524-4794-8570-150f60c64f31 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 200 len: 1613 microversion: 2.1 time: 0.532288 Oct 27 10:13:48.713620 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 788/1553] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:48 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 1613 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:48.733716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:48.734219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:48.766519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:48.767004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:48.767444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:48.781717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:48.782460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:48.783059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:48.844332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] HTTP exception thrown: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Request method failure captured: Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b HTTP/1.1 Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlm9qju9gdQfgnyy7wZxPcSeU_geWChLMPgr9s-mbwzdXr4yu1-WMD3HuGLTfb6L_lGkU1NvYTwlsqUy-gxCcF8tOBF_Xq4mKnRFmGOOxMla2b0p8HQuURQU8odTbntBxAyVTJBfyF6yXrDiha6FlTlpunMB1VpKmU8fAxl-n7B7x0I Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:48.846079 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6480c8676efb4a329d9f70493e89983b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d0567190ddb4d719d7e90216b6a9cea Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:48.847436 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '7e3389e1-7dee-4c6b-bb0b-7c6715cf154b'} Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:48.848216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:48.849449 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:48.855537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Returning 404 to user: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:48.855537 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-290b170f-69d5-4af5-86b4-2858032563d1 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 404 len: 111 microversion: 2.1 time: 0.132251 Oct 27 10:13:48.855537 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 789/1554] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:13:48 2022] DELETE /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:48.865382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-572ac4c4-1f6a-4d43-ac1e-fcb5c6defe52 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:48.866014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-572ac4c4-1f6a-4d43-ac1e-fcb5c6defe52 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:49.102184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-572ac4c4-1f6a-4d43-ac1e-fcb5c6defe52 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:49.111508 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-572ac4c4-1f6a-4d43-ac1e-fcb5c6defe52 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1212 microversion: 2.1 time: 0.256640 Oct 27 10:13:49.113976 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 790/1555] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:48 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1212 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:49.125202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:49.128947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:49.145365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:49.146048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:49.148429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:49.149478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:49.151618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:49.152977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:49.241940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:49.252975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-db125f99-2dff-483f-bf75-50936db05732 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 1.097513 Oct 27 10:13:49.258281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 766/1556] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:48 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:49.269281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:49.272165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] [instance: 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:49.287619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:49.288220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:49.292500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:49.293462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:49.294028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:49.294552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:49.342663 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] HTTP exception thrown: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Request method failure captured: Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b HTTP/1.1 Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlm9qju9gdQfgnyy7wZxPcSeU_geWChLMPgr9s-mbwzdXr4yu1-WMD3HuGLTfb6L_lGkU1NvYTwlsqUy-gxCcF8tOBF_Xq4mKnRFmGOOxMla2b0p8HQuURQU8odTbntBxAyVTJBfyF6yXrDiha6FlTlpunMB1VpKmU8fAxl-n7B7x0I Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:13:49.344778 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6480c8676efb4a329d9f70493e89983b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6480c8676efb4a329d9f70493e89983b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 6480c8676efb4a329d9f70493e89983b Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-196567081 Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5d0567190ddb4d719d7e90216b6a9cea Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesNegativeTestJSON-196567081-project Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:49.346093 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '7e3389e1-7dee-4c6b-bb0b-7c6715cf154b'} Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:49.346881 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. Oct 27 10:13:49.348222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:13:49.352388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] Returning 404 to user: Instance 7e3389e1-7dee-4c6b-bb0b-7c6715cf154b could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:49.354731 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-935c8b86-5407-48f5-9a36-39d67e69de74 tempest-ImagesNegativeTestJSON-196567081 tempest-ImagesNegativeTestJSON-196567081-project] 10.222.0.76 "GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b" status: 404 len: 111 microversion: 2.1 time: 0.094987 Oct 27 10:13:49.361670 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 767/1557] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:49 2022] GET /compute/v2.1/servers/7e3389e1-7dee-4c6b-bb0b-7c6715cf154b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:49.655662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:49.666882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:49.676868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:49.678965 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c158b73d-c78b-4f1e-b8b0-1fb386787927 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.561001 Oct 27 10:13:49.712532 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 791/1558] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:49 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:49.723480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1910271192", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "cb698d4f-9293-4505-96fd-2eab544a9110"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:49.731617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:49.732583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:49.755340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:49.760589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:49.761336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:49.762328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:49.763402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:49.764053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:49.850142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] validate_networks() for [('cb698d4f-9293-4505-96fd-2eab544a9110', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:13:50.425147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:50.439918 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-93c78d4e-3222-41df-ba6f-539c1feaa643 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1471 microversion: 2.1 time: 0.725850 Oct 27 10:13:50.444496 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 792/1559] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:49 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1471 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:50.472793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2856f0b7-3a44-4dd4-9076-ca06b29267c1 req-01d04c8a-9041-421a-a528-8a445d4c7aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95558ee4-40e1-4fff-a334-890711c72fe1", "name": "network-vif-deleted", "tag": "d07ac299-6fe3-4076-b485-2752928e0818"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:50.494930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2856f0b7-3a44-4dd4-9076-ca06b29267c1 req-01d04c8a-9041-421a-a528-8a445d4c7aef service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:50.495668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2856f0b7-3a44-4dd4-9076-ca06b29267c1 req-01d04c8a-9041-421a-a528-8a445d4c7aef service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:50.499549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2856f0b7-3a44-4dd4-9076-ca06b29267c1 req-01d04c8a-9041-421a-a528-8a445d4c7aef service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:50.527095 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2856f0b7-3a44-4dd4-9076-ca06b29267c1 req-01d04c8a-9041-421a-a528-8a445d4c7aef service nova] Creating event network-vif-deleted:d07ac299-6fe3-4076-b485-2752928e0818 for instance 95558ee4-40e1-4fff-a334-890711c72fe1 on n-h2-854663-10 Oct 27 10:13:50.548509 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2856f0b7-3a44-4dd4-9076-ca06b29267c1 req-01d04c8a-9041-421a-a528-8a445d4c7aef service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102267 Oct 27 10:13:50.552647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 793/1560] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:50.584527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:50.589815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:50.615367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:50.618417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:50.619221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:50.620273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:50.625203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:50.626735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:50.689655 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] HTTP exception thrown: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Request method failure captured: Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 HTTP/1.1 Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlksB_JDuj2RvgWvqCjGxIxyR6TR4U184FQefuxoqq9V0cI5EZobBN4cH0Rw6FyNIS305mgrQuWcFfTQlJEPmzZFcYaYoyTeho4gH8UDk5jQx3hOevlOevh-TVKeTiDRNOuwo3pjetNDbk0foaS9enZcSGNp7DmyIxOVugeLNHTdi9Y Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 9f4455cea86546b08fb9a4cce57efedb Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1900106182 Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:13:50.707554 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9f4455cea86546b08fb9a4cce57efedb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9f4455cea86546b08fb9a4cce57efedb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9f4455cea86546b08fb9a4cce57efedb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9f4455cea86546b08fb9a4cce57efedb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1900106182 Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 9f4455cea86546b08fb9a4cce57efedb Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1900106182 Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachSCSIVolumeTestJSON-1900106182-project Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 10ed2e5b74c14b579755e3c5cbe79689 Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1900106182-project Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:13:50.709263 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '95558ee4-40e1-4fff-a334-890711c72fe1'} Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:13:50.710165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:13:50.711644 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:13:50.715075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Returning 404 to user: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:13:50.716405 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-357c12de-2d98-432b-b6be-c6a2fa535b6a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 404 len: 111 microversion: 2.1 time: 0.162183 Oct 27 10:13:50.717491 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 794/1561] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:50 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:13:50.723006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:50.724984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:50.738967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:50.739740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:50.740463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:50.742619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:50.746911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:50.746911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:50.945969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:50.970577 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80c12123-b0ec-44c4-b912-c57fb9d68965 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1272 microversion: 2.1 time: 0.251455 Oct 27 10:13:50.980192 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 795/1562] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:50 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:50.987144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:50.988370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:51.006836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.007926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.008519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.010266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.011546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.012134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.239145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:13:51.240225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:13:51.241145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:13:51.241743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:13:51.242329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:13:51.262953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.263781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.265722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.271108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.274751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.275555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.342976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Getting quotas for project c83852e942904ae58e59f9f6b8e0bc16. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:51.355214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Getting quotas for user 7f431586b08d4b139a2e18aeffab9c49 and project c83852e942904ae58e59f9f6b8e0bc16. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:51.383127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:13:51.397121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:13:51.503588 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4d2d69a-deb9-41e3-87aa-42f5ab2e3f7b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140312 Oct 27 10:13:51.504859 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 768/1563] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:13:51.509873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c323868-d5f7-44ea-9902-1fd42a481da2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:51.519868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c323868-d5f7-44ea-9902-1fd42a481da2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:51.530337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c323868-d5f7-44ea-9902-1fd42a481da2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.532814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c323868-d5f7-44ea-9902-1fd42a481da2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.533416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c323868-d5f7-44ea-9902-1fd42a481da2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.543332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c323868-d5f7-44ea-9902-1fd42a481da2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.544072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c323868-d5f7-44ea-9902-1fd42a481da2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.544714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c323868-d5f7-44ea-9902-1fd42a481da2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.632188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:51.658005 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cfebdb03-d389-4824-9943-5c3f37dfd3f3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1719 microversion: 2.1 time: 0.673380 Oct 27 10:13:51.692192 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 796/1564] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:50 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1719 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:51.715539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45604428-2873-4197-95ed-c386f7a4e20a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '.version_select at 0x7f6d639993a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:51.747852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:51.793323 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45604428-2873-4197-95ed-c386f7a4e20a tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-247979697" status: 202 len: 0 microversion: 2.1 time: 0.097363 Oct 27 10:13:51.794073 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 797/1565] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:13:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-247979697 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:51.821375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:51.824548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:51.870026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.873230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.878016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.878936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.879367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.879798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.889761 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c323868-d5f7-44ea-9902-1fd42a481da2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "POST /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca/action" status: 202 len: 0 microversion: 2.1 time: 0.383392 Oct 27 10:13:51.890656 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 769/1566] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:13:51 2022] POST /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:51.912481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54e65958-20ae-4f58-9d6b-66750b729598 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:51.916742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54e65958-20ae-4f58-9d6b-66750b729598 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:53.023293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54e65958-20ae-4f58-9d6b-66750b729598 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:53.031171 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54e65958-20ae-4f58-9d6b-66750b729598 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1224 microversion: 2.1 time: 1.136005 Oct 27 10:13:53.040754 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 770/1567] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:51 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1224 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:53.046177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:53.046880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:53.066775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:53.067443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:53.068625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:53.069599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:53.070250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:53.071536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:53.519082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:53.542871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:53.544542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:53.546020 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69d3e935-1fe4-424f-83f3-b521947d3cf6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 1.746396 Oct 27 10:13:53.566485 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 798/1568] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:51 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:53.582506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:53.583137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:53.593811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:53.596237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:53.597289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:53.598864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:53.609433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:53.609901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:53.920642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:53.930534 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-400376b7-cee1-4e4d-baa0-12139a14b6df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1270 microversion: 2.1 time: 0.362644 Oct 27 10:13:53.933444 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 799/1569] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:53 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1270 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:53.940421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:53.941081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:53.965223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:53.974198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:53.974658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:53.975437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:53.976012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:53.976442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:54.054159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:54.065556 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8fc951a7-0b44-4d6b-b766-887759a159c9 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1470 microversion: 2.1 time: 1.023168 Oct 27 10:13:54.066173 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 771/1570] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:53 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1470 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:54.547307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1aea6a90-113c-4436-96bd-2d0b09b8b720 tempest-InstanceUsageAuditLogTestJSON-196326327 tempest-InstanceUsageAuditLogTestJSON-196326327-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:54.626814 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1aea6a90-113c-4436-96bd-2d0b09b8b720 tempest-InstanceUsageAuditLogTestJSON-196326327 tempest-InstanceUsageAuditLogTestJSON-196326327-project-admin] 10.222.0.76 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27 10:13:52" status: 200 len: 318 microversion: 2.1 time: 0.542908 Oct 27 10:13:54.631215 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 772/1571] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:13:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2010%3A13%3A52 => generated 318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:54.643422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8ba45c8c-cb7f-4353-99bc-f458e9d19b2a req-7010e145-303e-4889-ad1b-fbc2039f774c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2259f471-9ce2-4ad1-91a3-6bf122ab46ca", "name": "network-vif-plugged", "status": "completed", "tag": "1a4efe5d-7145-4c38-99cb-5f5f90f71dcc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:54.661117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8ba45c8c-cb7f-4353-99bc-f458e9d19b2a req-7010e145-303e-4889-ad1b-fbc2039f774c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:54.669297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8ba45c8c-cb7f-4353-99bc-f458e9d19b2a req-7010e145-303e-4889-ad1b-fbc2039f774c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:54.670126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8ba45c8c-cb7f-4353-99bc-f458e9d19b2a req-7010e145-303e-4889-ad1b-fbc2039f774c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:54.720903 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8ba45c8c-cb7f-4353-99bc-f458e9d19b2a req-7010e145-303e-4889-ad1b-fbc2039f774c service nova] Creating event network-vif-plugged:1a4efe5d-7145-4c38-99cb-5f5f90f71dcc for instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca on n-h2-854663-10 Oct 27 10:13:54.738988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-8ba45c8c-cb7f-4353-99bc-f458e9d19b2a req-7010e145-303e-4889-ad1b-fbc2039f774c service nova] Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:13:54.769318 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8ba45c8c-cb7f-4353-99bc-f458e9d19b2a req-7010e145-303e-4889-ad1b-fbc2039f774c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136211 Oct 27 10:13:54.780552 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 773/1572] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:54.797663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:54.805366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:54.824154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:54.824653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:54.825119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:54.825834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:54.826287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:54.826713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:55.074976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:55.089160 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c211e46b-26e2-461c-8aac-732dc37c557e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1709 microversion: 2.1 time: 1.154356 Oct 27 10:13:55.089854 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 800/1573] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:53 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1709 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:55.095975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:55.105464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:55.120569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:55.121119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:55.121557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:55.122277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:55.122730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:55.123153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:55.425311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:55.445449 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b106b741-1657-4c70-8a8d-32084a3649e4 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1276 microversion: 2.1 time: 0.663504 Oct 27 10:13:55.457499 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 774/1574] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:54 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1276 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:55.476865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd1cf100-b83e-4141-b0c5-b42a3e4fdd28 tempest-InstanceUsageAuditLogTestJSON-196326327 tempest-InstanceUsageAuditLogTestJSON-196326327-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:55.507530 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd1cf100-b83e-4141-b0c5-b42a3e4fdd28 tempest-InstanceUsageAuditLogTestJSON-196326327 tempest-InstanceUsageAuditLogTestJSON-196326327-project-admin] 10.222.0.76 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.048473 Oct 27 10:13:55.508145 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 775/1575] 10.222.0.76 () {58 vars in 1185 bytes} [Thu Oct 27 10:13:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:55.546847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:55.547529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:55.580865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:55.581327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:55.581784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:55.586397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:55.586898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:55.590166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:56.220432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:56.235818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:56.237445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:56.238701 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6862909f-9890-4218-836e-1e1a4ec2c16e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 1.146527 Oct 27 10:13:56.239284 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 801/1576] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:55 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:56.272021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:56.272964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:56.308741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:56.309448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:56.310973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:56.313490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:56.317332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:56.318216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:56.462005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:56.473233 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-03b833df-4188-4ae9-82e4-84dfec670861 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1312 microversion: 2.1 time: 0.963906 Oct 27 10:13:56.479342 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 776/1577] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:55 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1312 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:56.487679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5bf43de4-22be-49cb-9b85-f1cf3afc29f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '.version_select at 0x7f6d6380fdc0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:56.491744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bf43de4-22be-49cb-9b85-f1cf3afc29f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:56.495181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bf43de4-22be-49cb-9b85-f1cf3afc29f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:56.495943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bf43de4-22be-49cb-9b85-f1cf3afc29f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:56.523972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5bf43de4-22be-49cb-9b85-f1cf3afc29f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 3920 microversion: 2.1 time: 0.042773 Oct 27 10:13:56.525958 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 777/1578] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:13:56 2022] GET /compute/v2.1/os-migrations => generated 3920 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:56.532553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:56.534741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:56.545511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:56.551992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:56.552893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:56.553906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:56.554955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:56.555637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:56.790744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:56.804012 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1aed4d4a-cea7-4120-974f-9561665f8577 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1282 microversion: 2.1 time: 0.276146 Oct 27 10:13:56.805719 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 778/1579] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:56 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1282 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:56.812733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01d57d9f-4721-448a-a2c0-54c24040efe4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:56.814436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-01d57d9f-4721-448a-a2c0-54c24040efe4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:56.822939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01d57d9f-4721-448a-a2c0-54c24040efe4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:56.824031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01d57d9f-4721-448a-a2c0-54c24040efe4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:56.824800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01d57d9f-4721-448a-a2c0-54c24040efe4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:56.826107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01d57d9f-4721-448a-a2c0-54c24040efe4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:56.826808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01d57d9f-4721-448a-a2c0-54c24040efe4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:56.827709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01d57d9f-4721-448a-a2c0-54c24040efe4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:57.270474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:57.323088 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d43b5dd-8b75-4b3a-a22b-378f7c5e686f tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1470 microversion: 2.1 time: 1.059202 Oct 27 10:13:57.343845 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 802/1580] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:56 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1470 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:57.361757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:57.362381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:57.370895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:57.371878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:57.372857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:57.374617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:57.375761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:57.376802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:57.652479 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01d57d9f-4721-448a-a2c0-54c24040efe4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1862 microversion: 2.1 time: 0.842125 Oct 27 10:13:57.653818 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 779/1581] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:56 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1862 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:57.663386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:57.664065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:57.683466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:57.683959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:57.684398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:57.689170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:57.689660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:57.698877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:57.887090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:57.910276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:57.913285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:57.919250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5cb1adc8-39e7-471e-920c-30ded54b8d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.574165 Oct 27 10:13:57.920896 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 803/1582] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:57 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:57.951336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7720d290-b5a3-47a2-b932-2bc06266c8d4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:57.952345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7720d290-b5a3-47a2-b932-2bc06266c8d4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:57.959963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7720d290-b5a3-47a2-b932-2bc06266c8d4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:57.960685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7720d290-b5a3-47a2-b932-2bc06266c8d4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:57.961343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7720d290-b5a3-47a2-b932-2bc06266c8d4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:57.963784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7720d290-b5a3-47a2-b932-2bc06266c8d4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:57.964265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7720d290-b5a3-47a2-b932-2bc06266c8d4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:57.964808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7720d290-b5a3-47a2-b932-2bc06266c8d4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:58.020401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:58.031316 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6312c41c-270b-4262-8091-d077003f8cbe tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1312 microversion: 2.1 time: 0.374085 Oct 27 10:13:58.033428 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 780/1583] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:57 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1312 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:58.040195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:58.045953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:58.058065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:58.059319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:58.059905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:58.061153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:58.061790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:58.062345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:58.316936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:58.339318 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a6447c0-a12b-4517-ac60-0a980be6f410 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1282 microversion: 2.1 time: 0.302855 Oct 27 10:13:58.339960 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 781/1584] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:58 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1282 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:58.359318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:58.360347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:58.371245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:58.371866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:58.374393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:58.376617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:58.377593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:58.378225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:58.598377 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7720d290-b5a3-47a2-b932-2bc06266c8d4 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1862 microversion: 2.1 time: 0.671495 Oct 27 10:13:58.600793 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 804/1585] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:57 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1862 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:58.787188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:58.787961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:58.807140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:58.809303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:58.809874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:58.817702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:58.822952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:58.823757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:59.107699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:59.149474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lazy-loading 'services' on Instance uuid db810b22-71e9-4b8c-bbaf-59b8443d408b {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:13:59.319142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:59.338987 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c939c8ea-325d-4928-a8b2-b6f201b3fa9c tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1470 microversion: 2.1 time: 0.990474 Oct 27 10:13:59.357212 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 782/1586] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:58 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1470 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:59.366543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:59.367523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:59.375846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:59.376896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:59.377528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:59.378483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:59.379197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:59.379938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:59.450528 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9b5ed46-6900-4156-8a7a-ff45ef3de6d3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "DELETE /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments/28817a79-4f88-4b77-8e50-b6a6ec91c221" status: 202 len: 0 microversion: 2.1 time: 0.667376 Oct 27 10:13:59.451917 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 805/1587] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:13:58 2022] DELETE /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments/28817a79-4f88-4b77-8e50-b6a6ec91c221 => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:13:59.473471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:59.474698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:59.492364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:59.493449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:59.494296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:59.514200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:59.515719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:59.517440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:59.899041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:59.914926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:59.917326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:59.918841 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d333f712-f007-4ad3-8135-d5d18a746220 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.561947 Oct 27 10:13:59.933569 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 783/1588] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:13:59 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:13:59.945304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:59.945920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:59.979521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:59.980169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:59.981374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:59.982362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:59.983275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:59.984757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:00.086033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:00.095822 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7159b2a-9f99-4446-8ad4-47fdeadff04f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1333 microversion: 2.1 time: 0.641575 Oct 27 10:14:00.102176 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 806/1589] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:59 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1333 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:00.115517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66dfc3a1-1d97-4d64-aabb-147baf8e9990 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:00.118092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66dfc3a1-1d97-4d64-aabb-147baf8e9990 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:00.125771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dfc3a1-1d97-4d64-aabb-147baf8e9990 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:00.126253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dfc3a1-1d97-4d64-aabb-147baf8e9990 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:00.126952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dfc3a1-1d97-4d64-aabb-147baf8e9990 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:00.127719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dfc3a1-1d97-4d64-aabb-147baf8e9990 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:00.128241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dfc3a1-1d97-4d64-aabb-147baf8e9990 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:00.137148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dfc3a1-1d97-4d64-aabb-147baf8e9990 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:00.161909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:00.197144 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66dfc3a1-1d97-4d64-aabb-147baf8e9990 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093347 Oct 27 10:14:00.198064 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 807/1590] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:00 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:00.278346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7bb043a5-d4c5-474d-8589-5c47f3afb2c5 req-38185c84-177d-4efd-a5ad-9863f676cca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a303ce6-db7c-42ad-b551-24e839f1ac67", "tag": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:00.302382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7bb043a5-d4c5-474d-8589-5c47f3afb2c5 req-38185c84-177d-4efd-a5ad-9863f676cca9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:00.304450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7bb043a5-d4c5-474d-8589-5c47f3afb2c5 req-38185c84-177d-4efd-a5ad-9863f676cca9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:00.304922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7bb043a5-d4c5-474d-8589-5c47f3afb2c5 req-38185c84-177d-4efd-a5ad-9863f676cca9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:00.339212 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7bb043a5-d4c5-474d-8589-5c47f3afb2c5 req-38185c84-177d-4efd-a5ad-9863f676cca9 service nova] Creating event network-changed:5db2ef4f-d5fd-4da1-92f9-6150e66be6d2 for instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 on n-h2-854663-10 Oct 27 10:14:00.348407 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7bb043a5-d4c5-474d-8589-5c47f3afb2c5 req-38185c84-177d-4efd-a5ad-9863f676cca9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074652 Oct 27 10:14:00.355219 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 808/1591] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:00.370827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:00.371691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:00.388341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:00.388920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:00.389350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:00.390076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:00.390535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:00.391057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:00.584715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:00.603947 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-90be3614-eed2-4675-aa87-c3c75ed7f84d tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1324 microversion: 2.1 time: 0.667205 Oct 27 10:14:00.627376 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 784/1592] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:59 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1324 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:00.912051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:00.926974 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f6cda15-e5d6-4abb-a295-377bb7918b71 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1470 microversion: 2.1 time: 0.563091 Oct 27 10:14:00.944823 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 809/1593] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:00 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1470 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:00.950484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:00.951098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:00.968421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:00.969498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:00.969944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:00.971451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:00.977848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:00.978632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.127931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:01.129710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:01.143165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.149830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.153892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.154666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.155134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.155555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.305903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:01.528080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:01.538778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:01.545865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:01.550198 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f17f5aa7-1ba8-4829-b072-6e0ee5ee60ff tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.605034 Oct 27 10:14:01.551158 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 785/1594] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:00 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:01.561348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a5dd947-2e1b-471e-97e3-0ab1db3aaa90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:01.569700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a5dd947-2e1b-471e-97e3-0ab1db3aaa90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:01.590370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a5dd947-2e1b-471e-97e3-0ab1db3aaa90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.591734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a5dd947-2e1b-471e-97e3-0ab1db3aaa90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.592396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a5dd947-2e1b-471e-97e3-0ab1db3aaa90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.593361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a5dd947-2e1b-471e-97e3-0ab1db3aaa90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.594136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a5dd947-2e1b-471e-97e3-0ab1db3aaa90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.594761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a5dd947-2e1b-471e-97e3-0ab1db3aaa90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.652005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:01.665649 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b216bab-9f28-42d6-8cd7-2cc10c848734 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1333 microversion: 2.1 time: 0.541096 Oct 27 10:14:01.669037 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 810/1595] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:01 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1333 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:01.683518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:01.684455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:01.694898 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a5dd947-2e1b-471e-97e3-0ab1db3aaa90 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136176 Oct 27 10:14:01.695896 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 786/1596] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:01 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:01.708836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.711008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.712198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.714514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.715228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.717902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.953069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:01.954024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:01.964686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.966375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.967033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.969468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.973975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.974699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:02.078503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:02.088084 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28df318f-cbe0-4883-859c-2a185cc59b93 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1324 microversion: 2.1 time: 0.416419 Oct 27 10:14:02.102207 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 811/1597] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:01 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1324 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:02.407253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a3ca1ab3-59cf-43cc-b8f4-ac8633bc5de7 req-370ed628-5485-4ce1-a9ec-401e48678378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2259f471-9ce2-4ad1-91a3-6bf122ab46ca", "name": "network-vif-unplugged", "status": "completed", "tag": "1a4efe5d-7145-4c38-99cb-5f5f90f71dcc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:02.427346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a3ca1ab3-59cf-43cc-b8f4-ac8633bc5de7 req-370ed628-5485-4ce1-a9ec-401e48678378 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:02.430592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a3ca1ab3-59cf-43cc-b8f4-ac8633bc5de7 req-370ed628-5485-4ce1-a9ec-401e48678378 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:02.432225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a3ca1ab3-59cf-43cc-b8f4-ac8633bc5de7 req-370ed628-5485-4ce1-a9ec-401e48678378 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:02.473846 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a3ca1ab3-59cf-43cc-b8f4-ac8633bc5de7 req-370ed628-5485-4ce1-a9ec-401e48678378 service nova] Creating event network-vif-unplugged:1a4efe5d-7145-4c38-99cb-5f5f90f71dcc for instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca on n-h1-854663-10 Oct 27 10:14:02.483684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-a3ca1ab3-59cf-43cc-b8f4-ac8633bc5de7 req-370ed628-5485-4ce1-a9ec-401e48678378 service nova] Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:14:02.501269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a3ca1ab3-59cf-43cc-b8f4-ac8633bc5de7 req-370ed628-5485-4ce1-a9ec-401e48678378 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096411 Oct 27 10:14:02.503145 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 812/1598] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:14:02.581133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:02.582034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:02.597620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:02.600422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:02.601534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:02.605782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:02.607205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:02.609086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:02.623066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:02.630926 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e2ef754-a435-43a6-a15d-fd3078af26fa tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1470 microversion: 2.1 time: 0.682299 Oct 27 10:14:02.640823 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 787/1599] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:01 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1470 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:02.691945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:02.692895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:02.703247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:02.703743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:02.704183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:02.710628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:02.711167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:02.711620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.142385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:03.152626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:03.163141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:03.164392 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24530b15-3946-4f2e-b441-8761b72c6a4d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.590396 Oct 27 10:14:03.165022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 813/1600] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:02 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:14:03.179152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-977200c3-a832-4979-9548-579574fba8b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:03.179152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-977200c3-a832-4979-9548-579574fba8b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:03.197662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:03.204061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:03.206367 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cbb507b5-13b8-4a2b-9153-986b93dbb2fd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.519083 Oct 27 10:14:03.206958 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 788/1601] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:02 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:03.218667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-977200c3-a832-4979-9548-579574fba8b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.219173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-977200c3-a832-4979-9548-579574fba8b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.219611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-977200c3-a832-4979-9548-579574fba8b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.220338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-977200c3-a832-4979-9548-579574fba8b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.228224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-977200c3-a832-4979-9548-579574fba8b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.228934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-977200c3-a832-4979-9548-579574fba8b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.241016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:03.241963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:03.269100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.269706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.270162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.271316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.271776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.272200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.314159 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-977200c3-a832-4979-9548-579574fba8b5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147111 Oct 27 10:14:03.314752 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 814/1602] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:03 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:03.662144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:03.663054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:03.680494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.681223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.681908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.693340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.693845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.694283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.839260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:03.851838 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-33282c30-d29d-49ab-b2b8-413dd616b18a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1324 microversion: 2.1 time: 0.624875 Oct 27 10:14:03.854462 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 789/1603] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:03 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1324 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:03.870342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2badb769-95c5-4099-8855-d9c4af433cac req-d2a718a1-5e86-4a44-aed0-72ffaa7e4a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e93913f7-7e3d-4d26-89df-544623f1e443", "tag": "d0236827-a847-4110-82c7-f970195cba36"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:03.920610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2badb769-95c5-4099-8855-d9c4af433cac req-d2a718a1-5e86-4a44-aed0-72ffaa7e4a68 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.922642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2badb769-95c5-4099-8855-d9c4af433cac req-d2a718a1-5e86-4a44-aed0-72ffaa7e4a68 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.923197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2badb769-95c5-4099-8855-d9c4af433cac req-d2a718a1-5e86-4a44-aed0-72ffaa7e4a68 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.952847 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2badb769-95c5-4099-8855-d9c4af433cac req-d2a718a1-5e86-4a44-aed0-72ffaa7e4a68 service nova] Creating event network-changed:d0236827-a847-4110-82c7-f970195cba36 for instance e93913f7-7e3d-4d26-89df-544623f1e443 on n-h1-854663-10 Oct 27 10:14:03.973100 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2badb769-95c5-4099-8855-d9c4af433cac req-d2a718a1-5e86-4a44-aed0-72ffaa7e4a68 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114401 Oct 27 10:14:03.974715 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 790/1604] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:04.360622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1beab8bb-22de-4461-a52f-2e575ba9b634 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Action: 'create', calling method: .version_select at 0x7f6d63773ca0>, body: {"keypair": {"name": "tempest-keypair-1484643440", "type": "ssh", "user_id": "6169298189674c4ca3a98cdcf0d6176c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHozDkBXNCR5fdLzGIVhwDlFfejwP4ic9apTuLSMUF9ktSv1j/6hhaF0wqI2vN7hnIZOr70Y+zlptTMYEf5zS0AXLqOOr5xiPvDFWNMAoe3x3Xk+2eXJ78e0X7TT7ZJm0w=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:04.380466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:04.403717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-1beab8bb-22de-4461-a52f-2e575ba9b634 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Getting quotas for project 553c5863c06241398dcf7a86bb517836. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:04.419870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-1beab8bb-22de-4461-a52f-2e575ba9b634 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Getting quotas for user 24723d1e8e4448f8ad0caa4337a40878 and project 553c5863c06241398dcf7a86bb517836. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:04.479461 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1beab8bb-22de-4461-a52f-2e575ba9b634 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.502656 Oct 27 10:14:04.480840 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 791/1605] 10.222.0.76 () {62 vars in 1200 bytes} [Thu Oct 27 10:14:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 505 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 10:14:04.490942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:04.492227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:04.500504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.501267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.501852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.502858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.503438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.503957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.801335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:04.827042 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-348f3cfc-377b-4d80-9208-75b4a1a9e91a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1470 microversion: 2.1 time: 1.173967 Oct 27 10:14:04.841337 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 815/1606] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:03 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1470 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:04.849628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:04.850539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:04.857878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.859461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.860073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.861138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.861939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.862615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.074333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:05.091749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:05.097977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:05.099992 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6cd66f9-e648-45f4-918b-f537d0b8eec8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.617318 Oct 27 10:14:05.100922 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 792/1607] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:04 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:05.114109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec9cc868-4960-407c-820b-c7fda91843f7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:05.121214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec9cc868-4960-407c-820b-c7fda91843f7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:05.138367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec9cc868-4960-407c-820b-c7fda91843f7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:05.155073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec9cc868-4960-407c-820b-c7fda91843f7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:05.155841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec9cc868-4960-407c-820b-c7fda91843f7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.159662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec9cc868-4960-407c-820b-c7fda91843f7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:05.160316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec9cc868-4960-407c-820b-c7fda91843f7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:05.169603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec9cc868-4960-407c-820b-c7fda91843f7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.270621 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec9cc868-4960-407c-820b-c7fda91843f7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165125 Oct 27 10:14:05.271698 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 793/1608] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:05 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:05.282570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2762baa0-fa9a-4b1f-9de2-c46c755114f6 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Action: 'create', calling method: .version_select at 0x7f6d637ad430>, body: {"keypair": {"name": "tempest-keypair-2061753025", "type": "ssh", "user_id": "6169298189674c4ca3a98cdcf0d6176c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuoboj7UAB42jP+EIN8IQM/z1eK58jVbS50pP1w+RyEFrbVCy30KGyPYNhbVcfy/O8yPQ8XfHMcyeld9Xe4xRak0eEmOoKh45e6yyfNyHuWqJJEK2H3JUMob4zT37U7dg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:05.307852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-2762baa0-fa9a-4b1f-9de2-c46c755114f6 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Getting quotas for project 553c5863c06241398dcf7a86bb517836. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:05.313216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-2762baa0-fa9a-4b1f-9de2-c46c755114f6 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Getting quotas for user 24723d1e8e4448f8ad0caa4337a40878 and project 553c5863c06241398dcf7a86bb517836. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:05.340996 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2762baa0-fa9a-4b1f-9de2-c46c755114f6 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.067877 Oct 27 10:14:05.341814 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 794/1609] 10.222.0.76 () {62 vars in 1200 bytes} [Thu Oct 27 10:14:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 10:14:05.347267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b83e88b8-4ca4-4ffb-b8d0-bf54a599ae77 req-9f788c93-091a-41c6-91e1-4fbe67999001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2259f471-9ce2-4ad1-91a3-6bf122ab46ca", "tag": "1a4efe5d-7145-4c38-99cb-5f5f90f71dcc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:05.358186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:05.358836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b83e88b8-4ca4-4ffb-b8d0-bf54a599ae77 req-9f788c93-091a-41c6-91e1-4fbe67999001 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:05.359473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b83e88b8-4ca4-4ffb-b8d0-bf54a599ae77 req-9f788c93-091a-41c6-91e1-4fbe67999001 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:05.360000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b83e88b8-4ca4-4ffb-b8d0-bf54a599ae77 req-9f788c93-091a-41c6-91e1-4fbe67999001 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.374523 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b83e88b8-4ca4-4ffb-b8d0-bf54a599ae77 req-9f788c93-091a-41c6-91e1-4fbe67999001 service nova] Creating event network-changed:1a4efe5d-7145-4c38-99cb-5f5f90f71dcc for instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca on n-h1-854663-10 Oct 27 10:14:05.375244 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59f8d526-ce4c-4858-963e-16c16f834f42 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.532133 Oct 27 10:14:05.376166 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 816/1610] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:04 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:05.381498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-b83e88b8-4ca4-4ffb-b8d0-bf54a599ae77 req-9f788c93-091a-41c6-91e1-4fbe67999001 service nova] Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:14:05.392619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:05.393537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:05.394199 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b83e88b8-4ca4-4ffb-b8d0-bf54a599ae77 req-9f788c93-091a-41c6-91e1-4fbe67999001 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050820 Oct 27 10:14:05.407262 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 795/1611] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:05.407656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:05.408332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:05.414258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.415622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:05.416324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:05.417018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.423583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-36ff7be1-8698-4d0e-936e-763cca46fe15 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Calling method '.version_select at 0x7f6d5ad678b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:05.448333 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-36ff7be1-8698-4d0e-936e-763cca46fe15 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] 10.222.0.76 "GET /compute/v2.1/os-keypairs/tempest-keypair-1484643440?user_id=6169298189674c4ca3a98cdcf0d6176c" status: 200 len: 513 microversion: 2.10 time: 0.039464 Oct 27 10:14:05.450697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 796/1612] 10.222.0.76 () {60 vars in 1340 bytes} [Thu Oct 27 10:14:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1484643440?user_id=6169298189674c4ca3a98cdcf0d6176c => generated 513 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:05.464728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89745dd9-a116-4f66-bc00-ba666c0c2d20 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Action: 'create', calling method: .version_select at 0x7f6d6380f940>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-633055072", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT7nKq2IB+myUp3wYfiwEQ90XcHnMItwbFVmo5kqJmFcavjXNBB5rF/dFGr9EyGi4STQI0iCGOUYYNKlTmXouWSSJGZ/gAmcQZLgCFmzuFEp8UNpAKBh6Ro1pgESAly5A=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:05.492829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-89745dd9-a116-4f66-bc00-ba666c0c2d20 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Getting quotas for project 553c5863c06241398dcf7a86bb517836. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:05.503718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-89745dd9-a116-4f66-bc00-ba666c0c2d20 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Getting quotas for user 24723d1e8e4448f8ad0caa4337a40878 and project 553c5863c06241398dcf7a86bb517836. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:05.558155 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-89745dd9-a116-4f66-bc00-ba666c0c2d20 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.097034 Oct 27 10:14:05.559362 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 797/1613] 10.222.0.76 () {62 vars in 1200 bytes} [Thu Oct 27 10:14:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 27 10:14:05.570536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16f6bb1b-a972-4836-b8ed-9a0fcf829347 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Calling method '.version_select at 0x7f6d5b2c73a0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:05.575102 n-d-854663-10 devstack@n-api.service[120719]: WARNING oslo_db.sqlalchemy.utils [None req-16f6bb1b-a972-4836-b8ed-9a0fcf829347 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 10:14:05.583900 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16f6bb1b-a972-4836-b8ed-9a0fcf829347 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] 10.222.0.76 "GET /compute/v2.1/os-keypairs?user_id=6169298189674c4ca3a98cdcf0d6176c" status: 200 len: 726 microversion: 2.10 time: 0.017569 Oct 27 10:14:05.585058 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 798/1614] 10.222.0.76 () {60 vars in 1259 bytes} [Thu Oct 27 10:14:05 2022] GET /compute/v2.1/os-keypairs?user_id=6169298189674c4ca3a98cdcf0d6176c => generated 726 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:14:05.601545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0568436f-256e-413c-b699-3830f246ed61 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Calling method '.version_select at 0x7f6d637af820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:05.624956 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0568436f-256e-413c-b699-3830f246ed61 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-633055072" status: 204 len: 0 microversion: 2.10 time: 0.027227 Oct 27 10:14:05.626490 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 799/1615] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 27 10:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-633055072 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:14:05.652087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8778391d-0c28-4ff8-a24e-e7e03eb23640 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Calling method '.version_select at 0x7f6d6373e3a0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:05.703483 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8778391d-0c28-4ff8-a24e-e7e03eb23640 tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061753025?user_id=6169298189674c4ca3a98cdcf0d6176c" status: 204 len: 0 microversion: 2.10 time: 0.071447 Oct 27 10:14:05.704186 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 800/1616] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061753025?user_id=6169298189674c4ca3a98cdcf0d6176c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:14:05.714843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9cb3c4e1-3b70-48b0-bc5e-9427b6a3f15c tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] Calling method '.version_select at 0x7f6d6375e310>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:05.744180 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9cb3c4e1-3b70-48b0-bc5e-9427b6a3f15c tempest-KeyPairsV210TestJSON-4129958 tempest-KeyPairsV210TestJSON-4129958-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484643440?user_id=6169298189674c4ca3a98cdcf0d6176c" status: 204 len: 0 microversion: 2.10 time: 0.034449 Oct 27 10:14:05.744832 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 801/1617] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484643440?user_id=6169298189674c4ca3a98cdcf0d6176c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:14:05.854843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:05.855762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:05.863527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:05.864013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:05.864448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.865349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:05.865630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:05.866109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.881472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:05.896317 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7af7b96-bc46-481c-91e8-b311776efec9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1324 microversion: 2.1 time: 0.513446 Oct 27 10:14:05.911870 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 817/1618] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:05 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1324 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:06.130274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:06.131258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:06.149674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.150489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.151156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.153458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.154509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.155238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.218572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:06.237404 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-180cbc1f-a229-49c0-bf40-907c511aed05 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1470 microversion: 2.1 time: 0.387247 Oct 27 10:14:06.259194 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 802/1619] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:05 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1470 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:06.264947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-12f2b000-22c4-47f7-8603-2e661bc39249 req-44fcf86a-c10c-4ab6-a2a6-16b9f9f551be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e93913f7-7e3d-4d26-89df-544623f1e443", "tag": "c07b81f9-3b8a-41e6-a354-797ac9a9f706"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:06.296799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12f2b000-22c4-47f7-8603-2e661bc39249 req-44fcf86a-c10c-4ab6-a2a6-16b9f9f551be service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.297277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12f2b000-22c4-47f7-8603-2e661bc39249 req-44fcf86a-c10c-4ab6-a2a6-16b9f9f551be service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.297698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12f2b000-22c4-47f7-8603-2e661bc39249 req-44fcf86a-c10c-4ab6-a2a6-16b9f9f551be service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.341349 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-12f2b000-22c4-47f7-8603-2e661bc39249 req-44fcf86a-c10c-4ab6-a2a6-16b9f9f551be service nova] Creating event network-changed:c07b81f9-3b8a-41e6-a354-797ac9a9f706 for instance e93913f7-7e3d-4d26-89df-544623f1e443 on n-h1-854663-10 Oct 27 10:14:06.348651 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-12f2b000-22c4-47f7-8603-2e661bc39249 req-44fcf86a-c10c-4ab6-a2a6-16b9f9f551be service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086748 Oct 27 10:14:06.350442 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 803/1620] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:06.357656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7dacf843-c20c-4261-95a4-527daea3244e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:06.361809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7dacf843-c20c-4261-95a4-527daea3244e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:06.372498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dacf843-c20c-4261-95a4-527daea3244e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.373173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dacf843-c20c-4261-95a4-527daea3244e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.373783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dacf843-c20c-4261-95a4-527daea3244e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.374667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dacf843-c20c-4261-95a4-527daea3244e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.375289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dacf843-c20c-4261-95a4-527daea3244e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.375893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dacf843-c20c-4261-95a4-527daea3244e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.462476 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7dacf843-c20c-4261-95a4-527daea3244e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109599 Oct 27 10:14:06.469107 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 804/1621] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:06 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:06.483923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:06.485851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:06.502135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.503878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.506328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.508860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.510371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.512232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.803380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:06.822825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:06.824623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:06.826198 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f5695a4-8be2-408d-8308-a0ccbde0a62b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.699503 Oct 27 10:14:06.826769 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 818/1622] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:06 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:06.849747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a329d4a6-1611-405e-ada6-8bd3f3691634 req-900bc692-2285-4946-9ddf-79f13f31eb4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a303ce6-db7c-42ad-b551-24e839f1ac67", "name": "network-vif-plugged", "status": "completed", "tag": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:06.861437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a329d4a6-1611-405e-ada6-8bd3f3691634 req-900bc692-2285-4946-9ddf-79f13f31eb4d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.862336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a329d4a6-1611-405e-ada6-8bd3f3691634 req-900bc692-2285-4946-9ddf-79f13f31eb4d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.862917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a329d4a6-1611-405e-ada6-8bd3f3691634 req-900bc692-2285-4946-9ddf-79f13f31eb4d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.876397 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a329d4a6-1611-405e-ada6-8bd3f3691634 req-900bc692-2285-4946-9ddf-79f13f31eb4d service nova] Creating event network-vif-plugged:5db2ef4f-d5fd-4da1-92f9-6150e66be6d2 for instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 on n-h2-854663-10 Oct 27 10:14:06.883703 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a329d4a6-1611-405e-ada6-8bd3f3691634 req-900bc692-2285-4946-9ddf-79f13f31eb4d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040840 Oct 27 10:14:06.888111 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 819/1623] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:06.920947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:06.922095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:06.930678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.932457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.933191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.934199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.935339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.936019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:07.131512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:07.152826 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e87ba0d1-6c81-4000-8bbe-c1b2ca0dcd95 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.680809 Oct 27 10:14:07.154136 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 805/1624] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:06 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:07.275436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:07.276144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:07.283856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:07.284350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:07.285900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:07.286788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:07.287256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:07.287709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:07.316036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:07.325909 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5be69a15-6215-4452-8ba8-814d6ddcbaea tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1324 microversion: 2.1 time: 0.409832 Oct 27 10:14:07.329513 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 820/1625] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:06 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:07.481082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a31b41ba-7b26-47ad-a2a2-0d9a18a0bf13 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:07.483262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a31b41ba-7b26-47ad-a2a2-0d9a18a0bf13 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:07.490505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31b41ba-7b26-47ad-a2a2-0d9a18a0bf13 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:07.491216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31b41ba-7b26-47ad-a2a2-0d9a18a0bf13 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:07.491808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31b41ba-7b26-47ad-a2a2-0d9a18a0bf13 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:07.492684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31b41ba-7b26-47ad-a2a2-0d9a18a0bf13 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:07.493322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31b41ba-7b26-47ad-a2a2-0d9a18a0bf13 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:07.493898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31b41ba-7b26-47ad-a2a2-0d9a18a0bf13 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:07.531965 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a31b41ba-7b26-47ad-a2a2-0d9a18a0bf13 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057718 Oct 27 10:14:07.534385 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 821/1626] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:07 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:07.652252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:07.665414 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3aa2b7e1-2c92-4324-a495-00ce90a72b32 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1463 microversion: 2.1 time: 0.396192 Oct 27 10:14:07.677240 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 806/1627] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:07 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1463 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:07.856973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:07.858438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:07.865009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:07.865226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:07.865602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:07.866312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:07.874180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:07.874649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:08.061211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e142f281-3321-42aa-b58f-ed951179277f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:08.061917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e142f281-3321-42aa-b58f-ed951179277f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:08.072909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e142f281-3321-42aa-b58f-ed951179277f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:08.074795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e142f281-3321-42aa-b58f-ed951179277f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:08.077196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e142f281-3321-42aa-b58f-ed951179277f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:08.078869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e142f281-3321-42aa-b58f-ed951179277f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:08.081412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e142f281-3321-42aa-b58f-ed951179277f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:08.082106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e142f281-3321-42aa-b58f-ed951179277f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:08.420854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:08.438152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:08.440860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:08.442797 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b663fea6-3a8d-458d-a581-90e0bcccbe93 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.590792 Oct 27 10:14:08.444474 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 807/1628] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:07 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:08.451006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:08.451870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:08.474734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:08.475486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:08.476106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:08.477137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:08.477912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:08.478515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:08.577553 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e142f281-3321-42aa-b58f-ed951179277f tempest-MigrationsAdminTest-739870457 tempest-MigrationsAdminTest-739870457-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1616 microversion: 2.1 time: 0.889278 Oct 27 10:14:08.596213 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 822/1629] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:07 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1616 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:08.613817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:08.614494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:08.635380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:08.635788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:08.646729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:08.647556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:08.648051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:08.648476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.037529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:09.053838 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b67979a-159a-46e3-af42-164654c43826 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1520 microversion: 2.1 time: 0.467776 Oct 27 10:14:09.055467 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 823/1630] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:08 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1520 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:09.065414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e10f67e-8586-46e6-afb0-d1d2f54794eb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:09.069264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e10f67e-8586-46e6-afb0-d1d2f54794eb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:09.092024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e10f67e-8586-46e6-afb0-d1d2f54794eb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.092901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e10f67e-8586-46e6-afb0-d1d2f54794eb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.093909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e10f67e-8586-46e6-afb0-d1d2f54794eb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.094846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e10f67e-8586-46e6-afb0-d1d2f54794eb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.095453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e10f67e-8586-46e6-afb0-d1d2f54794eb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.096227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e10f67e-8586-46e6-afb0-d1d2f54794eb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.143440 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e10f67e-8586-46e6-afb0-d1d2f54794eb tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085114 Oct 27 10:14:09.150719 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 824/1631] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:09 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:09.156501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:09.157271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:09.163393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=96 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:09.169498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.170384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.170992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.171868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.172473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.173094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.214490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:14:09.221249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:09.293162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:09.309744 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54cebaa1-c20f-43dc-966c-3c3a119bafe9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.863951 Oct 27 10:14:09.312030 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 808/1632] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:08 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:09.323049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b4682afe-9faa-4d03-8a0c-0c85d667625f req-8730cd78-1698-4623-83bc-0acc510b8cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e93913f7-7e3d-4d26-89df-544623f1e443", "tag": "2dfb9101-5f11-4430-93ab-6396979677c9"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:09.347275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b4682afe-9faa-4d03-8a0c-0c85d667625f req-8730cd78-1698-4623-83bc-0acc510b8cbd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.347965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b4682afe-9faa-4d03-8a0c-0c85d667625f req-8730cd78-1698-4623-83bc-0acc510b8cbd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.349035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b4682afe-9faa-4d03-8a0c-0c85d667625f req-8730cd78-1698-4623-83bc-0acc510b8cbd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.375117 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b4682afe-9faa-4d03-8a0c-0c85d667625f req-8730cd78-1698-4623-83bc-0acc510b8cbd service nova] Creating event network-changed:2dfb9101-5f11-4430-93ab-6396979677c9 for instance e93913f7-7e3d-4d26-89df-544623f1e443 on n-h1-854663-10 Oct 27 10:14:09.396740 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4724586-df58-480d-88f3-d7b902d57973 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 204 len: 0 microversion: 2.1 time: 0.243557 Oct 27 10:14:09.402684 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 825/1633] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:09 2022] DELETE /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:14:09.406650 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b4682afe-9faa-4d03-8a0c-0c85d667625f req-8730cd78-1698-4623-83bc-0acc510b8cbd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089677 Oct 27 10:14:09.408905 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 809/1634] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:09.412374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0bbdea01-1a2b-4476-ac1e-86e475044a49 req-8c1ead18-341b-4578-ad07-63174dffbe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2259f471-9ce2-4ad1-91a3-6bf122ab46ca", "name": "network-vif-plugged", "status": "completed", "tag": "1a4efe5d-7145-4c38-99cb-5f5f90f71dcc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:09.438644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec5d1f2b-a279-47d1-8b8c-32dcaaa49048 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Action: 'create', calling method: .version_select at 0x7f6d63795ca0>, body: {"pool": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:09.447407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0bbdea01-1a2b-4476-ac1e-86e475044a49 req-8c1ead18-341b-4578-ad07-63174dffbe77 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.447924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0bbdea01-1a2b-4476-ac1e-86e475044a49 req-8c1ead18-341b-4578-ad07-63174dffbe77 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.448371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0bbdea01-1a2b-4476-ac1e-86e475044a49 req-8c1ead18-341b-4578-ad07-63174dffbe77 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.472201 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0bbdea01-1a2b-4476-ac1e-86e475044a49 req-8c1ead18-341b-4578-ad07-63174dffbe77 service nova] Creating event network-vif-plugged:1a4efe5d-7145-4c38-99cb-5f5f90f71dcc for instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca on n-h1-854663-10 Oct 27 10:14:09.478057 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0bbdea01-1a2b-4476-ac1e-86e475044a49 req-8c1ead18-341b-4578-ad07-63174dffbe77 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070026 Oct 27 10:14:09.491343 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 826/1635] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:09.497403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:09.498439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:09.505720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.506534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.507140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.508005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.508707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.509533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.925301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:09.938797 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43f2727d-47d2-424f-afd3-21a417e00d47 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1469 microversion: 2.1 time: 0.445815 Oct 27 10:14:09.939752 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 827/1636] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:09 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1469 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:09.945595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:09.946680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:09.956835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.958129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.958757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.959653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.960283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.968592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:10.323053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:10.349911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:10.352018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:10.354591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8dd2ba5b-8a46-4bda-9c5c-29237a157fad tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.412218 Oct 27 10:14:10.356287 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 828/1637] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:09 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:10.366330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd53495e-af8f-415e-b02e-b1f170957843 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:10.369104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd53495e-af8f-415e-b02e-b1f170957843 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:10.412196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd53495e-af8f-415e-b02e-b1f170957843 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:10.418253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd53495e-af8f-415e-b02e-b1f170957843 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:10.418735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd53495e-af8f-415e-b02e-b1f170957843 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:10.419475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd53495e-af8f-415e-b02e-b1f170957843 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:10.420102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd53495e-af8f-415e-b02e-b1f170957843 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:10.420531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd53495e-af8f-415e-b02e-b1f170957843 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:10.486830 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd53495e-af8f-415e-b02e-b1f170957843 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129237 Oct 27 10:14:10.501511 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 829/1638] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:10 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:10.507272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:10.513247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:10.529482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:10.530049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:10.530493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:10.531210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:10.531670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:10.532102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:11.716754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:11.726704 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1a71e676-02b2-42e6-9930-5481a44056c7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 1.223573 Oct 27 10:14:11.733156 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 830/1639] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:10 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:11.744207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:11.745057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:11.768921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:11.769824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:11.770970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:11.772000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:11.781102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:11.782597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:12.483045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:12.494994 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8a96224-83e0-416e-bdaa-6214e4861d63 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 200 len: 1469 microversion: 2.1 time: 0.760539 Oct 27 10:14:12.499643 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 831/1640] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:11 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 1469 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:12.508409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:12.509315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:12.524118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:12.533990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:12.534749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:12.537805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:12.538590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:12.539169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:12.584720 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] HTTP exception thrown: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Request method failure captured: Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 HTTP/1.1 Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlksB_JDuj2RvgWvqCjGxIxyR6TR4U184FQefuxoqq9V0cI5EZobBN4cH0Rw6FyNIS305mgrQuWcFfTQlJEPmzZFcYaYoyTeho4gH8UDk5jQx3hOevlOevh-TVKeTiDRNOuwo3pjetNDbk0foaS9enZcSGNp7DmyIxOVugeLNHTdi9Y Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 9f4455cea86546b08fb9a4cce57efedb Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1900106182 Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:12.593846 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9f4455cea86546b08fb9a4cce57efedb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9f4455cea86546b08fb9a4cce57efedb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9f4455cea86546b08fb9a4cce57efedb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9f4455cea86546b08fb9a4cce57efedb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1900106182 Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 9f4455cea86546b08fb9a4cce57efedb Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1900106182 Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachSCSIVolumeTestJSON-1900106182-project Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 10ed2e5b74c14b579755e3c5cbe79689 Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1900106182-project Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:12.595781 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '95558ee4-40e1-4fff-a334-890711c72fe1'} Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:12.596714 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:12.598065 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:12.602384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Returning 404 to user: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:12.602384 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-463c5f9c-6cd3-48cc-a0ab-e38ea1d9dce4 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "DELETE /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 404 len: 111 microversion: 2.1 time: 0.099647 Oct 27 10:14:12.602384 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 832/1641] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:12 2022] DELETE /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:12.616367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:12.616943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:12.635560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:12.636789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:12.637476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:12.638388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:12.641053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:12.641720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:13.094932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:13.113992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:13.116061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:13.119321 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-098bc40e-2be9-438d-8304-ef229c0cd2bd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.515631 Oct 27 10:14:13.133300 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 833/1642] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:12 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:13.133300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1db4c18-685a-49cf-ad26-d222a8c50352 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:13.140394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1db4c18-685a-49cf-ad26-d222a8c50352 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:13.150659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1db4c18-685a-49cf-ad26-d222a8c50352 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:13.151155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1db4c18-685a-49cf-ad26-d222a8c50352 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:13.151781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1db4c18-685a-49cf-ad26-d222a8c50352 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:13.152503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1db4c18-685a-49cf-ad26-d222a8c50352 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:13.152977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1db4c18-685a-49cf-ad26-d222a8c50352 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:13.153400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1db4c18-685a-49cf-ad26-d222a8c50352 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:13.227309 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1db4c18-685a-49cf-ad26-d222a8c50352 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105349 Oct 27 10:14:13.230242 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 834/1643] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:13 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:13.266526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:13.267592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] [instance: 95558ee4-40e1-4fff-a334-890711c72fe1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:13.282232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:13.291841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:13.292295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:13.293076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:13.293534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:13.294051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:13.357152 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] HTTP exception thrown: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Request method failure captured: Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 HTTP/1.1 Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlksB_JDuj2RvgWvqCjGxIxyR6TR4U184FQefuxoqq9V0cI5EZobBN4cH0Rw6FyNIS305mgrQuWcFfTQlJEPmzZFcYaYoyTeho4gH8UDk5jQx3hOevlOevh-TVKeTiDRNOuwo3pjetNDbk0foaS9enZcSGNp7DmyIxOVugeLNHTdi9Y Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 9f4455cea86546b08fb9a4cce57efedb Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1900106182 Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:13.373088 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9f4455cea86546b08fb9a4cce57efedb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9f4455cea86546b08fb9a4cce57efedb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9f4455cea86546b08fb9a4cce57efedb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9f4455cea86546b08fb9a4cce57efedb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1900106182 Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 9f4455cea86546b08fb9a4cce57efedb Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1900106182 Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachSCSIVolumeTestJSON-1900106182-project Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 10ed2e5b74c14b579755e3c5cbe79689 Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1900106182-project Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:13.374567 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '95558ee4-40e1-4fff-a334-890711c72fe1'} Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:13.375443 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. Oct 27 10:14:13.377126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:13.378479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] Returning 404 to user: Instance 95558ee4-40e1-4fff-a334-890711c72fe1 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:13.378479 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0d1a39d-1387-4a1e-ade0-f62d7328b4c0 tempest-AttachSCSIVolumeTestJSON-1900106182 tempest-AttachSCSIVolumeTestJSON-1900106182-project] 10.222.0.76 "GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1" status: 404 len: 111 microversion: 2.1 time: 0.130301 Oct 27 10:14:13.378479 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 835/1644] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:13 2022] GET /compute/v2.1/servers/95558ee4-40e1-4fff-a334-890711c72fe1 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:13.378479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:13.397024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:13.409814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:13.411441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:13.412186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:13.413224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:13.413892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:13.414671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.000603 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec5d1f2b-a279-47d1-8b8c-32dcaaa49048 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.585518 Oct 27 10:14:14.005956 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 810/1645] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:14:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:14.231406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:14.254335 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2137351-0bd7-47b3-ba75-30f4be7c817b tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.890052 Oct 27 10:14:14.261008 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 836/1646] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:13 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:14.267702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a8953919-9eea-4411-8de2-0fc176cbd2f3 req-b70cf21b-f769-4db3-811a-3dd7a11424bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2259f471-9ce2-4ad1-91a3-6bf122ab46ca", "name": "network-vif-deleted", "tag": "1a4efe5d-7145-4c38-99cb-5f5f90f71dcc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:14.318010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a8953919-9eea-4411-8de2-0fc176cbd2f3 req-b70cf21b-f769-4db3-811a-3dd7a11424bd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:14.319022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a8953919-9eea-4411-8de2-0fc176cbd2f3 req-b70cf21b-f769-4db3-811a-3dd7a11424bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:14.319475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a8953919-9eea-4411-8de2-0fc176cbd2f3 req-b70cf21b-f769-4db3-811a-3dd7a11424bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.360839 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a8953919-9eea-4411-8de2-0fc176cbd2f3 req-b70cf21b-f769-4db3-811a-3dd7a11424bd service nova] Creating event network-vif-deleted:1a4efe5d-7145-4c38-99cb-5f5f90f71dcc for instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca on n-h1-854663-10 Oct 27 10:14:14.376147 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a8953919-9eea-4411-8de2-0fc176cbd2f3 req-b70cf21b-f769-4db3-811a-3dd7a11424bd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113686 Oct 27 10:14:14.378266 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 837/1647] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:14.387756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:14.391076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 2259f471-9ce2-4ad1-91a3-6bf122ab46ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:14.416130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:14.421578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:14.422431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.435457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:14.436588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:14.438956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.491996 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] HTTP exception thrown: Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca could not be found. Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Request method failure captured: Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca HTTP/1.1 Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliSBM_kQnlJ8tqqRNq06NmfI0fL4hKZLitpcAPyN6ev-g5f7Ej7eMU8avi0lGd7lxlojGKJdrSjR2mSpaG4Mr1gRxbvFsdm019em-j6CKF6ZI_BzMQb88d1sUgjyKlDpKqHB1X5OZK2KTvOA-P4dFUmf62JtNsPo4zHbkQbU5GWrHo Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 895a8ef842a242469ffa508e1cf9f378 Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:14.500743 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_895a8ef842a242469ffa508e1cf9f378", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 895a8ef842a242469ffa508e1cf9f378 Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-MigrationsAdminTest-344464103-project Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: ae3b45c026064d6c946f50a4d9d32c2f Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-MigrationsAdminTest-344464103-project Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca could not be found. Oct 27 10:14:14.502170 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '2259f471-9ce2-4ad1-91a3-6bf122ab46ca'} Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca could not be found. Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:14.502965 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca could not be found. Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca could not be found. Oct 27 10:14:14.504744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.506998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Returning 404 to user: Instance 2259f471-9ce2-4ad1-91a3-6bf122ab46ca could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:14.506998 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-06e8abdb-0b26-4214-8b02-0cd84b0a5176 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca" status: 404 len: 111 microversion: 2.1 time: 0.122720 Oct 27 10:14:14.510480 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 838/1648] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:14 2022] GET /compute/v2.1/servers/2259f471-9ce2-4ad1-91a3-6bf122ab46ca => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:14.516435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:14.517151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:14.523880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:14.525326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:14.526009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.527247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:14.527922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:14.528731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.614360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4781ce31-ca74-4ef5-abe6-9ee1804eb72f tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] Action: 'create', calling method: .version_select at 0x7f6d5ad0f700>, body: {"security_group": {"name": "tempest-securitygroup-1049727467", "description": "tempest-description-731493335"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:15.177312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:15.198996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:15.202308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:15.206835 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13fb0550-47ed-4891-9396-50d5c714e4c6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.692838 Oct 27 10:14:15.208391 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 839/1649] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:14 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:15.231991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1127789616", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "cb698d4f-9293-4505-96fd-2eab544a9110"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:15.317362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] validate_networks() for [('cb698d4f-9293-4505-96fd-2eab544a9110', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:14:15.523157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=34 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:15.574022 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4781ce31-ca74-4ef5-abe6-9ee1804eb72f tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.566636 Oct 27 10:14:15.578881 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 811/1650] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:14:14 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:15.585177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:15.591083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:15.633825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:15.635446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:15.636121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:15.640104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:15.640922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:15.641675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:15.691727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:14:15.888258 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dfa59ffc-518c-442c-937d-da71b4b68af0 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 204 len: 0 microversion: 2.1 time: 0.307106 Oct 27 10:14:15.906659 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 812/1651] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:15 2022] DELETE /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:14:15.913437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:15.915679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:15.925636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:15.926314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:15.928137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:15.929062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:15.929616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:15.930395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:16.210422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:16.219802 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be7a303f-2517-4463-b449-0b9c96a8539c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.311405 Oct 27 10:14:16.222722 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 813/1652] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:15 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:16.237301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9daed5d6-66bc-41ad-bd7f-d73a6cb7ee16 tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] Action: 'create', calling method: .version_select at 0x7f6d637aff70>, body: {"security_group": {"name": "tempest-securitygroup-1646379239", "description": "tempest-description-260336045"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:16.432544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:14:16.433151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:14:16.433669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:14:16.434191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:14:16.434610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:14:16.454186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:16.493368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:16.493368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:16.499253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:16.501799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:16.502974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:16.545065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Getting quotas for project c83852e942904ae58e59f9f6b8e0bc16. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:16.554001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Getting quotas for user 7f431586b08d4b139a2e18aeffab9c49 and project c83852e942904ae58e59f9f6b8e0bc16. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:16.574250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:14:16.578722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:14:16.653117 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f820d4cc-eb11-4a15-a419-20bfe4209698 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442699 Oct 27 10:14:16.653976 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 840/1653] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:14:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:14:16.659341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:16.660926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:16.672554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:16.674275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:16.674938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:16.678435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:16.679462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:16.680144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:16.742154 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9daed5d6-66bc-41ad-bd7f-d73a6cb7ee16 tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.517599 Oct 27 10:14:16.744560 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 814/1654] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:14:16 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:16.752912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:16.753786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:16.774043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:16.775912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:16.776575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:16.779321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:16.780004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:16.782125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:17.449464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:17.474746 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-619a3be2-e4ef-4331-a69c-a0424e367f01 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1535 microversion: 2.1 time: 0.815737 Oct 27 10:14:17.488224 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 841/1655] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:16 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1535 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:17.619579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e66dc16c-9d93-4e0f-94c5-072df2195500 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d639485e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-193020789", "description": "tempest-description-1805289297"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:17.697455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:17.729517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:17.746501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:17.749819 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e59dd01a-81ae-4fdd-b649-795f83142f2f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 1.003437 Oct 27 10:14:17.754109 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 815/1656] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:16 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:17.764229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:17.765640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:17.776408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:17.783329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:17.783873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:17.797702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:17.798291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:17.798804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.010504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:18.022302 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bb1c8385-1145-4bfb-b0c3-75aa9dbef7f5 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1220 microversion: 2.1 time: 0.266960 Oct 27 10:14:18.036243 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 816/1657] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:17 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1220 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:18.125349 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e66dc16c-9d93-4e0f-94c5-072df2195500 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.635731 Oct 27 10:14:18.126567 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 842/1658] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:14:17 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:18.139985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:18.140940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:18.152301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.155287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.156889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.159754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.160434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.161066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.258950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c3f2d61a-f42f-4c46-bed6-fcaae14ba6f0 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] Action: 'create', calling method: .version_select at 0x7f6d637950d0>, body: {"security_group": {"name": "tempest-securitygroup-1759613213", "description": "tempest-description-841061258"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:18.674370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:18.682988 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6962dd74-223d-4eeb-a756-3a48e3041063 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.555100 Oct 27 10:14:18.704545 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 843/1659] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:18 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:18.718447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e949e2a-6045-4ab3-b77b-a2a0b2b67d08 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d639a1820>, body: {"security_group_rule": {"parent_group_id": "c93a49c3-1f14-41e0-ba3d-60b324d0a555", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:20.363245 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e949e2a-6045-4ab3-b77b-a2a0b2b67d08 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.657107 Oct 27 10:14:20.364917 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 844/1660] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:14:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:20.387998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:20.390841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:20.407295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:20.408179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:20.411317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:20.413619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:20.417573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:20.421403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:20.464629 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c3f2d61a-f42f-4c46-bed6-fcaae14ba6f0 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.422509 Oct 27 10:14:20.465307 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 817/1661] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:14:18 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:20.471631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:20.473693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:20.490861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:20.491582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:20.492335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:20.493178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lazy-loading 'fault' on Instance uuid 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:14:20.504039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:20.504527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:20.504924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:20.505642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:20.506083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:20.506500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:20.566953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:20.663575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:20.673825 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-522f88fb-9be2-4769-9b2d-8742ee0a7ba6 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 200 len: 1369 microversion: 2.1 time: 0.307263 Oct 27 10:14:20.674617 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 845/1662] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:20 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 1369 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:20.679571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:20.687321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:20.696484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:20.697339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:20.697998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:20.698985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:20.699720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:20.700141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:20.731671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:20.883539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:20.893233 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3da59c75-50de-48cc-9c83-b6320130f8f0 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1282 microversion: 2.1 time: 0.217108 Oct 27 10:14:20.893740 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 846/1663] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:20 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1282 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:20.914607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-857cda99-b788-4105-a425-d7b1fdeaf0f2 req-e75a047e-6f88-4bfb-9272-8a6bed04af98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7", "name": "network-vif-deleted", "tag": "4d13e56c-1fad-4227-983b-7b7a9cffcefd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:20.934403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-857cda99-b788-4105-a425-d7b1fdeaf0f2 req-e75a047e-6f88-4bfb-9272-8a6bed04af98 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:20.935609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-857cda99-b788-4105-a425-d7b1fdeaf0f2 req-e75a047e-6f88-4bfb-9272-8a6bed04af98 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:20.936231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-857cda99-b788-4105-a425-d7b1fdeaf0f2 req-e75a047e-6f88-4bfb-9272-8a6bed04af98 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:20.957125 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-857cda99-b788-4105-a425-d7b1fdeaf0f2 req-e75a047e-6f88-4bfb-9272-8a6bed04af98 service nova] Creating event network-vif-deleted:4d13e56c-1fad-4227-983b-7b7a9cffcefd for instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 on n-h2-854663-10 Oct 27 10:14:20.969761 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-857cda99-b788-4105-a425-d7b1fdeaf0f2 req-e75a047e-6f88-4bfb-9272-8a6bed04af98 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059599 Oct 27 10:14:20.971742 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 847/1664] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:20.994077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:20.996340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:21.014427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:21.015551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:21.017818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:21.018824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:21.021500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:21.023244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:21.059224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:21.082008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:21.083775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:21.085268 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01cf4c19-5945-4f61-9bfa-d930f54045cc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.618826 Oct 27 10:14:21.101717 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 818/1665] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:20 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:21.110411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e80c7a2-7286-4dcb-8e27-c0a7b5c4648a tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d6386b8b0>, body: {"security_group_rule": {"parent_group_id": "c93a49c3-1f14-41e0-ba3d-60b324d0a555", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:21.427539 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-6e80c7a2-7286-4dcb-8e27-c0a7b5c4648a tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] HTTP exception thrown: This rule already exists in group c93a49c3-1f14-41e0-ba3d-60b324d0a555 Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e80c7a2-7286-4dcb-8e27-c0a7b5c4648a tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Request method failure captured: Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 138 Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWln4pIZFt3ljPoaUThk7mLnBK6h80_Aiz1y30CBLVTBIrHs8BojH8rBUTaHTeBZEh1gtjIeqsD4BsxKQquaEn4OrO_QDlhUZHmTGuhlCiKcxuiiUbpEUP-dXNKMwWn8CGXrgiO6pyJO9g0gnlLqtyt7BE9tUes7Pk4lTbhi0jj90G9A Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:14:21.445832 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_367e974ca942481ba0e28e52dfda3a66", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 7da0d95418454bbd9e84ada0fc6f0d0a Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: {"security_group_rule": {"parent_group_id": "c93a49c3-1f14-41e0-ba3d-60b324d0a555", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 10:14:21.447706 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: exception: This rule already exists in group c93a49c3-1f14-41e0-ba3d-60b324d0a555 Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c93a49c3-1f14-41e0-ba3d-60b324d0a555', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group c93a49c3-1f14-41e0-ba3d-60b324d0a555 Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:14:21.448683 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group c93a49c3-1f14-41e0-ba3d-60b324d0a555 Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group c93a49c3-1f14-41e0-ba3d-60b324d0a555 Oct 27 10:14:21.450164 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:21.454096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e80c7a2-7286-4dcb-8e27-c0a7b5c4648a tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Returning 400 to user: This rule already exists in group c93a49c3-1f14-41e0-ba3d-60b324d0a555 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:21.455164 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e80c7a2-7286-4dcb-8e27-c0a7b5c4648a tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.352208 Oct 27 10:14:21.459261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 819/1666] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:14:21 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 353 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:14:21.461869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb9033e8-cdc5-4bba-8a8a-1724f4b73a50 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] Action: 'create', calling method: .version_select at 0x7f6d6375eca0>, body: {"security_group": {"name": "tempest-securitygroup-374857907", "description": "tempest-description-684630517"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:21.599006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:21.611144 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29555bfe-1ead-4938-8104-1b633bc9f56f tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.632301 Oct 27 10:14:21.612564 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 848/1667] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:20 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:21.619539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e65fc88-fd60-4d73-a68f-cc7b5b915ffa tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Calling method '.version_select at 0x7f6d5ba5ff70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:22.157595 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb9033e8-cdc5-4bba-8a8a-1724f4b73a50 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.700390 Oct 27 10:14:22.159511 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 820/1668] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:14:21 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:22.167084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:22.168346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:22.177441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:22.178810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:22.180720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:22.184682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:22.186171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:22.188560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:22.221466 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] HTTP exception thrown: Instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 could not be found. Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Request method failure captured: Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 HTTP/1.1 Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliSBM_kQnlJ8tqqRNq06NmfI0fL4hKZLitpcAPyN6ev-g5f7Ej7eMU8avi0lGd7lxlojGKJdrSjR2mSpaG4Mr1gRxbvFsdm019em-j6CKF6ZI_BzMQb88d1sUgjyKlDpKqHB1X5OZK2KTvOA-P4dFUmf62JtNsPo4zHbkQbU5GWrHo Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 895a8ef842a242469ffa508e1cf9f378 Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:14:22.223932 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_895a8ef842a242469ffa508e1cf9f378", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 895a8ef842a242469ffa508e1cf9f378 Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-MigrationsAdminTest-344464103-project Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: ae3b45c026064d6c946f50a4d9d32c2f Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-MigrationsAdminTest-344464103-project Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 could not be found. Oct 27 10:14:22.225965 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7'} Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 could not be found. Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:22.226960 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 could not be found. Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 could not be found. Oct 27 10:14:22.229502 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:22.232001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Returning 404 to user: Instance 6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:22.235421 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7dc61599-1ed2-45f5-a337-c52d45f70351 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7" status: 404 len: 111 microversion: 2.1 time: 0.072989 Oct 27 10:14:22.241154 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 821/1669] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:22 2022] GET /compute/v2.1/servers/6c79df4d-0d73-4bc2-8290-fcd53c0cc1a7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:22.275665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:22.277436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:22.312652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:22.321756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:22.322500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:22.325868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:22.326342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:22.330067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:22.572903 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e65fc88-fd60-4d73-a68f-cc7b5b915ffa tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-group-rules/2c6282d9-650e-4bd9-8a8d-0818c5b57bf9" status: 202 len: 0 microversion: 2.1 time: 0.958376 Oct 27 10:14:22.573813 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 849/1670] 10.222.0.76 () {58 vars in 1287 bytes} [Thu Oct 27 10:14:21 2022] DELETE /compute/v2.1/os-security-group-rules/2c6282d9-650e-4bd9-8a8d-0818c5b57bf9 => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:22.858852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:22.859543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:22.877198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:22.881139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:22.882457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:22.884298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:22.886614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:22.887802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:22.962257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:22.976784 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05f647d1-7e83-4d1e-a3e2-36594f2a5294 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1324 microversion: 2.1 time: 0.729755 Oct 27 10:14:22.995255 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 822/1671] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:22 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1324 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:23.003075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-724b2fd4-6a99-4845-81de-6aa72390ad02 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] Calling method '.version_select at 0x7f6d5ad679d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:23.705858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:23.719307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:23.722962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:23.728178 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e488b418-e9b3-4ae2-aae6-401376f4534e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 1.152403 Oct 27 10:14:23.729144 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 850/1672] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:22 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:23.735994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93894de2-b6da-4be5-a3e7-f854dd678b9e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '.version_select at 0x7f6d63967940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:23.761637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-93894de2-b6da-4be5-a3e7-f854dd678b9e tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183838655" status: 202 len: 0 microversion: 2.1 time: 0.031144 Oct 27 10:14:23.766193 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 851/1673] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:14:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183838655 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:23.772116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c500a6b-8abb-4e3f-af35-24ea2c0fbabf tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d639993a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1187006381", "description": "tempest-description-1729287608"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:24.540481 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c500a6b-8abb-4e3f-af35-24ea2c0fbabf tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.771017 Oct 27 10:14:24.546022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 852/1674] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:14:23 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:24.557697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:24.558590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:24.567842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:24.568703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:24.569656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:24.570872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:24.571617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:24.572265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:25.307445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:25.320521 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14ed2d39-065d-4db9-b1ee-ebc3bb2ed0c2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.772508 Oct 27 10:14:25.324448 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 853/1675] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:24 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:25.330379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c9eb9928-5da8-415d-854a-e59aa5090710 req-3894a406-ef0e-4c2c-8842-2a2b860c3721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029ff781-574b-48de-9033-cd8e69e64ec2", "name": "network-vif-unplugged", "status": "completed", "tag": "9d537db4-55a5-4b36-81b4-2f467d976981"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:25.348541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c9eb9928-5da8-415d-854a-e59aa5090710 req-3894a406-ef0e-4c2c-8842-2a2b860c3721 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:25.349653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c9eb9928-5da8-415d-854a-e59aa5090710 req-3894a406-ef0e-4c2c-8842-2a2b860c3721 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:25.350650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c9eb9928-5da8-415d-854a-e59aa5090710 req-3894a406-ef0e-4c2c-8842-2a2b860c3721 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:25.374531 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c9eb9928-5da8-415d-854a-e59aa5090710 req-3894a406-ef0e-4c2c-8842-2a2b860c3721 service nova] Creating event network-vif-unplugged:9d537db4-55a5-4b36-81b4-2f467d976981 for instance 029ff781-574b-48de-9033-cd8e69e64ec2 on n-h2-854663-10 Oct 27 10:14:25.382457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c9eb9928-5da8-415d-854a-e59aa5090710 req-3894a406-ef0e-4c2c-8842-2a2b860c3721 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056388 Oct 27 10:14:25.385019 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 854/1676] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:25.393267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:25.394939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:25.408688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:25.418057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:25.418506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:25.419386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:25.419687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:25.420109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:25.901382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:25.912502 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a073a2e-be0c-4705-8fe2-ef421991ef0c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1324 microversion: 2.1 time: 0.525578 Oct 27 10:14:25.926253 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 855/1677] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:25 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1324 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:25.937529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fc17f0d-1874-438c-a368-7a2ac53f6b1f tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d5bab1790>, body: {"security_group_rule": {"parent_group_id": "fc2d1bbc-bc42-443d-931b-4334d817b00a", "ip_protocol": "tcp", "from_port": 2005088487, "to_port": 22}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:26.116332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4fc17f0d-1874-438c-a368-7a2ac53f6b1f tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] HTTP exception thrown: Invalid port range 2005088487:22. Former value cannot be greater than the later Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fc17f0d-1874-438c-a368-7a2ac53f6b1f tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Request method failure captured: Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 146 Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWln4pIZFt3ljPoaUThk7mLnBK6h80_Aiz1y30CBLVTBIrHs8BojH8rBUTaHTeBZEh1gtjIeqsD4BsxKQquaEn4OrO_QDlhUZHmTGuhlCiKcxuiiUbpEUP-dXNKMwWn8CGXrgiO6pyJO9g0gnlLqtyt7BE9tUes7Pk4lTbhi0jj90G9A Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:26.120028 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_367e974ca942481ba0e28e52dfda3a66", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7da0d95418454bbd9e84ada0fc6f0d0a Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: {"security_group_rule": {"parent_group_id": "fc2d1bbc-bc42-443d-931b-4334d817b00a", "ip_protocol": "tcp", "from_port": 2005088487, "to_port": 22}} Oct 27 10:14:26.121659 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid port range 2005088487:22. Former value cannot be greater than the later Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fc2d1bbc-bc42-443d-931b-4334d817b00a', 'ip_protocol': 'tcp', 'from_port': 2005088487, 'to_port': 22}}} Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2005088487:22. Former value cannot be greater than the later Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:26.122574 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2005088487:22. Former value cannot be greater than the later Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2005088487:22. Former value cannot be greater than the later Oct 27 10:14:26.123861 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.144039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fc17f0d-1874-438c-a368-7a2ac53f6b1f tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Returning 400 to user: Invalid port range 2005088487:22. Former value cannot be greater than the later {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:26.145983 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fc17f0d-1874-438c-a368-7a2ac53f6b1f tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.217913 Oct 27 10:14:26.147551 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 856/1678] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:14:25 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:14:26.155677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:26.156733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:26.167343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:26.167927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:26.168431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:26.169229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:26.169742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:26.170242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:26.532368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:26.558477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:26.566448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:26.569989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:26.571526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:26.572821 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df54d432-5f69-4ef4-8dc9-b1058742ee50 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.423509 Oct 27 10:14:26.573731 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 857/1679] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:26 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:26.579268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:26.580059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:26.594611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:26.595236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:26.595856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:26.596566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:26.597056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:26.597698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:26.627776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:14:26.759743 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f29d291-c1d2-432e-9c61-7e2973847e41 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 204 len: 0 microversion: 2.1 time: 0.184234 Oct 27 10:14:26.760444 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 858/1680] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:26 2022] DELETE /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:14:26.771398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6396ff93-964a-4ef0-9847-9728c0be4d5c req-67398268-ce36-487d-b2cb-dc9157064ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e93913f7-7e3d-4d26-89df-544623f1e443", "name": "network-vif-plugged", "status": "completed", "tag": "c07b81f9-3b8a-41e6-a354-797ac9a9f706"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:26.782653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6396ff93-964a-4ef0-9847-9728c0be4d5c req-67398268-ce36-487d-b2cb-dc9157064ffc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:26.783688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6396ff93-964a-4ef0-9847-9728c0be4d5c req-67398268-ce36-487d-b2cb-dc9157064ffc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:26.784826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6396ff93-964a-4ef0-9847-9728c0be4d5c req-67398268-ce36-487d-b2cb-dc9157064ffc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:26.799161 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6396ff93-964a-4ef0-9847-9728c0be4d5c req-67398268-ce36-487d-b2cb-dc9157064ffc service nova] Creating event network-vif-plugged:c07b81f9-3b8a-41e6-a354-797ac9a9f706 for instance e93913f7-7e3d-4d26-89df-544623f1e443 on n-h1-854663-10 Oct 27 10:14:26.805011 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6396ff93-964a-4ef0-9847-9728c0be4d5c req-67398268-ce36-487d-b2cb-dc9157064ffc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042670 Oct 27 10:14:26.805964 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 859/1681] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:26.884682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3aaa9445-ea1a-494a-8824-d82c0df21528 req-f13a7205-4296-42bc-ab7b-fe2d01eb1d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2f136b-ddc6-40fe-8748-548f89936683", "tag": "c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:26.897841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3aaa9445-ea1a-494a-8824-d82c0df21528 req-f13a7205-4296-42bc-ab7b-fe2d01eb1d73 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:26.898563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3aaa9445-ea1a-494a-8824-d82c0df21528 req-f13a7205-4296-42bc-ab7b-fe2d01eb1d73 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:26.899341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3aaa9445-ea1a-494a-8824-d82c0df21528 req-f13a7205-4296-42bc-ab7b-fe2d01eb1d73 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:26.913275 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3aaa9445-ea1a-494a-8824-d82c0df21528 req-f13a7205-4296-42bc-ab7b-fe2d01eb1d73 service nova] Creating event network-changed:c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6 for instance ed2f136b-ddc6-40fe-8748-548f89936683 on n-h1-854663-10 Oct 27 10:14:26.940957 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3aaa9445-ea1a-494a-8824-d82c0df21528 req-f13a7205-4296-42bc-ab7b-fe2d01eb1d73 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133442 Oct 27 10:14:26.942501 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 860/1682] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:26.948735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c7531a3-062c-4600-b6ad-cd7c5fee8580 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d63915ee0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-461467850", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:26.951363 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-7c7531a3-062c-4600-b6ad-cd7c5fee8580 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] HTTP exception thrown: Security group id should be uuid Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c7531a3-062c-4600-b6ad-cd7c5fee8580 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Request method failure captured: Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 130 Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWln4pIZFt3ljPoaUThk7mLnBK6h80_Aiz1y30CBLVTBIrHs8BojH8rBUTaHTeBZEh1gtjIeqsD4BsxKQquaEn4OrO_QDlhUZHmTGuhlCiKcxuiiUbpEUP-dXNKMwWn8CGXrgiO6pyJO9g0gnlLqtyt7BE9tUes7Pk4lTbhi0jj90G9A Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:26.953803 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_367e974ca942481ba0e28e52dfda3a66", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7da0d95418454bbd9e84ada0fc6f0d0a Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-461467850", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:14:26.955343 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group id should be uuid Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-461467850', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:26.956181 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 27 10:14:26.957497 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:26.962792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c7531a3-062c-4600-b6ad-cd7c5fee8580 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Returning 400 to user: Security group id should be uuid {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:26.968148 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c7531a3-062c-4600-b6ad-cd7c5fee8580 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.019655 Oct 27 10:14:26.968148 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 861/1683] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:14:26 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:14:26.976505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:26.979202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:26.990927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:26.991409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:26.992159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:26.993012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:26.993527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:26.994003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:27.318878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:27.331381 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad02ba6f-e896-41d6-a6f5-5c58126e13ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.362355 Oct 27 10:14:27.349569 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 862/1684] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:26 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:27.356113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:27.357559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:27.371061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:27.371945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:27.372611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:27.373583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:27.374374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:27.375003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:28.038399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:28.053509 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fccd4555-6d94-4e7f-8ea1-d5c66d1f9cd7 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 200 len: 1468 microversion: 2.1 time: 0.701992 Oct 27 10:14:28.061073 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 863/1685] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:27 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 1468 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:28.072471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:28.073130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:28.102645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:28.103146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:28.103591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:28.104317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:28.104802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:28.105228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:28.551616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:28.561270 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae1f83e8-d1c6-4e49-b5db-2e02bd024dd6 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1324 microversion: 2.1 time: 0.498918 Oct 27 10:14:28.581121 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 864/1686] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:28 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1324 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:28.588396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-337ba060-18fa-4677-8819-879f99d7dd08 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d63944e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2049581368", "description": "tempest-description-1350844616"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:29.058958 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-337ba060-18fa-4677-8819-879f99d7dd08 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.475948 Oct 27 10:14:29.061705 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 865/1687] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:14:28 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:29.066969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-aa7d35d4-bd34-46c9-8b28-27408f9aaa10 req-295cb7b8-d7c6-4a05-a3d5-145c20989acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029ff781-574b-48de-9033-cd8e69e64ec2", "tag": "9d537db4-55a5-4b36-81b4-2f467d976981"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:29.079734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-aa7d35d4-bd34-46c9-8b28-27408f9aaa10 req-295cb7b8-d7c6-4a05-a3d5-145c20989acd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:29.080592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-aa7d35d4-bd34-46c9-8b28-27408f9aaa10 req-295cb7b8-d7c6-4a05-a3d5-145c20989acd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:29.081375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-aa7d35d4-bd34-46c9-8b28-27408f9aaa10 req-295cb7b8-d7c6-4a05-a3d5-145c20989acd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:29.123868 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-aa7d35d4-bd34-46c9-8b28-27408f9aaa10 req-295cb7b8-d7c6-4a05-a3d5-145c20989acd service nova] Creating event network-changed:9d537db4-55a5-4b36-81b4-2f467d976981 for instance 029ff781-574b-48de-9033-cd8e69e64ec2 on n-h2-854663-10 Oct 27 10:14:29.131613 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-aa7d35d4-bd34-46c9-8b28-27408f9aaa10 req-295cb7b8-d7c6-4a05-a3d5-145c20989acd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068055 Oct 27 10:14:29.132510 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 866/1688] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:29.140703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:29.165535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:29.168388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:29.186381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:29.187196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:29.187895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:29.188769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:29.189295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:29.191725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:29.619283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:29.632878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:29.637855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:29.643418 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be586b88-017f-4f5d-9d34-45e8891d57a1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.509263 Oct 27 10:14:29.652459 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 867/1689] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:29 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:29.658929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:29.664650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:29.689846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:29.690499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:29.691014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:29.691846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:29.700334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:29.700933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:30.114450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:30.130520 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df0100f0-9f18-444f-b939-653d01d5f062 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.473322 Oct 27 10:14:30.136426 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 868/1690] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:29 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:30.145985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c94947e2-9657-4680-ae70-b60ddbe3d8ee req-9fbaa431-e7a4-416e-8ac9-fbab2786a4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e93913f7-7e3d-4d26-89df-544623f1e443", "name": "network-vif-plugged", "status": "completed", "tag": "d0236827-a847-4110-82c7-f970195cba36"}, {"server_uuid": "e93913f7-7e3d-4d26-89df-544623f1e443", "name": "network-vif-plugged", "status": "completed", "tag": "2dfb9101-5f11-4430-93ab-6396979677c9"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:30.186365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c94947e2-9657-4680-ae70-b60ddbe3d8ee req-9fbaa431-e7a4-416e-8ac9-fbab2786a4dd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:30.188049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c94947e2-9657-4680-ae70-b60ddbe3d8ee req-9fbaa431-e7a4-416e-8ac9-fbab2786a4dd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:30.190129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c94947e2-9657-4680-ae70-b60ddbe3d8ee req-9fbaa431-e7a4-416e-8ac9-fbab2786a4dd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:30.244393 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c94947e2-9657-4680-ae70-b60ddbe3d8ee req-9fbaa431-e7a4-416e-8ac9-fbab2786a4dd service nova] Creating event network-vif-plugged:d0236827-a847-4110-82c7-f970195cba36 for instance e93913f7-7e3d-4d26-89df-544623f1e443 on n-h1-854663-10 Oct 27 10:14:30.248757 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c94947e2-9657-4680-ae70-b60ddbe3d8ee req-9fbaa431-e7a4-416e-8ac9-fbab2786a4dd service nova] Creating event network-vif-plugged:2dfb9101-5f11-4430-93ab-6396979677c9 for instance e93913f7-7e3d-4d26-89df-544623f1e443 on n-h1-854663-10 Oct 27 10:14:30.268922 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c94947e2-9657-4680-ae70-b60ddbe3d8ee req-9fbaa431-e7a4-416e-8ac9-fbab2786a4dd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.130552 Oct 27 10:14:30.270417 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 869/1691] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:30.283258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d48ce62-2c12-47e7-b2a3-dc9ed043f97d tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d63948dc0>, body: {"security_group_rule": {"parent_group_id": "29e7fd6e-3d0d-4107-9ca8-2a0050b7ba0a", "ip_protocol": "tempest-999-656708011", "from_port": 22, "to_port": 22}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:30.690137 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-8d48ce62-2c12-47e7-b2a3-dc9ed043f97d tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] HTTP exception thrown: Invalid IP protocol tempest-999-656708011. Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d48ce62-2c12-47e7-b2a3-dc9ed043f97d tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Request method failure captured: Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 156 Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWln4pIZFt3ljPoaUThk7mLnBK6h80_Aiz1y30CBLVTBIrHs8BojH8rBUTaHTeBZEh1gtjIeqsD4BsxKQquaEn4OrO_QDlhUZHmTGuhlCiKcxuiiUbpEUP-dXNKMwWn8CGXrgiO6pyJO9g0gnlLqtyt7BE9tUes7Pk4lTbhi0jj90G9A Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:30.693116 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_367e974ca942481ba0e28e52dfda3a66", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7da0d95418454bbd9e84ada0fc6f0d0a Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: {"security_group_rule": {"parent_group_id": "29e7fd6e-3d0d-4107-9ca8-2a0050b7ba0a", "ip_protocol": "tempest-999-656708011", "from_port": 22, "to_port": 22}} Oct 27 10:14:30.694738 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid IP protocol tempest-999-656708011. Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'security_group_rule': {'parent_group_id': '29e7fd6e-3d0d-4107-9ca8-2a0050b7ba0a', 'ip_protocol': 'tempest-999-656708011', 'from_port': 22, 'to_port': 22}}} Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-656708011. Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:30.695643 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-656708011. Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-656708011. Oct 27 10:14:30.697063 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.700019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d48ce62-2c12-47e7-b2a3-dc9ed043f97d tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Returning 400 to user: Invalid IP protocol tempest-999-656708011. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:30.701223 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d48ce62-2c12-47e7-b2a3-dc9ed043f97d tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.429680 Oct 27 10:14:30.702695 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 870/1692] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:14:30 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 432 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:14:30.707729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:30.712978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 8b50483e-af66-4d8d-b553-e465cd1389e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:30.735242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:30.735991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:30.736690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:30.738325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:30.739437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:30.740064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:30.762100 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] HTTP exception thrown: Instance 8b50483e-af66-4d8d-b553-e465cd1389e9 could not be found. Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Request method failure captured: Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 HTTP/1.1 Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWliSBM_kQnlJ8tqqRNq06NmfI0fL4hKZLitpcAPyN6ev-g5f7Ej7eMU8avi0lGd7lxlojGKJdrSjR2mSpaG4Mr1gRxbvFsdm019em-j6CKF6ZI_BzMQb88d1sUgjyKlDpKqHB1X5OZK2KTvOA-P4dFUmf62JtNsPo4zHbkQbU5GWrHo Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 895a8ef842a242469ffa508e1cf9f378 Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:30.776916 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_895a8ef842a242469ffa508e1cf9f378", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 895a8ef842a242469ffa508e1cf9f378 Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-MigrationsAdminTest-344464103-project Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: ae3b45c026064d6c946f50a4d9d32c2f Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-MigrationsAdminTest-344464103-project Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 8b50483e-af66-4d8d-b553-e465cd1389e9 could not be found. Oct 27 10:14:30.778453 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '8b50483e-af66-4d8d-b553-e465cd1389e9'} Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b50483e-af66-4d8d-b553-e465cd1389e9 could not be found. Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:30.779281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b50483e-af66-4d8d-b553-e465cd1389e9 could not be found. Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b50483e-af66-4d8d-b553-e465cd1389e9 could not be found. Oct 27 10:14:30.780582 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:30.783820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Returning 404 to user: Instance 8b50483e-af66-4d8d-b553-e465cd1389e9 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:30.785641 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1be208dd-3b93-4b14-adf5-6ce600df5a9a tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9" status: 404 len: 111 microversion: 2.1 time: 0.081760 Oct 27 10:14:30.790336 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 871/1693] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:30 2022] GET /compute/v2.1/servers/8b50483e-af66-4d8d-b553-e465cd1389e9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:30.798419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:30.801397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:30.816368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:30.817016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:30.817535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:30.818347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:30.818871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:30.819364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:31.072531 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-724b2fd4-6a99-4845-81de-6aa72390ad02 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] 10.222.0.76 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13905 microversion: 2.1 time: 8.075678 Oct 27 10:14:31.074317 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 823/1694] 10.222.0.76 () {58 vars in 1191 bytes} [Thu Oct 27 10:14:22 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13905 bytes in 8078 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:31.086628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:31.092305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:31.129693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:31.131023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:31.131671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:31.147359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:31.149817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:31.153574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:31.179977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:31.193422 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09baca14-07ec-492b-85c8-7779de4fed5a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1324 microversion: 2.1 time: 0.401382 Oct 27 10:14:31.194964 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 872/1695] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:30 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:31.201637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e47fd41d-627a-40cd-ac6c-20593a312f89 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d63937160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1588440429", "description": "tempest-description-1488185309"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:31.454225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:31.477108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:31.487480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:31.489638 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-065f3397-e2ed-47e8-be8a-d02620aa2e10 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.413771 Oct 27 10:14:31.495273 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 824/1696] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:31 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:31.514718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:31.515995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:31.536833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:31.540643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:31.541431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:31.543295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:31.546581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:31.549406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:31.574895 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e47fd41d-627a-40cd-ac6c-20593a312f89 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.378356 Oct 27 10:14:31.575483 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 873/1697] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:14:31 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:31.580160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b0e6fd8-0732-438d-9086-0f66ab28bec9 tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] Calling method '.version_select at 0x7f6d638dde50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:31.590919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:14:31.813341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:31.836963 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-200e9525-301e-4452-9520-ce729cfefc8d tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 204 len: 0 microversion: 2.1 time: 0.335525 Oct 27 10:14:31.840689 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 825/1698] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:31 2022] DELETE /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:14:31.846032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:31.846722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:31.855210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:31.855868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:31.857066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:31.858502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:31.859130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:31.860150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:32.015781 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b0e6fd8-0732-438d-9086-0f66ab28bec9 tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.439036 Oct 27 10:14:32.026901 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 874/1699] 10.222.0.76 () {58 vars in 1191 bytes} [Thu Oct 27 10:14:31 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:32.032348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4fc06f19-3a83-4be0-ab2d-a3f9cb08f94f req-1a9f4dfa-a76b-4050-a047-0fee3727e521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b50483e-af66-4d8d-b553-e465cd1389e9", "name": "network-vif-deleted", "tag": "2e4bd57c-5519-4d76-a1db-9fe07d5d4d69"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:32.044621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4fc06f19-3a83-4be0-ab2d-a3f9cb08f94f req-1a9f4dfa-a76b-4050-a047-0fee3727e521 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:32.047591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4fc06f19-3a83-4be0-ab2d-a3f9cb08f94f req-1a9f4dfa-a76b-4050-a047-0fee3727e521 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:32.048860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4fc06f19-3a83-4be0-ab2d-a3f9cb08f94f req-1a9f4dfa-a76b-4050-a047-0fee3727e521 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:32.055859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:32.070039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:32.073565 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4fc06f19-3a83-4be0-ab2d-a3f9cb08f94f req-1a9f4dfa-a76b-4050-a047-0fee3727e521 service nova] Creating event network-vif-deleted:2e4bd57c-5519-4d76-a1db-9fe07d5d4d69 for instance 8b50483e-af66-4d8d-b553-e465cd1389e9 on n-h2-854663-10 Oct 27 10:14:32.079959 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-42016863-7177-4d7a-8954-d7134063164e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1354 microversion: 2.1 time: 0.237822 Oct 27 10:14:32.081361 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 826/1700] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:31 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:32.087124 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4fc06f19-3a83-4be0-ab2d-a3f9cb08f94f req-1a9f4dfa-a76b-4050-a047-0fee3727e521 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056683 Oct 27 10:14:32.088178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fecc7acd-ccdf-4b15-b807-597c765869ef tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d5acd5e50>, body: {"security_group_rule": {"parent_group_id": "1127f4a5-133b-4ba2-987d-51cb583ad757", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:32.094906 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 875/1701] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:32.102521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:32.106744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:32.121448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:32.122607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:32.124774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:32.126987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:32.127989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:32.129081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:32.146362 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fecc7acd-ccdf-4b15-b807-597c765869ef tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fecc7acd-ccdf-4b15-b807-597c765869ef tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Request method failure captured: Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 138 Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWln4pIZFt3ljPoaUThk7mLnBK6h80_Aiz1y30CBLVTBIrHs8BojH8rBUTaHTeBZEh1gtjIeqsD4BsxKQquaEn4OrO_QDlhUZHmTGuhlCiKcxuiiUbpEUP-dXNKMwWn8CGXrgiO6pyJO9g0gnlLqtyt7BE9tUes7Pk4lTbhi0jj90G9A Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:14:32.148447 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_367e974ca942481ba0e28e52dfda3a66", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 7da0d95418454bbd9e84ada0fc6f0d0a Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: {"security_group_rule": {"parent_group_id": "1127f4a5-133b-4ba2-987d-51cb583ad757", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 27 10:14:32.150279 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1127f4a5-133b-4ba2-987d-51cb583ad757', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:32.151247 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 10:14:32.153313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:32.154925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fecc7acd-ccdf-4b15-b807-597c765869ef tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:32.154925 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fecc7acd-ccdf-4b15-b807-597c765869ef tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.070603 Oct 27 10:14:32.155548 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 827/1702] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:14:32 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:14:32.161752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-acad0cb4-060d-43f4-a104-bb829528a416 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] Calling method '.version_select at 0x7f6d63778ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:32.455502 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-acad0cb4-060d-43f4-a104-bb829528a416 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/59b95aa7-b13e-4ba0-82bb-fbe42e54363b" status: 202 len: 0 microversion: 2.1 time: 0.298862 Oct 27 10:14:32.460809 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 828/1703] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:14:32 2022] DELETE /compute/v2.1/os-security-groups/59b95aa7-b13e-4ba0-82bb-fbe42e54363b => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:32.466738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e5fa3df-8613-4d2c-bd47-dd81fdea3a88 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d6373e820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-101494671", "description": "tempest-description-360471268"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:32.786373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:32.801210 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-010610e1-d201-4e5d-9e21-6723ba0210f3 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1468 microversion: 2.1 time: 0.704982 Oct 27 10:14:32.810356 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 876/1704] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:32 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1468 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:32.826159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:32.827334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:32.844375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:32.846704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:32.850571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:32.851615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:32.852237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:32.852863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:33.258963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:33.270495 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c750be14-7788-4971-859c-a38e50246b71 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1324 microversion: 2.1 time: 0.458393 Oct 27 10:14:33.276888 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 877/1705] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:32 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:33.281691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0581e1b9-cfc1-498b-9d27-4c26a6c78585 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] Calling method '.version_select at 0x7f6d63999790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:33.368188 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e5fa3df-8613-4d2c-bd47-dd81fdea3a88 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.905854 Oct 27 10:14:33.378438 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 829/1706] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:14:32 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:33.385431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:33.386297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:33.404260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:33.405520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:33.406180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:33.407289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:33.407965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:33.408934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:33.788758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:33.812075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:33.814871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:33.817082 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9367d32-d657-44e1-b92f-af39215761cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.436284 Oct 27 10:14:33.828696 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 830/1707] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:33 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:33.836206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2a4a4c1f-0b48-4a7e-9b8f-920358d3e8c5 req-31534882-6205-4bc1-a8f0-91dea144ccd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2f136b-ddc6-40fe-8748-548f89936683", "name": "network-vif-plugged", "status": "completed", "tag": "c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:33.854952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2a4a4c1f-0b48-4a7e-9b8f-920358d3e8c5 req-31534882-6205-4bc1-a8f0-91dea144ccd0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:33.855864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2a4a4c1f-0b48-4a7e-9b8f-920358d3e8c5 req-31534882-6205-4bc1-a8f0-91dea144ccd0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:33.861942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2a4a4c1f-0b48-4a7e-9b8f-920358d3e8c5 req-31534882-6205-4bc1-a8f0-91dea144ccd0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:33.906551 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2a4a4c1f-0b48-4a7e-9b8f-920358d3e8c5 req-31534882-6205-4bc1-a8f0-91dea144ccd0 service nova] Creating event network-vif-plugged:c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6 for instance ed2f136b-ddc6-40fe-8748-548f89936683 on n-h1-854663-10 Oct 27 10:14:33.921898 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2a4a4c1f-0b48-4a7e-9b8f-920358d3e8c5 req-31534882-6205-4bc1-a8f0-91dea144ccd0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100679 Oct 27 10:14:33.922679 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 831/1708] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:33.931249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:33.932727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:33.951094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:33.952309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:33.953086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:33.954510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:33.955223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:33.956628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:33.999081 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0581e1b9-cfc1-498b-9d27-4c26a6c78585 tempest-SecurityGroupsTestAdminJSON-485824498 tempest-SecurityGroupsTestAdminJSON-485824498-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/12dc960a-2e73-4719-8d34-d590093d49b0" status: 202 len: 0 microversion: 2.1 time: 0.720891 Oct 27 10:14:34.000396 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 878/1709] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:14:33 2022] DELETE /compute/v2.1/os-security-groups/12dc960a-2e73-4719-8d34-d590093d49b0 => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:34.006406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de84d8c7-383c-4bed-9460-b63a34cdc4de tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d638a1d30>, body: {"security_group_rule": {"parent_group_id": "81e394f1-2bdd-4b47-8d87-c63fc72ccd01", "ip_protocol": "tcp", "from_port": 22, "to_port": 1620238809}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:34.255314 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-de84d8c7-383c-4bed-9460-b63a34cdc4de tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] HTTP exception thrown: Invalid port range 22:1620238809. Valid TCP ports should be between 1-65535 Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de84d8c7-383c-4bed-9460-b63a34cdc4de tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Request method failure captured: Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 146 Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWln4pIZFt3ljPoaUThk7mLnBK6h80_Aiz1y30CBLVTBIrHs8BojH8rBUTaHTeBZEh1gtjIeqsD4BsxKQquaEn4OrO_QDlhUZHmTGuhlCiKcxuiiUbpEUP-dXNKMwWn8CGXrgiO6pyJO9g0gnlLqtyt7BE9tUes7Pk4lTbhi0jj90G9A Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:34.259268 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_367e974ca942481ba0e28e52dfda3a66", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7da0d95418454bbd9e84ada0fc6f0d0a Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: {"security_group_rule": {"parent_group_id": "81e394f1-2bdd-4b47-8d87-c63fc72ccd01", "ip_protocol": "tcp", "from_port": 22, "to_port": 1620238809}} Oct 27 10:14:34.261054 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid port range 22:1620238809. Valid TCP ports should be between 1-65535 Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'security_group_rule': {'parent_group_id': '81e394f1-2bdd-4b47-8d87-c63fc72ccd01', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1620238809}}} Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1620238809. Valid TCP ports should be between 1-65535 Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:34.262073 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1620238809. Valid TCP ports should be between 1-65535 Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1620238809. Valid TCP ports should be between 1-65535 Oct 27 10:14:34.263604 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.266349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de84d8c7-383c-4bed-9460-b63a34cdc4de tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Returning 400 to user: Invalid port range 22:1620238809. Valid TCP ports should be between 1-65535 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:34.267387 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de84d8c7-383c-4bed-9460-b63a34cdc4de tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.265114 Oct 27 10:14:34.268774 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 879/1710] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:14:34 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:14:34.286923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:34.288472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:34.296125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:34.300307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:34.301343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:34.302380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:34.303374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:34.304127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:34.304851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:34.307683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa85495d-344c-4c78-9936-e4a17eb8d057 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1804 microversion: 2.1 time: 0.380236 Oct 27 10:14:34.308135 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 832/1711] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:33 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1804 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:34.316485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf0cf614-849f-4ac8-9a25-fce59e3befa3 tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] Calling method '.version_select at 0x7f6d5ad624c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:34.477950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3b45c026064d6c946f50a4d9d32c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a8ef842a242469ffa508e1cf9f378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:34.489125 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb7d38be-36b7-4982-8237-952d5add0112 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 200 len: 1426 microversion: 2.1 time: 0.218918 Oct 27 10:14:34.489892 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 880/1712] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:34 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 1426 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:34.495364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-200878fb-6e38-40fb-9268-04e8d35142ac req-f4ede767-d360-4fe8-b038-0d6b19576b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb77378-15a7-4ccf-ac15-96574a205e0a", "name": "network-vif-deleted", "tag": "ba2f9293-c098-436c-8a1a-23b264e8b733"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:34.517687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-200878fb-6e38-40fb-9268-04e8d35142ac req-f4ede767-d360-4fe8-b038-0d6b19576b31 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:34.518166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-200878fb-6e38-40fb-9268-04e8d35142ac req-f4ede767-d360-4fe8-b038-0d6b19576b31 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:34.518589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-200878fb-6e38-40fb-9268-04e8d35142ac req-f4ede767-d360-4fe8-b038-0d6b19576b31 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:34.538893 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-200878fb-6e38-40fb-9268-04e8d35142ac req-f4ede767-d360-4fe8-b038-0d6b19576b31 service nova] Creating event network-vif-deleted:ba2f9293-c098-436c-8a1a-23b264e8b733 for instance 3eb77378-15a7-4ccf-ac15-96574a205e0a on n-h1-854663-10 Oct 27 10:14:34.545723 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-200878fb-6e38-40fb-9268-04e8d35142ac req-f4ede767-d360-4fe8-b038-0d6b19576b31 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053933 Oct 27 10:14:34.546948 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 881/1713] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:34.553805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10c47114-87d7-4323-9a12-f87153aed951 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Action: 'create', calling method: .version_select at 0x7f6d639480d0>, body: {"security_group_rule": {"parent_group_id": "108d1500-2bae-4429-8ba3-01288fa1192a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:34.644423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-10c47114-87d7-4323-9a12-f87153aed951 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 108d1500-2bae-4429-8ba3-01288fa1192a does not exist", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:14:34.645518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.security_group_api [None req-10c47114-87d7-4323-9a12-f87153aed951 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Neutron security group 108d1500-2bae-4429-8ba3-01288fa1192a not found {{(pid=120720) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:14:34.646135 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-10c47114-87d7-4323-9a12-f87153aed951 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] HTTP exception thrown: Security group 108d1500-2bae-4429-8ba3-01288fa1192a does not exist Oct 27 10:14:34.646135 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-534a469f-9227-4a89-9e67-ac87755e8b80'] Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10c47114-87d7-4323-9a12-f87153aed951 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Request method failure captured: Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 138 Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWln4pIZFt3ljPoaUThk7mLnBK6h80_Aiz1y30CBLVTBIrHs8BojH8rBUTaHTeBZEh1gtjIeqsD4BsxKQquaEn4OrO_QDlhUZHmTGuhlCiKcxuiiUbpEUP-dXNKMwWn8CGXrgiO6pyJO9g0gnlLqtyt7BE9tUes7Pk4lTbhi0jj90G9A Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:34.648438 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_367e974ca942481ba0e28e52dfda3a66", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7da0d95418454bbd9e84ada0fc6f0d0a Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: {"security_group_rule": {"parent_group_id": "108d1500-2bae-4429-8ba3-01288fa1192a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 10:14:34.650287 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group 108d1500-2bae-4429-8ba3-01288fa1192a does not exist Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-534a469f-9227-4a89-9e67-ac87755e8b80'] Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'security_group_rule': {'parent_group_id': '108d1500-2bae-4429-8ba3-01288fa1192a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:14:34.651388 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 108d1500-2bae-4429-8ba3-01288fa1192a does not exist Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-534a469f-9227-4a89-9e67-ac87755e8b80'] Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 27 10:14:34.652960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 108d1500-2bae-4429-8ba3-01288fa1192a does not exist Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-534a469f-9227-4a89-9e67-ac87755e8b80'] Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 108d1500-2bae-4429-8ba3-01288fa1192a does not exist Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-534a469f-9227-4a89-9e67-ac87755e8b80'] Oct 27 10:14:34.654437 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 108d1500-2bae-4429-8ba3-01288fa1192a does not exist Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-534a469f-9227-4a89-9e67-ac87755e8b80'] Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10c47114-87d7-4323-9a12-f87153aed951 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Returning 404 to user: Security group 108d1500-2bae-4429-8ba3-01288fa1192a does not exist Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-534a469f-9227-4a89-9e67-ac87755e8b80'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:34.655992 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10c47114-87d7-4323-9a12-f87153aed951 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.103247 Oct 27 10:14:34.658088 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 882/1714] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:14:34 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:34.666267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:34.667011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:34.677499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:34.678451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:34.679440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:34.681696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:34.682412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:34.682996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:35.364011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:35.375001 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef16fe5f-af1d-4ec7-ac8b-e5d25677a313 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1324 microversion: 2.1 time: 0.719443 Oct 27 10:14:35.377724 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 883/1715] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:34 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1324 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:35.384898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d38dcea8-7a5d-4225-a6b1-c8b4a08564e5 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:35.386119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d38dcea8-7a5d-4225-a6b1-c8b4a08564e5 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:35.392645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d38dcea8-7a5d-4225-a6b1-c8b4a08564e5 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:35.393540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d38dcea8-7a5d-4225-a6b1-c8b4a08564e5 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:35.394113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d38dcea8-7a5d-4225-a6b1-c8b4a08564e5 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:35.395295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d38dcea8-7a5d-4225-a6b1-c8b4a08564e5 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:35.395807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d38dcea8-7a5d-4225-a6b1-c8b4a08564e5 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:35.402312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d38dcea8-7a5d-4225-a6b1-c8b4a08564e5 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:35.418913 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf0cf614-849f-4ac8-9a25-fce59e3befa3 tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/f763fd69-9cc7-42e3-90c3-895e062a0206" status: 202 len: 0 microversion: 2.1 time: 1.109442 Oct 27 10:14:35.420385 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 833/1716] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:14:34 2022] DELETE /compute/v2.1/os-security-groups/f763fd69-9cc7-42e3-90c3-895e062a0206 => generated 0 bytes in 1112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:35.431986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7dfdbbaa-25c4-4c8f-9c7d-2cf88ae0e5e1 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Calling method '.version_select at 0x7f6d5ad62280>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:35.463507 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d38dcea8-7a5d-4225-a6b1-c8b4a08564e5 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443/ips" status: 200 len: 218 microversion: 2.1 time: 0.084215 Oct 27 10:14:35.464274 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 884/1717] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:14:35 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443/ips => generated 218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:35.472789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG neutronclient.v2_0.client [None req-7dfdbbaa-25c4-4c8f-9c7d-2cf88ae0e5e1 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule d40838bf-9fb4-4aa4-a419-78ce1203ea99 does not exist", "detail": ""}} {{(pid=120719) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:14:35.473394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.security_group_api [None req-7dfdbbaa-25c4-4c8f-9c7d-2cf88ae0e5e1 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Neutron security group rule d40838bf-9fb4-4aa4-a419-78ce1203ea99 not found {{(pid=120719) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 27 10:14:35.473922 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-7dfdbbaa-25c4-4c8f-9c7d-2cf88ae0e5e1 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] HTTP exception thrown: Security group rule d40838bf-9fb4-4aa4-a419-78ce1203ea99 does not exist Oct 27 10:14:35.473922 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-b122c4bb-f5ae-4073-8229-d02789f71644'] Oct 27 10:14:35.474273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:35.474886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7dfdbbaa-25c4-4c8f-9c7d-2cf88ae0e5e1 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Request method failure captured: Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-security-group-rules/d40838bf-9fb4-4aa4-a419-78ce1203ea99 HTTP/1.1 Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWln4pIZFt3ljPoaUThk7mLnBK6h80_Aiz1y30CBLVTBIrHs8BojH8rBUTaHTeBZEh1gtjIeqsD4BsxKQquaEn4OrO_QDlhUZHmTGuhlCiKcxuiiUbpEUP-dXNKMwWn8CGXrgiO6pyJO9g0gnlLqtyt7BE9tUes7Pk4lTbhi0jj90G9A Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:14:35.477493 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_367e974ca942481ba0e28e52dfda3a66", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/367e974ca942481ba0e28e52dfda3a66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 367e974ca942481ba0e28e52dfda3a66 Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308 Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 7da0d95418454bbd9e84ada0fc6f0d0a Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-194592308-project Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: exception: Security group rule d40838bf-9fb4-4aa4-a419-78ce1203ea99 does not exist Oct 27 10:14:35.479216 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-b122c4bb-f5ae-4073-8229-d02789f71644'] Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd40838bf-9fb4-4aa4-a419-78ce1203ea99'} Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:35.480123 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule d40838bf-9fb4-4aa4-a419-78ce1203ea99 does not exist Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b122c4bb-f5ae-4073-8229-d02789f71644'] Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 27 10:14:35.481702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule d40838bf-9fb4-4aa4-a419-78ce1203ea99 does not exist Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b122c4bb-f5ae-4073-8229-d02789f71644'] Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule d40838bf-9fb4-4aa4-a419-78ce1203ea99 does not exist Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b122c4bb-f5ae-4073-8229-d02789f71644'] Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:35.483012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule d40838bf-9fb4-4aa4-a419-78ce1203ea99 does not exist Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b122c4bb-f5ae-4073-8229-d02789f71644'] Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7dfdbbaa-25c4-4c8f-9c7d-2cf88ae0e5e1 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Returning 404 to user: Security group rule d40838bf-9fb4-4aa4-a419-78ce1203ea99 does not exist Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-b122c4bb-f5ae-4073-8229-d02789f71644'] {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7dfdbbaa-25c4-4c8f-9c7d-2cf88ae0e5e1 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-group-rules/d40838bf-9fb4-4aa4-a419-78ce1203ea99" status: 404 len: 199 microversion: 2.1 time: 0.057192 Oct 27 10:14:35.484435 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 834/1718] 10.222.0.76 () {58 vars in 1287 bytes} [Thu Oct 27 10:14:35 2022] DELETE /compute/v2.1/os-security-group-rules/d40838bf-9fb4-4aa4-a419-78ce1203ea99 => generated 199 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:35.487411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:35.487971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:35.488465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:35.489266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:35.489715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:35.490136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:35.493643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92b31527-0687-4907-8380-442509a42387 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Calling method '.version_select at 0x7f6d5ad0fc10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:35.542574 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92b31527-0687-4907-8380-442509a42387 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156" status: 200 len: 637 microversion: 2.1 time: 0.059344 Oct 27 10:14:35.543141 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 835/1719] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:14:35 2022] GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156 => generated 637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:35.548323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f01ffc57-e293-41f5-a22c-be3923b5785d tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] Calling method '.version_select at 0x7f6d639745e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:35.770650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:35.781360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:35.782897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:35.784247 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81859e4d-249b-481b-a89f-bbe1e0e28a5e tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.314142 Oct 27 10:14:35.785197 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 885/1720] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:35 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:35.791490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:35.791990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:35.798336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:35.799018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:35.799471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:35.800149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:35.800864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:35.801449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:35.828135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:14:35.921010 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f42d8873-1337-4e1f-9ff5-8ec481a83da8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 204 len: 0 microversion: 2.1 time: 0.134018 Oct 27 10:14:35.922115 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 886/1721] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:35 2022] DELETE /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:14:35.928057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1cb22c52-3c63-49fa-9008-d83776834cb0 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Calling method '.version_select at 0x7f6d638b78b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:35.949184 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f01ffc57-e293-41f5-a22c-be3923b5785d tempest-SecurityGroupsTestAdminJSON-609884146 tempest-SecurityGroupsTestAdminJSON-609884146-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/047cc42e-f3bc-4056-99fe-4ef67c2e9f8b" status: 202 len: 0 microversion: 2.1 time: 0.404707 Oct 27 10:14:35.950045 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 836/1722] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:14:35 2022] DELETE /compute/v2.1/os-security-groups/047cc42e-f3bc-4056-99fe-4ef67c2e9f8b => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:35.959596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:35.960940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] [instance: 3eb77378-15a7-4ccf-ac15-96574a205e0a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:35.968807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:35.969680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:35.970532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:35.972102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:35.973277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:35.974159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:35.995744 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] HTTP exception thrown: Instance 3eb77378-15a7-4ccf-ac15-96574a205e0a could not be found. Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Request method failure captured: Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a HTTP/1.1 Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWliSBM_kQnlJ8tqqRNq06NmfI0fL4hKZLitpcAPyN6ev-g5f7Ej7eMU8avi0lGd7lxlojGKJdrSjR2mSpaG4Mr1gRxbvFsdm019em-j6CKF6ZI_BzMQb88d1sUgjyKlDpKqHB1X5OZK2KTvOA-P4dFUmf62JtNsPo4zHbkQbU5GWrHo Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 895a8ef842a242469ffa508e1cf9f378 Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:14:36.006144 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_895a8ef842a242469ffa508e1cf9f378", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/895a8ef842a242469ffa508e1cf9f378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 895a8ef842a242469ffa508e1cf9f378 Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-MigrationsAdminTest-344464103 Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-MigrationsAdminTest-344464103-project Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: ae3b45c026064d6c946f50a4d9d32c2f Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-MigrationsAdminTest-344464103-project Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 3eb77378-15a7-4ccf-ac15-96574a205e0a could not be found. Oct 27 10:14:36.007787 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '3eb77378-15a7-4ccf-ac15-96574a205e0a'} Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb77378-15a7-4ccf-ac15-96574a205e0a could not be found. Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:36.008626 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb77378-15a7-4ccf-ac15-96574a205e0a could not be found. Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb77378-15a7-4ccf-ac15-96574a205e0a could not be found. Oct 27 10:14:36.009984 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:36.011223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] Returning 404 to user: Instance 3eb77378-15a7-4ccf-ac15-96574a205e0a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:36.011223 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-108c1157-a896-4d0a-8dc1-2f17c1c3d2b2 tempest-MigrationsAdminTest-344464103 tempest-MigrationsAdminTest-344464103-project] 10.222.0.76 "GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a" status: 404 len: 111 microversion: 2.1 time: 0.058275 Oct 27 10:14:36.011223 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 837/1723] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:35 2022] GET /compute/v2.1/servers/3eb77378-15a7-4ccf-ac15-96574a205e0a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:36.020579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ba2f0e5-6e68-4ed2-ba96-38a468a7564e tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Action: 'update_all', calling method: .version_select at 0x7f6d5ad62a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:36.087528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ba2f0e5-6e68-4ed2-ba96-38a468a7564e tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:36.095752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ba2f0e5-6e68-4ed2-ba96-38a468a7564e tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for user 8e828407e1db47389a89ae02da5215d5 and project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:36.268366 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1cb22c52-3c63-49fa-9008-d83776834cb0 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/81e394f1-2bdd-4b47-8d87-c63fc72ccd01" status: 202 len: 0 microversion: 2.1 time: 0.344702 Oct 27 10:14:36.270200 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 887/1724] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:14:35 2022] DELETE /compute/v2.1/os-security-groups/81e394f1-2bdd-4b47-8d87-c63fc72ccd01 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:36.277918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:36.278914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:36.296634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:36.302589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:36.303100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:36.303882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:36.304348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:36.304822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:36.488407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:36.498950 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25b3d717-fc6f-45a5-bfdd-5b3529d407f8 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1810 microversion: 2.1 time: 0.227458 Oct 27 10:14:36.500026 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 888/1725] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:36 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:36.505854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44f3ef20-fa4b-437e-803d-ad080a3dd86f tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Calling method '.version_select at 0x7f6d63948af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:36.729906 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ba2f0e5-6e68-4ed2-ba96-38a468a7564e tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 61 microversion: 2.1 time: 0.713752 Oct 27 10:14:36.735258 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 838/1726] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:14:36 2022] PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 61 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:36.744132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:36.746255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:36.753638 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44f3ef20-fa4b-437e-803d-ad080a3dd86f tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/1127f4a5-133b-4ba2-987d-51cb583ad757" status: 202 len: 0 microversion: 2.1 time: 0.252202 Oct 27 10:14:36.755405 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 889/1727] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:14:36 2022] DELETE /compute/v2.1/os-security-groups/1127f4a5-133b-4ba2-987d-51cb583ad757 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:36.762970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6228e33e-be10-44dd-88e9-b672f8848b99 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Calling method '.version_select at 0x7f6d5b4a5940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:36.764942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:36.765435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:36.765865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:36.766898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:36.767017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:36.767388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:36.981038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:36.989486 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77ac9021-2f1c-4f43-ad3a-7c9f032c1109 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1324 microversion: 2.1 time: 0.253114 Oct 27 10:14:37.005228 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 839/1728] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:36 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:37.012507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df8f7cfc-df08-4b8c-8c6c-e90ab90a98c3 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Calling method '.version_select at 0x7f6d63752af0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:37.119337 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6228e33e-be10-44dd-88e9-b672f8848b99 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "DELETE /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.361826 Oct 27 10:14:37.123491 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 890/1729] 10.222.0.76 () {58 vars in 1296 bytes} [Thu Oct 27 10:14:36 2022] DELETE /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata/os_version => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:14:37.139446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:37.141110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:37.156682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:37.157379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:37.158012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:37.160861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:37.161525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:37.162359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:37.405959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:37.423087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:37.424974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:37.428815 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e26e77df-0575-4006-985a-7314b785b1cd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.304135 Oct 27 10:14:37.432539 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 891/1730] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:37 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:37.440734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35c58676-a4de-4273-b92e-96f766a3caf7 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Calling method '.version_select at 0x7f6d638b78b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:37.453601 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df8f7cfc-df08-4b8c-8c6c-e90ab90a98c3 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/29e7fd6e-3d0d-4107-9ca8-2a0050b7ba0a" status: 202 len: 0 microversion: 2.1 time: 0.446652 Oct 27 10:14:37.454382 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 840/1731] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:14:37 2022] DELETE /compute/v2.1/os-security-groups/29e7fd6e-3d0d-4107-9ca8-2a0050b7ba0a => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:37.463742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c85d0acb-cfd1-4135-9239-738c25de4b85 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Calling method '.version_select at 0x7f6d63778670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:37.504096 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35c58676-a4de-4273-b92e-96f766a3caf7 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 37 microversion: 2.1 time: 0.070233 Oct 27 10:14:37.512524 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 892/1732] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:14:37 2022] GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 37 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:37.521221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9647481-9805-4431-a57c-8922430042f4 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Action: 'update_all', calling method: .version_select at 0x7f6d63944af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:37.609039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c9647481-9805-4431-a57c-8922430042f4 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:37.623136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c9647481-9805-4431-a57c-8922430042f4 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for user 8e828407e1db47389a89ae02da5215d5 and project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:37.970593 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9647481-9805-4431-a57c-8922430042f4 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 61 microversion: 2.1 time: 0.456329 Oct 27 10:14:37.972138 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 893/1733] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:14:37 2022] PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 61 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:37.978187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:37.979117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:37.988305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:37.989425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:37.990204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:37.991652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:37.992423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:37.993104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:38.085029 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c85d0acb-cfd1-4135-9239-738c25de4b85 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/fc2d1bbc-bc42-443d-931b-4334d817b00a" status: 202 len: 0 microversion: 2.1 time: 0.626107 Oct 27 10:14:38.085949 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 841/1734] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:14:37 2022] DELETE /compute/v2.1/os-security-groups/fc2d1bbc-bc42-443d-931b-4334d817b00a => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:14:38.091084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a3ef089-a11a-4f02-9a64-be53b05f3036 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Calling method '.version_select at 0x7f6d63773af0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:38.157106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a3ef089-a11a-4f02-9a64-be53b05f3036 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.069688 Oct 27 10:14:38.157725 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 842/1735] 10.222.0.76 () {58 vars in 1290 bytes} [Thu Oct 27 10:14:38 2022] GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata/os_distro => generated 33 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:38.171447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:38.172084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:38.191275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:38.191772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:38.192212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:38.193078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:38.193530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:38.193962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:38.648108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:38.672272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:38.677595 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-612fbfe8-f6aa-43d2-859b-25a136ae9a53 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 200 len: 1519 microversion: 2.1 time: 0.515480 Oct 27 10:14:38.678109 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 843/1736] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:38 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 1519 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:38.697399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4744f528-4978-46cd-b650-360699e5de97 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] Calling method '.version_select at 0x7f6d6375e670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:38.703149 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6cb33267-8e47-428b-8668-f61debc29ec7 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1810 microversion: 2.1 time: 0.729600 Oct 27 10:14:38.704017 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 894/1737] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:37 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1810 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:38.709479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05adc2a7-d756-4f4d-a459-b00788977783 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Action: 'update_all', calling method: .version_select at 0x7f6d638e5ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:38.835329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-05adc2a7-d756-4f4d-a459-b00788977783 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:38.869180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-05adc2a7-d756-4f4d-a459-b00788977783 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for user 8e828407e1db47389a89ae02da5215d5 and project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:39.311533 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05adc2a7-d756-4f4d-a459-b00788977783 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 61 microversion: 2.1 time: 0.605770 Oct 27 10:14:39.312594 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 895/1738] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:14:38 2022] PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 61 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:39.327525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:39.328348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:39.347445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:39.347946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:39.349010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:39.349144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:39.363827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:39.364860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:39.636850 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4744f528-4978-46cd-b650-360699e5de97 tempest-SecurityGroupRulesNegativeTestJSON-194592308 tempest-SecurityGroupRulesNegativeTestJSON-194592308-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/c93a49c3-1f14-41e0-ba3d-60b324d0a555" status: 202 len: 0 microversion: 2.1 time: 0.955713 Oct 27 10:14:39.641751 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 844/1739] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:14:38 2022] DELETE /compute/v2.1/os-security-groups/c93a49c3-1f14-41e0-ba3d-60b324d0a555 => generated 0 bytes in 963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:39.649817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Action: 'action', calling method: .version_select at 0x7f6d612998b0>, body: {"addFloatingIp": {"address": "172.25.9.66"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:39.658841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:39.673122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:39.674577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:39.675239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:39.677006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:39.678129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:39.679063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:39.756563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:39.771691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:39.801384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:39.806499 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-06565e30-363c-44ec-aa5c-77724e1cc6e7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1815 microversion: 2.25 time: 0.490128 Oct 27 10:14:39.810316 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 896/1740] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:39 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1815 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:39.839999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e31772c7-b313-4db4-990c-37bfa639ddc5 req-5e489fdc-762c-4701-837a-25a8532367e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e93913f7-7e3d-4d26-89df-544623f1e443", "name": "network-vif-deleted", "tag": "c07b81f9-3b8a-41e6-a354-797ac9a9f706"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:39.859533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e31772c7-b313-4db4-990c-37bfa639ddc5 req-5e489fdc-762c-4701-837a-25a8532367e0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:39.860897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e31772c7-b313-4db4-990c-37bfa639ddc5 req-5e489fdc-762c-4701-837a-25a8532367e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:39.861953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e31772c7-b313-4db4-990c-37bfa639ddc5 req-5e489fdc-762c-4701-837a-25a8532367e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:39.876714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "refresh_cache-6a303ce6-db7c-42ad-b551-24e839f1ac67" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:14:39.877112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquired lock "refresh_cache-6a303ce6-db7c-42ad-b551-24e839f1ac67" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:14:39.913019 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e31772c7-b313-4db4-990c-37bfa639ddc5 req-5e489fdc-762c-4701-837a-25a8532367e0 service nova] Creating event network-vif-deleted:c07b81f9-3b8a-41e6-a354-797ac9a9f706 for instance e93913f7-7e3d-4d26-89df-544623f1e443 on n-h1-854663-10 Oct 27 10:14:39.918995 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e31772c7-b313-4db4-990c-37bfa639ddc5 req-5e489fdc-762c-4701-837a-25a8532367e0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105492 Oct 27 10:14:39.919638 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 897/1741] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:39.924908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e495c1a-4972-4685-8fd5-3a38ed8c000f tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Calling method '.version_select at 0x7f6d638cd0d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:39.998561 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e495c1a-4972-4685-8fd5-3a38ed8c000f tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 61 microversion: 2.1 time: 0.076952 Oct 27 10:14:39.999147 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 898/1742] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:14:39 2022] GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 61 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:40.007306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:40.021093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:40.028483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:40.029263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:40.029895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:40.030781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:40.031404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:40.031995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:41.040639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:41.053003 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-967c333b-8511-47eb-9599-f48282e6ebcd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 200 len: 1632 microversion: 2.1 time: 1.052174 Oct 27 10:14:41.054280 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 899/1743] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:39 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 1632 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:41.065443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1f80ea9-0f8d-4fe7-aaad-2debee7782dc tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Action: 'update_all', calling method: .version_select at 0x7f6d638b11f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:41.152206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b1f80ea9-0f8d-4fe7-aaad-2debee7782dc tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:41.164895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b1f80ea9-0f8d-4fe7-aaad-2debee7782dc tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for user 8e828407e1db47389a89ae02da5215d5 and project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:41.432015 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1f80ea9-0f8d-4fe7-aaad-2debee7782dc tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 61 microversion: 2.1 time: 0.375997 Oct 27 10:14:41.433348 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 900/1744] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:14:41 2022] PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 61 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:41.443862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:41.444982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:41.452971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:41.453850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:41.454388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:41.455293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:41.455842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:41.456390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:42.138998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:42.153844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:42.157635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:42.160948 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ba7a7b4-6911-4389-b1a5-ccaf6c3e08c9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1805 microversion: 2.25 time: 0.726162 Oct 27 10:14:42.161801 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 901/1745] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:41 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1805 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:42.167463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b221424c-92f7-4e21-a2ec-d15cfa53d6df tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Action: 'update_all', calling method: .version_select at 0x7f6d638a1a60>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:42.254478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b221424c-92f7-4e21-a2ec-d15cfa53d6df tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:42.266584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b221424c-92f7-4e21-a2ec-d15cfa53d6df tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for user 8e828407e1db47389a89ae02da5215d5 and project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:42.705738 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b221424c-92f7-4e21-a2ec-d15cfa53d6df tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 64 microversion: 2.1 time: 0.541871 Oct 27 10:14:42.715436 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 902/1746] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:14:42 2022] PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 64 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:42.756250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Building network info cache for instance {{(pid=120719) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:14:43.031771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-91473226", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:43.117374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:14:43.425774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:14:43.426475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:14:43.426651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:14:43.427719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:14:43.428137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:14:43.443499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:43.444294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:43.445280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:43.447279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:43.450195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:43.450833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:43.489229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:43.517932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:43.558164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:14:43.564917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:14:43.663466 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed42a9e4-d653-4372-9a5e-87136cc824fa tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950888 Oct 27 10:14:43.664679 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 903/1747] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:14:43.673547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-51672176", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f584544f-ec56-4541-905d-7537ec4732b5"}], "block_device_mapping_v2": [{"uuid": "a01e7d4f-349d-4bef-8c01-6f405b81763d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:43.699614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Updating instance_info_cache with network_info: [{"id": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2", "address": "fa:16:3e:7c:f0:a0", "network": {"id": "cb698d4f-9293-4505-96fd-2eab544a9110", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-429421790-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c83852e942904ae58e59f9f6b8e0bc16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5db2ef4f-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120719) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:14:43.722414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Releasing lock "refresh_cache-6a303ce6-db7c-42ad-b551-24e839f1ac67" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:14:43.723590 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07503666-b062-452d-b08b-3043920e9989 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "POST /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67/action" status: 202 len: 0 microversion: 2.1 time: 4.080745 Oct 27 10:14:43.730891 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 845/1748] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:14:39 2022] POST /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67/action => generated 0 bytes in 4089 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 10:14:43.746621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:43.747277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:43.770222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:43.770811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:43.771169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:43.774941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:43.775644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:43.777168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:43.813233 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] HTTP exception thrown: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Request method failure captured: Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 HTTP/1.1 Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlnP4L5suYQXbz5qpPuGGevrujrRpzZ-vLfzXUF3ZaSlSX98orT2Cfi986wColyK07_HVLhuX1oEUP213nlEajHqSgzVHat2a2GhbVQPLn7d6HBtQk8uLaWXwaf9qe3Z7MBQU1KuUvs5iH5BWz4nrGK0YsOtTbCzC8YloNXi8zDQtBs Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:14:43.814799 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cdba716768804fa1b1e939964ccf25cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestMultiNic-1755480493 Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 7dbf1513514a45479dd04815d34889b6 Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:14:43.816214 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e93913f7-7e3d-4d26-89df-544623f1e443'} Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:43.817184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:14:43.818570 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:14:43.819952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Returning 404 to user: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:43.819952 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0dcf5e9a-0732-4682-86c1-a1b5a46a4f39 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 404 len: 111 microversion: 2.1 time: 0.082292 Oct 27 10:14:43.822591 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 846/1749] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:43 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:43.830324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95f068bb-d03a-44ee-b56b-5f63360ffbe5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '.version_select at 0x7f6d5ad67c10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:43.835910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f068bb-d03a-44ee-b56b-5f63360ffbe5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:43.836686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f068bb-d03a-44ee-b56b-5f63360ffbe5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:43.837298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f068bb-d03a-44ee-b56b-5f63360ffbe5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:43.857258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] validate_networks() for [('f584544f-ec56-4541-905d-7537ec4732b5', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:14:43.870499 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95f068bb-d03a-44ee-b56b-5f63360ffbe5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 2549 microversion: 2.25 time: 0.046076 Oct 27 10:14:43.881668 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 847/1750] 10.222.0.76 () {60 vars in 1184 bytes} [Thu Oct 27 10:14:43 2022] GET /compute/v2.1/os-migrations => generated 2549 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:44.001360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3231c78-2bc1-4700-bd53-4d04fe0a16d1 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Action: 'update', calling method: .version_select at 0x7f6d637f4b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:44.117000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3231c78-2bc1-4700-bd53-4d04fe0a16d1 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.117494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3231c78-2bc1-4700-bd53-4d04fe0a16d1 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.117935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3231c78-2bc1-4700-bd53-4d04fe0a16d1 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.118687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3231c78-2bc1-4700-bd53-4d04fe0a16d1 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.119141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3231c78-2bc1-4700-bd53-4d04fe0a16d1 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.119567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3231c78-2bc1-4700-bd53-4d04fe0a16d1 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.278629 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f3231c78-2bc1-4700-bd53-4d04fe0a16d1 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/ae1ebfacb9ee4593b99e145df7e1c5b0" status: 200 len: 240 microversion: 2.36 time: 0.394149 Oct 27 10:14:44.279504 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 848/1751] 10.222.0.76 () {62 vars in 1303 bytes} [Thu Oct 27 10:14:43 2022] PUT /compute/v2.1/os-quota-sets/ae1ebfacb9ee4593b99e145df7e1c5b0 => generated 240 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:44.292583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-39c7d4df-c544-4234-ad39-ce3800c72e69 req-b997b28c-39cb-40f6-9a70-0e84450652a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e93913f7-7e3d-4d26-89df-544623f1e443", "name": "network-vif-deleted", "tag": "d0236827-a847-4110-82c7-f970195cba36"}, {"server_uuid": "e93913f7-7e3d-4d26-89df-544623f1e443", "name": "network-vif-deleted", "tag": "2dfb9101-5f11-4430-93ab-6396979677c9"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:44.328029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-39c7d4df-c544-4234-ad39-ce3800c72e69 req-b997b28c-39cb-40f6-9a70-0e84450652a2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.328508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-39c7d4df-c544-4234-ad39-ce3800c72e69 req-b997b28c-39cb-40f6-9a70-0e84450652a2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.329041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-39c7d4df-c544-4234-ad39-ce3800c72e69 req-b997b28c-39cb-40f6-9a70-0e84450652a2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.368829 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-39c7d4df-c544-4234-ad39-ce3800c72e69 req-b997b28c-39cb-40f6-9a70-0e84450652a2 service nova] Creating event network-vif-deleted:d0236827-a847-4110-82c7-f970195cba36 for instance e93913f7-7e3d-4d26-89df-544623f1e443 on n-h1-854663-10 Oct 27 10:14:44.371190 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-39c7d4df-c544-4234-ad39-ce3800c72e69 req-b997b28c-39cb-40f6-9a70-0e84450652a2 service nova] Creating event network-vif-deleted:2dfb9101-5f11-4430-93ab-6396979677c9 for instance e93913f7-7e3d-4d26-89df-544623f1e443 on n-h1-854663-10 Oct 27 10:14:44.384515 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-39c7d4df-c544-4234-ad39-ce3800c72e69 req-b997b28c-39cb-40f6-9a70-0e84450652a2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098589 Oct 27 10:14:44.385961 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 849/1752] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:44.408607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7199e2b1-fefc-4822-b649-240d8040c18d tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Calling method '.version_select at 0x7f6d5ad67940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:44.516268 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7199e2b1-fefc-4822-b649-240d8040c18d tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 64 microversion: 2.1 time: 0.126333 Oct 27 10:14:44.517863 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 850/1753] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:14:44 2022] GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 64 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:44.528926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b5e6d993-6426-4bf9-8466-a40f8e2c5f04 req-09574c2a-317e-4c16-8620-59f8d4c20c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a303ce6-db7c-42ad-b551-24e839f1ac67", "tag": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:44.542721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b5e6d993-6426-4bf9-8466-a40f8e2c5f04 req-09574c2a-317e-4c16-8620-59f8d4c20c64 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.543483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b5e6d993-6426-4bf9-8466-a40f8e2c5f04 req-09574c2a-317e-4c16-8620-59f8d4c20c64 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.543940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b5e6d993-6426-4bf9-8466-a40f8e2c5f04 req-09574c2a-317e-4c16-8620-59f8d4c20c64 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.558980 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b5e6d993-6426-4bf9-8466-a40f8e2c5f04 req-09574c2a-317e-4c16-8620-59f8d4c20c64 service nova] Creating event network-changed:5db2ef4f-d5fd-4da1-92f9-6150e66be6d2 for instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 on n-h2-854663-10 Oct 27 10:14:44.566106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b5e6d993-6426-4bf9-8466-a40f8e2c5f04 req-09574c2a-317e-4c16-8620-59f8d4c20c64 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044534 Oct 27 10:14:44.567028 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 851/1754] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:44.576255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:44.577138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:44.596581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.596948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.598095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.598938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.601463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.602340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.750262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:44.760401 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f3ee412-0727-4449-8b4f-0ded4f078c2d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1219 microversion: 2.1 time: 0.191937 Oct 27 10:14:44.761482 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 852/1755] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:44 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:44.796468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.66"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:44.805091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:44.839923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.841095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.841783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.842740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.843711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.844355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.888361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "refresh_cache-ed2f136b-ddc6-40fe-8748-548f89936683" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:14:44.889189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquired lock "refresh_cache-ed2f136b-ddc6-40fe-8748-548f89936683" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:14:45.301294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:14:45.302320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:14:45.302983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:14:45.303621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:14:45.304187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:14:45.322782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:45.323434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:45.323687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:45.324405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:45.324895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:45.325314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:45.351655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:45.375893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:45.389000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Getting quotas for user 5db106c72e8745de8266a3ab7a5fe531 and project bda464c030cc4b3bb14a81d9a83261aa. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:45.567213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:14:45.569436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a01e7d4f-349d-4bef-8c01-6f405b81763d',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:14:45.884389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1acab1ca-787c-4b98-b1a3-bd85432a0ce9 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218267 Oct 27 10:14:45.887798 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 904/1756] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:14:45.900215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:45.901067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:45.909667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:45.910437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:45.911120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:45.912911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:45.913778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:45.914448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:46.857243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:46.864374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 029ff781-574b-48de-9033-cd8e69e64ec2 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:14:46.899623 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e121da9-7466-4093-b5a8-5921aa504fac tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 2426 microversion: 2.25 time: 1.009798 Oct 27 10:14:46.900034 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 905/1757] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:45 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 2426 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:46.923075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa5daddc-0398-4e21-afce-5a5712e23b3f tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Calling method '.version_select at 0x7f6d5bab1670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:47.161593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5daddc-0398-4e21-afce-5a5712e23b3f tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:47.162428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5daddc-0398-4e21-afce-5a5712e23b3f tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:47.163528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5daddc-0398-4e21-afce-5a5712e23b3f tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:47.164549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5daddc-0398-4e21-afce-5a5712e23b3f tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:47.165186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5daddc-0398-4e21-afce-5a5712e23b3f tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:47.166349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5daddc-0398-4e21-afce-5a5712e23b3f tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:47.187737 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa5daddc-0398-4e21-afce-5a5712e23b3f tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/ae1ebfacb9ee4593b99e145df7e1c5b0/detail" status: 200 len: 672 microversion: 2.36 time: 0.286161 Oct 27 10:14:47.188475 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 906/1758] 10.222.0.76 () {60 vars in 1304 bytes} [Thu Oct 27 10:14:46 2022] GET /compute/v2.1/os-quota-sets/ae1ebfacb9ee4593b99e145df7e1c5b0/detail => generated 672 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:47.193500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30578164-e5c1-48bd-880f-36df0f3f3fdc tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Action: 'update_all', calling method: .version_select at 0x7f6d638dde50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:47.254661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-30578164-e5c1-48bd-880f-36df0f3f3fdc tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:47.263647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-30578164-e5c1-48bd-880f-36df0f3f3fdc tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for user 8e828407e1db47389a89ae02da5215d5 and project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:47.832882 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30578164-e5c1-48bd-880f-36df0f3f3fdc tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 61 microversion: 2.1 time: 0.642971 Oct 27 10:14:47.834073 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 907/1759] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:14:47 2022] PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 61 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:47.840987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:47.842624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:47.857636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:47.859605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:47.860634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:47.861780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:47.862688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:47.863566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:48.192194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:48.206950 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16e69136-6b10-4116-a34d-8a538be1247d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1315 microversion: 2.1 time: 0.370376 Oct 27 10:14:48.208318 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 908/1760] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:47 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:48.221061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:48.221950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:48.237977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:48.240392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:48.245135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:48.246493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:48.247256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:48.247860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:48.512038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:48.547732 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b7d321d-d147-4267-9b13-6d128187c2f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1167 microversion: 2.1 time: 0.336132 Oct 27 10:14:48.570300 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 909/1761] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:48 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1167 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:48.575975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:48.576593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:48.586488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:48.586981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:48.587412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:48.588256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:48.589001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:48.589619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:48.947986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 029ff781-574b-48de-9033-cd8e69e64ec2 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:14:48.978620 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-834c8ac7-577d-4d88-a149-6be8a9878302 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 2426 microversion: 2.25 time: 0.407216 Oct 27 10:14:48.982855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 910/1762] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:14:48 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 2426 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:14:49.011020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Action: 'update', calling method: .version_select at 0x7f6d63944f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:49.454262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:49.460701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:49.461177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:49.462013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:49.462487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:49.462920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:49.513737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:49.514643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:49.515310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:49.516276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:49.517049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:49.518187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:49.605013 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2da37433-dca6-4580-9855-569f89752ee0 tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/ae1ebfacb9ee4593b99e145df7e1c5b0?user_id=1807b1f7790b443288c7c42ff66068f0" status: 200 len: 240 microversion: 2.36 time: 0.606317 Oct 27 10:14:49.613537 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 911/1763] 10.222.0.76 () {62 vars in 1384 bytes} [Thu Oct 27 10:14:48 2022] PUT /compute/v2.1/os-quota-sets/ae1ebfacb9ee4593b99e145df7e1c5b0?user_id=1807b1f7790b443288c7c42ff66068f0 => generated 240 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:49.623499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72b02ebd-d0d5-4f12-a584-4f3e0c6ce38e tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Action: 'update', calling method: .version_select at 0x7f6d63948dc0>, body: {"meta": {"os_version": "alt"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:49.684022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-72b02ebd-d0d5-4f12-a584-4f3e0c6ce38e tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:49.689515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-72b02ebd-d0d5-4f12-a584-4f3e0c6ce38e tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for user 8e828407e1db47389a89ae02da5215d5 and project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:50.014173 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.network.neutron [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] re-assign floating IP 172.25.9.66 from instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 Oct 27 10:14:50.022168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:50.046576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Building network info cache for instance {{(pid=120719) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:14:50.168924 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72b02ebd-d0d5-4f12-a584-4f3e0c6ce38e tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.554134 Oct 27 10:14:50.176934 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 912/1764] 10.222.0.76 () {60 vars in 1313 bytes} [Thu Oct 27 10:14:49 2022] PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata/os_version => generated 31 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:50.185413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:50.186326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:50.196464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:50.198518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:50.201245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:50.202245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:50.204178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:50.204836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:50.380448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lazy-loading 'services' on Instance uuid 029ff781-574b-48de-9033-cd8e69e64ec2 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:14:50.529279 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee59b076-7703-4362-bb50-6a1ea37945ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments/b0c3e322-3073-4653-8684-b035f9f0d4fa" status: 202 len: 0 microversion: 2.25 time: 0.350355 Oct 27 10:14:50.529897 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 913/1765] 10.222.0.76 () {60 vars in 1457 bytes} [Thu Oct 27 10:14:50 2022] DELETE /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments/b0c3e322-3073-4653-8684-b035f9f0d4fa => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:14:50.556476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:50.557191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:50.580647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:50.582391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:50.583076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:50.584089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:50.585467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:50.586143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:51.210250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:51.229172 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5db153e4-7898-4144-a724-8313c7ec52b8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1315 microversion: 2.1 time: 0.694182 Oct 27 10:14:51.230126 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 914/1766] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:50 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:51.236734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:51.237545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:51.254268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:51.255240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:51.255878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:51.257134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:51.258134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:51.259781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:52.086644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Updating instance_info_cache with network_info: [{"id": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2", "address": "fa:16:3e:7c:f0:a0", "network": {"id": "cb698d4f-9293-4505-96fd-2eab544a9110", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-429421790-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c83852e942904ae58e59f9f6b8e0bc16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5db2ef4f-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120719) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:14:52.109442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Building network info cache for instance {{(pid=120719) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:14:52.110537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:52.119153 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f96482a2-d873-4b4c-9067-054322cf2fda tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1209 microversion: 2.1 time: 0.887669 Oct 27 10:14:52.120285 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 915/1767] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:51 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1209 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:52.125395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c18bc564-82e7-4bf1-b7db-8f3ae02476fd tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] Calling method '.version_select at 0x7f6d638e5f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:52.285327 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c18bc564-82e7-4bf1-b7db-8f3ae02476fd tempest-QuotasAdminTestV236-347829682 tempest-QuotasAdminTestV236-347829682-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/ae1ebfacb9ee4593b99e145df7e1c5b0?user_id=1807b1f7790b443288c7c42ff66068f0" status: 200 len: 282 microversion: 2.36 time: 0.163492 Oct 27 10:14:52.286787 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 916/1768] 10.222.0.76 () {60 vars in 1364 bytes} [Thu Oct 27 10:14:52 2022] GET /compute/v2.1/os-quota-sets/ae1ebfacb9ee4593b99e145df7e1c5b0?user_id=1807b1f7790b443288c7c42ff66068f0 => generated 282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:52.297753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d910a7f8-66a4-4f46-8825-548105934831 req-d3d1fc17-08e5-4292-9749-9ff3789c6856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3771f18-a29a-4d03-97cf-1e23ec142e87", "tag": "1faa7e08-93b7-42ef-afb8-fe49e32820b8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:52.322854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d910a7f8-66a4-4f46-8825-548105934831 req-d3d1fc17-08e5-4292-9749-9ff3789c6856 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:52.326592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d910a7f8-66a4-4f46-8825-548105934831 req-d3d1fc17-08e5-4292-9749-9ff3789c6856 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:52.330402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d910a7f8-66a4-4f46-8825-548105934831 req-d3d1fc17-08e5-4292-9749-9ff3789c6856 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:52.369552 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d910a7f8-66a4-4f46-8825-548105934831 req-d3d1fc17-08e5-4292-9749-9ff3789c6856 service nova] Creating event network-changed:1faa7e08-93b7-42ef-afb8-fe49e32820b8 for instance a3771f18-a29a-4d03-97cf-1e23ec142e87 on n-h2-854663-10 Oct 27 10:14:52.380754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d910a7f8-66a4-4f46-8825-548105934831 req-d3d1fc17-08e5-4292-9749-9ff3789c6856 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092393 Oct 27 10:14:52.389795 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 917/1769] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:52.399732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cba179c4-bcb4-4207-943a-609143931fd7 req-facaa266-f9ac-464d-83c8-2cef566bbdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a303ce6-db7c-42ad-b551-24e839f1ac67", "tag": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:52.437032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cba179c4-bcb4-4207-943a-609143931fd7 req-facaa266-f9ac-464d-83c8-2cef566bbdc0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:52.440178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cba179c4-bcb4-4207-943a-609143931fd7 req-facaa266-f9ac-464d-83c8-2cef566bbdc0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:52.442580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cba179c4-bcb4-4207-943a-609143931fd7 req-facaa266-f9ac-464d-83c8-2cef566bbdc0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:52.473477 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cba179c4-bcb4-4207-943a-609143931fd7 req-facaa266-f9ac-464d-83c8-2cef566bbdc0 service nova] Creating event network-changed:5db2ef4f-d5fd-4da1-92f9-6150e66be6d2 for instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 on n-h2-854663-10 Oct 27 10:14:52.491285 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cba179c4-bcb4-4207-943a-609143931fd7 req-facaa266-f9ac-464d-83c8-2cef566bbdc0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095170 Oct 27 10:14:52.496004 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 918/1770] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:52.504407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70539755-1cec-496c-9090-65100a63f468 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Calling method '.version_select at 0x7f6d63925a60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:52.585855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70539755-1cec-496c-9090-65100a63f468 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 58 microversion: 2.1 time: 0.086600 Oct 27 10:14:52.587629 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 919/1771] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:14:52 2022] GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 58 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:52.600755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ef8aeb4-402b-45a5-a44a-69fe60da5d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:52.604436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ef8aeb4-402b-45a5-a44a-69fe60da5d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:52.622014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef8aeb4-402b-45a5-a44a-69fe60da5d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:52.623652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef8aeb4-402b-45a5-a44a-69fe60da5d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:52.624106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef8aeb4-402b-45a5-a44a-69fe60da5d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:52.626610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef8aeb4-402b-45a5-a44a-69fe60da5d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:52.627080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef8aeb4-402b-45a5-a44a-69fe60da5d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:52.627513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef8aeb4-402b-45a5-a44a-69fe60da5d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:52.680444 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ef8aeb4-402b-45a5-a44a-69fe60da5d4f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090869 Oct 27 10:14:52.699536 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 920/1772] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:14:52 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:52.714825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:52.716250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:52.736184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:52.743964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:52.745958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:52.747694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:52.749290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:52.750668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:53.297963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:53.309309 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf97e4cf-a885-400b-8c11-1c6243c48e2f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1315 microversion: 2.1 time: 0.607620 Oct 27 10:14:53.309909 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 921/1773] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:52 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:53.331985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74fbd369-fcf4-4522-893d-e99e5560d7f9 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Action: 'update_all', calling method: .version_select at 0x7f6d638a1a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:53.398525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-74fbd369-fcf4-4522-893d-e99e5560d7f9 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:53.405454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-74fbd369-fcf4-4522-893d-e99e5560d7f9 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for user 8e828407e1db47389a89ae02da5215d5 and project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:53.732911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Updating instance_info_cache with network_info: [{"id": "c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6", "address": "fa:16:3e:37:1e:2e", "network": {"id": "cb698d4f-9293-4505-96fd-2eab544a9110", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-429421790-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c83852e942904ae58e59f9f6b8e0bc16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc8c9d5b4-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120719) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:14:53.769640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Releasing lock "refresh_cache-ed2f136b-ddc6-40fe-8748-548f89936683" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:14:53.770799 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2be4bc84-c16f-4be5-a7ee-6b490e019d8a tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "POST /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683/action" status: 202 len: 0 microversion: 2.1 time: 8.984466 Oct 27 10:14:53.772094 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 853/1774] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:14:44 2022] POST /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683/action => generated 0 bytes in 8994 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 10:14:53.777475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:53.778683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:53.795450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:53.803672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:53.804357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:53.805424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:53.806234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:53.806817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:53.948577 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74fbd369-fcf4-4522-893d-e99e5560d7f9 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 61 microversion: 2.1 time: 0.621061 Oct 27 10:14:53.953900 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 922/1775] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:14:53 2022] PUT /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 61 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:53.958537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56dc8a2b-7bd3-4759-b27b-91fed998374d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:53.961069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56dc8a2b-7bd3-4759-b27b-91fed998374d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:53.976080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dc8a2b-7bd3-4759-b27b-91fed998374d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:53.976739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dc8a2b-7bd3-4759-b27b-91fed998374d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:53.977110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dc8a2b-7bd3-4759-b27b-91fed998374d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:53.977818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dc8a2b-7bd3-4759-b27b-91fed998374d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:53.978271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dc8a2b-7bd3-4759-b27b-91fed998374d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:53.978694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dc8a2b-7bd3-4759-b27b-91fed998374d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:54.070681 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56dc8a2b-7bd3-4759-b27b-91fed998374d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119987 Oct 27 10:14:54.074238 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 923/1776] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:14:53 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:54.083655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Action: 'action', calling method: .version_select at 0x7f6d61448790>, body: {"removeFloatingIp": {"address": "172.25.9.66"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:54.147730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:54.223512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:54.242343 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a7f302c-0d6f-4d28-a748-bdfd6ece1a9f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1209 microversion: 2.1 time: 0.467804 Oct 27 10:14:54.244875 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 854/1777] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:53 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1209 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:54.259513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-287a3bb5-3d1d-40e3-9c06-43efaf4639c1 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Action: 'create', calling method: .version_select at 0x7f6d5acbfee0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:54.286866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:54.365699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-287a3bb5-3d1d-40e3-9c06-43efaf4639c1 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:54.378397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-287a3bb5-3d1d-40e3-9c06-43efaf4639c1 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Getting quotas for user 8e828407e1db47389a89ae02da5215d5 and project 15c4e01483c340be86f0f23f82bac61b. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:54.673986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:54.680589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:54.681132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:54.681573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:54.682285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:54.682737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:54.683160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:54.903908 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-287a3bb5-3d1d-40e3-9c06-43efaf4639c1 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "POST /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 85 microversion: 2.1 time: 0.656173 Oct 27 10:14:54.913546 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 855/1778] 10.222.0.76 () {60 vars in 1281 bytes} [Thu Oct 27 10:14:54 2022] POST /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 85 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:54.921795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:54.923988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:54.941801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:54.942698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:54.944100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:54.945124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:54.946078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:54.947125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:56.126540 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] HTTP exception thrown: Floating IP 172.25.9.66 is not associated with instance 6a303ce6-db7c-42ad-b551-24e839f1ac67. Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Request method failure captured: Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67/action HTTP/1.1 Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 48 Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlnc2dXDjsUzsUMoVfvV1FNvO4_hxAuf1xwL9Kl4Et2qaB1JX4q6CYHlgzXIM7-YSF_VA_aquxl8Wl6JQmY7CBr07SYgGtUn3j1PYHWJ0Ung8JTXocDoEAMTiOR6ettS-xdXOZ9qU8j3rHIo5BiypqEx_5K9-Dqsg6Dw4gkOLaOTdD4 Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c83852e942904ae58e59f9f6b8e0bc16 Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:14:56.131085 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c83852e942904ae58e59f9f6b8e0bc16", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c83852e942904ae58e59f9f6b8e0bc16 Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsAssociationTestJSON-1191915132-project Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7f431586b08d4b139a2e18aeffab9c49 Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1191915132-project Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: {"removeFloatingIp": {"address": "172.25.9.66"}} Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:14:56.133067 n-d-854663-10 devstack@n-api.service[120720]: exception: Floating IP 172.25.9.66 is not associated with instance 6a303ce6-db7c-42ad-b551-24e839f1ac67. Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '6a303ce6-db7c-42ad-b551-24e839f1ac67', 'body': {'removeFloatingIp': {'address': '172.25.9.66'}}} Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.66 is not associated with instance 6a303ce6-db7c-42ad-b551-24e839f1ac67. Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:56.134059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:56.135489 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:56.135489 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:56.135489 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:56.135489 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:56.135489 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.66 is not associated with instance 6a303ce6-db7c-42ad-b551-24e839f1ac67. Oct 27 10:14:56.135489 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:14:56.135489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Returning 409 to user: Floating IP 172.25.9.66 is not associated with instance 6a303ce6-db7c-42ad-b551-24e839f1ac67. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:56.136090 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8e6ca2f-f71e-462d-9438-277a11f56627 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "POST /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67/action" status: 409 len: 145 microversion: 2.1 time: 2.060526 Oct 27 10:14:56.140632 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 924/1779] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:14:54 2022] POST /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67/action => generated 145 bytes in 2066 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:14:56.153203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e3efb187-13cc-46de-9b9e-c9b98993d2bd req-335d6a39-219b-432e-abb7-60e454ba7998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6435a0-0a3f-42a7-b87e-6d46af12f65d", "tag": "297733c1-9497-45d2-a8bd-4a6f5f31dcab"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:56.183071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:56.199420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e3efb187-13cc-46de-9b9e-c9b98993d2bd req-335d6a39-219b-432e-abb7-60e454ba7998 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:56.200117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e3efb187-13cc-46de-9b9e-c9b98993d2bd req-335d6a39-219b-432e-abb7-60e454ba7998 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:56.202555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e3efb187-13cc-46de-9b9e-c9b98993d2bd req-335d6a39-219b-432e-abb7-60e454ba7998 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:56.203057 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ecb5d22-d6eb-4db8-bf6a-3c2785b0487e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1315 microversion: 2.1 time: 1.284728 Oct 27 10:14:56.205438 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 856/1780] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:54 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1315 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:56.216616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6fe91668-3eb6-426f-bd4e-c330af204e54 req-08adc7d4-c940-424e-819f-5bcd7a62771d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2f136b-ddc6-40fe-8748-548f89936683", "tag": "c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:56.235786 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e3efb187-13cc-46de-9b9e-c9b98993d2bd req-335d6a39-219b-432e-abb7-60e454ba7998 service nova] Creating event network-changed:297733c1-9497-45d2-a8bd-4a6f5f31dcab for instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d on n-h1-854663-10 Oct 27 10:14:56.242385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6fe91668-3eb6-426f-bd4e-c330af204e54 req-08adc7d4-c940-424e-819f-5bcd7a62771d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:56.243699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6fe91668-3eb6-426f-bd4e-c330af204e54 req-08adc7d4-c940-424e-819f-5bcd7a62771d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:56.245310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6fe91668-3eb6-426f-bd4e-c330af204e54 req-08adc7d4-c940-424e-819f-5bcd7a62771d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:56.260868 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e3efb187-13cc-46de-9b9e-c9b98993d2bd req-335d6a39-219b-432e-abb7-60e454ba7998 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113867 Oct 27 10:14:56.261849 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 925/1781] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:56.288978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a474c5b-a57f-48c7-94cb-0f8e19e529a3 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] Calling method '.version_select at 0x7f6d63944160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:56.299067 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6fe91668-3eb6-426f-bd4e-c330af204e54 req-08adc7d4-c940-424e-819f-5bcd7a62771d service nova] Creating event network-changed:c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6 for instance ed2f136b-ddc6-40fe-8748-548f89936683 on n-h1-854663-10 Oct 27 10:14:56.313786 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6fe91668-3eb6-426f-bd4e-c330af204e54 req-08adc7d4-c940-424e-819f-5bcd7a62771d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106868 Oct 27 10:14:56.318305 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 857/1782] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:56.348424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c59cc632-2323-4d0b-a41f-b1bf173f14c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:56.358275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c59cc632-2323-4d0b-a41f-b1bf173f14c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:56.373332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c59cc632-2323-4d0b-a41f-b1bf173f14c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:56.374469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c59cc632-2323-4d0b-a41f-b1bf173f14c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:56.375145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c59cc632-2323-4d0b-a41f-b1bf173f14c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:56.379951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c59cc632-2323-4d0b-a41f-b1bf173f14c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:56.380655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c59cc632-2323-4d0b-a41f-b1bf173f14c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:56.382965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c59cc632-2323-4d0b-a41f-b1bf173f14c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:56.413522 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a474c5b-a57f-48c7-94cb-0f8e19e529a3 tempest-ImagesMetadataTestJSON-715641128 tempest-ImagesMetadataTestJSON-715641128-project] 10.222.0.76 "GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata" status: 200 len: 85 microversion: 2.1 time: 0.150144 Oct 27 10:14:56.415109 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 926/1783] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:14:56 2022] GET /compute/v2.1/images/ccfb5334-f8e5-483b-a01d-d1413f771156/metadata => generated 85 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:14:56.429248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:56.434462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:56.454572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:56.464728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:56.468827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:56.470027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:56.474016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:56.478139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:56.478139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:56.488419 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c59cc632-2323-4d0b-a41f-b1bf173f14c8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.157849 Oct 27 10:14:56.489054 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 858/1784] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:14:56 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:56.505683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Action: 'action', calling method: .version_select at 0x7f6d617bf9d0>, body: {"removeFloatingIp": {"address": "172.25.9.66"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:57.115255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:57.122945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:57.123671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:57.123850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:57.126315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:57.130087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:57.131570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:57.372100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:57.380862 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e0f165e2-60c2-4729-9cda-c0ef88ad014c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1209 microversion: 2.1 time: 0.964215 Oct 27 10:14:57.381849 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 927/1785] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:56 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1209 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:57.405803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:57.419384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:57.447592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:57.448087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:57.448528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:57.449287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:57.456752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:57.456752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:57.853573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "refresh_cache-ed2f136b-ddc6-40fe-8748-548f89936683" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:14:57.855904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquired lock "refresh_cache-ed2f136b-ddc6-40fe-8748-548f89936683" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:14:58.537582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:58.548470 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50715c18-a770-48ea-b72a-6af30b342d86 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1315 microversion: 2.1 time: 1.146499 Oct 27 10:14:58.553647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 928/1786] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:57 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1315 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:58.562456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ef89cee-cd8a-465f-8619-52be5bc747eb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:58.568903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ef89cee-cd8a-465f-8619-52be5bc747eb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:58.593739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef89cee-cd8a-465f-8619-52be5bc747eb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:58.594816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef89cee-cd8a-465f-8619-52be5bc747eb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:58.595782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef89cee-cd8a-465f-8619-52be5bc747eb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:58.606744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef89cee-cd8a-465f-8619-52be5bc747eb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:58.607336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef89cee-cd8a-465f-8619-52be5bc747eb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:58.607849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef89cee-cd8a-465f-8619-52be5bc747eb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:58.691926 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ef89cee-cd8a-465f-8619-52be5bc747eb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135431 Oct 27 10:14:58.699162 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 929/1787] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:14:58 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:14:58.704681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:58.717454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:58.724618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:58.728988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:58.730017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:58.731067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:58.733444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:58.734128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:58.749960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:59.536917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=11 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:59.574115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:59.586661 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17f0af3f-3cd1-4391-b343-bb00cad71f64 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1209 microversion: 2.1 time: 0.885913 Oct 27 10:14:59.606989 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 930/1788] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:58 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1209 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:59.612050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-899855031", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "de1cfd5d-9dd9-412e-9407-3d2729e92745"}, {"uuid": "e317c4d7-3db5-4542-a6a6-ff7fdb877f13"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:59.738123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] validate_networks() for [('de1cfd5d-9dd9-412e-9407-3d2729e92745', None, None, None, None, None), ('e317c4d7-3db5-4542-a6a6-ff7fdb877f13', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:15:01.620728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Building network info cache for instance {{(pid=120719) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:15:02.433706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:15:02.434244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:15:02.434673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:15:02.434987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:15:02.435347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:15:02.452449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:02.453478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:02.454088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:02.454979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:02.455593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:02.462694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:02.500515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Getting quotas for project cdba716768804fa1b1e939964ccf25cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:02.506459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Getting quotas for user 7dbf1513514a45479dd04815d34889b6 and project cdba716768804fa1b1e939964ccf25cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:02.537954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:15:02.540314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:15:02.720605 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d30e77d-10fe-4fb5-be82-55829a09c6de tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.112156 Oct 27 10:15:02.724741 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 931/1789] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:15:02.738821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:02.739467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:02.764702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:02.765599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:02.766263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:02.767179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:02.767809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:02.769273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.307110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:03.319941 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4adf9489-9e5d-401d-8da6-4daecae83a02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1315 microversion: 2.1 time: 0.593289 Oct 27 10:15:03.321301 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 932/1790] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:02 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:03.344142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cfa91973-10a4-4010-86ee-a4466b669ad9 req-b13ebd4e-1336-49e7-916a-da22cae49d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3771f18-a29a-4d03-97cf-1e23ec142e87", "name": "network-vif-plugged", "status": "completed", "tag": "1faa7e08-93b7-42ef-afb8-fe49e32820b8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:03.355742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cfa91973-10a4-4010-86ee-a4466b669ad9 req-b13ebd4e-1336-49e7-916a-da22cae49d97 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.356396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cfa91973-10a4-4010-86ee-a4466b669ad9 req-b13ebd4e-1336-49e7-916a-da22cae49d97 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.356976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cfa91973-10a4-4010-86ee-a4466b669ad9 req-b13ebd4e-1336-49e7-916a-da22cae49d97 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.371171 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cfa91973-10a4-4010-86ee-a4466b669ad9 req-b13ebd4e-1336-49e7-916a-da22cae49d97 service nova] Creating event network-vif-plugged:1faa7e08-93b7-42ef-afb8-fe49e32820b8 for instance a3771f18-a29a-4d03-97cf-1e23ec142e87 on n-h2-854663-10 Oct 27 10:15:03.384904 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cfa91973-10a4-4010-86ee-a4466b669ad9 req-b13ebd4e-1336-49e7-916a-da22cae49d97 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052040 Oct 27 10:15:03.386080 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 933/1791] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:03.398474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45d2b8ef-be10-45e0-9f33-364389a5a924 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:03.401899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-45d2b8ef-be10-45e0-9f33-364389a5a924 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:03.418537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d2b8ef-be10-45e0-9f33-364389a5a924 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.419167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d2b8ef-be10-45e0-9f33-364389a5a924 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.420584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d2b8ef-be10-45e0-9f33-364389a5a924 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.422392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d2b8ef-be10-45e0-9f33-364389a5a924 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.424926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d2b8ef-be10-45e0-9f33-364389a5a924 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.425446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d2b8ef-be10-45e0-9f33-364389a5a924 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.508173 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45d2b8ef-be10-45e0-9f33-364389a5a924 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.120391 Oct 27 10:15:03.517661 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 934/1792] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:15:03 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:03.532395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:03.540291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:03.544504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Updating instance_info_cache with network_info: [{"id": "c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6", "address": "fa:16:3e:37:1e:2e", "network": {"id": "cb698d4f-9293-4505-96fd-2eab544a9110", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-429421790-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c83852e942904ae58e59f9f6b8e0bc16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc8c9d5b4-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120719) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:15:03.565826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.566693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.569320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Releasing lock "refresh_cache-ed2f136b-ddc6-40fe-8748-548f89936683" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:15:03.570717 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd964586-47c8-4d7b-b59f-420f438a31b3 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "POST /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683/action" status: 202 len: 0 microversion: 2.1 time: 7.075636 Oct 27 10:15:03.572925 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 859/1793] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:14:56 2022] POST /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683/action => generated 0 bytes in 7078 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 10:15:03.577083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.582207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.584397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.585449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-34d6a520-199f-48ce-9b74-96ddbcc479c1 req-652c2807-5202-4bb9-9e6a-3d4f67a0321c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2f136b-ddc6-40fe-8748-548f89936683", "tag": "c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:03.592053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.610257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:03.652554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-34d6a520-199f-48ce-9b74-96ddbcc479c1 req-652c2807-5202-4bb9-9e6a-3d4f67a0321c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.654026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-34d6a520-199f-48ce-9b74-96ddbcc479c1 req-652c2807-5202-4bb9-9e6a-3d4f67a0321c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.655312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-34d6a520-199f-48ce-9b74-96ddbcc479c1 req-652c2807-5202-4bb9-9e6a-3d4f67a0321c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.672813 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-34d6a520-199f-48ce-9b74-96ddbcc479c1 req-652c2807-5202-4bb9-9e6a-3d4f67a0321c service nova] Creating event network-changed:c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6 for instance ed2f136b-ddc6-40fe-8748-548f89936683 on n-h1-854663-10 Oct 27 10:15:03.681069 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-34d6a520-199f-48ce-9b74-96ddbcc479c1 req-652c2807-5202-4bb9-9e6a-3d4f67a0321c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105984 Oct 27 10:15:03.682142 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 860/1794] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:04.048977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1174456985", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:04.201918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:15:04.288251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:04.297359 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd7eb71f-3111-4300-84e0-931abe3258af tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1209 microversion: 2.1 time: 0.776528 Oct 27 10:15:04.308859 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 935/1795] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:03 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1209 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:04.389240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:04.519231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88e96bc9-9517-46c8-8dfb-0602a275d181 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:04.523421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e96bc9-9517-46c8-8dfb-0602a275d181 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.523903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e96bc9-9517-46c8-8dfb-0602a275d181 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.524334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e96bc9-9517-46c8-8dfb-0602a275d181 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.525078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e96bc9-9517-46c8-8dfb-0602a275d181 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.541658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e96bc9-9517-46c8-8dfb-0602a275d181 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.542025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e96bc9-9517-46c8-8dfb-0602a275d181 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.631914 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-88e96bc9-9517-46c8-8dfb-0602a275d181 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.317719 Oct 27 10:15:04.634905 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 936/1796] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:15:04 2022] GET /compute/v2.1/os-services => generated 949 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:04.666820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:04.667446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:04.699124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.699873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.700514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.707082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.710941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.714786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.727614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:15:04.728098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:15:04.728497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:15:04.740625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:15:04.741564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:15:04.762481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.769876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.770969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.772542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.775089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.775609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.839850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Getting quotas for project 686cacfed6704a9585df56d80cb7273f. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:04.864774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Getting quotas for user f972a5c34e294e63b10e7c97ba23739f and project 686cacfed6704a9585df56d80cb7273f. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:04.920083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:15:04.922874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:04.940010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:15:04.952432 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d98faa1f-8698-4b94-8a35-ff21f8ac3966 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1264 microversion: 2.1 time: 0.298313 Oct 27 10:15:04.955975 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 937/1797] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:04 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1264 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:05.114863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-119c74d7-5d82-40c3-8b41-6e640cb1a358 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Action: 'create', calling method: .version_select at 0x7f6d63915b80>, body: {"keypair": {"name": "tempest-keypair-969432771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOd4O8DmRxj8aHhBGa5s0SDEAIhBbKogZ+w9Y2y2qOtAi6PxCXUX9INZY9fNQ/3GxTmzkf8SJX7psNAsfU+Qpw81VlYMD4aXoYlBNsxiNu2xkt+OosddV5GVXeUAKxP9XA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:05.150134 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c3385fe-b8f7-44fe-bb78-43603ab05ae2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466379 Oct 27 10:15:05.150810 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 861/1798] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:15:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:15:05.174460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:05.174971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:05.177405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-119c74d7-5d82-40c3-8b41-6e640cb1a358 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Getting quotas for project cc167a3f85d6418a81b90bcca09977d3. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:05.185565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-119c74d7-5d82-40c3-8b41-6e640cb1a358 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Getting quotas for user a5cbe7895b4f47deb85d169990050d3d and project cc167a3f85d6418a81b90bcca09977d3. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:05.225153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.225960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.226420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.227192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.227643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.228064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.242042 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-119c74d7-5d82-40c3-8b41-6e640cb1a358 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.282120 Oct 27 10:15:05.242975 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 938/1799] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:15:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:05.257815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:05.258701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:05.287655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.288369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.288896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.289681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.291851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.292506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.353297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:15:05.554319 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d9d22c59-69ef-40d5-927d-55797a2f6408 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 204 len: 0 microversion: 2.1 time: 0.402205 Oct 27 10:15:05.563409 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 862/1800] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:15:05 2022] DELETE /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:15:05.572086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5220c969-9887-4122-84c9-899fb71b0b0f tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:05.580490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5220c969-9887-4122-84c9-899fb71b0b0f tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.581029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5220c969-9887-4122-84c9-899fb71b0b0f tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.581804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5220c969-9887-4122-84c9-899fb71b0b0f tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.584497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5220c969-9887-4122-84c9-899fb71b0b0f tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.585497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5220c969-9887-4122-84c9-899fb71b0b0f tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.586103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5220c969-9887-4122-84c9-899fb71b0b0f tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.662022 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5220c969-9887-4122-84c9-899fb71b0b0f tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?host=n-d-854663-10" status: 200 len: 581 microversion: 2.1 time: 0.097167 Oct 27 10:15:05.670901 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 863/1801] 10.222.0.76 () {58 vars in 1174 bytes} [Thu Oct 27 10:15:05 2022] GET /compute/v2.1/os-services?host=n-d-854663-10 => generated 581 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:05.695439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77d051d9-cb35-4b8a-988a-c7dd57fcbecc tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:05.696879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77d051d9-cb35-4b8a-988a-c7dd57fcbecc tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:06.039781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77d051d9-cb35-4b8a-988a-c7dd57fcbecc tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:06.065555 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77d051d9-cb35-4b8a-988a-c7dd57fcbecc tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1217 microversion: 2.1 time: 0.378777 Oct 27 10:15:06.066422 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 864/1802] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:05 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1217 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:06.087845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:06.088926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:06.114835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.120229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.121161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:06.126872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.127397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.129181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:06.330063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:06.341973 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7a026ce-3df3-47ec-b1de-b3471fb95522 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1315 microversion: 2.1 time: 1.096808 Oct 27 10:15:06.342718 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 939/1803] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:05 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1315 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:06.357906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Action: 'action', calling method: .version_select at 0x7f6d6141c8b0>, body: {"addFloatingIp": {"address": "172.25.9.66"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:06.388476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:06.410491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.410903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.411437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:06.415829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.416318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.416797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:06.462730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "refresh_cache-6a303ce6-db7c-42ad-b551-24e839f1ac67" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:15:06.463452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquired lock "refresh_cache-6a303ce6-db7c-42ad-b551-24e839f1ac67" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:15:06.693607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:06.711873 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22b2a321-b2ee-4ed6-a678-a060763f7ae3 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1197 microversion: 2.1 time: 0.643545 Oct 27 10:15:06.715791 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 865/1804] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:06 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1197 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:06.732080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c5395dbd-fef6-4b29-97c4-f906f542bba4 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:06.758637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5395dbd-fef6-4b29-97c4-f906f542bba4 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.760823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5395dbd-fef6-4b29-97c4-f906f542bba4 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.762327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5395dbd-fef6-4b29-97c4-f906f542bba4 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:06.764346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5395dbd-fef6-4b29-97c4-f906f542bba4 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.767348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5395dbd-fef6-4b29-97c4-f906f542bba4 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.769123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5395dbd-fef6-4b29-97c4-f906f542bba4 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:06.859675 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c5395dbd-fef6-4b29-97c4-f906f542bba4 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.142472 Oct 27 10:15:06.861675 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 866/1805] 10.222.0.76 () {58 vars in 1176 bytes} [Thu Oct 27 10:15:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:06.869701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:06.872316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:06.903437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.905414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.908190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:06.911143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.913435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.914816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.095755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:07.111265 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a18fa32b-c419-44d2-8dad-25e7a28bda64 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1270 microversion: 2.1 time: 0.247438 Oct 27 10:15:07.113252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 867/1806] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:06 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1270 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:07.121743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fbe33d2-e37c-4e25-bb97-4c7c82e5d371 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:07.125973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbe33d2-e37c-4e25-bb97-4c7c82e5d371 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.126704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbe33d2-e37c-4e25-bb97-4c7c82e5d371 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.127358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbe33d2-e37c-4e25-bb97-4c7c82e5d371 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.128471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbe33d2-e37c-4e25-bb97-4c7c82e5d371 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.129165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbe33d2-e37c-4e25-bb97-4c7c82e5d371 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.129811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbe33d2-e37c-4e25-bb97-4c7c82e5d371 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.182351 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fbe33d2-e37c-4e25-bb97-4c7c82e5d371 tempest-ServicesAdminTestJSON-809535846 tempest-ServicesAdminTestJSON-809535846-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.065460 Oct 27 10:15:07.183621 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 868/1807] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:15:07 2022] GET /compute/v2.1/os-services => generated 949 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:07.212192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:07.216452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:07.231210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.232045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.232703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.234289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.235898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.238551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.434403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:07.446786 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30fb0fa3-2b38-460b-a1a5-9b726b73e8c6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1269 microversion: 2.1 time: 0.260328 Oct 27 10:15:07.455392 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 869/1808] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:07 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1269 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:07.483853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:07.487203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:07.525153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.531057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.532006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.534913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.535935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.539355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:08.434822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:08.446375 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81beab92-471d-4cf6-8a87-fa92e063521c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1465 microversion: 2.1 time: 0.978837 Oct 27 10:15:08.461502 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 870/1809] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:07 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1465 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:08.479534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:08.480436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:08.489363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:08.490517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:08.491237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:08.492108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:08.493211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:08.493822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:08.516970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:09.192572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:09.205466 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4f23cee1-160a-4b07-b3f9-51ddbcdd5f45 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1197 microversion: 2.1 time: 0.731756 Oct 27 10:15:09.205883 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 871/1810] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:08 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1197 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:09.231504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:09.232276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:09.240563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:09.241776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:09.242467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:09.243369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:09.244287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:09.245110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:09.876156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:09.894673 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9d40f6a0-76b6-4508-82e2-c5c8927217cd tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1312 microversion: 2.1 time: 0.672497 Oct 27 10:15:09.895640 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 872/1811] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:09 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1312 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:10.310284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07bd7102-ae1d-4929-9f57-31e40efa6844 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:10.311182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-07bd7102-ae1d-4929-9f57-31e40efa6844 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:10.320856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07bd7102-ae1d-4929-9f57-31e40efa6844 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:10.321824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07bd7102-ae1d-4929-9f57-31e40efa6844 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:10.322934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07bd7102-ae1d-4929-9f57-31e40efa6844 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:10.324174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07bd7102-ae1d-4929-9f57-31e40efa6844 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:10.325505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07bd7102-ae1d-4929-9f57-31e40efa6844 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:10.326582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07bd7102-ae1d-4929-9f57-31e40efa6844 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:11.431954 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07bd7102-ae1d-4929-9f57-31e40efa6844 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1618 microversion: 2.1 time: 1.534841 Oct 27 10:15:11.432580 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 873/1812] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:09 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1618 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:11.443691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:11.448981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:11.457976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:11.458913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:11.459978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:11.460997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:11.464735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:11.465541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:11.664962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:11.681975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-40ed83a7-e461-4f6d-b019-fd90bb80e436 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1275 microversion: 2.1 time: 0.247724 Oct 27 10:15:11.687042 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 874/1813] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:11 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:11.707799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2b7a4b3c-001d-4c29-a831-f6dc835f0282 req-3cf48168-0b0b-4517-816e-57b7291606c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2f136b-ddc6-40fe-8748-548f89936683", "name": "network-vif-deleted", "tag": "c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:11.753772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2b7a4b3c-001d-4c29-a831-f6dc835f0282 req-3cf48168-0b0b-4517-816e-57b7291606c2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:11.765652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2b7a4b3c-001d-4c29-a831-f6dc835f0282 req-3cf48168-0b0b-4517-816e-57b7291606c2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:11.766523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2b7a4b3c-001d-4c29-a831-f6dc835f0282 req-3cf48168-0b0b-4517-816e-57b7291606c2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:11.808745 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2b7a4b3c-001d-4c29-a831-f6dc835f0282 req-3cf48168-0b0b-4517-816e-57b7291606c2 service nova] Creating event network-vif-deleted:c8c9d5b4-8b9e-487a-abc1-942aeeba5ea6 for instance ed2f136b-ddc6-40fe-8748-548f89936683 on n-h1-854663-10 Oct 27 10:15:11.820376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Building network info cache for instance {{(pid=120720) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:15:11.856598 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2b7a4b3c-001d-4c29-a831-f6dc835f0282 req-3cf48168-0b0b-4517-816e-57b7291606c2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165019 Oct 27 10:15:11.861414 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 875/1814] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:11.881423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:11.882134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:11.901171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:11.901661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:11.902096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:11.902809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:11.903251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:11.903702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:13.219119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:13.230564 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38e8dddf-bd25-4ff2-b481-ff12d1402f41 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1197 microversion: 2.1 time: 1.367640 Oct 27 10:15:13.232947 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 876/1815] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:11 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1197 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:13.249144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:13.254151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:13.290033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:13.291664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:13.292866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:13.294187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:13.294822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:13.295480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:13.834666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:13.851027 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-84244111-3994-4c00-90b3-09a00ab7302c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1333 microversion: 2.1 time: 0.616010 Oct 27 10:15:13.852357 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 877/1816] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:13 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1333 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:13.871805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ea86612-b6f9-46da-842a-e3e3ad6300f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Action: 'create', calling method: .version_select at 0x7f6d5ac6eca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-951183614", "policies": ["affinity"]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:13.893779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6ea86612-b6f9-46da-842a-e3e3ad6300f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:13.904633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6ea86612-b6f9-46da-842a-e3e3ad6300f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:13.969264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6ea86612-b6f9-46da-842a-e3e3ad6300f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:13.974997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6ea86612-b6f9-46da-842a-e3e3ad6300f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:13.993285 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ea86612-b6f9-46da-842a-e3e3ad6300f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.138611 Oct 27 10:15:14.005804 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 878/1817] 10.222.0.76 () {60 vars in 1174 bytes} [Thu Oct 27 10:15:13 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:14.011656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b6939c74-ccb7-4336-8688-55d1a5d2e8f4 req-f6dde1d3-3ea6-4c65-ac78-1a133ee285ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a303ce6-db7c-42ad-b551-24e839f1ac67", "tag": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:14.023087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b6939c74-ccb7-4336-8688-55d1a5d2e8f4 req-f6dde1d3-3ea6-4c65-ac78-1a133ee285ca service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:14.023736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b6939c74-ccb7-4336-8688-55d1a5d2e8f4 req-f6dde1d3-3ea6-4c65-ac78-1a133ee285ca service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:14.024546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b6939c74-ccb7-4336-8688-55d1a5d2e8f4 req-f6dde1d3-3ea6-4c65-ac78-1a133ee285ca service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:14.041502 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b6939c74-ccb7-4336-8688-55d1a5d2e8f4 req-f6dde1d3-3ea6-4c65-ac78-1a133ee285ca service nova] Creating event network-changed:5db2ef4f-d5fd-4da1-92f9-6150e66be6d2 for instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 on n-h2-854663-10 Oct 27 10:15:14.049801 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b6939c74-ccb7-4336-8688-55d1a5d2e8f4 req-f6dde1d3-3ea6-4c65-ac78-1a133ee285ca service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041738 Oct 27 10:15:14.054315 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 879/1818] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:14.062792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:14.064376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:14.072714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:14.073755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:14.074403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:14.075544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:14.076456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:14.078058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:14.190503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Updating instance_info_cache with network_info: [{"id": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2", "address": "fa:16:3e:7c:f0:a0", "network": {"id": "cb698d4f-9293-4505-96fd-2eab544a9110", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-429421790-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c83852e942904ae58e59f9f6b8e0bc16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5db2ef4f-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120720) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:15:14.218345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Releasing lock "refresh_cache-6a303ce6-db7c-42ad-b551-24e839f1ac67" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:15:14.219330 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2766334d-48d1-4bc5-bf0a-6e73d391e63c tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "POST /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67/action" status: 202 len: 0 microversion: 2.1 time: 7.875788 Oct 27 10:15:14.220354 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 940/1819] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:15:06 2022] POST /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67/action => generated 0 bytes in 7877 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 10:15:14.228331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05b1bf0a-8fe2-4f63-8a07-f4b8de6ad108 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '.version_select at 0x7f6d6383f5e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:14.564891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:14.684172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:14.692725 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f784a7d-864e-4902-aa5b-e0c10b36d4eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1317 microversion: 2.1 time: 0.636248 Oct 27 10:15:14.693419 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 880/1820] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:14 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:14.726013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-520201102", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1ad64767-929d-4bd4-a8be-c14b8bbdcbcd"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:14.940711 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05b1bf0a-8fe2-4f63-8a07-f4b8de6ad108 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/os-floating-ips/ddb8c657-d5bb-4f13-a5b8-088b9a698290" status: 200 len: 184 microversion: 2.1 time: 0.715381 Oct 27 10:15:14.943456 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 941/1821] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:15:14 2022] GET /compute/v2.1/os-floating-ips/ddb8c657-d5bb-4f13-a5b8-088b9a698290 => generated 184 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:15:14.956710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:14.957351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:14.973179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:14.974717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:14.975414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:14.982230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:14.982724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:14.983794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:15.205339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=68 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:15.324936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:15.337357 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0975d17b-94c8-4465-8010-0642518424b6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1197 microversion: 2.1 time: 0.390952 Oct 27 10:15:15.338387 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 942/1822] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:14 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1197 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:15.532352 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-abffdf76-99ab-4f06-a424-a06093f2cdd5 tempest-TenantUsagesNegativeTestJSON-390655376 tempest-TenantUsagesNegativeTestJSON-390655376-project-admin] 10.222.0.76 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-26T10%3A15%3A14.636294&end=2022-10-28T10%3A15%3A14.636294" status: 404 len: 112 microversion: - time: 0.192224 Oct 27 10:15:15.532987 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 943/1823] 10.222.0.76 () {58 vars in 1316 bytes} [Thu Oct 27 10:15:15 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-26T10%3A15%3A14.636294&end=2022-10-28T10%3A15%3A14.636294 => generated 112 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 10:15:15.541356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:15.542326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:15.550671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:15.552060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:15.552228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:15.553395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:15.554480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:15.555616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:15.957343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:15.966983 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b97b876d-c08d-433a-99b8-cf6c5ad761df tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1333 microversion: 2.1 time: 0.432176 Oct 27 10:15:15.967932 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 944/1824] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:15 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1333 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:15.974727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.66"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:16.349394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:16.363579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:16.364216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:16.365068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:16.367030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:16.367620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:16.368135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:17.082295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "refresh_cache-6a303ce6-db7c-42ad-b551-24e839f1ac67" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:15:17.082841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquired lock "refresh_cache-6a303ce6-db7c-42ad-b551-24e839f1ac67" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:15:17.153875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:18.194221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Building network info cache for instance {{(pid=120720) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:15:19.311050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Updating instance_info_cache with network_info: [{"id": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2", "address": "fa:16:3e:7c:f0:a0", "network": {"id": "cb698d4f-9293-4505-96fd-2eab544a9110", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-429421790-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c83852e942904ae58e59f9f6b8e0bc16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5db2ef4f-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120720) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:15:19.330916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Releasing lock "refresh_cache-6a303ce6-db7c-42ad-b551-24e839f1ac67" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:15:19.332126 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-459e986d-8f8e-4e15-b4ce-9ee37c1c5ed2 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "POST /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67/action" status: 202 len: 0 microversion: 2.1 time: 3.362860 Oct 27 10:15:19.333149 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 945/1825] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:15:15 2022] POST /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67/action => generated 0 bytes in 3364 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 10:15:19.340062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ebf079b-03d3-4bd9-b35b-348545780042 tempest-TenantUsagesNegativeTestJSON-390655376 tempest-TenantUsagesNegativeTestJSON-390655376-project-admin] Calling method '.version_select at 0x7f6d6377af70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:19.347002 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6ebf079b-03d3-4bd9-b35b-348545780042 tempest-TenantUsagesNegativeTestJSON-390655376 tempest-TenantUsagesNegativeTestJSON-390655376-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ebf079b-03d3-4bd9-b35b-348545780042 tempest-TenantUsagesNegativeTestJSON-390655376 tempest-TenantUsagesNegativeTestJSON-390655376-project-admin] Request method failure captured: Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-simple-tenant-usage/f6fc44a0055943dda415e4ea298cf774?start=2022-10-28T10%3A15%3A14.636294&end=2022-10-26T10%3A15%3A14.636294 HTTP/1.1 Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWloyKlZscdT52d_jPQXTTsf3UIQMKxMhokccZwki9UuDXxYoW9bdy8P1j98F5CVdsszaAeOkiIR4qyiE9x3pp_caNwE6KRTdPdyzTp9mR_9IlltsKmtFYB4XS2DpDNexIQWrCIJEfTm6p3hjI93nWXE9mo-jh2hc07WsTx926S1Y93M Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ac8a0dce80c840e5a574f0f9fec6c926 Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-390655376 Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:15:19.354562 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ac8a0dce80c840e5a574f0f9fec6c926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ac8a0dce80c840e5a574f0f9fec6c926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ac8a0dce80c840e5a574f0f9fec6c926", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ac8a0dce80c840e5a574f0f9fec6c926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-390655376 Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ac8a0dce80c840e5a574f0f9fec6c926 Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-390655376 Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TenantUsagesNegativeTestJSON-390655376-project-admin Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9ab33fed791948e3bf4a207621bf797d Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-390655376-project-admin Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid start time. The start time cannot occur after the end time. Oct 27 10:15:19.357152 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'f6fc44a0055943dda415e4ea298cf774'} Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 10:15:19.358756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ebf079b-03d3-4bd9-b35b-348545780042 tempest-TenantUsagesNegativeTestJSON-390655376 tempest-TenantUsagesNegativeTestJSON-390655376-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:19.366110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ebf079b-03d3-4bd9-b35b-348545780042 tempest-TenantUsagesNegativeTestJSON-390655376 tempest-TenantUsagesNegativeTestJSON-390655376-project-admin] 10.222.0.76 "GET /compute/v2.1/os-simple-tenant-usage/f6fc44a0055943dda415e4ea298cf774?start=2022-10-28T10%3A15%3A14.636294&end=2022-10-26T10%3A15%3A14.636294" status: 400 len: 111 microversion: 2.1 time: 0.024381 Oct 27 10:15:19.367122 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 946/1826] 10.222.0.76 () {58 vars in 1412 bytes} [Thu Oct 27 10:15:19 2022] GET /compute/v2.1/os-simple-tenant-usage/f6fc44a0055943dda415e4ea298cf774?start=2022-10-28T10%3A15%3A14.636294&end=2022-10-26T10%3A15%3A14.636294 => generated 111 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:15:19.367122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:19.369213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:19.380834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:19.381322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:19.381944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:19.382810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:19.383411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:19.383982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:19.581599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:19.590934 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1900973c-1055-43f7-bbf4-05238255244c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1317 microversion: 2.1 time: 0.230124 Oct 27 10:15:19.591786 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 947/1827] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:19 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:19.596846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e6a006fd-ae6d-4fab-a1fd-4b224b9f5da0 req-c3549ecf-213e-44c4-9dd3-fb49a07487da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe2d6b4-731c-4567-9abb-a7924c8dd43b", "tag": "ef734916-25b8-4e1e-8214-27785b87cd71"}, {"name": "network-changed", "server_uuid": "1f9af47a-23f1-41b0-8c43-6dc621ba0494", "tag": "573a7332-90d5-4382-b7dd-dbb333241922"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:19.610263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e6a006fd-ae6d-4fab-a1fd-4b224b9f5da0 req-c3549ecf-213e-44c4-9dd3-fb49a07487da service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:19.610738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e6a006fd-ae6d-4fab-a1fd-4b224b9f5da0 req-c3549ecf-213e-44c4-9dd3-fb49a07487da service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:19.611160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e6a006fd-ae6d-4fab-a1fd-4b224b9f5da0 req-c3549ecf-213e-44c4-9dd3-fb49a07487da service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:19.631708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e6a006fd-ae6d-4fab-a1fd-4b224b9f5da0 req-c3549ecf-213e-44c4-9dd3-fb49a07487da service nova] Creating event network-changed:ef734916-25b8-4e1e-8214-27785b87cd71 for instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b on n-h2-854663-10 Oct 27 10:15:19.632459 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e6a006fd-ae6d-4fab-a1fd-4b224b9f5da0 req-c3549ecf-213e-44c4-9dd3-fb49a07487da service nova] Creating event network-changed:573a7332-90d5-4382-b7dd-dbb333241922 for instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 on n-h1-854663-10 Oct 27 10:15:19.640779 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e6a006fd-ae6d-4fab-a1fd-4b224b9f5da0 req-c3549ecf-213e-44c4-9dd3-fb49a07487da service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047646 Oct 27 10:15:19.641383 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 948/1828] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:19.647093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:19.647780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:19.654148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:19.654966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:19.655595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:19.656470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:19.657255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:19.657830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:19.936207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:19.951377 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6c178db-f5e9-4c78-ada6-f58a5ea13fff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1197 microversion: 2.1 time: 0.308596 Oct 27 10:15:19.951960 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 949/1829] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:19 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1197 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:19.965833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f1779a76-15fd-41b1-a0d4-65df072dca4a req-ea40aab3-abb7-49e8-bb19-7ac9c920ccb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6435a0-0a3f-42a7-b87e-6d46af12f65d", "name": "network-vif-plugged", "status": "completed", "tag": "297733c1-9497-45d2-a8bd-4a6f5f31dcab"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:19.987730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1779a76-15fd-41b1-a0d4-65df072dca4a req-ea40aab3-abb7-49e8-bb19-7ac9c920ccb9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:19.988205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1779a76-15fd-41b1-a0d4-65df072dca4a req-ea40aab3-abb7-49e8-bb19-7ac9c920ccb9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:19.991989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1779a76-15fd-41b1-a0d4-65df072dca4a req-ea40aab3-abb7-49e8-bb19-7ac9c920ccb9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:20.006159 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f1779a76-15fd-41b1-a0d4-65df072dca4a req-ea40aab3-abb7-49e8-bb19-7ac9c920ccb9 service nova] Creating event network-vif-plugged:297733c1-9497-45d2-a8bd-4a6f5f31dcab for instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d on n-h1-854663-10 Oct 27 10:15:20.011561 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f1779a76-15fd-41b1-a0d4-65df072dca4a req-ea40aab3-abb7-49e8-bb19-7ac9c920ccb9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058010 Oct 27 10:15:20.012372 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 950/1830] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:20.023509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:20.025540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:20.033036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:20.033573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:20.033978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:20.034936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:20.035391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:20.035935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:20.288608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:20.299426 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bec6af17-a012-41a5-83b8-19d7f634ebda tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1333 microversion: 2.1 time: 0.284391 Oct 27 10:15:20.300233 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 951/1831] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:20 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1333 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:20.305431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:20.306154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:20.313205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:20.314375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:20.314989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:20.316094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:20.316552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:20.317143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:20.335127 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] HTTP exception thrown: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Request method failure captured: Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 HTTP/1.1 Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlnc2dXDjsUzsUMoVfvV1FNvO4_hxAuf1xwL9Kl4Et2qaB1JX4q6CYHlgzXIM7-YSF_VA_aquxl8Wl6JQmY7CBr07SYgGtUn3j1PYHWJ0Ung8JTXocDoEAMTiOR6ettS-xdXOZ9qU8j3rHIo5BiypqEx_5K9-Dqsg6Dw4gkOLaOTdD4 Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c83852e942904ae58e59f9f6b8e0bc16 Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:15:20.337771 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c83852e942904ae58e59f9f6b8e0bc16", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c83852e942904ae58e59f9f6b8e0bc16 Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsAssociationTestJSON-1191915132-project Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7f431586b08d4b139a2e18aeffab9c49 Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1191915132-project Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.339600 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ed2f136b-ddc6-40fe-8748-548f89936683'} Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:20.340780 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.342672 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.344468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Returning 404 to user: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:20.344468 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40b0a4b0-6872-4253-a9a8-0eeb790bcf92 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 404 len: 111 microversion: 2.1 time: 0.037571 Oct 27 10:15:20.344468 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 952/1832] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:15:20 2022] DELETE /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:20.495253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74603f03-09d5-4050-8547-b484a94fa911 tempest-TenantUsagesNegativeTestJSON-577933607 tempest-TenantUsagesNegativeTestJSON-577933607-project] Calling method '.version_select at 0x7f6d63999790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:20.501335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-74603f03-09d5-4050-8547-b484a94fa911 tempest-TenantUsagesNegativeTestJSON-577933607 tempest-TenantUsagesNegativeTestJSON-577933607-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '3662461a1dfc4de68c061759142489ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fc44a0055943dda415e4ea298cf774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74603f03-09d5-4050-8547-b484a94fa911 tempest-TenantUsagesNegativeTestJSON-577933607 tempest-TenantUsagesNegativeTestJSON-577933607-project] Request method failure captured: Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T10%3A15%3A14.636294&end=2022-10-28T10%3A15%3A14.636294&detailed=1 HTTP/1.1 Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWloxtohiSEJJYJrJHlG929Mn9TubXrKFrRiw31GyllHXUyrDAiD19sw2PpD5T-hWVjsPxNKF-OCZ7-BiODaIKpUeXaM8nici8c_bral-EBK2VLmbDBDQt48xy-N8VgP49mQgQdg9yrazuJlJTPUqoPsNHZs--tPG68bkr84Fg8HowLI Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f6fc44a0055943dda415e4ea298cf774 Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-577933607 Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:15:20.504037 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f6fc44a0055943dda415e4ea298cf774"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f6fc44a0055943dda415e4ea298cf774"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f6fc44a0055943dda415e4ea298cf774", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f6fc44a0055943dda415e4ea298cf774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-577933607 Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f6fc44a0055943dda415e4ea298cf774 Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-577933607 Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TenantUsagesNegativeTestJSON-577933607-project Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3662461a1dfc4de68c061759142489ec Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-577933607-project Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: action_args: {} Oct 27 10:15:20.505961 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:15:20.507102 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:15:20.508629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:15:20.510199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 10:15:20.510199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.511262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74603f03-09d5-4050-8547-b484a94fa911 tempest-TenantUsagesNegativeTestJSON-577933607 tempest-TenantUsagesNegativeTestJSON-577933607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:20.512296 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74603f03-09d5-4050-8547-b484a94fa911 tempest-TenantUsagesNegativeTestJSON-577933607 tempest-TenantUsagesNegativeTestJSON-577933607-project] 10.222.0.76 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T10%3A15%3A14.636294&end=2022-10-28T10%3A15%3A14.636294&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.167831 Oct 27 10:15:20.513355 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 953/1833] 10.222.0.76 () {58 vars in 1335 bytes} [Thu Oct 27 10:15:20 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T10%3A15%3A14.636294&end=2022-10-28T10%3A15%3A14.636294&detailed=1 => generated 123 bytes in 173 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:20.523427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:20.524284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: ed2f136b-ddc6-40fe-8748-548f89936683] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:20.534639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:20.535055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:20.535545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:20.536254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:20.536731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:20.537154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:20.556791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:20.558035 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] HTTP exception thrown: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Request method failure captured: Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 HTTP/1.1 Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlnc2dXDjsUzsUMoVfvV1FNvO4_hxAuf1xwL9Kl4Et2qaB1JX4q6CYHlgzXIM7-YSF_VA_aquxl8Wl6JQmY7CBr07SYgGtUn3j1PYHWJ0Ung8JTXocDoEAMTiOR6ettS-xdXOZ9qU8j3rHIo5BiypqEx_5K9-Dqsg6Dw4gkOLaOTdD4 Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c83852e942904ae58e59f9f6b8e0bc16 Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:15:20.560346 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c83852e942904ae58e59f9f6b8e0bc16", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c83852e942904ae58e59f9f6b8e0bc16 Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsAssociationTestJSON-1191915132-project Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7f431586b08d4b139a2e18aeffab9c49 Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1191915132-project Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.562572 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ed2f136b-ddc6-40fe-8748-548f89936683'} Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:20.563703 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. Oct 27 10:15:20.565361 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:20.566827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Returning 404 to user: Instance ed2f136b-ddc6-40fe-8748-548f89936683 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:20.566827 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66dcf213-53f0-47b2-8003-b4c85e897968 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683" status: 404 len: 111 microversion: 2.1 time: 0.046621 Oct 27 10:15:20.566827 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 954/1834] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:20 2022] GET /compute/v2.1/servers/ed2f136b-ddc6-40fe-8748-548f89936683 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:20.572814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed8c11a3-6f95-408a-84af-8e5f56d9a608 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '.version_select at 0x7f6d63999670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:22.193958 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed8c11a3-6f95-408a-84af-8e5f56d9a608 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/ddb8c657-d5bb-4f13-a5b8-088b9a698290" status: 202 len: 0 microversion: 2.1 time: 1.625773 Oct 27 10:15:22.193958 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 955/1835] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:15:20 2022] DELETE /compute/v2.1/os-floating-ips/ddb8c657-d5bb-4f13-a5b8-088b9a698290 => generated 0 bytes in 1627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:15:22.201103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:22.201740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:22.214024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:22.214508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:22.214935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:22.215626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:22.216069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:22.216482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:22.438765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:22.451095 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62bc510c-f3f0-4e93-9874-22c78753d1b2 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1317 microversion: 2.1 time: 0.255086 Oct 27 10:15:22.451866 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 956/1836] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:22 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:22.458311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:22.459091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:22.470380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:22.470872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:22.471302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:22.472000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:22.472446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:22.472985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:22.645039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:22.657559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d9c64d9-6d6c-4ec1-a2c5-992093469833 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1381 microversion: 2.1 time: 0.203870 Oct 27 10:15:22.658784 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 957/1837] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:22 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1381 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:22.670106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:22.674632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:22.685726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:22.689423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:22.691862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:22.692858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:22.697193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:22.699743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:22.915721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:22.931902 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b760b0d-34fe-47ad-9847-19c69167ff1c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1333 microversion: 2.1 time: 0.271072 Oct 27 10:15:22.933096 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 958/1838] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:22 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1333 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:22.938267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-63ae039b-6a4d-4698-8605-9a2fe26f4fa0 req-e72dc448-47dc-42a6-8917-9c455eac29d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9af47a-23f1-41b0-8c43-6dc621ba0494", "tag": "681460f1-99c1-4ea1-b001-2559f8e423c6"}, {"name": "network-changed", "server_uuid": "6a303ce6-db7c-42ad-b551-24e839f1ac67", "tag": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:22.953593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-63ae039b-6a4d-4698-8605-9a2fe26f4fa0 req-e72dc448-47dc-42a6-8917-9c455eac29d4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:22.954279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-63ae039b-6a4d-4698-8605-9a2fe26f4fa0 req-e72dc448-47dc-42a6-8917-9c455eac29d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:22.954874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-63ae039b-6a4d-4698-8605-9a2fe26f4fa0 req-e72dc448-47dc-42a6-8917-9c455eac29d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:22.973652 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-63ae039b-6a4d-4698-8605-9a2fe26f4fa0 req-e72dc448-47dc-42a6-8917-9c455eac29d4 service nova] Creating event network-changed:681460f1-99c1-4ea1-b001-2559f8e423c6 for instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 on n-h1-854663-10 Oct 27 10:15:22.974503 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-63ae039b-6a4d-4698-8605-9a2fe26f4fa0 req-e72dc448-47dc-42a6-8917-9c455eac29d4 service nova] Creating event network-changed:5db2ef4f-d5fd-4da1-92f9-6150e66be6d2 for instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 on n-h2-854663-10 Oct 27 10:15:22.985655 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-63ae039b-6a4d-4698-8605-9a2fe26f4fa0 req-e72dc448-47dc-42a6-8917-9c455eac29d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050887 Oct 27 10:15:22.986621 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 959/1839] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:23.013514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3985cc9f-3e3f-474e-846c-724c04b7d0bc req-f80c06d2-84ca-4c6f-a109-381307d0f3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe2d6b4-731c-4567-9abb-a7924c8dd43b", "name": "network-vif-plugged", "status": "completed", "tag": "ef734916-25b8-4e1e-8214-27785b87cd71"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:23.035845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3985cc9f-3e3f-474e-846c-724c04b7d0bc req-f80c06d2-84ca-4c6f-a109-381307d0f3f8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:23.035845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3985cc9f-3e3f-474e-846c-724c04b7d0bc req-f80c06d2-84ca-4c6f-a109-381307d0f3f8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:23.035845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3985cc9f-3e3f-474e-846c-724c04b7d0bc req-f80c06d2-84ca-4c6f-a109-381307d0f3f8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:23.050599 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3985cc9f-3e3f-474e-846c-724c04b7d0bc req-f80c06d2-84ca-4c6f-a109-381307d0f3f8 service nova] Creating event network-vif-plugged:ef734916-25b8-4e1e-8214-27785b87cd71 for instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b on n-h2-854663-10 Oct 27 10:15:23.085152 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3985cc9f-3e3f-474e-846c-724c04b7d0bc req-f80c06d2-84ca-4c6f-a109-381307d0f3f8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096745 Oct 27 10:15:23.085799 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 960/1840] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:23.100096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:23.101743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:23.112151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:23.121001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:23.123058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:23.123837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:23.124828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:23.127819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:23.161996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:15:23.305768 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74367090-5bfd-4ae2-9710-b8a438ac6cf9 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 204 len: 0 microversion: 2.1 time: 0.218022 Oct 27 10:15:23.306329 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 961/1841] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:15:23 2022] DELETE /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:15:23.587292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d747a06-65f7-4349-8a6f-bc28ce3a531e tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:23.588324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d747a06-65f7-4349-8a6f-bc28ce3a531e tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:23.605805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d747a06-65f7-4349-8a6f-bc28ce3a531e tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:23.606316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d747a06-65f7-4349-8a6f-bc28ce3a531e tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:23.606782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d747a06-65f7-4349-8a6f-bc28ce3a531e tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:23.609248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d747a06-65f7-4349-8a6f-bc28ce3a531e tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:23.609899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d747a06-65f7-4349-8a6f-bc28ce3a531e tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:23.610319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d747a06-65f7-4349-8a6f-bc28ce3a531e tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:23.861009 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d747a06-65f7-4349-8a6f-bc28ce3a531e tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1534 microversion: 2.1 time: 0.553481 Oct 27 10:15:23.881663 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 962/1842] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:23 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1534 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:23.895126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:23.895755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:23.908211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:23.921032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:23.923272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:23.926711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:23.928200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:23.929633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:23.985316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=16 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:24.125613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:24.136412 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-faa987a9-3ae7-40ff-8562-e1e4385c7175 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1526 microversion: 2.1 time: 0.253254 Oct 27 10:15:24.148688 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 963/1843] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:23 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1526 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:24.155597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:24.155597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:24.161657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.162195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.162624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.163378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.164123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.164545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.335480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:24.344645 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b6d4772-c1c3-490e-b99c-642bf1e13213 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1317 microversion: 2.1 time: 0.206208 Oct 27 10:15:24.345240 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 964/1844] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:24 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:24.358567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95f7d391-ab4d-470c-a0ab-f629f6b3b443 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:24.360287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95f7d391-ab4d-470c-a0ab-f629f6b3b443 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:24.367236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f7d391-ab4d-470c-a0ab-f629f6b3b443 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.367772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f7d391-ab4d-470c-a0ab-f629f6b3b443 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.368200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f7d391-ab4d-470c-a0ab-f629f6b3b443 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.369115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f7d391-ab4d-470c-a0ab-f629f6b3b443 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.369595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f7d391-ab4d-470c-a0ab-f629f6b3b443 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.370011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95f7d391-ab4d-470c-a0ab-f629f6b3b443 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.541329 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95f7d391-ab4d-470c-a0ab-f629f6b3b443 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1534 microversion: 2.1 time: 0.194854 Oct 27 10:15:24.542003 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 965/1845] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:24 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1534 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:24.548392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:24.549266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:24.556397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:24.558375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.558975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.559468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.560384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.561279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.561771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.692960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=42 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:24.748413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:24.799815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:24.809190 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf86eb25-09db-4c10-b9fe-3538637fd6d4 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1333 microversion: 2.1 time: 0.266010 Oct 27 10:15:24.825811 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 966/1846] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:24 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1333 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:24.832604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72ed60cc-b3c8-4bc9-99ba-0e1dcd2207c0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:24.836744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72ed60cc-b3c8-4bc9-99ba-0e1dcd2207c0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.837405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72ed60cc-b3c8-4bc9-99ba-0e1dcd2207c0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.837846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72ed60cc-b3c8-4bc9-99ba-0e1dcd2207c0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.838583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72ed60cc-b3c8-4bc9-99ba-0e1dcd2207c0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.839033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72ed60cc-b3c8-4bc9-99ba-0e1dcd2207c0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.839461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72ed60cc-b3c8-4bc9-99ba-0e1dcd2207c0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.866725 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72ed60cc-b3c8-4bc9-99ba-0e1dcd2207c0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.039387 Oct 27 10:15:24.867640 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 967/1847] 10.222.0.76 () {58 vars in 1176 bytes} [Thu Oct 27 10:15:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:24.880945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854663-10", "block_migration": false, "disk_over_commit": false}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:24.886037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:24.892491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.908739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.909396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.910375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:24.911025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:24.911623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:24.941383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lazy-loading 'flavor' on Instance uuid 8d6435a0-0a3f-42a7-b87e-6d46af12f65d {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:15:24.957524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Going to try to live migrate instance to n-h2-854663-10 {{(pid=120720) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:15:25.714056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:15:26.075357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:15:26.075901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:15:26.076557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:15:26.077986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:15:26.079085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:15:26.122494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:26.123297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:26.124095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:26.125153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:26.125790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:26.126896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:26.156544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:26.174553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:26.202503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Going to run 2 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:15:26.207007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:15:26.278305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120719) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 27 10:15:26.306732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:26.314778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:26.415720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:26.451203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:26.502479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=6871d90b-e5ff-4ed9-9d3b-dab2493aa564,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:15:26.680421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:26.699761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:26.837755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:26.844571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:26.946112 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-66bda6f5-aafb-4d98-b63d-088f1463baf3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 12.223326 Oct 27 10:15:26.950924 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 881/1848] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:15:14 2022] POST /compute/v2.1/servers => generated 32 bytes in 12255 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 10:15:26.962827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:26.968752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:26.980323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:26.981010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:26.982211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:26.983031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:26.983582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:26.984277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:27.076492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:27.081255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:27.082504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:27.083830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lazy-loading 'fault' on Instance uuid 6a303ce6-db7c-42ad-b551-24e839f1ac67 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:15:27.302578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f431586b08d4b139a2e18aeffab9c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83852e942904ae58e59f9f6b8e0bc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:27.346074 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b48f6372-4511-485a-aab2-a6f6aa45f208 tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 200 len: 1314 microversion: 2.1 time: 0.393808 Oct 27 10:15:27.348124 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 882/1849] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:26 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:27.359606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:27.363907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:27.390465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:27.391659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:27.392340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:27.393700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:27.395327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:27.395810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:27.792227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:27.809821 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-048b1b4b-f489-4a08-9f96-a740a5468f39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1466 microversion: 2.1 time: 0.458437 Oct 27 10:15:27.812903 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 883/1850] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:27 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1466 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:27.829352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:27.829983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:27.842611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:27.843239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:27.843516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:27.848699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:27.854081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:27.854795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:28.212363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:28.224888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-333b1de4-4d5e-4c23-b371-0ebb7ad6cfc9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1333 microversion: 2.1 time: 0.410512 Oct 27 10:15:28.227863 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 884/1851] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:27 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1333 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:28.246285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-03df7ef2-2a46-4c5a-9bb3-7780b481b26e req-5c00f523-fa58-47b6-ba61-620f1439d7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9af47a-23f1-41b0-8c43-6dc621ba0494", "name": "network-vif-plugged", "status": "completed", "tag": "681460f1-99c1-4ea1-b001-2559f8e423c6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:28.328803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-03df7ef2-2a46-4c5a-9bb3-7780b481b26e req-5c00f523-fa58-47b6-ba61-620f1439d7bf service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:28.330173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-03df7ef2-2a46-4c5a-9bb3-7780b481b26e req-5c00f523-fa58-47b6-ba61-620f1439d7bf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:28.332009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-03df7ef2-2a46-4c5a-9bb3-7780b481b26e req-5c00f523-fa58-47b6-ba61-620f1439d7bf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:28.381426 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-03df7ef2-2a46-4c5a-9bb3-7780b481b26e req-5c00f523-fa58-47b6-ba61-620f1439d7bf service nova] Creating event network-vif-plugged:681460f1-99c1-4ea1-b001-2559f8e423c6 for instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 on n-h1-854663-10 Oct 27 10:15:28.401316 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-03df7ef2-2a46-4c5a-9bb3-7780b481b26e req-5c00f523-fa58-47b6-ba61-620f1439d7bf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166535 Oct 27 10:15:28.411084 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 885/1852] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:28.414941 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7dd1e775-c74c-4f01-8538-db505ec905a6 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d/action" status: 202 len: 0 microversion: 2.1 time: 3.538405 Oct 27 10:15:28.416770 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 968/1853] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:15:24 2022] POST /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d/action => generated 0 bytes in 3541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:15:28.427661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:28.483105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:28.484636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-26d17363-dc49-4c5b-876c-86341f5723a2 req-322f3adc-04d6-4704-95fd-46b6fb965909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a303ce6-db7c-42ad-b551-24e839f1ac67", "name": "network-vif-deleted", "tag": "5db2ef4f-d5fd-4da1-92f9-6150e66be6d2"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:28.490220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Searching by: {'deleted': False, 'project_id': '88e242ed84c14a5eaabf74309f00b689'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:15:28.541357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-26d17363-dc49-4c5b-876c-86341f5723a2 req-322f3adc-04d6-4704-95fd-46b6fb965909 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:28.542396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-26d17363-dc49-4c5b-876c-86341f5723a2 req-322f3adc-04d6-4704-95fd-46b6fb965909 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:28.546152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-26d17363-dc49-4c5b-876c-86341f5723a2 req-322f3adc-04d6-4704-95fd-46b6fb965909 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:28.567778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:28.569497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:28.570144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:28.571210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:28.571902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:28.572544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:28.599387 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-26d17363-dc49-4c5b-876c-86341f5723a2 req-322f3adc-04d6-4704-95fd-46b6fb965909 service nova] Creating event network-vif-deleted:5db2ef4f-d5fd-4da1-92f9-6150e66be6d2 for instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 on n-h2-854663-10 Oct 27 10:15:28.608222 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-26d17363-dc49-4c5b-876c-86341f5723a2 req-322f3adc-04d6-4704-95fd-46b6fb965909 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177683 Oct 27 10:15:28.609372 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 886/1854] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:28.617116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1192484605", "metadata": {"image_type": "test"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:28.620263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:28.628988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:28.629940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:28.630566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:28.631727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:28.632837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:28.633548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:28.692063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Getting quotas for project 686cacfed6704a9585df56d80cb7273f. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:28.699614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Getting quotas for user f972a5c34e294e63b10e7c97ba23739f and project 686cacfed6704a9585df56d80cb7273f. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:28.859874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:15:28.985863 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8616e50c-9da7-49a4-824c-4dcc4fba4f82 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.564049 Oct 27 10:15:28.986882 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 969/1855] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:15:28 2022] GET /compute/v2.1/servers => generated 1000 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:28.992700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:28.993643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] [instance: 6a303ce6-db7c-42ad-b551-24e839f1ac67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:29.002785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:29.004418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:29.004418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:29.005433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:29.006303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:29.011759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:29.057686 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] HTTP exception thrown: Instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 could not be found. Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Request method failure captured: Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 HTTP/1.1 Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlnc2dXDjsUzsUMoVfvV1FNvO4_hxAuf1xwL9Kl4Et2qaB1JX4q6CYHlgzXIM7-YSF_VA_aquxl8Wl6JQmY7CBr07SYgGtUn3j1PYHWJ0Ung8JTXocDoEAMTiOR6ettS-xdXOZ9qU8j3rHIo5BiypqEx_5K9-Dqsg6Dw4gkOLaOTdD4 Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c83852e942904ae58e59f9f6b8e0bc16 Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:15:29.059481 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c83852e942904ae58e59f9f6b8e0bc16", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c83852e942904ae58e59f9f6b8e0bc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c83852e942904ae58e59f9f6b8e0bc16 Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1191915132 Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsAssociationTestJSON-1191915132-project Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7f431586b08d4b139a2e18aeffab9c49 Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1191915132-project Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 could not be found. Oct 27 10:15:29.061401 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '6a303ce6-db7c-42ad-b551-24e839f1ac67'} Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 could not be found. Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:29.062591 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 could not be found. Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 could not be found. Oct 27 10:15:29.064309 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:29.067903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] Returning 404 to user: Instance 6a303ce6-db7c-42ad-b551-24e839f1ac67 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:29.070241 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d09b8a5-d049-4065-9e86-15eca7e6c95b tempest-FloatingIPsAssociationTestJSON-1191915132 tempest-FloatingIPsAssociationTestJSON-1191915132-project] 10.222.0.76 "GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67" status: 404 len: 111 microversion: 2.1 time: 0.081847 Oct 27 10:15:29.071531 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 970/1856] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:28 2022] GET /compute/v2.1/servers/6a303ce6-db7c-42ad-b551-24e839f1ac67 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:29.086828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:29.087704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:29.094937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:29.095685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:29.096313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:29.097810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:29.098427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:29.099010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:29.103812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:29.198568 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7bff7001-ecb8-4590-9734-616579839f4e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "POST /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b/action" status: 202 len: 0 microversion: 2.1 time: 0.587029 Oct 27 10:15:29.214377 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 887/1857] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:15:28 2022] POST /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:15:29.235590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:29.237737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:29.257749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:29.259020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:29.260006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:29.261895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:29.263370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:29.264059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:29.791882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:29.805673 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e7cf825-73f2-426f-8131-2e08cdc577a5 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1214 microversion: 2.1 time: 0.586555 Oct 27 10:15:29.824359 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 888/1858] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:29 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1214 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:29.840187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-607dbd38-f347-4a8d-a61c-35adba37e2c5 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d63778a60>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:29.953437 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-607dbd38-f347-4a8d-a61c-35adba37e2c5 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.123847 Oct 27 10:15:29.954991 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 889/1859] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:29 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:29.970870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:29.974323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:29.992782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:29.993149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:30.014684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:30.014684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:30.023355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:30.026639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:30.029322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:30.046148 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cce8e1a3-ea16-4642-a147-17b5a389c1a6 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.967184 Oct 27 10:15:30.053386 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 971/1860] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:29 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:30.656640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c7405f05-43d0-4c7d-bed2-1b54c3b47f18 req-6c33bd20-5173-4e80-afa1-ed29e8b218a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9af47a-23f1-41b0-8c43-6dc621ba0494", "name": "network-vif-plugged", "status": "completed", "tag": "573a7332-90d5-4382-b7dd-dbb333241922"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:30.702138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c7405f05-43d0-4c7d-bed2-1b54c3b47f18 req-6c33bd20-5173-4e80-afa1-ed29e8b218a8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:30.702655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c7405f05-43d0-4c7d-bed2-1b54c3b47f18 req-6c33bd20-5173-4e80-afa1-ed29e8b218a8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:30.703102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c7405f05-43d0-4c7d-bed2-1b54c3b47f18 req-6c33bd20-5173-4e80-afa1-ed29e8b218a8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:30.750347 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c7405f05-43d0-4c7d-bed2-1b54c3b47f18 req-6c33bd20-5173-4e80-afa1-ed29e8b218a8 service nova] Creating event network-vif-plugged:573a7332-90d5-4382-b7dd-dbb333241922 for instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 on n-h1-854663-10 Oct 27 10:15:30.765123 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c7405f05-43d0-4c7d-bed2-1b54c3b47f18 req-6c33bd20-5173-4e80-afa1-ed29e8b218a8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120879 Oct 27 10:15:30.765741 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 972/1861] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:30.839515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:30.840208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:30.850534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:30.852626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:30.856242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:30.857387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:30.858011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:30.871014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:30.995932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:31.006457 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25d5429e-9821-4bdd-8cef-5a089a052eaf tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1333 microversion: 2.1 time: 1.047760 Oct 27 10:15:31.013254 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 890/1862] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:29 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1333 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:31.022397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0136ae63-fed8-499d-a603-11a31129b6eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5abd0d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:31.091417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:31.102164 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c7c0fdb-7ca7-4cbc-bc6b-31b40bce436a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1270 microversion: 2.1 time: 0.267324 Oct 27 10:15:31.112282 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 973/1863] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:30 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1270 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:31.127848 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0136ae63-fed8-499d-a603-11a31129b6eb tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.112980 Oct 27 10:15:31.129098 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 891/1864] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:31 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:31.131330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:31.135292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:31.150560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:31.151415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:31.152286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:31.153261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:31.153919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:31.155816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:31.520746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:31.531843 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4faae7f8-8913-4f87-a1c0-b115eae3d84d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.414474 Oct 27 10:15:31.533605 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 974/1865] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:31 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:32.037949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:32.039763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:32.059229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:32.062969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:32.063682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:32.067816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:32.068633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:32.069328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:32.143896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:32.144652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:32.173045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:32.173923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:32.175020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:32.189834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:32.200346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:32.203149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:32.480135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:32.495435 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc8c0961-9c8a-45f5-b676-9b53a8eade69 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1276 microversion: 2.1 time: 0.356197 Oct 27 10:15:32.508871 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 975/1866] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:32 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1276 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:32.515917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a2b982f-204a-47b4-abd6-3bae93830be6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ae9caf0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:32.633844 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a2b982f-204a-47b4-abd6-3bae93830be6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.122255 Oct 27 10:15:32.637395 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 976/1867] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:32 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:32.656964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:32.657801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:32.681412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:32.685834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:32.689628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:32.692873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:32.693499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:32.694613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:33.006444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:33.039005 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f8eac87-3321-4d6a-96c4-8c84e100e98d tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1333 microversion: 2.1 time: 1.004321 Oct 27 10:15:33.041827 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 892/1868] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:32 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1333 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:33.534653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:33.535750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:33.543882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:33.558540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:33.564353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:33.568338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:33.569254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:33.574066 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5922b92-dd46-41ff-a170-03072059b47d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.929970 Oct 27 10:15:33.574601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:33.575124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:33.579470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:33.591814 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 977/1869] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:32 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:33.651694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-307b5a08-d04e-4294-81e1-e5620a8f8355 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d6381ae50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:33.783318 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-307b5a08-d04e-4294-81e1-e5620a8f8355 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.135358 Oct 27 10:15:33.784089 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 978/1870] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:33 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:33.966699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:33.988583 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a5895de-4f69-4cab-ab70-cddb1c730d89 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1276 microversion: 2.1 time: 0.451729 Oct 27 10:15:33.991249 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 893/1871] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:33 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1276 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:34.067022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:34.068033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:34.082974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:34.085484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:34.093339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:34.103511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:34.104279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:34.105857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:34.599995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:34.600801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:34.623529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:34.632595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:34.633218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:34.634118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:34.634703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:34.635224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:35.940055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:35.972494 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31ead8f1-cf63-43e8-a475-1453fc8636ce tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1667 microversion: 2.1 time: 1.909206 Oct 27 10:15:35.977329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:35.984070 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 979/1872] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:34 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1667 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:35.987643 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff92a116-f164-42eb-9d48-6269abf62761 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 1.391785 Oct 27 10:15:35.994748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c33f9161-844d-4bdf-ace5-dbe903fb2246 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d638dd3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:35.995629 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 894/1873] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:34 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:36.009963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:36.010932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:36.034666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:36.039727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:36.040468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:36.045637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:36.046440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:36.047118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:36.101371 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c33f9161-844d-4bdf-ace5-dbe903fb2246 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.115540 Oct 27 10:15:36.102291 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 980/1874] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:35 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:36.132278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c94aa02-d993-45a6-be74-39f69590ba9e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:36.133288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c94aa02-d993-45a6-be74-39f69590ba9e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:36.148332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c94aa02-d993-45a6-be74-39f69590ba9e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:36.156236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:36.162685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c94aa02-d993-45a6-be74-39f69590ba9e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:36.163324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c94aa02-d993-45a6-be74-39f69590ba9e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:36.164243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c94aa02-d993-45a6-be74-39f69590ba9e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:36.164887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c94aa02-d993-45a6-be74-39f69590ba9e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:36.165621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c94aa02-d993-45a6-be74-39f69590ba9e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:36.259825 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c94aa02-d993-45a6-be74-39f69590ba9e tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494/ips" status: 200 len: 178 microversion: 2.1 time: 0.154685 Oct 27 10:15:36.263509 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 981/1875] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:15:36 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494/ips => generated 178 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:36.281734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:36.282640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:36.295659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:36.297926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:36.302715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:36.304021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:36.311227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:36.312847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:36.367300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:15:36.741285 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a238d11-963a-4263-825d-523f6e14ff77 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 204 len: 0 microversion: 2.1 time: 0.468602 Oct 27 10:15:36.741932 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 982/1876] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:15:36 2022] DELETE /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:15:36.752577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:36.757700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:36.774938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:36.776507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:36.776991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:36.777735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:36.778196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:36.778626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:36.853510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=22 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:37.245664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:37.261094 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9339f2f3-235d-45a4-a7bb-38c90cea2f27 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1318 microversion: 2.1 time: 1.264146 Oct 27 10:15:37.268281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 895/1877] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:35 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1318 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:37.297527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:37.298291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:37.339352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:37.340293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:37.340401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:37.365898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:37.367639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:37.368111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:38.431032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:38.444780 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-653de2d9-f68c-40c2-8959-960ffb9e073c tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1673 microversion: 2.1 time: 1.697618 Oct 27 10:15:38.445664 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 983/1878] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:36 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1673 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:38.456946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-583054dd-707a-42c5-9d9a-32eba86f3bf3 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5aeb2d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:38.571628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:38.598118 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e9ca8212-15d7-4181-bae7-ad71f4970b5e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 1.324839 Oct 27 10:15:38.600286 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-583054dd-707a-42c5-9d9a-32eba86f3bf3 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.153789 Oct 27 10:15:38.603721 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 896/1879] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:37 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:38.604342 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 984/1880] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:38 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:38.636502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:38.637314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:38.649177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-82309452-92ea-4961-93f7-0896399305f2 req-caf112d8-9829-4c8e-b76f-d52d98d12d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe2d6b4-731c-4567-9abb-a7924c8dd43b", "name": "network-vif-plugged", "status": "completed", "tag": "ef734916-25b8-4e1e-8214-27785b87cd71"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:38.654190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:38.661049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:38.669960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:38.671045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:38.671660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:38.674683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:38.683813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-82309452-92ea-4961-93f7-0896399305f2 req-caf112d8-9829-4c8e-b76f-d52d98d12d7e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:38.687021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-82309452-92ea-4961-93f7-0896399305f2 req-caf112d8-9829-4c8e-b76f-d52d98d12d7e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:38.690968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-82309452-92ea-4961-93f7-0896399305f2 req-caf112d8-9829-4c8e-b76f-d52d98d12d7e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:38.721081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:38.729735 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-82309452-92ea-4961-93f7-0896399305f2 req-caf112d8-9829-4c8e-b76f-d52d98d12d7e service nova] Creating event network-vif-plugged:ef734916-25b8-4e1e-8214-27785b87cd71 for instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b on n-h2-854663-10 Oct 27 10:15:38.760419 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-82309452-92ea-4961-93f7-0896399305f2 req-caf112d8-9829-4c8e-b76f-d52d98d12d7e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154478 Oct 27 10:15:38.766939 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 985/1881] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:39.478243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:39.496262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:39.520746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:39.522175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:39.523285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:39.524522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:39.526406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:39.527402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:40.002459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:40.062437 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b957d5d-512f-4b1c-95aa-7f90d2ab3f37 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1318 microversion: 2.1 time: 1.436889 Oct 27 10:15:40.063596 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 897/1882] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:38 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1318 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:40.084932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ebad78a-de64-4882-aee6-ba7720e4cbad tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ab5b4c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:40.193663 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ebad78a-de64-4882-aee6-ba7720e4cbad tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.116477 Oct 27 10:15:40.193663 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 898/1883] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:40 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:40.208796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:40.209612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:40.217764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:40.218392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:40.218939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:40.219761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:40.220322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:40.220940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:40.627342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:40.644214 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-129fc0a4-4cb1-41b5-a879-898d7fdedee9 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1673 microversion: 2.1 time: 1.173349 Oct 27 10:15:40.661616 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 986/1884] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:39 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1673 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:40.670571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e5149f03-f53d-489c-a4be-a71cb3cf511c req-00c1c1ea-25e9-4111-af2e-62cf02837825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8466938a-c392-46e1-a1d1-611553fc1dbc", "tag": "93c54aa8-0c1f-44c8-a95f-50938f87be5d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:40.694627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e5149f03-f53d-489c-a4be-a71cb3cf511c req-00c1c1ea-25e9-4111-af2e-62cf02837825 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:40.701639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e5149f03-f53d-489c-a4be-a71cb3cf511c req-00c1c1ea-25e9-4111-af2e-62cf02837825 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:40.702398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e5149f03-f53d-489c-a4be-a71cb3cf511c req-00c1c1ea-25e9-4111-af2e-62cf02837825 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:40.727050 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e5149f03-f53d-489c-a4be-a71cb3cf511c req-00c1c1ea-25e9-4111-af2e-62cf02837825 service nova] Creating event network-changed:93c54aa8-0c1f-44c8-a95f-50938f87be5d for instance 8466938a-c392-46e1-a1d1-611553fc1dbc on n-h1-854663-10 Oct 27 10:15:40.738638 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e5149f03-f53d-489c-a4be-a71cb3cf511c req-00c1c1ea-25e9-4111-af2e-62cf02837825 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073602 Oct 27 10:15:40.739454 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 987/1885] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:40.891303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:40.894995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab8dfc8c-3b28-4d4f-98ba-542989431f43 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.705013 Oct 27 10:15:40.902732 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 899/1886] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:40 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:41.091430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:41.092630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:41.118673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:41.122647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:41.127734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:41.133609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:41.137750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:41.138602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:41.204458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dbb0285c-84a8-49ba-b9da-be6f27b00632 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ab5b5e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:41.333342 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dbb0285c-84a8-49ba-b9da-be6f27b00632 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.135556 Oct 27 10:15:41.336627 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 900/1887] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:41 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:41.672708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:41.673607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:41.697124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:41.697898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:41.698354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:41.699478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:41.702923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:41.705520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:41.722044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:41.875282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:41.892190 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc9cbb0b-ad0f-4a10-bc27-077b985fb57e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1318 microversion: 2.1 time: 0.804053 Oct 27 10:15:41.893643 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 988/1888] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:41 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:41.930312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:41.932341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:41.942735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:41.943724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:41.945409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:41.946446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:41.949360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:41.950088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:42.713347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:42.727427 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-adfa4fe1-e7ad-491a-911f-51471f1a45be tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1652 microversion: 2.1 time: 1.058728 Oct 27 10:15:42.729076 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 901/1889] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:41 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1652 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:42.766791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4124e946-31d3-482d-9b46-ddd71abac2b5 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ab48d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:42.872095 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4124e946-31d3-482d-9b46-ddd71abac2b5 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.122588 Oct 27 10:15:42.873152 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 902/1890] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:42 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:42.929897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:42.945691 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b1b73e8-1496-436d-914b-ff6d51c7e473 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 1.019111 Oct 27 10:15:42.948560 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 989/1891] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:41 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:42.955154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:42.961389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:42.973875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:42.976564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:42.980418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:42.982581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:42.983311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:42.984533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:43.247485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0a749ac-b53c-4aa1-a93c-aef9bd7e9bd5 tempest-FloatingIPDetailsNegativeTestJSON-1115227325 tempest-FloatingIPDetailsNegativeTestJSON-1115227325-project] Calling method '.version_select at 0x7f6d5ab5bd30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:43.418425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG neutronclient.v2_0.client [None req-d0a749ac-b53c-4aa1-a93c-aef9bd7e9bd5 tempest-FloatingIPDetailsNegativeTestJSON-1115227325 tempest-FloatingIPDetailsNegativeTestJSON-1115227325-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c6c2754f-55c4-4e47-8bc4-9ad331ce588d could not be found", "detail": ""}} {{(pid=120719) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:15:43.421187 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-d0a749ac-b53c-4aa1-a93c-aef9bd7e9bd5 tempest-FloatingIPDetailsNegativeTestJSON-1115227325 tempest-FloatingIPDetailsNegativeTestJSON-1115227325-project] HTTP exception thrown: Floating IP not found for ID c6c2754f-55c4-4e47-8bc4-9ad331ce588d Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0a749ac-b53c-4aa1-a93c-aef9bd7e9bd5 tempest-FloatingIPDetailsNegativeTestJSON-1115227325 tempest-FloatingIPDetailsNegativeTestJSON-1115227325-project] Request method failure captured: Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-floating-ips/c6c2754f-55c4-4e47-8bc4-9ad331ce588d HTTP/1.1 Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlpOitePLJmPM82UwNA_uUbwKjghJJwAaSV474jvwRQnT7o-3auSb3yazfe8a3-szAXynhm0hjCGg6AbP1Sj8_WlQnEaaII6klw-LpI7S2IomnFB43TM2oGMvZ0OzfZYgvzES8IQWuz_pQZZbdeVYBLVZrN5YfbzIza0JYOJZ5OIrnA Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: fc9e56e0c6d441b8ba28c5c5ef4024e8 Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1115227325 Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:15:43.421708 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fc9e56e0c6d441b8ba28c5c5ef4024e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fc9e56e0c6d441b8ba28c5c5ef4024e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fc9e56e0c6d441b8ba28c5c5ef4024e8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fc9e56e0c6d441b8ba28c5c5ef4024e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1115227325 Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: fc9e56e0c6d441b8ba28c5c5ef4024e8 Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1115227325 Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1115227325-project Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3c9e8ab92d4e42dcadee32f44ea02f73 Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1115227325-project Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: exception: Floating IP not found for ID c6c2754f-55c4-4e47-8bc4-9ad331ce588d Oct 27 10:15:43.423790 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'c6c2754f-55c4-4e47-8bc4-9ad331ce588d'} Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:15:43.425110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c6c2754f-55c4-4e47-8bc4-9ad331ce588d could not be found Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df312ab3-8cc7-46b7-9748-bbd8b0a685da'] Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c6c2754f-55c4-4e47-8bc4-9ad331ce588d. Oct 27 10:15:43.426965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c6c2754f-55c4-4e47-8bc4-9ad331ce588d Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:43.428628 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:43.430550 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:43.430550 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c6c2754f-55c4-4e47-8bc4-9ad331ce588d Oct 27 10:15:43.430550 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:15:43.430550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0a749ac-b53c-4aa1-a93c-aef9bd7e9bd5 tempest-FloatingIPDetailsNegativeTestJSON-1115227325 tempest-FloatingIPDetailsNegativeTestJSON-1115227325-project] Returning 404 to user: Floating IP not found for ID c6c2754f-55c4-4e47-8bc4-9ad331ce588d {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:43.430550 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0a749ac-b53c-4aa1-a93c-aef9bd7e9bd5 tempest-FloatingIPDetailsNegativeTestJSON-1115227325 tempest-FloatingIPDetailsNegativeTestJSON-1115227325-project] 10.222.0.76 "GET /compute/v2.1/os-floating-ips/c6c2754f-55c4-4e47-8bc4-9ad331ce588d" status: 404 len: 111 microversion: 2.1 time: 0.551455 Oct 27 10:15:43.433180 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 903/1892] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:15:42 2022] GET /compute/v2.1/os-floating-ips/c6c2754f-55c4-4e47-8bc4-9ad331ce588d => generated 111 bytes in 557 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:43.442921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-75f8932c-f8e5-4ab0-9f65-e76481d43f9b req-62b6703f-77b2-4569-9d83-49e80906e93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6871d90b-e5ff-4ed9-9d3b-dab2493aa564", "tag": "0b1720a9-d828-407b-b675-46ba50b25eb9"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:43.487614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-75f8932c-f8e5-4ab0-9f65-e76481d43f9b req-62b6703f-77b2-4569-9d83-49e80906e93f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:43.496826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-75f8932c-f8e5-4ab0-9f65-e76481d43f9b req-62b6703f-77b2-4569-9d83-49e80906e93f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:43.501109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-75f8932c-f8e5-4ab0-9f65-e76481d43f9b req-62b6703f-77b2-4569-9d83-49e80906e93f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:43.528866 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-75f8932c-f8e5-4ab0-9f65-e76481d43f9b req-62b6703f-77b2-4569-9d83-49e80906e93f service nova] Creating event network-changed:0b1720a9-d828-407b-b675-46ba50b25eb9 for instance 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 on n-h1-854663-10 Oct 27 10:15:43.554754 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-75f8932c-f8e5-4ab0-9f65-e76481d43f9b req-62b6703f-77b2-4569-9d83-49e80906e93f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121881 Oct 27 10:15:43.555404 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 904/1893] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:43.561129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-929109832", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "50cb7bc6-6235-4029-9fd6-9407e53e51ed"}], "block_device_mapping_v2": [{"uuid": "29241d66-f0fc-4847-b6ec-1015c5e62331", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:43.839168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] validate_networks() for [('50cb7bc6-6235-4029-9fd6-9407e53e51ed', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:15:44.290444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:44.322856 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef7fd45d-8025-4275-b17e-f8b23dc3ff3f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1318 microversion: 2.1 time: 1.372591 Oct 27 10:15:44.347843 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 990/1894] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:42 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1318 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:44.379736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6546b0ca-3425-4b8f-ab67-6729d11e03f2 req-eed66d0f-62a3-4227-a04e-baf8bae77413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9af47a-23f1-41b0-8c43-6dc621ba0494", "name": "network-vif-deleted", "tag": "681460f1-99c1-4ea1-b001-2559f8e423c6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:44.457654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6546b0ca-3425-4b8f-ab67-6729d11e03f2 req-eed66d0f-62a3-4227-a04e-baf8bae77413 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:44.461804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6546b0ca-3425-4b8f-ab67-6729d11e03f2 req-eed66d0f-62a3-4227-a04e-baf8bae77413 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:44.464817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6546b0ca-3425-4b8f-ab67-6729d11e03f2 req-eed66d0f-62a3-4227-a04e-baf8bae77413 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:44.504428 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6546b0ca-3425-4b8f-ab67-6729d11e03f2 req-eed66d0f-62a3-4227-a04e-baf8bae77413 service nova] Creating event network-vif-deleted:681460f1-99c1-4ea1-b001-2559f8e423c6 for instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 on n-h1-854663-10 Oct 27 10:15:44.513435 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6546b0ca-3425-4b8f-ab67-6729d11e03f2 req-eed66d0f-62a3-4227-a04e-baf8bae77413 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163325 Oct 27 10:15:44.515029 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 991/1895] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:44.523918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:44.525145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:44.534709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:44.535791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:44.536448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:44.537515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:44.538156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:44.538775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:45.847406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbf1513514a45479dd04815d34889b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdba716768804fa1b1e939964ccf25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:45.879343 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7127f5c2-98b2-4864-8d6a-394292b406b2 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 200 len: 1610 microversion: 2.1 time: 1.362340 Oct 27 10:15:45.894251 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 992/1896] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:44 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 1610 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:45.911143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6f779be-8fb6-4b71-8264-27bd3d5a3587 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5aefe3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:46.059039 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6f779be-8fb6-4b71-8264-27bd3d5a3587 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.159081 Oct 27 10:15:46.059766 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 993/1897] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:45 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:46.081032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:46.083410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:46.125192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:46.127776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:46.129332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:46.133051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:46.136702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:46.138279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:46.168364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:47.298889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:47.314792 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67141d6d-e1d2-4afb-9644-e36374928ab2 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 1.249169 Oct 27 10:15:47.316076 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 994/1898] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:46 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:47.329375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:47.330034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:47.344168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:47.345754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:47.346211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:47.349060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:47.349540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:47.351832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:48.265421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:48.283350 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e8fbf75-b9e6-4b2a-8173-936cc29e71de tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1318 microversion: 2.1 time: 0.966090 Oct 27 10:15:48.284279 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 995/1899] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:47 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1318 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:48.290019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:48.296051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:48.314215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:48.317411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:48.321417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:48.323965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:48.328830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:48.331984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:48.360606 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] HTTP exception thrown: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Request method failure captured: Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 HTTP/1.1 Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlnP4L5suYQXbz5qpPuGGevrujrRpzZ-vLfzXUF3ZaSlSX98orT2Cfi986wColyK07_HVLhuX1oEUP213nlEajHqSgzVHat2a2GhbVQPLn7d6HBtQk8uLaWXwaf9qe3Z7MBQU1KuUvs5iH5BWz4nrGK0YsOtTbCzC8YloNXi8zDQtBs Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:15:48.362997 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cdba716768804fa1b1e939964ccf25cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestMultiNic-1755480493 Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7dbf1513514a45479dd04815d34889b6 Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:48.365009 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1f9af47a-23f1-41b0-8c43-6dc621ba0494'} Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:48.366040 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:48.367730 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:48.370370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Returning 404 to user: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:48.371773 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-84068e6d-d75b-4643-9c7a-d35ea03d5f79 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 404 len: 111 microversion: 2.1 time: 0.085812 Oct 27 10:15:48.389599 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 996/1900] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:48 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:48.424078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-014c71cf-0e08-4b26-9364-cd4b6190374e req-2cd88e53-ebee-469c-9990-e344f537554c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9af47a-23f1-41b0-8c43-6dc621ba0494", "name": "network-vif-deleted", "tag": "573a7332-90d5-4382-b7dd-dbb333241922"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:48.469162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-014c71cf-0e08-4b26-9364-cd4b6190374e req-2cd88e53-ebee-469c-9990-e344f537554c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:48.469894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-014c71cf-0e08-4b26-9364-cd4b6190374e req-2cd88e53-ebee-469c-9990-e344f537554c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:48.474366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-014c71cf-0e08-4b26-9364-cd4b6190374e req-2cd88e53-ebee-469c-9990-e344f537554c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:48.512051 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-014c71cf-0e08-4b26-9364-cd4b6190374e req-2cd88e53-ebee-469c-9990-e344f537554c service nova] Creating event network-vif-deleted:573a7332-90d5-4382-b7dd-dbb333241922 for instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 on n-h1-854663-10 Oct 27 10:15:48.526837 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-014c71cf-0e08-4b26-9364-cd4b6190374e req-2cd88e53-ebee-469c-9990-e344f537554c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135125 Oct 27 10:15:48.533232 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 997/1901] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:48.553649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:15:48.554676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:15:48.555206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:15:48.555617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:15:48.556033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:15:48.557460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d36bd94-398f-47c7-b110-e316841f64a3 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ae9c160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:48.580541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:48.581297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:48.585875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:48.588906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:48.592779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:48.593624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:48.646497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for project 8e2d013afa6544b3972160d82f111127. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:48.659138 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4d36bd94-398f-47c7-b110-e316841f64a3 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.124372 Oct 27 10:15:48.661117 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 998/1902] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:48 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:48.668568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:48.670121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Getting quotas for user dd2f7b7849014a6bae41317a3e68426e and project 8e2d013afa6544b3972160d82f111127. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:48.680693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:48.719719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:48.727329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:48.729693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:48.734768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:48.737956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:48.738713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:48.792911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:15:48.797978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29241d66-f0fc-4847-b6ec-1015c5e62331',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:15:49.087434 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72041d89-5b98-4cdd-8efc-aedc7cbcc184 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 5.530001 Oct 27 10:15:49.088683 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 905/1903] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 5533 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:15:49.095300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1123446479", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "861fa0a3-dbe2-4359-bfc4-1d143a1e9b33"}], "security_groups": [{"name": "tempest-securitygroup--1947593829"}], "key_name": "tempest-keypair-969432771", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "804a4850-1265-4ed8-a4ac-5f62c9ec8750", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:49.139465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:49.163126 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45e0531b-a7ca-49b2-b96b-baaf309eb232 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.496883 Oct 27 10:15:49.164144 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 999/1904] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:48 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:49.176237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c705f4d-4507-4bd4-ba7b-e8dd9b58d8fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:49.184052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c705f4d-4507-4bd4-ba7b-e8dd9b58d8fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:49.452009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c705f4d-4507-4bd4-ba7b-e8dd9b58d8fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:49.465625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c705f4d-4507-4bd4-ba7b-e8dd9b58d8fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:49.470269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c705f4d-4507-4bd4-ba7b-e8dd9b58d8fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:49.470269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c705f4d-4507-4bd4-ba7b-e8dd9b58d8fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1103 microversion: 2.25 time: 0.303210 Oct 27 10:15:49.470269 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1000/1905] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:15:49 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1103 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:15:49.496596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:49.499585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:49.515907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:49.519042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:49.519956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:49.521188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:49.523232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:49.523922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:49.778904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] validate_networks() for [('861fa0a3-dbe2-4359-bfc4-1d143a1e9b33', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:15:50.570731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:50.587260 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5df84987-5668-4d5f-8632-dd1f55febcf8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1318 microversion: 2.1 time: 1.116863 Oct 27 10:15:50.588347 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1001/1906] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:49 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1318 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:50.611821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-866ebc9f-24b1-462f-bcf7-0d575783ae2f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d637e7af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:50.672678 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-866ebc9f-24b1-462f-bcf7-0d575783ae2f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.065111 Oct 27 10:15:50.673627 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1002/1907] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:50 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:50.694084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:50.694710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:50.702531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:50.703015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:50.703554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:50.704256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:50.704785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:50.705256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:52.712474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:52.753257 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8285e97-9e50-4ddb-ac10-638dd00afa81 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 2.070277 Oct 27 10:15:52.756992 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1003/1908] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:50 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:52.776117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d8511e3f-cc7c-4a05-b967-bf01f0d1d358 req-51243659-1f49-435a-80b2-7c9bcd81c6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8466938a-c392-46e1-a1d1-611553fc1dbc", "name": "network-vif-plugged", "status": "completed", "tag": "93c54aa8-0c1f-44c8-a95f-50938f87be5d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:52.806142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d8511e3f-cc7c-4a05-b967-bf01f0d1d358 req-51243659-1f49-435a-80b2-7c9bcd81c6a4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:52.808477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d8511e3f-cc7c-4a05-b967-bf01f0d1d358 req-51243659-1f49-435a-80b2-7c9bcd81c6a4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:52.811719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d8511e3f-cc7c-4a05-b967-bf01f0d1d358 req-51243659-1f49-435a-80b2-7c9bcd81c6a4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:52.874158 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d8511e3f-cc7c-4a05-b967-bf01f0d1d358 req-51243659-1f49-435a-80b2-7c9bcd81c6a4 service nova] Creating event network-vif-plugged:93c54aa8-0c1f-44c8-a95f-50938f87be5d for instance 8466938a-c392-46e1-a1d1-611553fc1dbc on n-h1-854663-10 Oct 27 10:15:52.895663 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d8511e3f-cc7c-4a05-b967-bf01f0d1d358 req-51243659-1f49-435a-80b2-7c9bcd81c6a4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131363 Oct 27 10:15:52.898294 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1004/1909] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:52.915338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:52.916088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:52.936329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:52.936894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:52.937342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:52.940770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:52.942425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:52.943690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:53.109183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Getting quotas for project cc167a3f85d6418a81b90bcca09977d3. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:53.122433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Getting quotas for user a5cbe7895b4f47deb85d169990050d3d and project cc167a3f85d6418a81b90bcca09977d3. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:53.156327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:15:53.156810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:15:53.183000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:15:53.185814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:15:53.191404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:15:53.234172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:53.241369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:53.242205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:53.249147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:53.250109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:53.256147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:53.279081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:53.305649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:53.310790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:53.315689 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17d540f1-6349-4fd5-a459-da9542caceae tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1240 microversion: 2.25 time: 0.414628 Oct 27 10:15:53.338241 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1005/1910] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:15:52 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1240 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:15:53.358640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:53.363734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Getting quotas for project cc167a3f85d6418a81b90bcca09977d3. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:53.364170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:53.375232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Getting quotas for user a5cbe7895b4f47deb85d169990050d3d and project cc167a3f85d6418a81b90bcca09977d3. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:53.379195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:53.379704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:53.384364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:53.385413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:53.385695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:53.386128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:53.501247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:15:53.504289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='804a4850-1265-4ed8-a4ac-5f62c9ec8750',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:15:53.884464 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1d33ec8-3879-43ea-9ca1-41587cd3e007 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.789385 Oct 27 10:15:53.885463 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 906/1911] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:15:49 2022] POST /compute/v2.1/servers => generated 407 bytes in 4796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:15:53.905213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2be9dfec-9b12-4cb1-a6db-7a9f78f97fe5 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ab5b160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:54.038444 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2be9dfec-9b12-4cb1-a6db-7a9f78f97fe5 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.150702 Oct 27 10:15:54.048910 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 907/1912] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:53 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:54.054800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:54.055742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:54.064139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:54.065182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:54.065835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:54.067627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:54.068807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:54.069421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:55.386076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:55.395537 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-923b5f94-9e85-4182-be7b-6aeab59216f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1318 microversion: 2.1 time: 2.053509 Oct 27 10:15:55.412018 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1006/1913] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:53 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1318 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:55.417546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:55.435471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:55.442952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:55.472191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:55.475027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:55.475507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:55.480896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:55.481407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:55.483765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:55.692504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:55.704082 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da653bc1-4e5c-46ca-aa8e-ef42a7dd1542 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1171 microversion: 2.1 time: 0.290392 Oct 27 10:15:55.708879 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1007/1914] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:55 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1171 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:55.715518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:55.716147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:55.733976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:55.736592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:55.737138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:55.737896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:55.738357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:55.738793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:55.787448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:55.821233 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1ab8b92-3469-4ab2-b1a0-682fb339d59c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 1.769435 Oct 27 10:15:55.832692 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 908/1915] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:54 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:55.849528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-365fdf14-dea6-4523-987c-32e9652fa40c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ab6ed30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:55.920251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:55.930682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:55.954770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:55.956389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95fa99d4-fd11-4b89-931d-1b4e16460c57 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1250 microversion: 2.25 time: 0.246271 Oct 27 10:15:55.957076 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1008/1916] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:15:55 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1250 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:15:55.989745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2ff41070-9ad7-4448-b220-2b254519aad7 req-bf609b64-d2ac-4c7f-8f96-19ba71caeab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6871d90b-e5ff-4ed9-9d3b-dab2493aa564", "name": "network-vif-plugged", "status": "completed", "tag": "0b1720a9-d828-407b-b675-46ba50b25eb9"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:56.001234 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-365fdf14-dea6-4523-987c-32e9652fa40c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.173245 Oct 27 10:15:56.001897 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 909/1917] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:55 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:56.011100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2ff41070-9ad7-4448-b220-2b254519aad7 req-bf609b64-d2ac-4c7f-8f96-19ba71caeab8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:56.017975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2ff41070-9ad7-4448-b220-2b254519aad7 req-bf609b64-d2ac-4c7f-8f96-19ba71caeab8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:56.019129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2ff41070-9ad7-4448-b220-2b254519aad7 req-bf609b64-d2ac-4c7f-8f96-19ba71caeab8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:56.056060 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2ff41070-9ad7-4448-b220-2b254519aad7 req-bf609b64-d2ac-4c7f-8f96-19ba71caeab8 service nova] Creating event network-vif-plugged:0b1720a9-d828-407b-b675-46ba50b25eb9 for instance 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 on n-h1-854663-10 Oct 27 10:15:56.080915 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2ff41070-9ad7-4448-b220-2b254519aad7 req-bf609b64-d2ac-4c7f-8f96-19ba71caeab8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107949 Oct 27 10:15:56.084461 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1009/1918] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:56.434912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:56.436817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:56.467843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:56.468950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:56.469917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:56.472728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:56.473511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:56.474195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:56.729299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:56.730026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:56.753771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:56.754570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:56.755213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:56.756332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:56.757003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:56.757621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:57.289684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:57.301469 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c2983d2-6e82-4b01-866f-c467e8e6112e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1219 microversion: 2.1 time: 0.576424 Oct 27 10:15:57.317312 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1010/1919] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:56 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1219 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:57.324949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:57.337725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:57.367674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:57.368174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:57.368650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:57.369391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:57.369840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:57.370258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:58.342609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:58.356296 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-79e4de15-64f6-4813-916e-c16c438a31bc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1467 microversion: 2.1 time: 1.933116 Oct 27 10:15:58.358563 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 910/1920] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:56 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1467 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:58.379737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ec1cd6a2-aa32-4413-9092-749fee4fec46 req-caa657ca-7495-4297-9ed9-40be6f46b018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6435a0-0a3f-42a7-b87e-6d46af12f65d", "name": "network-vif-unplugged", "status": "completed", "tag": "297733c1-9497-45d2-a8bd-4a6f5f31dcab"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:58.427393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ec1cd6a2-aa32-4413-9092-749fee4fec46 req-caa657ca-7495-4297-9ed9-40be6f46b018 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:58.429785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ec1cd6a2-aa32-4413-9092-749fee4fec46 req-caa657ca-7495-4297-9ed9-40be6f46b018 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:58.431405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ec1cd6a2-aa32-4413-9092-749fee4fec46 req-caa657ca-7495-4297-9ed9-40be6f46b018 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:58.481031 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ec1cd6a2-aa32-4413-9092-749fee4fec46 req-caa657ca-7495-4297-9ed9-40be6f46b018 service nova] Creating event network-vif-unplugged:297733c1-9497-45d2-a8bd-4a6f5f31dcab for instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d on n-h1-854663-10 Oct 27 10:15:58.509878 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ec1cd6a2-aa32-4413-9092-749fee4fec46 req-caa657ca-7495-4297-9ed9-40be6f46b018 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146183 Oct 27 10:15:58.513545 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 911/1921] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:58.530515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:58.535505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:58.550680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:58.551302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:58.551757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:58.553802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:58.554287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:58.555725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:58.693856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:58.706740 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed554e5a-cb95-4579-967d-ad08e477ba75 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 1.386188 Oct 27 10:15:58.708207 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1011/1922] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:57 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:58.714590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-334758f8-db3b-4d08-96e8-fdb8eed3c9a6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d63948550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:58.829311 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-334758f8-db3b-4d08-96e8-fdb8eed3c9a6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.119769 Oct 27 10:15:58.832277 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1012/1923] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:15:58 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:58.861377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:58.866893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:58.910322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:58.911690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:58.915044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:58.915856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:58.917476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:58.918251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:58.982855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] HTTP exception thrown: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Request method failure captured: Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 HTTP/1.1 Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlnP4L5suYQXbz5qpPuGGevrujrRpzZ-vLfzXUF3ZaSlSX98orT2Cfi986wColyK07_HVLhuX1oEUP213nlEajHqSgzVHat2a2GhbVQPLn7d6HBtQk8uLaWXwaf9qe3Z7MBQU1KuUvs5iH5BWz4nrGK0YsOtTbCzC8YloNXi8zDQtBs Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:15:58.985454 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cdba716768804fa1b1e939964ccf25cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestMultiNic-1755480493 Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7dbf1513514a45479dd04815d34889b6 Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:58.987745 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1f9af47a-23f1-41b0-8c43-6dc621ba0494'} Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:58.988924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:15:58.990559 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:15:58.994541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Returning 404 to user: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:58.995696 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a50f922-5ab4-4195-9b03-4d1d77134124 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 404 len: 111 microversion: 2.1 time: 0.160026 Oct 27 10:15:58.996805 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1013/1924] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:15:58 2022] DELETE /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:59.002737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:59.003990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:59.011547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:59.012468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:59.013506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:59.014737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:59.015441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:59.016033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:59.457742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:59.816924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:59.818444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:59.854608 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c995fa5d-c44d-4cec-a344-a5d77de85de0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1237 microversion: 2.1 time: 0.853666 Oct 27 10:15:59.861197 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1014/1925] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:58 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1237 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:59.863036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:59.875035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:59.876285 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab1298b4-66e7-41ad-a024-da8cd89ea3fc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1292 microversion: 2.25 time: 1.359369 Oct 27 10:15:59.888398 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 912/1926] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:15:58 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1292 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:15:59.890392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:59.895012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:59.907834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:59.908159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:59.908519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:59.908715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: 1f9af47a-23f1-41b0-8c43-6dc621ba0494] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:59.908994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:59.909701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:59.914309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:59.917324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:59.931416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:59.936167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:59.936753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:59.943634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:59.944231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:59.944722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.004370 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] HTTP exception thrown: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Request method failure captured: Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 HTTP/1.1 Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlnP4L5suYQXbz5qpPuGGevrujrRpzZ-vLfzXUF3ZaSlSX98orT2Cfi986wColyK07_HVLhuX1oEUP213nlEajHqSgzVHat2a2GhbVQPLn7d6HBtQk8uLaWXwaf9qe3Z7MBQU1KuUvs5iH5BWz4nrGK0YsOtTbCzC8YloNXi8zDQtBs Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:16:00.018289 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cdba716768804fa1b1e939964ccf25cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestMultiNic-1755480493 Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 7dbf1513514a45479dd04815d34889b6 Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:16:00.020259 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '1f9af47a-23f1-41b0-8c43-6dc621ba0494'} Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:00.021400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. Oct 27 10:16:00.023184 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.024757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Returning 404 to user: Instance 1f9af47a-23f1-41b0-8c43-6dc621ba0494 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:00.024757 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-366b422c-ab26-4862-8c82-e528f6979e66 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494" status: 404 len: 111 microversion: 2.1 time: 0.130434 Oct 27 10:16:00.024757 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 913/1927] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:59 2022] GET /compute/v2.1/servers/1f9af47a-23f1-41b0-8c43-6dc621ba0494 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:16:00.036875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:00.037571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:00.065317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.065861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.066310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.072282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.072836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.073279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.553272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:00.562854 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-880d36ba-9c46-4315-b8cd-1af5ce3e2167 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 200 len: 1467 microversion: 2.1 time: 0.699768 Oct 27 10:16:00.567457 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1015/1928] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:59 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 1467 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:00.607129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d627b1dc-226b-4374-80b1-55c7089fbae6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d637cfca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:00.663994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:00.691274 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-db0f2da8-77d4-494c-9222-b6af67a038dc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.669344 Oct 27 10:16:00.707050 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d627b1dc-226b-4374-80b1-55c7089fbae6 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.137887 Oct 27 10:16:00.708807 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1016/1929] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:00 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:00.710147 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 914/1930] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:00 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:00.733155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:00.733738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:00.736503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:00.754059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.754553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.754991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.755632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:00.759063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Searching by: {'reservation_id': 'r-bvldtg51', 'deleted': False, 'project_id': '88e242ed84c14a5eaabf74309f00b689'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:16:00.759837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.763470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.764279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.774093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.774609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.777141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.778690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.780715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.781350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.808296 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] HTTP exception thrown: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Request method failure captured: Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 HTTP/1.1 Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlnP4L5suYQXbz5qpPuGGevrujrRpzZ-vLfzXUF3ZaSlSX98orT2Cfi986wColyK07_HVLhuX1oEUP213nlEajHqSgzVHat2a2GhbVQPLn7d6HBtQk8uLaWXwaf9qe3Z7MBQU1KuUvs5iH5BWz4nrGK0YsOtTbCzC8YloNXi8zDQtBs Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:16:00.814096 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cdba716768804fa1b1e939964ccf25cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestMultiNic-1755480493 Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7dbf1513514a45479dd04815d34889b6 Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.816437 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'e93913f7-7e3d-4d26-89df-544623f1e443'} Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:00.818039 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.819600 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.821872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Returning 404 to user: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:00.823847 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab999de9-b701-4e59-b2d6-963244617cdb tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 404 len: 111 microversion: 2.1 time: 0.113904 Oct 27 10:16:00.826369 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1017/1931] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:16:00 2022] DELETE /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:16:00.840325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:00.841503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] [instance: e93913f7-7e3d-4d26-89df-544623f1e443] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:00.855537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.856305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.857075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.858611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.859202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.859823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.878383 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] HTTP exception thrown: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Request method failure captured: Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 HTTP/1.1 Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlnP4L5suYQXbz5qpPuGGevrujrRpzZ-vLfzXUF3ZaSlSX98orT2Cfi986wColyK07_HVLhuX1oEUP213nlEajHqSgzVHat2a2GhbVQPLn7d6HBtQk8uLaWXwaf9qe3Z7MBQU1KuUvs5iH5BWz4nrGK0YsOtTbCzC8YloNXi8zDQtBs Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:16:00.890844 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cdba716768804fa1b1e939964ccf25cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cdba716768804fa1b1e939964ccf25cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestMultiNic-1755480493 Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: cdba716768804fa1b1e939964ccf25cf Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestMultiNic-1755480493 Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7dbf1513514a45479dd04815d34889b6 Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestMultiNic-1755480493-project Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.893808 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'e93913f7-7e3d-4d26-89df-544623f1e443'} Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:00.894695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. Oct 27 10:16:00.897189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:00.900975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] Returning 404 to user: Instance e93913f7-7e3d-4d26-89df-544623f1e443 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:00.902420 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66feb786-5f04-4302-9b81-38e05c305756 tempest-ServersTestMultiNic-1755480493 tempest-ServersTestMultiNic-1755480493-project] 10.222.0.76 "GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443" status: 404 len: 111 microversion: 2.1 time: 0.070914 Oct 27 10:16:00.903655 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1018/1932] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:00 2022] GET /compute/v2.1/servers/e93913f7-7e3d-4d26-89df-544623f1e443 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:16:00.910443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:00.911429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:00.920428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.921481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.922361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.923356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:00.925156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:00.926347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:01.274957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:01.286373 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28fe8b47-e71f-4407-8a73-107642878d9b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1237 microversion: 2.1 time: 0.381248 Oct 27 10:16:01.291544 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1019/1933] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:00 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1237 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:01.305921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:01.310008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:01.329622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:01.331406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:01.332502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:01.349636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:01.350424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:01.351545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:01.405382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:01.663853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:16:01.762563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:01.773162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:01.774073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:01.774703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:02.135945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:02.152919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:02.155938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:02.162513 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45d676b2-fc40-4b9e-b94c-47712778301f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1292 microversion: 2.25 time: 0.867959 Oct 27 10:16:02.164072 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1020/1934] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:01 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1292 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:02.178256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b02c571f-e579-4a29-a2a4-0326f9d0a055 req-6d0a710c-2c33-41b1-b2f7-924b5e8822d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6435a0-0a3f-42a7-b87e-6d46af12f65d", "tag": "297733c1-9497-45d2-a8bd-4a6f5f31dcab"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:02.215578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b02c571f-e579-4a29-a2a4-0326f9d0a055 req-6d0a710c-2c33-41b1-b2f7-924b5e8822d0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:02.216275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b02c571f-e579-4a29-a2a4-0326f9d0a055 req-6d0a710c-2c33-41b1-b2f7-924b5e8822d0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:02.217102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b02c571f-e579-4a29-a2a4-0326f9d0a055 req-6d0a710c-2c33-41b1-b2f7-924b5e8822d0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:02.257866 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b02c571f-e579-4a29-a2a4-0326f9d0a055 req-6d0a710c-2c33-41b1-b2f7-924b5e8822d0 service nova] Creating event network-changed:297733c1-9497-45d2-a8bd-4a6f5f31dcab for instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d on n-h1-854663-10 Oct 27 10:16:02.290718 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b02c571f-e579-4a29-a2a4-0326f9d0a055 req-6d0a710c-2c33-41b1-b2f7-924b5e8822d0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123081 Oct 27 10:16:02.291533 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1021/1935] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:02.313442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb049ac3-30df-48d1-92b3-739298669a93 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d637e15e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:02.406750 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb049ac3-30df-48d1-92b3-739298669a93 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.108629 Oct 27 10:16:02.407938 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1022/1936] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:02 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:02.422756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:02.424139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:02.431460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:02.432371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:02.433188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:02.434652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:02.435373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:02.436202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:02.952443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:02.964448 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c459954-0e57-466f-a3bb-0ddde5e55983 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.545951 Oct 27 10:16:02.977888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7bcb0fe2-1f93-43ce-965d-fe8edb9c143b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/detail?reservation_id=r-bvldtg51" status: 200 len: 2927 microversion: 2.1 time: 2.266239 Oct 27 10:16:02.979670 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 915/1937] 10.222.0.76 () {58 vars in 1197 bytes} [Thu Oct 27 10:16:00 2022] GET /compute/v2.1/servers/detail?reservation_id=r-bvldtg51 => generated 2927 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:02.986185 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1023/1938] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:02 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:02.987456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:02.987603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:03.007846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:03.008609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:03.009433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:03.010494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:03.011173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:03.011759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:03.014411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9bfc283-eaab-4524-b1f0-b24697b03f9b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:03.127209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_groups [None req-a9bfc283-eaab-4524-b1f0-b24697b03f9b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Querying cell 9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) for 2 instances {{(pid=120720) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 10:16:03.129525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9bfc283-eaab-4524-b1f0-b24697b03f9b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:03.130035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9bfc283-eaab-4524-b1f0-b24697b03f9b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:03.130475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9bfc283-eaab-4524-b1f0-b24697b03f9b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:03.204077 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9bfc283-eaab-4524-b1f0-b24697b03f9b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups/1ad64767-929d-4bd4-a8be-c14b8bbdcbcd" status: 200 len: 265 microversion: 2.1 time: 0.197805 Oct 27 10:16:03.211579 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1024/1939] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:16:03 2022] GET /compute/v2.1/os-server-groups/1ad64767-929d-4bd4-a8be-c14b8bbdcbcd => generated 265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:03.228919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:03.229996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:03.255644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:03.259028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:03.262051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:03.264267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:03.269783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:03.270505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:03.418072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:03.432160 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bc23c14-e232-4400-a04c-f50dd54fd4dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1237 microversion: 2.1 time: 0.447274 Oct 27 10:16:03.433237 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 916/1940] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:02 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1237 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:03.465728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-292d56c2-e3a2-418b-aa30-a6b22d79df5f tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:03.467755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-292d56c2-e3a2-418b-aa30-a6b22d79df5f tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:03.492159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-292d56c2-e3a2-418b-aa30-a6b22d79df5f tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:03.494749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-292d56c2-e3a2-418b-aa30-a6b22d79df5f tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:03.495450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-292d56c2-e3a2-418b-aa30-a6b22d79df5f tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:03.498927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-292d56c2-e3a2-418b-aa30-a6b22d79df5f tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:03.501205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-292d56c2-e3a2-418b-aa30-a6b22d79df5f tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:03.503746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-292d56c2-e3a2-418b-aa30-a6b22d79df5f tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:04.443985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:04.463433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:04.464999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:04.466194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3962505c-fee6-4a23-b369-bbe645889c2d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1292 microversion: 2.25 time: 1.253373 Oct 27 10:16:04.466774 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1025/1941] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:03 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1292 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:04.518417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53aec282-0c9b-4b59-a7bf-2052f6d34ce9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d638dddc0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:04.582092 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-292d56c2-e3a2-418b-aa30-a6b22d79df5f tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 200 len: 1620 microversion: 2.1 time: 1.128279 Oct 27 10:16:04.582703 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 917/1942] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:03 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 1620 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:04.610043 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53aec282-0c9b-4b59-a7bf-2052f6d34ce9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.108074 Oct 27 10:16:04.611214 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1026/1943] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:04 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:04.617843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:04.619431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:04.621091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:04.622025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:04.641961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:04.642820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:04.643530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:04.644524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:04.645872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:04.646926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:04.649008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:04.669411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:04.669945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:04.670579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:04.671498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:04.672183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:04.672826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:05.458616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:05.473404 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-429948a5-3d7e-447c-bfdb-b56c540a2bf1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.864224 Oct 27 10:16:05.477248 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 918/1944] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:04 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:05.484908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a897fcbe-57fa-4499-b5ce-501e3c996bd0 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:05.488534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a897fcbe-57fa-4499-b5ce-501e3c996bd0 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:05.507318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a897fcbe-57fa-4499-b5ce-501e3c996bd0 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:05.508120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a897fcbe-57fa-4499-b5ce-501e3c996bd0 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:05.508790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a897fcbe-57fa-4499-b5ce-501e3c996bd0 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:05.510081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a897fcbe-57fa-4499-b5ce-501e3c996bd0 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:05.511180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a897fcbe-57fa-4499-b5ce-501e3c996bd0 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:05.514526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a897fcbe-57fa-4499-b5ce-501e3c996bd0 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:05.531819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:05.543595 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a3e9fbf-6af7-46ad-93fa-ffcaf81ee4be tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1305 microversion: 2.1 time: 0.930789 Oct 27 10:16:05.569501 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1027/1945] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:04 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1305 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:05.576538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:05.577555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:05.594063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:05.597244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:05.607839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:05.612074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:05.617885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:05.618587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:06.122441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:06.149278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:06.157752 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a897fcbe-57fa-4499-b5ce-501e3c996bd0 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1620 microversion: 2.1 time: 0.679096 Oct 27 10:16:06.158420 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 919/1946] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:05 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1620 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:06.167825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:06.169586 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7a85098-35d9-4987-9aa9-cd1b69de4fbe tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1292 microversion: 2.25 time: 0.598872 Oct 27 10:16:06.170226 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1028/1947] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:05 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1292 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:06.189827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ab383482-cf03-4078-b404-bf437e1bfba5 req-eb1c309f-848e-4bdb-9a62-aa1e07852803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7232d0b5-da9e-42f8-b828-2fe18f89e60c", "tag": "445e30db-5e71-4997-b764-66abde871cfd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:06.210099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4dea46ab-56d5-4315-877a-daff3711ab39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5acd53a0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:06.213255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ab383482-cf03-4078-b404-bf437e1bfba5 req-eb1c309f-848e-4bdb-9a62-aa1e07852803 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:06.213769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ab383482-cf03-4078-b404-bf437e1bfba5 req-eb1c309f-848e-4bdb-9a62-aa1e07852803 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:06.214216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ab383482-cf03-4078-b404-bf437e1bfba5 req-eb1c309f-848e-4bdb-9a62-aa1e07852803 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:06.278946 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ab383482-cf03-4078-b404-bf437e1bfba5 req-eb1c309f-848e-4bdb-9a62-aa1e07852803 service nova] Creating event network-changed:445e30db-5e71-4997-b764-66abde871cfd for instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c on n-h2-854663-10 Oct 27 10:16:06.292154 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ab383482-cf03-4078-b404-bf437e1bfba5 req-eb1c309f-848e-4bdb-9a62-aa1e07852803 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120660 Oct 27 10:16:06.303648 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4dea46ab-56d5-4315-877a-daff3711ab39 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1424 microversion: 2.1 time: 0.111845 Oct 27 10:16:06.304235 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 920/1948] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:06 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1424 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:06.305518 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1029/1949] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:06.324872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed8e123d-bc2d-4b1a-afa0-0f11651b757c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Action: 'create', calling method: .version_select at 0x7f6d6375e3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1516464367", "policies": ["anti-affinity"]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:06.415722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ed8e123d-bc2d-4b1a-afa0-0f11651b757c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:06.453096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ed8e123d-bc2d-4b1a-afa0-0f11651b757c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:06.503303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:06.503950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:06.521171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:06.521561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:06.523641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:06.524347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:06.524845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:06.525277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:06.541158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ed8e123d-bc2d-4b1a-afa0-0f11651b757c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:06.555485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ed8e123d-bc2d-4b1a-afa0-0f11651b757c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:06.587832 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed8e123d-bc2d-4b1a-afa0-0f11651b757c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.277828 Oct 27 10:16:06.592633 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 921/1950] 10.222.0.76 () {60 vars in 1174 bytes} [Thu Oct 27 10:16:06 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:06.607201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:06.608020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:06.623335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:06.630176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:06.630898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:06.631972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:06.632588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:06.633388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:07.661330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:07.674941 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3b02cd6e-05cd-4bbe-8cc3-720d7c57a8ff tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1305 microversion: 2.1 time: 1.079462 Oct 27 10:16:07.681483 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 922/1951] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:06 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1305 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:07.687146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-465435411", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "00172b71-74b7-47e3-a29d-bf0868c6b155"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:07.717525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:07.729501 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9da399ce-83d6-418e-84ee-82fab8e3d92b tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 1.231175 Oct 27 10:16:07.730232 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1030/1952] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:06 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:07.748627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:07.749421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:07.761920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:07.762942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:07.763409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:07.764167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:07.764631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:07.765095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:07.797003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:16:08.315315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:08.324050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:08.325506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:08.326638 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c0be2d9-86e2-426e-9208-c35fa4a90348 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1292 microversion: 2.25 time: 0.594917 Oct 27 10:16:08.327203 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1031/1953] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:07 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1292 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:08.358921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83b99451-c7ef-4fe3-be1e-8e79ce9ef73a tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ae71790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:08.443724 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83b99451-c7ef-4fe3-be1e-8e79ce9ef73a tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1433 microversion: 2.1 time: 0.115421 Oct 27 10:16:08.444316 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1032/1954] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:08 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1433 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:08.462201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5bfa2a9-64cf-4958-9315-4176ec2a4849 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5aeab160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:08.549633 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5bfa2a9-64cf-4958-9315-4176ec2a4849 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 200 len: 1433 microversion: 2.1 time: 0.091619 Oct 27 10:16:08.554272 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1033/1955] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:08 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 1433 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:08.563721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:16:08.564536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:16:08.565380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:16:08.565951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:16:08.566538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:16:08.578075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:08.578688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:08.617228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:08.617712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:08.618354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:08.619368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:08.619723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:08.620150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:08.678826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:08.697406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:08.728885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Going to run 2 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:16:08.731652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2b9e146-ce04-4819-953d-f1e4c7e53bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:16:08.851592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:08.857224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:08.939222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:08.944639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:08.973622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=c2b9e146-ce04-4819-953d-f1e4c7e53bbf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:16:09.083224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:09.088079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:09.121309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.122690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.123762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:09.127586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.128585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.133417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:09.162478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:09.169343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:09.180171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:09.302815 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ed5c28e-b145-41dd-ba45-60297a1b22ac tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.620022 Oct 27 10:16:09.307640 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 923/1956] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:16:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 1626 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 10:16:09.322576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:09.328236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:09.354113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.355542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.355542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:09.357050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.357527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.357954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:09.585806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:09.594959 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff122912-68cf-4fc9-962d-693aea23fb4f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1466 microversion: 2.1 time: 1.023870 Oct 27 10:16:09.604876 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1034/1957] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:08 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1466 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:09.618948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:09.624325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:09.647847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.650883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.651579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:09.652481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.659639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.660266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:09.694507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:09.707173 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da5f4727-333b-42be-af73-d85621c23346 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1305 microversion: 2.1 time: 0.396117 Oct 27 10:16:09.708538 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 924/1958] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:09 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1305 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:09.744156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:09.779084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:09.785253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Searching by: {'deleted': False, 'project_id': '88e242ed84c14a5eaabf74309f00b689'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:16:09.834753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.837778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.838987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:09.840655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.843503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.845306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:09.991422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:10.002593 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b189e7e5-c455-4489-a57a-339242871665 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.395660 Oct 27 10:16:10.005851 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1035/1959] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:09 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:10.025444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:16:10.026089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:10.026953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:10.044209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:10.046230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:10.046759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:10.049628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:10.050221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:10.050969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:10.105120 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d9fdd9be-9140-47b7-ab97-fd0c4c0fe98e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 1660 microversion: 2.1 time: 0.394920 Oct 27 10:16:10.106058 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 925/1960] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:16:09 2022] GET /compute/v2.1/servers => generated 1660 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:10.117670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-64b3641b-1693-460f-84d6-d170111aaeb0 req-22a6862b-4bb4-4db3-9bb2-cf2b601aaee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4608367-69ad-4d48-9fba-b7affe4d5167", "tag": "85ebd7c9-da7f-4bed-beb9-ad9438b98979"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:10.130548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-64b3641b-1693-460f-84d6-d170111aaeb0 req-22a6862b-4bb4-4db3-9bb2-cf2b601aaee2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:10.131406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-64b3641b-1693-460f-84d6-d170111aaeb0 req-22a6862b-4bb4-4db3-9bb2-cf2b601aaee2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:10.132284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-64b3641b-1693-460f-84d6-d170111aaeb0 req-22a6862b-4bb4-4db3-9bb2-cf2b601aaee2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:10.146695 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-64b3641b-1693-460f-84d6-d170111aaeb0 req-22a6862b-4bb4-4db3-9bb2-cf2b601aaee2 service nova] Creating event network-changed:85ebd7c9-da7f-4bed-beb9-ad9438b98979 for instance c4608367-69ad-4d48-9fba-b7affe4d5167 on n-h2-854663-10 Oct 27 10:16:10.153126 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-64b3641b-1693-460f-84d6-d170111aaeb0 req-22a6862b-4bb4-4db3-9bb2-cf2b601aaee2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045684 Oct 27 10:16:10.155379 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 926/1961] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:10.161920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac4254bd-3f57-449e-9f7c-572fff9b829c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d63773160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:10.225740 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac4254bd-3f57-449e-9f7c-572fff9b829c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/e360a591-87a4-48a1-b578-afd9703b636a" status: 200 len: 784 microversion: 2.1 time: 0.068702 Oct 27 10:16:10.238945 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 927/1962] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:10 2022] GET /compute/v2.1/images/e360a591-87a4-48a1-b578-afd9703b636a => generated 784 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:10.247298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-805a9066-eedb-4da9-8238-299664f6165d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:10.251252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-805a9066-eedb-4da9-8238-299664f6165d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:10.314143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:10.337714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:10.341889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:10.347852 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96d83cb6-c09d-4cbc-a57c-84c9298c2c58 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1292 microversion: 2.25 time: 0.340560 Oct 27 10:16:10.368731 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1036/1963] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:10 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1292 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:10.394200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05ccc5ec-4e9a-49e5-adef-6539edcb6128 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:10.430915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-805a9066-eedb-4da9-8238-299664f6165d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:10.432435 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05ccc5ec-4e9a-49e5-adef-6539edcb6128 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.062420 Oct 27 10:16:10.433436 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1037/1964] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:16:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:10.446960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf45c31a-7aa4-4c24-8087-33d92f541177 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ae68e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:10.447519 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-805a9066-eedb-4da9-8238-299664f6165d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1218 microversion: 2.1 time: 0.206100 Oct 27 10:16:10.448283 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 928/1965] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:10 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:10.731413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:10.732089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:10.759246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:10.760792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:10.762100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:10.772257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:10.773627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:10.774949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:10.843303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:11.130807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:11.142105 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2db6330a-8ac9-4ee9-8ee1-19670f937c43 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1305 microversion: 2.1 time: 0.414620 Oct 27 10:16:11.144434 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 929/1966] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:10 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1305 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:11.149889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:11.150714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:11.181292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:11.181803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:11.182250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:11.182978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:11.183426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:11.184269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:11.529405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:11.538019 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bd9a24d0-6805-4ad3-a55c-1a596569a8c7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.392179 Oct 27 10:16:11.551267 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 930/1967] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:11 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:11.573437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:11.576174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:11.607960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:11.608482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:11.608959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:11.610203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:11.610662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:11.611657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:11.664460 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf45c31a-7aa4-4c24-8087-33d92f541177 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "DELETE /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 204 len: 0 microversion: 2.1 time: 1.222180 Oct 27 10:16:11.665640 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1038/1968] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:10 2022] DELETE /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 0 bytes in 1224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:16:11.672470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:11.673444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:11.682627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:11.683469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:11.684239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:11.685485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:11.686264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:11.687021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:11.860915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:11.876730 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68ba4602-4fdb-49ce-9ca6-15ffb4565cfc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1270 microversion: 2.1 time: 0.206374 Oct 27 10:16:11.895002 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1039/1969] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:11 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:11.906048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cbd1e5ff-ba67-4ce0-8a2a-4a8e405f4629 req-90d28bb4-39da-45f3-a1c1-62a719856937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe2d6b4-731c-4567-9abb-a7924c8dd43b", "name": "network-vif-unplugged", "status": "completed", "tag": "ef734916-25b8-4e1e-8214-27785b87cd71"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:11.930048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cbd1e5ff-ba67-4ce0-8a2a-4a8e405f4629 req-90d28bb4-39da-45f3-a1c1-62a719856937 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:11.930739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cbd1e5ff-ba67-4ce0-8a2a-4a8e405f4629 req-90d28bb4-39da-45f3-a1c1-62a719856937 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:11.931341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cbd1e5ff-ba67-4ce0-8a2a-4a8e405f4629 req-90d28bb4-39da-45f3-a1c1-62a719856937 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:11.944982 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cbd1e5ff-ba67-4ce0-8a2a-4a8e405f4629 req-90d28bb4-39da-45f3-a1c1-62a719856937 service nova] Creating event network-vif-unplugged:ef734916-25b8-4e1e-8214-27785b87cd71 for instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b on n-h2-854663-10 Oct 27 10:16:11.954940 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cbd1e5ff-ba67-4ce0-8a2a-4a8e405f4629 req-90d28bb4-39da-45f3-a1c1-62a719856937 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055425 Oct 27 10:16:11.955591 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1040/1970] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:11.964995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66c9c704-f00d-479e-b862-b76a01dd5ec0 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d6381ac10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:12.012647 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-66c9c704-f00d-479e-b862-b76a01dd5ec0 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] HTTP exception thrown: Image not found. Oct 27 10:16:12.018967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66c9c704-f00d-479e-b862-b76a01dd5ec0 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Request method failure captured: Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a HTTP/1.1 Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlolEfayIW_AoXGh_QFaF08ropDDD-j3c-KFiCSTUvDUGLJIVMMivCHwivJ9ljFUw0Zt9JTHj0l1F7vYkraXwLClmhXsbAmgz2PaeIITeMbw8k6LijnMukbxZdWVEPXtKhv9ihtrf5b75Q8DJ6urMJOAFBF-tKYEpJuEyrGTdJQg4L0 Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 686cacfed6704a9585df56d80cb7273f Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerTestJSON-1485835016 Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:16:12.028417 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/686cacfed6704a9585df56d80cb7273f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/686cacfed6704a9585df56d80cb7273f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_686cacfed6704a9585df56d80cb7273f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/686cacfed6704a9585df56d80cb7273f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerTestJSON-1485835016 Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 686cacfed6704a9585df56d80cb7273f Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1485835016 Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerTestJSON-1485835016-project Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: f972a5c34e294e63b10e7c97ba23739f Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerTestJSON-1485835016-project Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ad4fdf12-87a1-4f59-98bf-106922613c2a'} Oct 27 10:16:12.030460 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:16:12.031682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ad4fdf12-87a1-4f59-98bf-106922613c2a Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:16:12.033167 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ad4fdf12-87a1-4f59-98bf-106922613c2a could not be found. Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:16:12.036009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66c9c704-f00d-479e-b862-b76a01dd5ec0 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:12.037782 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66c9c704-f00d-479e-b862-b76a01dd5ec0 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 404 len: 62 microversion: 2.1 time: 0.073004 Oct 27 10:16:12.039064 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1041/1971] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:11 2022] GET /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:16:12.039153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:12.041484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:12.041810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-726035e8-6b35-4b88-90b4-67da3ea9ed86 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ae71790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:12.048200 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da6c7022-e044-4449-8d72-c125e22ec3d9 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1292 microversion: 2.25 time: 0.494505 Oct 27 10:16:12.058938 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 931/1972] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:11 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1292 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:12.075555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e3b7c79-2fdf-4367-b73f-af5080c1bed9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-584578894"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:12.085199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e3b7c79-2fdf-4367-b73f-af5080c1bed9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:12.102990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e3b7c79-2fdf-4367-b73f-af5080c1bed9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:12.103499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e3b7c79-2fdf-4367-b73f-af5080c1bed9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:12.103947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e3b7c79-2fdf-4367-b73f-af5080c1bed9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:12.104684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e3b7c79-2fdf-4367-b73f-af5080c1bed9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:12.106587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e3b7c79-2fdf-4367-b73f-af5080c1bed9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:12.107464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e3b7c79-2fdf-4367-b73f-af5080c1bed9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:12.128497 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-726035e8-6b35-4b88-90b4-67da3ea9ed86 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/34dd97b3-c45f-4fee-b79b-065b7e8e6785" status: 200 len: 662 microversion: 2.1 time: 0.090295 Oct 27 10:16:12.134344 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1042/1973] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:12 2022] GET /compute/v2.1/images/34dd97b3-c45f-4fee-b79b-065b7e8e6785 => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:12.152897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef4b7a71-fd00-45d7-b333-c1edc61a714e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ae298b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:12.305767 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef4b7a71-fd00-45d7-b333-c1edc61a714e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/34dd97b3-c45f-4fee-b79b-065b7e8e6785" status: 200 len: 662 microversion: 2.1 time: 0.160153 Oct 27 10:16:12.307604 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1043/1974] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:12 2022] GET /compute/v2.1/images/34dd97b3-c45f-4fee-b79b-065b7e8e6785 => generated 662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:12.318074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:12.319126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:12.329537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:12.330118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:12.330641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:12.331597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:12.332134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:12.332628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:12.609751 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e3b7c79-2fdf-4367-b73f-af5080c1bed9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "POST /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b/action" status: 202 len: 0 microversion: 2.1 time: 0.543155 Oct 27 10:16:12.618516 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 932/1975] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:16:12 2022] POST /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:16:12.628293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:12.638749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:12.653047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:12.653973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:12.655056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:12.658472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:12.660944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:12.661632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:12.662123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:12.676769 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7b11684-2e73-42ab-88cb-3890d47b48f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1305 microversion: 2.1 time: 0.367012 Oct 27 10:16:12.678438 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1044/1976] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:12 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1305 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:12.705795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf7953b8-4d1e-4c22-92c0-6f27e1ebd99e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d63801160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:12.782319 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf7953b8-4d1e-4c22-92c0-6f27e1ebd99e tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.102502 Oct 27 10:16:12.788717 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1045/1977] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:12 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:12.901394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:12.902017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:12.911908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:12.912405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:12.914747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:12.915491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:12.915951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:12.918893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:12.928742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:12.943838 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf83e8d4-efa0-4fed-956d-fa99903dca8a tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.323908 Oct 27 10:16:12.964878 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 933/1978] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:12 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:13.036835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:13.048162 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6075388f-f84f-45a3-b234-bb0de95675e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1270 microversion: 2.1 time: 0.151578 Oct 27 10:16:13.049445 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1046/1979] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:12 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:16:13.089923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:13.090902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:13.104478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:13.109154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:13.112865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:13.114339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:13.118135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:13.118932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:13.196926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-537945893", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "92ce5af8-13b4-4c3c-9c98-0e84f065a9ea"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:13.320054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] validate_networks() for [('92ce5af8-13b4-4c3c-9c98-0e84f065a9ea', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:16:13.923168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:13.937421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:13.939232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:13.943948 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24a85b2a-c28b-4373-aaf9-08945ccea36b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1280 microversion: 2.25 time: 0.861643 Oct 27 10:16:13.962205 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1047/1980] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:13 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1280 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:16:13.973920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:13.975277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:13.982802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:13.983655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:13.984410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:13.985380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:13.986117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:13.986863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:14.550694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:14.565224 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c67fb34c-4509-4a3a-9019-82a2c3a4a05f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1305 microversion: 2.1 time: 0.601983 Oct 27 10:16:14.566422 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1048/1981] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:13 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1305 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:14.571620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a186c6a-c1fd-4cbf-800b-2e11f7590675 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ae29550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:14.652854 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a186c6a-c1fd-4cbf-800b-2e11f7590675 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.084841 Oct 27 10:16:14.653804 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1049/1982] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:14 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:14.662140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e836809-a0c2-40ef-b746-6fb23abd6aa6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d638139d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:14.746407 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e836809-a0c2-40ef-b746-6fb23abd6aa6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/d13f6e16-0238-47fd-bbee-19fe6d819b53" status: 200 len: 662 microversion: 2.1 time: 0.088784 Oct 27 10:16:14.755937 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1050/1983] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:14 2022] GET /compute/v2.1/images/d13f6e16-0238-47fd-bbee-19fe6d819b53 => generated 662 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:14.761475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:14.762108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:14.776449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:14.776449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:14.779882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:14.781025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:14.782611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:14.785918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:14.823992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:14.991375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:16:14.992633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:16:14.993457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:16:14.994210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:16:14.995089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:16:15.017317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:15.020844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:15.023715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:15.027621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:15.029359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:15.033770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:15.109330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Getting quotas for project 50dd8d17dbe24743a91623359e7ab3ea. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:15.128372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Getting quotas for user 1e81a5a542844654a4b517d4c13de3c3 and project 50dd8d17dbe24743a91623359e7ab3ea. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:15.204500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:16:15.216820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:16:15.418450 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1d86bf56-7464-4373-9817-c6c6457865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.440433 Oct 27 10:16:15.419808 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 934/1984] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:16:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:16:15.440080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:15.442496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:15.451442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:15.452238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:15.452995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:15.454359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:15.455070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:15.457404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:15.860192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:15.872800 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3b1981f7-a600-427b-865a-b68dfde3c294 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1276 microversion: 2.1 time: 0.443465 Oct 27 10:16:15.876760 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 935/1985] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:15 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1276 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:15.886499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c467ef6-65b9-434c-91f3-41b1f5576c16 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d637afe50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:15.957230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:16.003008 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c82ed94-f027-4f2b-9bd7-6bcfb76912fc tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 1.252848 Oct 27 10:16:16.003669 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1051/1986] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:14 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:16.005408 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c467ef6-65b9-434c-91f3-41b1f5576c16 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/d13f6e16-0238-47fd-bbee-19fe6d819b53" status: 200 len: 662 microversion: 2.1 time: 0.125856 Oct 27 10:16:16.025240 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 936/1987] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:15 2022] GET /compute/v2.1/images/d13f6e16-0238-47fd-bbee-19fe6d819b53 => generated 662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:16.040712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:16.045361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:16.045772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17db0d50-d3f0-4506-a63d-a00e8be11fc2 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:16.048489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17db0d50-d3f0-4506-a63d-a00e8be11fc2 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:16.061002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:16.062261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:16.064234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:16.068384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:16.069181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:16.070520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:16.525328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-17db0d50-d3f0-4506-a63d-a00e8be11fc2 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:16.550239 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17db0d50-d3f0-4506-a63d-a00e8be11fc2 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1231 microversion: 2.1 time: 0.516281 Oct 27 10:16:16.550239 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 937/1988] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:16 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1231 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:16.554364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:16.562403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:16.601797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:16.604525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:16.609902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:16.613955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:16.614661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:16.616226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:17.040340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:17.061108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:17.064092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:17.070086 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8359d516-104a-4db9-9189-6a0f14f7e935 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1280 microversion: 2.25 time: 1.053414 Oct 27 10:16:17.073342 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1052/1989] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:16 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1280 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:17.085422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00c4b871-3618-4981-af43-d302e03259aa tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d6383f9d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:17.187235 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00c4b871-3618-4981-af43-d302e03259aa tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.112239 Oct 27 10:16:17.188212 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1053/1990] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:17 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:17.196708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:17.200993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:17.215145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:17.217494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:17.218383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:17.225601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:17.226655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:17.227280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:17.232174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:17.253488 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52149126-223b-4514-9cdb-fd9ec18b2407 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1293 microversion: 2.1 time: 0.702118 Oct 27 10:16:17.273683 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 938/1991] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:16 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1293 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:17.296315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:17.305649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:17.323613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:17.326598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:17.329102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:17.335466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:17.336433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:17.339445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:18.296875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:18.316044 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a44f6c14-6643-4a5c-8e19-0ba3fb44443c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 1.038876 Oct 27 10:16:18.322053 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 939/1992] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:17 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:18.347600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:18.348722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:18.368292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:18.368837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:18.378113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:18.379191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:18.380037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:18.380639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:18.521322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:18.533777 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c8d66c32-53e3-458d-8c67-4b2ad4e4a308 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1289 microversion: 2.1 time: 0.207816 Oct 27 10:16:18.535030 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 940/1993] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:18 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1289 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:18.539128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:18.549900 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ec54cb3-5621-4cf6-b608-16b730e00f5e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1318 microversion: 2.1 time: 1.360370 Oct 27 10:16:18.556956 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1054/1994] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:17 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1318 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:18.568233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8dd6d82e-3d55-4f15-bd61-78ed6e7f0491 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d63773820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:18.570468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:18.589293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:18.610114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:18.612351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:18.613008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:18.615771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:18.617142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:18.617856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:18.688447 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8dd6d82e-3d55-4f15-bd61-78ed6e7f0491 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/83bc2e3d-e9e8-42a9-b0f4-8ee1ade839aa" status: 200 len: 662 microversion: 2.1 time: 0.136025 Oct 27 10:16:18.689301 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 941/1995] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:18 2022] GET /compute/v2.1/images/83bc2e3d-e9e8-42a9-b0f4-8ee1ade839aa => generated 662 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:18.704139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1069df65-eaa2-46c9-9c4f-5a6a08513d0a tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d637a18b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:18.798011 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1069df65-eaa2-46c9-9c4f-5a6a08513d0a tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.107246 Oct 27 10:16:18.798532 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 942/1996] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:18 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:18.814659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:18.818127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:18.852606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:18.853391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:18.856797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:18.858201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:18.858866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:18.859472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:20.334145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:20.362518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:20.382411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:20.388242 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5634c7a5-921c-4558-9a22-1771e563ce66 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1293 microversion: 2.1 time: 1.588565 Oct 27 10:16:20.392054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:20.393424 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 943/1997] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:18 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1293 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:20.395629 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45c7d013-e8b0-45fe-bc04-c6af8b8b62a2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1280 microversion: 2.25 time: 1.835773 Oct 27 10:16:20.396970 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1055/1998] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:18 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1280 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:20.403290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2cbddcbe-bf0c-4537-85f3-1a715957429a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d63845ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:20.404086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-392c8a50-239d-4e47-b511-6144ebfa3a7d req-1f5f17a7-0c98-48f4-9344-54be0d345c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b9e146-ce04-4819-953d-f1e4c7e53bbf", "tag": "84dcab08-a68b-4fe0-8dc6-00d5b6e2d967"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:20.442175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-392c8a50-239d-4e47-b511-6144ebfa3a7d req-1f5f17a7-0c98-48f4-9344-54be0d345c19 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:20.442711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-392c8a50-239d-4e47-b511-6144ebfa3a7d req-1f5f17a7-0c98-48f4-9344-54be0d345c19 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:20.443145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-392c8a50-239d-4e47-b511-6144ebfa3a7d req-1f5f17a7-0c98-48f4-9344-54be0d345c19 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:20.456594 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-392c8a50-239d-4e47-b511-6144ebfa3a7d req-1f5f17a7-0c98-48f4-9344-54be0d345c19 service nova] Creating event network-changed:84dcab08-a68b-4fe0-8dc6-00d5b6e2d967 for instance c2b9e146-ce04-4819-953d-f1e4c7e53bbf on n-h1-854663-10 Oct 27 10:16:20.463869 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-392c8a50-239d-4e47-b511-6144ebfa3a7d req-1f5f17a7-0c98-48f4-9344-54be0d345c19 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066502 Oct 27 10:16:20.464761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 944/1999] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:20.475207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:20.476119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:20.489539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:20.490412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:20.491262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:20.492637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:20.493389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:20.494069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:20.498401 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2cbddcbe-bf0c-4537-85f3-1a715957429a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/83bc2e3d-e9e8-42a9-b0f4-8ee1ade839aa" status: 200 len: 662 microversion: 2.1 time: 0.099026 Oct 27 10:16:20.499110 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1056/2000] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:20 2022] GET /compute/v2.1/images/83bc2e3d-e9e8-42a9-b0f4-8ee1ade839aa => generated 662 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:20.503681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:20.504348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:20.560700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:20.560700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:20.561414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:20.562045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:20.562554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:20.572860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:20.821030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:20.833242 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bcb7a05c-98fb-437d-8c22-f110fb534b11 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1289 microversion: 2.1 time: 0.333035 Oct 27 10:16:20.837257 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1057/2001] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:20 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1289 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:20.844182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:20.848981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:20.864946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:20.866216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:20.880462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:20.883618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:20.884355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:20.885918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:21.106717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:21.143203 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-79e17dd6-15f2-4298-99fb-135de56d89bf tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.668322 Oct 27 10:16:21.146011 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 945/2002] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:20 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:21.172210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce1939fa-63bb-4f9b-a633-240966ebfa86 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ad15d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:21.273663 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce1939fa-63bb-4f9b-a633-240966ebfa86 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.122262 Oct 27 10:16:21.285450 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 946/2003] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:21 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:21.291411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-362666867", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:21.407212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:16:21.852206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:21.867100 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c0eadfc-319e-47f5-ace8-1553ed2cdda7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1318 microversion: 2.1 time: 1.028415 Oct 27 10:16:21.882454 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1058/2004] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:20 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1318 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:21.896011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b5984da7-c81a-4767-9b7d-9e23180656f0 req-e593e7fa-d8aa-40fd-bca1-e499e822071c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d1def7-512a-42be-8a51-eafdc75b0fed", "tag": "0921a48e-bbf8-4fc8-9fb5-f8abeef0fa1b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:21.928878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b5984da7-c81a-4767-9b7d-9e23180656f0 req-e593e7fa-d8aa-40fd-bca1-e499e822071c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:21.943343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b5984da7-c81a-4767-9b7d-9e23180656f0 req-e593e7fa-d8aa-40fd-bca1-e499e822071c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:21.944335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b5984da7-c81a-4767-9b7d-9e23180656f0 req-e593e7fa-d8aa-40fd-bca1-e499e822071c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:21.977461 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b5984da7-c81a-4767-9b7d-9e23180656f0 req-e593e7fa-d8aa-40fd-bca1-e499e822071c service nova] Creating event network-changed:0921a48e-bbf8-4fc8-9fb5-f8abeef0fa1b for instance c2d1def7-512a-42be-8a51-eafdc75b0fed on n-h2-854663-10 Oct 27 10:16:21.996127 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b5984da7-c81a-4767-9b7d-9e23180656f0 req-e593e7fa-d8aa-40fd-bca1-e499e822071c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112008 Oct 27 10:16:21.996782 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1059/2005] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:22.001999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:22.003020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:22.010864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:22.011661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:22.012324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:22.013373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:22.014044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:22.014955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:22.306869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:16:22.307381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:16:22.307951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:16:22.309362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:16:22.309839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:16:22.344062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=59 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:22.347116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:22.349145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:22.350958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:22.353008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:22.354273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:22.354939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:22.373531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=13 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:22.388639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Getting quotas for project 496dab6d3c584e328de368214c3d5189. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:22.404124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Getting quotas for user 6e4a9982da0949a2b255e743864962a4 and project 496dab6d3c584e328de368214c3d5189. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:22.416445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:22.434054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:16:22.437256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:16:22.447635 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9048e8d-5a20-4531-a35c-a35c0fa4577b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1293 microversion: 2.1 time: 0.449595 Oct 27 10:16:22.448259 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1060/2006] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:21 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1293 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:22.461199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:22.462059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:22.476305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:22.476829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:22.477506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:22.478438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:22.479739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:22.481175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:22.533285 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f44c8ed-6b05-402c-a5d3-e313a4def3ea tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245792 Oct 27 10:16:22.542644 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 947/2007] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:16:22.553202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4953b52a-98e1-441a-993c-e9665ba07acf req-05517bb7-1251-4ef0-a041-933a4848841d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe2d6b4-731c-4567-9abb-a7924c8dd43b", "name": "network-vif-plugged", "status": "completed", "tag": "ef734916-25b8-4e1e-8214-27785b87cd71"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:22.572209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4953b52a-98e1-441a-993c-e9665ba07acf req-05517bb7-1251-4ef0-a041-933a4848841d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:22.573956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4953b52a-98e1-441a-993c-e9665ba07acf req-05517bb7-1251-4ef0-a041-933a4848841d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:22.574230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4953b52a-98e1-441a-993c-e9665ba07acf req-05517bb7-1251-4ef0-a041-933a4848841d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:22.604763 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4953b52a-98e1-441a-993c-e9665ba07acf req-05517bb7-1251-4ef0-a041-933a4848841d service nova] Creating event network-vif-plugged:ef734916-25b8-4e1e-8214-27785b87cd71 for instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b on n-h2-854663-10 Oct 27 10:16:22.617302 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4953b52a-98e1-441a-993c-e9665ba07acf req-05517bb7-1251-4ef0-a041-933a4848841d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072949 Oct 27 10:16:22.618507 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 948/2008] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:22.646391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:22.649274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:22.671330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:22.673348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:22.676605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:22.680449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:22.683727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:22.685635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:23.346597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:23.367869 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f0a0d6ca-1372-43d9-9856-2a4c19623f41 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1331 microversion: 2.1 time: 0.734583 Oct 27 10:16:23.389302 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 949/2009] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:22 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1331 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:23.395967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:23.397022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:23.421225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:23.422066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:23.423726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:23.425416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:23.428298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:23.437143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:23.519005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:23.536285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:23.537915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:23.545543 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97f8f799-bb0b-4d4f-8344-c06d739f6db6 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1280 microversion: 2.25 time: 1.090201 Oct 27 10:16:23.549949 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1061/2010] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:22 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1280 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:23.566778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58ac4e10-a1a6-4500-a6c5-dce80f74f243 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ae29f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:23.681603 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58ac4e10-a1a6-4500-a6c5-dce80f74f243 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.128585 Oct 27 10:16:23.687644 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1062/2011] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:23 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:23.698413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-572927107", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:23.810336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:16:24.260366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:24.276066 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ca1347a9-4eaf-4bde-9072-e7028cbb90e4 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1391 microversion: 2.1 time: 0.884684 Oct 27 10:16:24.277271 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 950/2012] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:23 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1391 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:24.286834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:24.287787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:24.342221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:24.349226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:24.353678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:24.356012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:24.357240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:24.364757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:25.166919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:25.190355 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-74bac028-1022-41e5-bcc8-65b148ca9e34 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1318 microversion: 2.1 time: 0.910821 Oct 27 10:16:25.197058 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 951/2013] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:24 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1318 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:25.214422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:25.222889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:25.242111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:25.243827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:25.244875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:25.246075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:25.247694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:25.248365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:25.300057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:25.615488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:16:25.616220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:16:25.616856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:16:25.617330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:16:25.617853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:16:25.626094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=84 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:25.655148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:25.655800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:25.656333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:25.658157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:25.659268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:25.663877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:25.723534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Getting quotas for project 496dab6d3c584e328de368214c3d5189. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:25.737555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Getting quotas for user 6e4a9982da0949a2b255e743864962a4 and project 496dab6d3c584e328de368214c3d5189. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:25.785198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:16:25.791146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:16:25.925372 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4253fd44-c8f4-4db1-8663-7bfdb04df832 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.236125 Oct 27 10:16:25.926447 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1063/2014] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:16:25.933030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:25.935320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:25.946238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:25.975452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:25.976219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:25.977103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:25.977684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:25.981014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:26.352226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:26.373184 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dee360c3-a115-40f5-af26-b3b33b49e2c7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1293 microversion: 2.1 time: 1.174168 Oct 27 10:16:26.374212 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 952/2015] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:25 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1293 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:26.386787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:26.387413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:26.405397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:26.406117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:26.406727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:26.408019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:26.408838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:26.409466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:27.576441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:27.596716 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cfdf858f-7d4c-405e-872e-447c2048ee15 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1331 microversion: 2.1 time: 1.668429 Oct 27 10:16:27.613727 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1064/2016] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:25 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1331 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:27.631990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-35601251-e438-482e-ac3f-b8133004994d req-68f2507c-e2d3-4e53-803d-2d9f75b3e8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7232d0b5-da9e-42f8-b828-2fe18f89e60c", "name": "network-vif-plugged", "status": "completed", "tag": "445e30db-5e71-4997-b764-66abde871cfd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:27.658639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-35601251-e438-482e-ac3f-b8133004994d req-68f2507c-e2d3-4e53-803d-2d9f75b3e8c1 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:27.664216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-35601251-e438-482e-ac3f-b8133004994d req-68f2507c-e2d3-4e53-803d-2d9f75b3e8c1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:27.664897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-35601251-e438-482e-ac3f-b8133004994d req-68f2507c-e2d3-4e53-803d-2d9f75b3e8c1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:27.691195 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-35601251-e438-482e-ac3f-b8133004994d req-68f2507c-e2d3-4e53-803d-2d9f75b3e8c1 service nova] Creating event network-vif-plugged:445e30db-5e71-4997-b764-66abde871cfd for instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c on n-h2-854663-10 Oct 27 10:16:27.698723 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-35601251-e438-482e-ac3f-b8133004994d req-68f2507c-e2d3-4e53-803d-2d9f75b3e8c1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082546 Oct 27 10:16:27.724794 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1065/2017] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:27.737068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-870a0ee0-1bed-4954-9282-51bb94a073f9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ae71790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:27.868850 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-870a0ee0-1bed-4954-9282-51bb94a073f9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.142303 Oct 27 10:16:27.883621 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1066/2018] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:27 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:27.889797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:27.890760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:27.900979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:27.913142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:27.918362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:27.920109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:27.920994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:27.921990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.279442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:28.297309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:28.331103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:28.338519 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8cdd356a-5b35-4805-bf37-8ccaa8441446 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1280 microversion: 2.25 time: 1.962046 Oct 27 10:16:28.339426 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 953/2019] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:26 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1280 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:28.378815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:28.385913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:28.399404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:28.411055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.411811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.413290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.413565 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-172a7880-238f-48aa-8b8f-11955bacacf7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1381 microversion: 2.1 time: 0.527778 Oct 27 10:16:28.414910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.417090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.429781 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1067/2020] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:27 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1381 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:28.433350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:28.441859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.445123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:28.468734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.469625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.470262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.471288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.473232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.473880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.772625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:28.786240 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e184778-83ad-4ca2-9b42-aaa7451e9f07 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1213 microversion: 2.1 time: 0.416553 Oct 27 10:16:28.787639 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 954/2021] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:28 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1213 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:28.805217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-cf05c8a9-0173-4f2b-ad8c-a8ae965b85fc req-6688896e-da32-48b8-a273-1c8447e0c40f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3773dce-56b1-44be-bc19-4e5bdc5ff072", "tag": "e638ef34-6ca1-49f2-8ada-7febf4785532"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:28.826684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cf05c8a9-0173-4f2b-ad8c-a8ae965b85fc req-6688896e-da32-48b8-a273-1c8447e0c40f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.832979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cf05c8a9-0173-4f2b-ad8c-a8ae965b85fc req-6688896e-da32-48b8-a273-1c8447e0c40f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.833605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cf05c8a9-0173-4f2b-ad8c-a8ae965b85fc req-6688896e-da32-48b8-a273-1c8447e0c40f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.867326 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-cf05c8a9-0173-4f2b-ad8c-a8ae965b85fc req-6688896e-da32-48b8-a273-1c8447e0c40f service nova] Creating event network-changed:e638ef34-6ca1-49f2-8ada-7febf4785532 for instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 on n-h1-854663-10 Oct 27 10:16:28.877266 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-cf05c8a9-0173-4f2b-ad8c-a8ae965b85fc req-6688896e-da32-48b8-a273-1c8447e0c40f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086070 Oct 27 10:16:28.880079 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 955/2022] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:28.889849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:28.895380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:28.921704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.925415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.926209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.927280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.929007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.936857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.975541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:28.984460 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c069a9b8-f470-49c5-ae4a-2e105c6651eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1318 microversion: 2.1 time: 0.561100 Oct 27 10:16:28.990877 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1068/2023] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:28 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:29.013159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9120d913-b5c5-4dfe-a25e-3e5328b6c8f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '.version_select at 0x7f6d5ae29040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:29.022107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9120d913-b5c5-4dfe-a25e-3e5328b6c8f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:29.023797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9120d913-b5c5-4dfe-a25e-3e5328b6c8f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:29.026494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9120d913-b5c5-4dfe-a25e-3e5328b6c8f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:29.066131 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9120d913-b5c5-4dfe-a25e-3e5328b6c8f0 tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 2722 microversion: 2.1 time: 0.073770 Oct 27 10:16:29.080417 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1069/2024] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:16:28 2022] GET /compute/v2.1/os-migrations => generated 2722 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:29.085703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:29.086636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:29.109638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:29.118764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:29.119825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:29.121605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:29.123759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:29.124463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:29.506909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:29.515912 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bb2e7bc1-caf4-4bd8-8476-c9a9c3e2b673 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1293 microversion: 2.1 time: 0.630462 Oct 27 10:16:29.519046 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 956/2025] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:28 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1293 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:29.537883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2fe7f9c-7c26-4b25-95b3-624a13dbf6f5 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d6386bd30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:29.621868 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e2fe7f9c-7c26-4b25-95b3-624a13dbf6f5 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.100678 Oct 27 10:16:29.631601 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 957/2026] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:29 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:29.645162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d7ce0a3-3a88-4c7d-8d22-6113f10fa2ec tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:29.646511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d7ce0a3-3a88-4c7d-8d22-6113f10fa2ec tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:29.674747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0a3-3a88-4c7d-8d22-6113f10fa2ec tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:29.675558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0a3-3a88-4c7d-8d22-6113f10fa2ec tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:29.676156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0a3-3a88-4c7d-8d22-6113f10fa2ec tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:29.677388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0a3-3a88-4c7d-8d22-6113f10fa2ec tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:29.678693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0a3-3a88-4c7d-8d22-6113f10fa2ec tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:29.679283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0a3-3a88-4c7d-8d22-6113f10fa2ec tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:29.696502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:29.712367 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82c11273-f3a6-4720-a6ee-0744e42f4b32 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1331 microversion: 2.1 time: 0.630502 Oct 27 10:16:29.713914 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1070/2027] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:29 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1331 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:29.721741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:29.722841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:29.730516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:29.731351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:29.732030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:29.733576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:29.734264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:29.734926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:29.995849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2d7ce0a3-3a88-4c7d-8d22-6113f10fa2ec tempest-LiveMigrationTest-1012944609 tempest-LiveMigrationTest-1012944609-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1534 microversion: 2.1 time: 0.362754 Oct 27 10:16:30.015854 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 958/2028] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:29 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1534 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:30.039413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:30.042204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:30.058742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:30.059612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:30.060916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:30.062533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:30.063408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:30.064862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:30.124949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:30.140515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:30.142368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:30.147273 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc272aef-1a06-41b1-aaca-58c324cb952a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1476 microversion: 2.25 time: 0.431958 Oct 27 10:16:30.151189 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1071/2029] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:29 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1476 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:30.165145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-211c026b-889d-482d-a45e-c6f5bde034d3 req-3c887635-6bf9-4151-b3ad-8b00bc56ce22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b9e146-ce04-4819-953d-f1e4c7e53bbf", "name": "network-vif-plugged", "status": "completed", "tag": "84dcab08-a68b-4fe0-8dc6-00d5b6e2d967"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:30.188209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-211c026b-889d-482d-a45e-c6f5bde034d3 req-3c887635-6bf9-4151-b3ad-8b00bc56ce22 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:30.191754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-211c026b-889d-482d-a45e-c6f5bde034d3 req-3c887635-6bf9-4151-b3ad-8b00bc56ce22 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:30.192376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-211c026b-889d-482d-a45e-c6f5bde034d3 req-3c887635-6bf9-4151-b3ad-8b00bc56ce22 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:30.204455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:30.209187 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-211c026b-889d-482d-a45e-c6f5bde034d3 req-3c887635-6bf9-4151-b3ad-8b00bc56ce22 service nova] Creating event network-vif-plugged:84dcab08-a68b-4fe0-8dc6-00d5b6e2d967 for instance c2b9e146-ce04-4819-953d-f1e4c7e53bbf on n-h1-854663-10 Oct 27 10:16:30.215133 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-211c026b-889d-482d-a45e-c6f5bde034d3 req-3c887635-6bf9-4151-b3ad-8b00bc56ce22 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062356 Oct 27 10:16:30.216258 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1072/2030] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:30.216906 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ad0c3039-e1d7-4186-b82d-19a1820ce89b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1269 microversion: 2.1 time: 0.197519 Oct 27 10:16:30.225189 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 959/2031] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:30 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1269 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:30.234214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:30.235307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:30.239113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:30.239870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:30.245933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:30.246570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:30.247040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:30.248466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:30.249143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:30.249788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:30.255319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:30.257985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:30.261385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:30.262335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:30.262962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:30.263550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:30.296965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:16:30.483062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:30.491220 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d0515ea-18f3-4afc-8b0c-657455e0165c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 204 len: 0 microversion: 2.1 time: 0.264034 Oct 27 10:16:30.494139 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 960/2032] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:16:30 2022] DELETE /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:16:30.515191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:30.546993 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cdd5bd81-1ab6-4e89-8ea9-4d6f8330723d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1318 microversion: 2.1 time: 0.329065 Oct 27 10:16:30.571047 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1073/2033] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:30 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:30.582813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:30.583511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:30.602851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:30.603349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:30.603782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:30.604493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:30.604967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:30.605388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:31.028558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:31.030071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:31.055748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:31.057870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:31.060330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:31.064129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:31.065013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:31.066105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:31.322043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:31.335421 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a55f0311-039f-4123-8aa5-1a1fe48b2d4c tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1387 microversion: 2.1 time: 0.762938 Oct 27 10:16:31.353114 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1074/2034] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:30 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1387 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:31.365573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:31.366338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:31.378807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:31.384105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:31.384745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:31.385865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:31.386464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:31.387028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:31.429538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:31.744124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 7232d0b5-da9e-42f8-b828-2fe18f89e60c {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:16:31.772253 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5bddcd75-6420-428d-a1e6-901e2cfa2fc5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1970 microversion: 2.25 time: 1.274326 Oct 27 10:16:31.773573 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 961/2035] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:30 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1970 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:31.785607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee0a8e3e-4cb8-4d5e-b0d7-942afe0c4131 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5b3d4820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:31.879974 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee0a8e3e-4cb8-4d5e-b0d7-942afe0c4131 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.100962 Oct 27 10:16:31.881060 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 962/2036] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:31 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:31.895913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:31.900559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:31.911792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:31.914555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:31.915341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:31.918463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:31.919277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:31.927285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.101092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:32.110870 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec7f98e7-e5c5-4d37-815b-a3d8a73f4fb0 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1293 microversion: 2.1 time: 0.756269 Oct 27 10:16:32.118461 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1075/2037] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:31 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1293 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:32.124244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:32.133011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:32.144000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.144816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.147513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.148468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.149162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.151493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.235213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:32.249136 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-abf46dc1-7e4e-4f17-8f9b-9ee17007fc73 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1331 microversion: 2.1 time: 0.365904 Oct 27 10:16:32.257498 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 963/2038] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:31 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1331 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:32.280697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-60ac4791-3777-4c36-8c01-d0d76c509e33 req-63d5575d-ed33-4834-b9d3-53a7faca328e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2ecebf-5910-45cc-a64b-46987db5e3e7", "tag": "47847440-7b60-4683-a35e-007be8b78338"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:32.322689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-60ac4791-3777-4c36-8c01-d0d76c509e33 req-63d5575d-ed33-4834-b9d3-53a7faca328e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.325358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-60ac4791-3777-4c36-8c01-d0d76c509e33 req-63d5575d-ed33-4834-b9d3-53a7faca328e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.331594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-60ac4791-3777-4c36-8c01-d0d76c509e33 req-63d5575d-ed33-4834-b9d3-53a7faca328e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.371804 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-60ac4791-3777-4c36-8c01-d0d76c509e33 req-63d5575d-ed33-4834-b9d3-53a7faca328e service nova] Creating event network-changed:47847440-7b60-4683-a35e-007be8b78338 for instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 on n-h1-854663-10 Oct 27 10:16:32.393345 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-60ac4791-3777-4c36-8c01-d0d76c509e33 req-63d5575d-ed33-4834-b9d3-53a7faca328e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131306 Oct 27 10:16:32.402848 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 964/2039] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:32.408702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:32.430939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:32.447251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:32.448089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:32.461192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.461921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.466622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.467547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.468286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.469096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.511908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:32.535882 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-610b77b9-8dbe-4f55-905c-58505b703eaa tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1275 microversion: 2.1 time: 0.413643 Oct 27 10:16:32.538250 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1076/2040] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:32 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1275 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:32.547738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:32.550580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:32.567860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.568388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.569056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.569870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.570325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.570749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.948650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:32.970846 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc7194eb-40fb-49f7-a4d7-d14e4dc79680 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1318 microversion: 2.1 time: 0.566414 Oct 27 10:16:32.973081 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 965/2041] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:32 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:32.987805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e94f30f3-f668-4b6d-9957-5b5869477490 req-a9b0893c-c740-4240-8c42-223b648b4813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4608367-69ad-4d48-9fba-b7affe4d5167", "name": "network-vif-plugged", "status": "completed", "tag": "85ebd7c9-da7f-4bed-beb9-ad9438b98979"}, {"server_uuid": "c2d1def7-512a-42be-8a51-eafdc75b0fed", "name": "network-vif-plugged", "status": "completed", "tag": "0921a48e-bbf8-4fc8-9fb5-f8abeef0fa1b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:33.023878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e94f30f3-f668-4b6d-9957-5b5869477490 req-a9b0893c-c740-4240-8c42-223b648b4813 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:33.031543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e94f30f3-f668-4b6d-9957-5b5869477490 req-a9b0893c-c740-4240-8c42-223b648b4813 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:33.032286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e94f30f3-f668-4b6d-9957-5b5869477490 req-a9b0893c-c740-4240-8c42-223b648b4813 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:33.057674 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e94f30f3-f668-4b6d-9957-5b5869477490 req-a9b0893c-c740-4240-8c42-223b648b4813 service nova] Creating event network-vif-plugged:85ebd7c9-da7f-4bed-beb9-ad9438b98979 for instance c4608367-69ad-4d48-9fba-b7affe4d5167 on n-h2-854663-10 Oct 27 10:16:33.058486 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e94f30f3-f668-4b6d-9957-5b5869477490 req-a9b0893c-c740-4240-8c42-223b648b4813 service nova] Creating event network-vif-plugged:0921a48e-bbf8-4fc8-9fb5-f8abeef0fa1b for instance c2d1def7-512a-42be-8a51-eafdc75b0fed on n-h2-854663-10 Oct 27 10:16:33.065356 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e94f30f3-f668-4b6d-9957-5b5869477490 req-a9b0893c-c740-4240-8c42-223b648b4813 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090686 Oct 27 10:16:33.066717 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 966/2042] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:33.073499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:33.077910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:33.121530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:33.122580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:33.123893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:33.126052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:33.126836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:33.130723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:33.143418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 7232d0b5-da9e-42f8-b828-2fe18f89e60c {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:16:33.158755 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-189dd84b-d643-4b1d-ace4-d7495976b136 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1970 microversion: 2.25 time: 0.618973 Oct 27 10:16:33.177482 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1077/2043] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:32 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1970 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:33.189064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55609f3a-d392-4107-9344-e821ec9f8362 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d638b19d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:33.253414 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55609f3a-d392-4107-9344-e821ec9f8362 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.074089 Oct 27 10:16:33.263644 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1078/2044] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:33 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:33.269092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:33.270098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:33.279852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:33.280607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:33.281303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:33.282284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:33.283102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:33.283791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:33.399714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:33.412871 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-441e5146-b851-4055-806d-bc6baf690961 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1345 microversion: 2.1 time: 0.340655 Oct 27 10:16:33.414878 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 967/2045] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:33 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1345 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:33.433639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38e08287-557b-40f4-a6a6-3de4cf12f3c5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:33.437527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e08287-557b-40f4-a6a6-3de4cf12f3c5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:33.438219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e08287-557b-40f4-a6a6-3de4cf12f3c5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:33.438860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e08287-557b-40f4-a6a6-3de4cf12f3c5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:33.439790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e08287-557b-40f4-a6a6-3de4cf12f3c5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:33.443872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e08287-557b-40f4-a6a6-3de4cf12f3c5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:33.444828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38e08287-557b-40f4-a6a6-3de4cf12f3c5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:33.523108 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38e08287-557b-40f4-a6a6-3de4cf12f3c5 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.104461 Oct 27 10:16:33.524213 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 968/2046] 10.222.0.76 () {60 vars in 1217 bytes} [Thu Oct 27 10:16:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:16:33.533718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:33.536791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:33.565703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:33.568002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:33.570355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:33.573651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:33.575071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:33.580148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:33.941939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:33.955629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:33.961989 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-920e46e9-87e5-4002-ae80-83ed9fce8195 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1331 microversion: 2.1 time: 0.436594 Oct 27 10:16:33.962612 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 969/2047] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:33 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1331 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:33.971005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854663-10", "block_migration": "auto"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:33.978012 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dbe3a2a7-32c8-49dd-8986-1c8fb7eba13e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1293 microversion: 2.1 time: 0.712900 Oct 27 10:16:33.978617 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1079/2048] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:33 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1293 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:33.981597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:33.998262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4970b218-afb5-48ed-89b4-4c2d613b5a7e req-12bf3ac9-7ed6-4e2d-9914-2bf117835368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6435a0-0a3f-42a7-b87e-6d46af12f65d", "name": "network-vif-deleted", "tag": "297733c1-9497-45d2-a8bd-4a6f5f31dcab"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:34.016219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.017018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.019664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.022283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.026039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.028282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.034965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4970b218-afb5-48ed-89b4-4c2d613b5a7e req-12bf3ac9-7ed6-4e2d-9914-2bf117835368 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.041329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4970b218-afb5-48ed-89b4-4c2d613b5a7e req-12bf3ac9-7ed6-4e2d-9914-2bf117835368 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.046367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4970b218-afb5-48ed-89b4-4c2d613b5a7e req-12bf3ac9-7ed6-4e2d-9914-2bf117835368 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.085017 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4970b218-afb5-48ed-89b4-4c2d613b5a7e req-12bf3ac9-7ed6-4e2d-9914-2bf117835368 service nova] Creating event network-vif-deleted:297733c1-9497-45d2-a8bd-4a6f5f31dcab for instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d on n-h2-854663-10 Oct 27 10:16:34.106402 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4970b218-afb5-48ed-89b4-4c2d613b5a7e req-12bf3ac9-7ed6-4e2d-9914-2bf117835368 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114773 Oct 27 10:16:34.110229 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1080/2049] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:34.125757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'flavor' on Instance uuid 7232d0b5-da9e-42f8-b828-2fe18f89e60c {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:16:34.134228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:34.135754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:34.143422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.144156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.144796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.145720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.146356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.147877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.155709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Going to try to live migrate instance to n-h1-854663-10 {{(pid=120719) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:16:34.252009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:34.303473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:34.334049 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-878506cb-033b-4075-bb63-2c21eaa6a01e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1275 microversion: 2.1 time: 0.207448 Oct 27 10:16:34.355330 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1081/2050] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:34 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:34.369429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:34.370075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:34.417731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.418107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.418550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.419287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.419738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.420161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.792876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:34.810487 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99d5a030-48fe-4e10-9756-fbc5c4cae8f0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1318 microversion: 2.1 time: 0.449384 Oct 27 10:16:34.812621 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1082/2051] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:34 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:34.825407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be523452-233f-4ed2-ba44-df8e165ff799 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d6381a310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:34.916868 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be523452-233f-4ed2-ba44-df8e165ff799 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.101788 Oct 27 10:16:34.926170 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1083/2052] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:34 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:34.934503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:34.934891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:34.953364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.953901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.967294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.969735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.973302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.974737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:35.136580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:35.151072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1959c553-1bc2-4777-843a-73cfeae422ed tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1182 microversion: 2.1 time: 0.230034 Oct 27 10:16:35.170306 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1084/2053] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:34 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1182 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:35.179047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:35.180228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:35.190228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:35.191394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:35.192060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:35.193448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:35.194333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:35.195083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:35.386972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:35.401080 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b72b2dd9-7de9-4170-8c88-b459f3131079 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1331 microversion: 2.1 time: 0.228872 Oct 27 10:16:35.402827 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1085/2054] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:35 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1331 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:35.409441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:35.410258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:35.421627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:35.423204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:35.424083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:35.425236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:35.425800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:35.426401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:35.685146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:35.762972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:35.773904 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d7fbf48-8c10-4921-b361-d5a609648de3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1293 microversion: 2.1 time: 0.369662 Oct 27 10:16:35.798323 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1086/2055] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:35 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1293 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:35.810404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:35.816018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:35.819779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:35.833697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:35.833697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:35.836511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:35.837644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:35.839620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:35.842620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:36.132965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:36.153168 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03e095ac-c87f-4e48-b832-5252ed6f2930 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1317 microversion: 2.1 time: 0.353406 Oct 27 10:16:36.154553 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1087/2056] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:35 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:36.160134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:36.160981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:36.168968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:36.169655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:36.170248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:36.171136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:36.171745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:36.172328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:36.480956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:36.492327 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ec2364b-71f4-49fc-886b-8363d5175bbb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1318 microversion: 2.1 time: 0.336420 Oct 27 10:16:36.494655 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1088/2057] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:36 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:36.506296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0239cc47-f1d6-40ef-be1a-9abd3b8316b9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5bdd21f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:36.596920 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0239cc47-f1d6-40ef-be1a-9abd3b8316b9 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.098168 Oct 27 10:16:36.607634 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1089/2058] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:36 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:36.615944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:36.620597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:36.628466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:36.629349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:36.629961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:36.630872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:36.631552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:36.632156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:36.708321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:36.720032 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d360d93f-cbb0-4023-8496-35632ac10d3d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1182 microversion: 2.1 time: 0.110747 Oct 27 10:16:36.722338 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1090/2059] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:36 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1182 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:36.728856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:36.729687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:36.748271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:36.749075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:36.749712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:36.750639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:36.751429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:36.752423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:37.185707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:37.212777 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9a7c9a9-6ce5-4d08-bc66-d6e5613fd401 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1331 microversion: 2.1 time: 0.489081 Oct 27 10:16:37.234533 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1091/2060] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:36 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1331 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:37.240568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:37.242037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:37.255353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:37.256211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:37.257903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:37.258934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:37.259606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:37.260631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:37.954840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:37.967834 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39e4049e-b4e4-433b-affb-064467cf3a0a tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1483 microversion: 2.1 time: 0.732047 Oct 27 10:16:37.968637 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1092/2061] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:37 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1483 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:37.998088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-dc7c2c26-c9ec-4b54-a1ec-687545950633 req-6ede869b-00d2-43de-98d3-f63b4b6f09cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3773dce-56b1-44be-bc19-4e5bdc5ff072", "name": "network-vif-plugged", "status": "completed", "tag": "e638ef34-6ca1-49f2-8ada-7febf4785532"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:38.026610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dc7c2c26-c9ec-4b54-a1ec-687545950633 req-6ede869b-00d2-43de-98d3-f63b4b6f09cb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:38.028452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dc7c2c26-c9ec-4b54-a1ec-687545950633 req-6ede869b-00d2-43de-98d3-f63b4b6f09cb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:38.029158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dc7c2c26-c9ec-4b54-a1ec-687545950633 req-6ede869b-00d2-43de-98d3-f63b4b6f09cb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:38.056011 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-dc7c2c26-c9ec-4b54-a1ec-687545950633 req-6ede869b-00d2-43de-98d3-f63b4b6f09cb service nova] Creating event network-vif-plugged:e638ef34-6ca1-49f2-8ada-7febf4785532 for instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 on n-h1-854663-10 Oct 27 10:16:38.069072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-dc7c2c26-c9ec-4b54-a1ec-687545950633 req-6ede869b-00d2-43de-98d3-f63b4b6f09cb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091841 Oct 27 10:16:38.070614 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1093/2062] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:38.083131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:38.085687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:38.100088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:38.101528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:38.102793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:38.108523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:38.109418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:38.110102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:38.327303 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55584cad-bc8f-4554-ab9e-c65f920d29bb tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c/action" status: 202 len: 0 microversion: 2.25 time: 4.361344 Oct 27 10:16:38.331966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 970/2063] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:16:33 2022] POST /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c/action => generated 0 bytes in 4366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:16:38.474882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-573826377", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "a083a069-1c5f-4798-ae6e-612bd2e50580"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:38.485838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:38.495246 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c73f7147-4bf5-44bf-9dbe-3d8364a9bdf3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1317 microversion: 2.1 time: 0.423091 Oct 27 10:16:38.513205 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1094/2064] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:38 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:38.526718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:38.532158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:38.546882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:38.549972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:38.550993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:38.556348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:38.557283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:38.558004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:38.662798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] validate_networks() for [('a083a069-1c5f-4798-ae6e-612bd2e50580', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:16:39.360213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:39.376373 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76ed5c99-8d5f-4ee3-ac8a-0e943649e42b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1468 microversion: 2.1 time: 0.861408 Oct 27 10:16:39.379545 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1095/2065] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:38 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1468 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:39.389490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3bebd3e-0526-483c-80aa-cec267934def tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5bdd2e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:39.507010 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3bebd3e-0526-483c-80aa-cec267934def tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.125360 Oct 27 10:16:39.518846 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1096/2066] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:39 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:39.527499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:39.528407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:39.537621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:39.538519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:39.539144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:39.540069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:39.540749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:39.541470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:39.547190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:39.687423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:39.700022 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b675cd18-eb76-48d0-9f52-b29e71519fac tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 200 len: 1182 microversion: 2.1 time: 0.176577 Oct 27 10:16:39.706277 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1097/2067] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:39 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 1182 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:39.713885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7334a04-35c1-4a0c-a0ca-39adf20e8f83 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:39.727076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7334a04-35c1-4a0c-a0ca-39adf20e8f83 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:39.753117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7334a04-35c1-4a0c-a0ca-39adf20e8f83 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:39.754073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7334a04-35c1-4a0c-a0ca-39adf20e8f83 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:39.765618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7334a04-35c1-4a0c-a0ca-39adf20e8f83 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:39.766771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7334a04-35c1-4a0c-a0ca-39adf20e8f83 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:39.767424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7334a04-35c1-4a0c-a0ca-39adf20e8f83 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:39.768095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7334a04-35c1-4a0c-a0ca-39adf20e8f83 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:39.952313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:16:39.952951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:16:39.953291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:16:39.953853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:16:39.954318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:16:39.974819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:39.975319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:39.975798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:39.978180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:39.982778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:39.984458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:40.031910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Getting quotas for project e24ab6322c834c3c8444cf403aca0825. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:40.040058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Getting quotas for user 7f2b5253b841436588fa27532e0491d8 and project e24ab6322c834c3c8444cf403aca0825. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:40.041661 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7334a04-35c1-4a0c-a0ca-39adf20e8f83 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332038 Oct 27 10:16:40.042361 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1098/2068] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:16:39 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167/os-interface => generated 284 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:40.047960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:40.048950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:40.067621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:40.068565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:40.069389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:40.070496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:40.073988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:40.074781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:40.075439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:16:40.083011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:16:40.222458 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c0dbec3-6e02-4c23-86b9-2812ba1f46fe tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.889084 Oct 27 10:16:40.223126 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 971/2069] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:16:40.267610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:40.268273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:40.279389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:40.280201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:40.281864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:40.282978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:40.284322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:40.285298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:41.331083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:41.386621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:41.401716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:41.403459 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff8ab70e-8257-4093-a275-94e7db8024b2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 1.165782 Oct 27 10:16:41.405131 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 972/2070] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:40 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:41.412692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ff500ecb-3d47-46a4-a302-87e667c571b2 req-5f7b1439-4122-4929-aaed-26af4e1ba313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c30935-9c9d-4098-bb50-beeb93a1edbe", "tag": "1b3185dc-06ff-479d-8971-a9d01cf40ea7"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:41.425705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ff500ecb-3d47-46a4-a302-87e667c571b2 req-5f7b1439-4122-4929-aaed-26af4e1ba313 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:41.426689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ff500ecb-3d47-46a4-a302-87e667c571b2 req-5f7b1439-4122-4929-aaed-26af4e1ba313 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:41.427416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ff500ecb-3d47-46a4-a302-87e667c571b2 req-5f7b1439-4122-4929-aaed-26af4e1ba313 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:41.443703 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ff500ecb-3d47-46a4-a302-87e667c571b2 req-5f7b1439-4122-4929-aaed-26af4e1ba313 service nova] Creating event network-changed:1b3185dc-06ff-479d-8971-a9d01cf40ea7 for instance 45c30935-9c9d-4098-bb50-beeb93a1edbe on n-h1-854663-10 Oct 27 10:16:41.453462 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ff500ecb-3d47-46a4-a302-87e667c571b2 req-5f7b1439-4122-4929-aaed-26af4e1ba313 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045694 Oct 27 10:16:41.456069 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 973/2071] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:41.484049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:41.488604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2b9e146-ce04-4819-953d-f1e4c7e53bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:41.512275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:41.515150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:41.521583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:41.523335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:41.524351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:41.525109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:42.256093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:42.302574 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa69a28b-2234-4877-9271-10c6eed5e94d tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1534 microversion: 2.1 time: 2.258595 Oct 27 10:16:42.353553 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1099/2072] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:40 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1534 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:42.361132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:42.361775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:42.394735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:42.404162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:42.404918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:42.406021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:42.406666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:42.407263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:42.716875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:42.730618 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e52073c3-9156-41f1-850e-82c056ae315e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf" status: 200 len: 1468 microversion: 2.1 time: 1.265199 Oct 27 10:16:42.731602 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 974/2073] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:41 2022] GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf => generated 1468 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:42.740125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:42.742394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:42.758813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:42.761827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:42.762287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:42.763028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:42.765084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:42.765518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:42.841543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:42.850440 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b576bda-3eba-41a2-9784-183ace375f83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1317 microversion: 2.1 time: 0.495795 Oct 27 10:16:42.851463 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1100/2074] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:42 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:42.864340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2349cdd5-8e29-43cd-8f48-0df09a2c5550 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5ae71af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:42.939463 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2349cdd5-8e29-43cd-8f48-0df09a2c5550 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1428 microversion: 2.1 time: 0.086660 Oct 27 10:16:42.948173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1101/2075] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:42 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:42.953706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-01785883-bdf4-413d-bebc-1f1413a5de11 req-cdce42e4-e326-4c17-b737-a059289b1337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2ecebf-5910-45cc-a64b-46987db5e3e7", "name": "network-vif-plugged", "status": "completed", "tag": "47847440-7b60-4683-a35e-007be8b78338"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:42.966379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-01785883-bdf4-413d-bebc-1f1413a5de11 req-cdce42e4-e326-4c17-b737-a059289b1337 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:42.967202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-01785883-bdf4-413d-bebc-1f1413a5de11 req-cdce42e4-e326-4c17-b737-a059289b1337 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:42.967912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-01785883-bdf4-413d-bebc-1f1413a5de11 req-cdce42e4-e326-4c17-b737-a059289b1337 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:42.993921 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-01785883-bdf4-413d-bebc-1f1413a5de11 req-cdce42e4-e326-4c17-b737-a059289b1337 service nova] Creating event network-vif-plugged:47847440-7b60-4683-a35e-007be8b78338 for instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 on n-h1-854663-10 Oct 27 10:16:43.002725 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-01785883-bdf4-413d-bebc-1f1413a5de11 req-cdce42e4-e326-4c17-b737-a059289b1337 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052935 Oct 27 10:16:43.003974 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1102/2076] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:43.028482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:43.030756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: 8d6435a0-0a3f-42a7-b87e-6d46af12f65d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:43.047478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:43.048252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:43.051265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:43.052273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:43.052944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:43.055382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:43.065230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:43.080335 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0220ba23-143b-4d4b-9687-8b88cbca27d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1269 microversion: 2.1 time: 0.346646 Oct 27 10:16:43.084638 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 975/2077] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:42 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1269 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:43.114924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e933343-2d6a-487f-b3bd-365ba7055ba3 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Action: 'create', calling method: .version_select at 0x7f6d63773f70>, body: {"pool": "1f5b69b3-b392-4769-acea-e0cfb8d1d3ed"} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:43.140402 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] HTTP exception thrown: Instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d could not be found. Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Request method failure captured: Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d HTTP/1.1 Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWli886LgLJebOrqEGu5OQKeMdg-g9g74XkvzRnuVHl0YART7Y27YsyAi2tQDgwO0fkq1ljumZnbE2L_xQKPuiuXFnhFv37vSYcuTHmVrudD8hQIAY52cFjk0ZIn5dJMeEVrJnRBMCeBGXFnIKiMIqBgNqVBuQ_wKonQD2tsRriR_RNM Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: bda464c030cc4b3bb14a81d9a83261aa Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-LiveMigrationTest-1960045742 Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:16:43.153425 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bda464c030cc4b3bb14a81d9a83261aa", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-LiveMigrationTest-1960045742 Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: bda464c030cc4b3bb14a81d9a83261aa Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-LiveMigrationTest-1960045742 Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-LiveMigrationTest-1960045742-project Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5db106c72e8745de8266a3ab7a5fe531 Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-LiveMigrationTest-1960045742-project Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d could not be found. Oct 27 10:16:43.155480 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '8d6435a0-0a3f-42a7-b87e-6d46af12f65d'} Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d could not be found. Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:43.156553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d could not be found. Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d could not be found. Oct 27 10:16:43.158630 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:43.160305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Returning 404 to user: Instance 8d6435a0-0a3f-42a7-b87e-6d46af12f65d could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:43.160305 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c2ef653-3a43-415d-bce8-4f5cb1dee427 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d" status: 404 len: 111 microversion: 2.1 time: 0.150553 Oct 27 10:16:43.160305 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1103/2078] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:43 2022] GET /compute/v2.1/servers/8d6435a0-0a3f-42a7-b87e-6d46af12f65d => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:16:43.170999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:43.171617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:43.192719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:43.193237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:43.193674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:43.194392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:43.194900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:43.195338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:44.145774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:44.162497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:44.164164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:44.165450 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-443dfd42-9ff0-4c26-8f54-556af651bb0c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 1.005798 Oct 27 10:16:44.166019 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1104/2079] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:43 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:44.188559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:44.194554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:44.195834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Searching by: {'reservation_id': 'r-o4kf96bp', 'deleted': False, 'project_id': '88e242ed84c14a5eaabf74309f00b689'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:16:44.202060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:44.202824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:44.203440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:44.204353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:44.205036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:44.205718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:44.348292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:16:44.634129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:44.650887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:44.651604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:44.652068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:45.500461 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb469cfc-011d-4a99-a7ad-3b3cf1780d6e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/detail?reservation_id=r-o4kf96bp" status: 200 len: 2929 microversion: 2.1 time: 1.317175 Oct 27 10:16:45.501547 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1105/2080] 10.222.0.76 () {58 vars in 1197 bytes} [Thu Oct 27 10:16:44 2022] GET /compute/v2.1/servers/detail?reservation_id=r-o4kf96bp => generated 2929 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:45.506750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:45.507625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:45.522070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:45.531441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:45.532172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:45.533134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:45.533765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:45.534362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:46.327619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:46.341845 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35fa4ea3-0776-4944-9320-479c0b51eff4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1317 microversion: 2.1 time: 0.838807 Oct 27 10:16:46.344217 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1106/2081] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:45 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:46.360259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb9bf0ea-11d1-408d-b113-c18837a1ec9d tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d60fb0b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:46.439884 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb9bf0ea-11d1-408d-b113-c18837a1ec9d tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1437 microversion: 2.1 time: 0.092015 Oct 27 10:16:46.440824 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1107/2082] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:46 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:46.450610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:46.453493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:46.469392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:46.471955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:46.472546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:46.473262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:46.473741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:46.477069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:46.959633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:46.974486 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6e9267a-dcee-4f51-bc80-a7fa95199858 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1317 microversion: 2.1 time: 0.531720 Oct 27 10:16:46.975412 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1108/2083] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:46 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:46.987554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:46.988601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:47.006093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:47.007508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:47.008198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:47.009674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:47.015072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:47.018697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:47.369252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:47.386689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:47.390914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:47.395924 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-853df478-6a83-4b9f-a867-676bc0f02411 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.416821 Oct 27 10:16:47.396836 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1109/2084] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:46 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:47.406879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53eaadd3-299b-4cc9-963e-96ed45ab7570 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:47.451806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_groups [None req-53eaadd3-299b-4cc9-963e-96ed45ab7570 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Querying cell 9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) for 2 instances {{(pid=120720) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 10:16:47.453205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53eaadd3-299b-4cc9-963e-96ed45ab7570 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:47.454853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53eaadd3-299b-4cc9-963e-96ed45ab7570 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:47.456113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53eaadd3-299b-4cc9-963e-96ed45ab7570 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:47.513403 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53eaadd3-299b-4cc9-963e-96ed45ab7570 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups/00172b71-74b7-47e3-a29d-bf0868c6b155" status: 200 len: 271 microversion: 2.1 time: 0.111859 Oct 27 10:16:47.516701 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1110/2085] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:16:47 2022] GET /compute/v2.1/os-server-groups/00172b71-74b7-47e3-a29d-bf0868c6b155 => generated 271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:47.530229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:47.531211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:47.546026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:47.551724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:47.552197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:47.557178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:47.557793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:47.558239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.353146 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e933343-2d6a-487f-b3bd-365ba7055ba3 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.265245 Oct 27 10:16:48.354142 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 976/2086] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:16:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:48.358848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ecb3ad19-ca4a-43de-89f4-c784ba6b2901 req-76b611c6-74cc-43b4-8c3d-37b9b66a514a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4608367-69ad-4d48-9fba-b7affe4d5167", "tag": "85ebd7c9-da7f-4bed-beb9-ad9438b98979"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:48.385240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ecb3ad19-ca4a-43de-89f4-c784ba6b2901 req-76b611c6-74cc-43b4-8c3d-37b9b66a514a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.386102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ecb3ad19-ca4a-43de-89f4-c784ba6b2901 req-76b611c6-74cc-43b4-8c3d-37b9b66a514a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.386715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ecb3ad19-ca4a-43de-89f4-c784ba6b2901 req-76b611c6-74cc-43b4-8c3d-37b9b66a514a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.409230 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ecb3ad19-ca4a-43de-89f4-c784ba6b2901 req-76b611c6-74cc-43b4-8c3d-37b9b66a514a service nova] Creating event network-changed:85ebd7c9-da7f-4bed-beb9-ad9438b98979 for instance c4608367-69ad-4d48-9fba-b7affe4d5167 on n-h2-854663-10 Oct 27 10:16:48.440283 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ecb3ad19-ca4a-43de-89f4-c784ba6b2901 req-76b611c6-74cc-43b4-8c3d-37b9b66a514a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080938 Oct 27 10:16:48.441623 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 977/2087] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:48.447111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b375369d-a2c2-4ef6-bd46-541655120b67 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d5b8551f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:48.503792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:48.517676 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b375369d-a2c2-4ef6-bd46-541655120b67 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 200 len: 1437 microversion: 2.1 time: 0.074628 Oct 27 10:16:48.519678 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 978/2088] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:48 2022] GET /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:48.534124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:48.535156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:48.539706 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe0aa761-7cd2-455f-a4da-2cc9f0edb463 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1483 microversion: 2.1 time: 0.995476 Oct 27 10:16:48.543643 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1111/2089] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:47 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1483 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:48.548300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-04607073-604e-49fc-9ba5-5b2c62195262 req-975d669c-4035-44dc-a257-a334d2c907d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c30935-9c9d-4098-bb50-beeb93a1edbe", "name": "network-vif-plugged", "status": "completed", "tag": "1b3185dc-06ff-479d-8971-a9d01cf40ea7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:48.550671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.555363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.559637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.560622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.561398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.562030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.609769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-04607073-604e-49fc-9ba5-5b2c62195262 req-975d669c-4035-44dc-a257-a334d2c907d4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.618430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-04607073-604e-49fc-9ba5-5b2c62195262 req-975d669c-4035-44dc-a257-a334d2c907d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.621126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-04607073-604e-49fc-9ba5-5b2c62195262 req-975d669c-4035-44dc-a257-a334d2c907d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.663486 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-04607073-604e-49fc-9ba5-5b2c62195262 req-975d669c-4035-44dc-a257-a334d2c907d4 service nova] Creating event network-vif-plugged:1b3185dc-06ff-479d-8971-a9d01cf40ea7 for instance 45c30935-9c9d-4098-bb50-beeb93a1edbe on n-h1-854663-10 Oct 27 10:16:48.682697 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-04607073-604e-49fc-9ba5-5b2c62195262 req-975d669c-4035-44dc-a257-a334d2c907d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137786 Oct 27 10:16:48.691382 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1112/2090] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:48.711221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1bb9e76-8872-47ed-9a1c-75f35c8f4c5a tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:48.713878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1bb9e76-8872-47ed-9a1c-75f35c8f4c5a tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:48.718743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:48.726637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1bb9e76-8872-47ed-9a1c-75f35c8f4c5a tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.728464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1bb9e76-8872-47ed-9a1c-75f35c8f4c5a tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.729051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1bb9e76-8872-47ed-9a1c-75f35c8f4c5a tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.729845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1bb9e76-8872-47ed-9a1c-75f35c8f4c5a tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.730493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1bb9e76-8872-47ed-9a1c-75f35c8f4c5a tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.730919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1bb9e76-8872-47ed-9a1c-75f35c8f4c5a tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:49.131155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:49.147973 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a94c7da2-b8d6-4ba0-9c47-2493d525e041 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1317 microversion: 2.1 time: 0.623830 Oct 27 10:16:49.164754 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 979/2091] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:48 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:49.164754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:49.164754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:49.175509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:49.188891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:49.189584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:49.190495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:49.191072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:49.191517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:49.214158 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1bb9e76-8872-47ed-9a1c-75f35c8f4c5a tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 200 len: 1621 microversion: 2.1 time: 0.520877 Oct 27 10:16:49.215163 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1113/2092] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:48 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 1621 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:49.229550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.29"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:49.234619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:49.248822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:49.250140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:49.252041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:49.252963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:49.254450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:49.255713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:49.317997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:16:49.321265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquired lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:16:49.657758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:49.670712 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c50b4b1a-7d7a-4d54-81c1-9617bd9cdfee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1317 microversion: 2.1 time: 0.516550 Oct 27 10:16:49.671266 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 980/2093] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:49 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:49.690052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:49.690722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:49.702064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:49.702563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:49.705978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:49.708345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:49.713383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:49.713978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:50.013330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:50.060589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:50.101089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:50.115003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:50.137302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:50.144047 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3e6f441-bfb0-434e-b8e8-76472cce439b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.471547 Oct 27 10:16:50.144847 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 981/2094] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:49 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:50.158174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:50.159139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:50.177154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:50.179725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:50.180440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:50.183968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:50.186515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:50.187326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:50.470073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:50.480981 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6dcb70e-a175-448c-a831-e1d050b06c44 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1466 microversion: 2.1 time: 0.334569 Oct 27 10:16:50.482237 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 982/2095] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:50 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1466 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:50.487668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:50.489859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:50.529856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:50.530385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:50.530835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:50.531570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:50.532027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:50.532451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:50.575005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:16:50.757421 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0b1f9a32-4aad-4ccf-a0e5-9187494efeb1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "DELETE /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 204 len: 0 microversion: 2.1 time: 0.273383 Oct 27 10:16:50.761346 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 983/2096] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:16:50 2022] DELETE /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:16:50.764016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5887f3df-6721-4583-835c-729daf978f73 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:50.764813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5887f3df-6721-4583-835c-729daf978f73 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] [instance: c2b9e146-ce04-4819-953d-f1e4c7e53bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:50.772930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5887f3df-6721-4583-835c-729daf978f73 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:50.773430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5887f3df-6721-4583-835c-729daf978f73 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:50.773869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5887f3df-6721-4583-835c-729daf978f73 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:50.782953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5887f3df-6721-4583-835c-729daf978f73 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:50.783580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5887f3df-6721-4583-835c-729daf978f73 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:50.784079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5887f3df-6721-4583-835c-729daf978f73 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:51.040167 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5887f3df-6721-4583-835c-729daf978f73 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf" status: 200 len: 1621 microversion: 2.1 time: 0.280171 Oct 27 10:16:51.041041 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 984/2097] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:50 2022] GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf => generated 1621 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:51.046056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:51.047054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:51.055889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:51.056764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:51.057454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:51.058671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:51.059364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:51.060010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:51.721293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:51.730372 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-849e9ada-1032-4155-a8c2-657f09071475 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1467 microversion: 2.1 time: 0.688037 Oct 27 10:16:51.730989 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 985/2098] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:51 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1467 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:51.735985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c83ff1e1-670e-4c8b-ad7f-f96636a5297f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d637f4c10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:51.831335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Building network info cache for instance {{(pid=120720) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:16:52.570836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Updating instance_info_cache with network_info: [{"id": "e638ef34-6ca1-49f2-8ada-7febf4785532", "address": "fa:16:3e:4c:ca:02", "network": {"id": "92ce5af8-13b4-4c3c-9c98-0e84f065a9ea", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-766299972-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "50dd8d17dbe24743a91623359e7ab3ea", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape638ef34-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120720) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:16:52.587290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Releasing lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:16:52.589719 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19aab433-e913-45a3-be35-28d0a743be38 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action" status: 202 len: 0 microversion: 2.1 time: 3.372390 Oct 27 10:16:52.590938 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1114/2099] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:16:49 2022] POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action => generated 0 bytes in 3375 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 10:16:52.601159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d87c2da0-6e98-4d02-a6f0-0bd04edaa954 req-0c35f7c4-48c3-4029-aa40-763c0ce2e3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04509dd-1faf-474a-a02d-fc408bf96fe2", "tag": "77a3d39c-827a-4840-98c9-d82e01a85658"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:52.604789 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c83ff1e1-670e-4c8b-ad7f-f96636a5297f tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "DELETE /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d" status: 204 len: 0 microversion: 2.1 time: 0.872652 Oct 27 10:16:52.610253 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 986/2100] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:51 2022] DELETE /compute/v2.1/images/08d19015-6aad-466f-815f-f70e2832bc5d => generated 0 bytes in 875 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:16:52.615176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d87c2da0-6e98-4d02-a6f0-0bd04edaa954 req-0c35f7c4-48c3-4029-aa40-763c0ce2e3e4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:52.615657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d87c2da0-6e98-4d02-a6f0-0bd04edaa954 req-0c35f7c4-48c3-4029-aa40-763c0ce2e3e4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:52.616092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d87c2da0-6e98-4d02-a6f0-0bd04edaa954 req-0c35f7c4-48c3-4029-aa40-763c0ce2e3e4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:52.617144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:52.618369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:52.627306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:52.628079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:52.628740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:52.629607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:52.630325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:52.630941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:52.631280 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d87c2da0-6e98-4d02-a6f0-0bd04edaa954 req-0c35f7c4-48c3-4029-aa40-763c0ce2e3e4 service nova] Creating event network-changed:77a3d39c-827a-4840-98c9-d82e01a85658 for instance d04509dd-1faf-474a-a02d-fc408bf96fe2 on n-h1-854663-10 Oct 27 10:16:52.638778 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d87c2da0-6e98-4d02-a6f0-0bd04edaa954 req-0c35f7c4-48c3-4029-aa40-763c0ce2e3e4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046332 Oct 27 10:16:52.639716 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1115/2101] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:52.645984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-96df2ada-2bf6-4aea-9913-257e153791a3 req-9697a207-6664-4a5d-b905-9501391da02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe2d6b4-731c-4567-9abb-a7924c8dd43b", "name": "network-vif-unplugged", "status": "completed", "tag": "ef734916-25b8-4e1e-8214-27785b87cd71"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:52.657805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-96df2ada-2bf6-4aea-9913-257e153791a3 req-9697a207-6664-4a5d-b905-9501391da02f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:52.658285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-96df2ada-2bf6-4aea-9913-257e153791a3 req-9697a207-6664-4a5d-b905-9501391da02f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:52.658713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-96df2ada-2bf6-4aea-9913-257e153791a3 req-9697a207-6664-4a5d-b905-9501391da02f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:52.678784 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-96df2ada-2bf6-4aea-9913-257e153791a3 req-9697a207-6664-4a5d-b905-9501391da02f service nova] Creating event network-vif-unplugged:ef734916-25b8-4e1e-8214-27785b87cd71 for instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b on n-h2-854663-10 Oct 27 10:16:52.686466 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-96df2ada-2bf6-4aea-9913-257e153791a3 req-9697a207-6664-4a5d-b905-9501391da02f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045351 Oct 27 10:16:52.687868 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1116/2102] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:52.694561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:52.695870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:52.705299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:52.706217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:52.706856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:52.708077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:52.711734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:52.712611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:52.812394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:52.823232 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d27e321b-d145-4235-b770-c60392a06f9d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1601 microversion: 2.1 time: 0.133805 Oct 27 10:16:52.824082 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1117/2103] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:52 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1601 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:52.832187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:52.832957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:52.847216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:52.847957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:52.848612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:52.849942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:52.850326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:52.851042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:52.857988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:52.866016 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-164ec74c-fd59-4eaf-90e6-73cc4a9f4350 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1317 microversion: 2.1 time: 0.254402 Oct 27 10:16:52.872181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:52.881140 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 987/2104] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:52 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:52.888970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1747662337", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a3771f18-a29a-4d03-97cf-1e23ec142e87"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:52.947467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:16:53.162644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:53.181642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:53.183411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:53.189763 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-64616f92-d361-4a8d-8811-4655b3177715 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.364726 Oct 27 10:16:53.191078 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1118/2105] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:52 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:53.205108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:53.206063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:53.220260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:53.221130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:53.224266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:53.225546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:53.226193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:53.226807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:53.438968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:16:53.439412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:16:53.439894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:16:53.440316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:16:53.440839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:16:53.461233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:53.461917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:53.462640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:53.463561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:53.464138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:53.464620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:53.506985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:53.513633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:53.514581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:53.527549 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ecbcdeeb-4124-4d9b-96db-e99bae1d6435 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1465 microversion: 2.1 time: 0.334560 Oct 27 10:16:53.530773 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1119/2106] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:53 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1465 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:53.544264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dea2b749-a0fe-4d6a-8c41-75e756c50293 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Action: 'create', calling method: .version_select at 0x7f6d5aeb2040>, body: {"pool": "1f5b69b3-b392-4769-acea-e0cfb8d1d3ed"} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:53.555320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:16:53.575080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:16:53.693433 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b3aa3c1-09a9-4884-8488-3d5cf4b6a750 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810990 Oct 27 10:16:53.695391 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 988/2107] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:16:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:16:53.702728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5858d281-38f9-4aca-bde7-b81b8661b924 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '.version_select at 0x7f6d6386b040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:53.787921 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5858d281-38f9-4aca-bde7-b81b8661b924 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] HTTP exception thrown: Image not found. Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5858d281-38f9-4aca-bde7-b81b8661b924 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Request method failure captured: Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a HTTP/1.1 Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlolEfayIW_AoXGh_QFaF08ropDDD-j3c-KFiCSTUvDUGLJIVMMivCHwivJ9ljFUw0Zt9JTHj0l1F7vYkraXwLClmhXsbAmgz2PaeIITeMbw8k6LijnMukbxZdWVEPXtKhv9ihtrf5b75Q8DJ6urMJOAFBF-tKYEpJuEyrGTdJQg4L0 Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 686cacfed6704a9585df56d80cb7273f Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesOneServerTestJSON-1485835016 Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:16:53.791233 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/686cacfed6704a9585df56d80cb7273f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/686cacfed6704a9585df56d80cb7273f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_686cacfed6704a9585df56d80cb7273f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/686cacfed6704a9585df56d80cb7273f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesOneServerTestJSON-1485835016 Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 686cacfed6704a9585df56d80cb7273f Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1485835016 Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesOneServerTestJSON-1485835016-project Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: f972a5c34e294e63b10e7c97ba23739f Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesOneServerTestJSON-1485835016-project Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'ad4fdf12-87a1-4f59-98bf-106922613c2a'} Oct 27 10:16:53.793096 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ad4fdf12-87a1-4f59-98bf-106922613c2a to delete Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:53.794249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ad4fdf12-87a1-4f59-98bf-106922613c2a could not be found. Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:53.795783 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5858d281-38f9-4aca-bde7-b81b8661b924 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:53.798044 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5858d281-38f9-4aca-bde7-b81b8661b924 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "DELETE /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a" status: 404 len: 62 microversion: 2.1 time: 0.096831 Oct 27 10:16:53.800799 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 989/2108] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:53 2022] DELETE /compute/v2.1/images/ad4fdf12-87a1-4f59-98bf-106922613c2a => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:16:53.812169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f0075ac1-98df-4c34-82ca-4dbe891dfe11 req-1123c2bc-c244-43d8-8ff9-24a09270532c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db810b22-71e9-4b8c-bbaf-59b8443d408b", "name": "network-vif-deleted", "tag": "3dd60d44-bd56-4d7b-b71c-ba708a3df480"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:53.834351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f0075ac1-98df-4c34-82ca-4dbe891dfe11 req-1123c2bc-c244-43d8-8ff9-24a09270532c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:53.834943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f0075ac1-98df-4c34-82ca-4dbe891dfe11 req-1123c2bc-c244-43d8-8ff9-24a09270532c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:53.835456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f0075ac1-98df-4c34-82ca-4dbe891dfe11 req-1123c2bc-c244-43d8-8ff9-24a09270532c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:53.872871 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f0075ac1-98df-4c34-82ca-4dbe891dfe11 req-1123c2bc-c244-43d8-8ff9-24a09270532c service nova] Creating event network-vif-deleted:3dd60d44-bd56-4d7b-b71c-ba708a3df480 for instance db810b22-71e9-4b8c-bbaf-59b8443d408b on n-h1-854663-10 Oct 27 10:16:53.879740 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f0075ac1-98df-4c34-82ca-4dbe891dfe11 req-1123c2bc-c244-43d8-8ff9-24a09270532c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077336 Oct 27 10:16:53.880806 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 990/2109] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:53.890892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1de9f88-a670-4edc-a858-b413c2651e2b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-982973387"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:53.895446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1de9f88-a670-4edc-a858-b413c2651e2b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:53.907620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1de9f88-a670-4edc-a858-b413c2651e2b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:53.908469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1de9f88-a670-4edc-a858-b413c2651e2b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:53.909958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1de9f88-a670-4edc-a858-b413c2651e2b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:53.911246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1de9f88-a670-4edc-a858-b413c2651e2b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:53.915505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1de9f88-a670-4edc-a858-b413c2651e2b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:53.917867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1de9f88-a670-4edc-a858-b413c2651e2b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:54.236040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:54.256006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:54.321995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1de9f88-a670-4edc-a858-b413c2651e2b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "POST /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7/action" status: 202 len: 0 microversion: 2.1 time: 0.439111 Oct 27 10:16:54.330322 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 991/2110] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:16:53 2022] POST /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:16:54.336393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ffb16929-af24-47c5-9ae6-646cc343db6d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:54.342518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ffb16929-af24-47c5-9ae6-646cc343db6d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:54.424258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ffb16929-af24-47c5-9ae6-646cc343db6d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:54.432281 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ffb16929-af24-47c5-9ae6-646cc343db6d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1217 microversion: 2.1 time: 0.105100 Oct 27 10:16:54.440809 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 992/2111] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:54 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:54.440809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:54.440809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:54.447561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:54.448197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:54.448788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:54.449728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:54.450297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:54.450893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:54.481915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:16:54.584475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:54.621270 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-538a6b3f-66c6-4a99-8c97-132f82cb2921 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 204 len: 0 microversion: 2.1 time: 0.185881 Oct 27 10:16:54.625368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:54.628955 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 993/2112] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:16:54 2022] DELETE /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:16:54.654804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:54.661640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:54.670759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:54.671403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:54.671939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:54.672898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:54.673522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:54.674050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:54.735121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:54.736196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:54.736701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:54.737670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lazy-loading 'fault' on Instance uuid db810b22-71e9-4b8c-bbaf-59b8443d408b {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:16:54.818557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:54.831534 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5130b847-5a18-4521-9c0f-f7d172bd2dfd tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 200 len: 1324 microversion: 2.1 time: 0.197769 Oct 27 10:16:54.833812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 994/2113] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:54 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 1324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:54.840533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:54.841267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:54.851253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:54.854645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:54.855237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:54.856113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:54.857212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:54.858054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.195034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:55.203740 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59c9a9f6-c9d1-490e-9348-94e44bb9d18a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1317 microversion: 2.1 time: 0.368358 Oct 27 10:16:55.219738 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 995/2114] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:54 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:55.224982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:55.225616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:55.232895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.233464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.233907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.234634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.235124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.235548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.477655 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dea2b749-a0fe-4d6a-8c41-75e756c50293 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.944432 Oct 27 10:16:55.478560 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1120/2115] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:16:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:55.485067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6df5ea32-9d60-4132-9859-296b854be0b5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d63925790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:55.488021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:55.500893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:55.502447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:55.503868 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5fe4b8a7-b869-4f5e-a91c-ff7d38f0a4e8 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.282943 Oct 27 10:16:55.505294 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 996/2116] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:55 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:55.512879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:55.513892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:55.523718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.524868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.525714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.526699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.527605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.528752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.539740 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6df5ea32-9d60-4132-9859-296b854be0b5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.059726 Oct 27 10:16:55.540965 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1121/2117] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:55 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:55.545942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3326a9fc-00ec-4495-bf2e-989023033ea3 req-79cd8fd5-695d-478f-b95f-6e73834b8cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3773dce-56b1-44be-bc19-4e5bdc5ff072", "tag": "e638ef34-6ca1-49f2-8ada-7febf4785532"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:55.556382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3326a9fc-00ec-4495-bf2e-989023033ea3 req-79cd8fd5-695d-478f-b95f-6e73834b8cd5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.556892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3326a9fc-00ec-4495-bf2e-989023033ea3 req-79cd8fd5-695d-478f-b95f-6e73834b8cd5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.557467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3326a9fc-00ec-4495-bf2e-989023033ea3 req-79cd8fd5-695d-478f-b95f-6e73834b8cd5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.582822 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3326a9fc-00ec-4495-bf2e-989023033ea3 req-79cd8fd5-695d-478f-b95f-6e73834b8cd5 service nova] Creating event network-changed:e638ef34-6ca1-49f2-8ada-7febf4785532 for instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 on n-h1-854663-10 Oct 27 10:16:55.589326 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3326a9fc-00ec-4495-bf2e-989023033ea3 req-79cd8fd5-695d-478f-b95f-6e73834b8cd5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046908 Oct 27 10:16:55.590317 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1122/2118] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:55.595659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:55.596518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:55.603918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.604428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.604904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.605605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.606051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.606468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.703702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:55.714472 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-988e35ed-ab5d-463d-986f-00799fa4f944 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1213 microversion: 2.1 time: 0.122779 Oct 27 10:16:55.728759 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1123/2119] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:55 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:55.728759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.113"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:55.728759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:55.734578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.735937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.737116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.739543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.740351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.741621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.749792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:55.760156 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5a16f74a-efe3-458c-aa40-57d25f435b9c tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1472 microversion: 2.1 time: 0.253065 Oct 27 10:16:55.760765 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 997/2120] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:55 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:55.777991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:16:55.778977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquired lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:16:55.862404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:55.863314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: db810b22-71e9-4b8c-bbaf-59b8443d408b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:55.874130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.874957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.875407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.876525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:55.877050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:55.877439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:55.903883 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] HTTP exception thrown: Instance db810b22-71e9-4b8c-bbaf-59b8443d408b could not be found. Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Request method failure captured: Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b HTTP/1.1 Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWli886LgLJebOrqEGu5OQKeMdg-g9g74XkvzRnuVHl0YART7Y27YsyAi2tQDgwO0fkq1ljumZnbE2L_xQKPuiuXFnhFv37vSYcuTHmVrudD8hQIAY52cFjk0ZIn5dJMeEVrJnRBMCeBGXFnIKiMIqBgNqVBuQ_wKonQD2tsRriR_RNM Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: bda464c030cc4b3bb14a81d9a83261aa Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-LiveMigrationTest-1960045742 Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:16:55.906168 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bda464c030cc4b3bb14a81d9a83261aa", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-LiveMigrationTest-1960045742 Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: bda464c030cc4b3bb14a81d9a83261aa Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-LiveMigrationTest-1960045742 Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-LiveMigrationTest-1960045742-project Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5db106c72e8745de8266a3ab7a5fe531 Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-LiveMigrationTest-1960045742-project Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance db810b22-71e9-4b8c-bbaf-59b8443d408b could not be found. Oct 27 10:16:55.908003 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'db810b22-71e9-4b8c-bbaf-59b8443d408b'} Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db810b22-71e9-4b8c-bbaf-59b8443d408b could not be found. Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:55.909009 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db810b22-71e9-4b8c-bbaf-59b8443d408b could not be found. Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db810b22-71e9-4b8c-bbaf-59b8443d408b could not be found. Oct 27 10:16:55.912201 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:16:55.915008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Returning 404 to user: Instance db810b22-71e9-4b8c-bbaf-59b8443d408b could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:55.915008 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4b0eb13-9ffe-42f1-9986-59e6ac0b0a2e tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b" status: 404 len: 111 microversion: 2.1 time: 0.050788 Oct 27 10:16:55.915008 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 998/2121] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:55 2022] GET /compute/v2.1/servers/db810b22-71e9-4b8c-bbaf-59b8443d408b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:16:55.920242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afbcd384-81db-47ce-ad2e-5893b9c2bb95 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '.version_select at 0x7f6d637a1dc0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:55.944965 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afbcd384-81db-47ce-ad2e-5893b9c2bb95 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755539163" status: 202 len: 0 microversion: 2.1 time: 0.031764 Oct 27 10:16:55.945798 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 999/2122] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:16:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755539163 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:16:56.213477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.113 (abd0d375-a1a5-431c-87cb-bb77902fe3dc) with port e638ef34-6ca1-49f2-8ada-7febf4785532 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1f5b69b3-b392-4769-acea-e0cfb8d1d3ed.", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:16:56.214214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Releasing lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:16:56.215029 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.113 (abd0d375-a1a5-431c-87cb-bb77902fe3dc) with port e638ef34-6ca1-49f2-8ada-7febf4785532 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1f5b69b3-b392-4769-acea-e0cfb8d1d3ed. Oct 27 10:16:56.215029 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-3e4d1233-ebb3-411b-afed-410faac9bfa8'] Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Request method failure captured: Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action HTTP/1.1 Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 46 Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlpsZuU1blQVvOQU2wvxRwcn8XrVQhlyim8KOYrwN5zqWvkwAkxI2F0aLBMNmtaaQGlPErXqR0trgIGxMHuPBFsuZZHaY1LPbra-AtoweQflgpQxGYtg6soYNnd1p9xe06Xh5Zhau_rJu5oyMYorFsN52Qapde093Oq6rl29Ua3YvWE Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:16:56.217190 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_50dd8d17dbe24743a91623359e7ab3ea", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 1e81a5a542844654a4b517d4c13de3c3 Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: {"addFloatingIp": {"address": "172.25.9.113"}} Oct 27 10:16:56.219334 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: exception: Cannot associate floating IP 172.25.9.113 (abd0d375-a1a5-431c-87cb-bb77902fe3dc) with port e638ef34-6ca1-49f2-8ada-7febf4785532 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1f5b69b3-b392-4769-acea-e0cfb8d1d3ed. Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-3e4d1233-ebb3-411b-afed-410faac9bfa8'] Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'c3773dce-56b1-44be-bc19-4e5bdc5ff072', 'body': {'addFloatingIp': {'address': '172.25.9.113'}}} Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:16:56.221375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:16:56.224812 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.113 (abd0d375-a1a5-431c-87cb-bb77902fe3dc) with port e638ef34-6ca1-49f2-8ada-7febf4785532 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1f5b69b3-b392-4769-acea-e0cfb8d1d3ed. Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e4d1233-ebb3-411b-afed-410faac9bfa8'] Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.113 (abd0d375-a1a5-431c-87cb-bb77902fe3dc) with port e638ef34-6ca1-49f2-8ada-7febf4785532 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1f5b69b3-b392-4769-acea-e0cfb8d1d3ed. Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e4d1233-ebb3-411b-afed-410faac9bfa8'] Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:56.227094 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.113 (abd0d375-a1a5-431c-87cb-bb77902fe3dc) with port e638ef34-6ca1-49f2-8ada-7febf4785532 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1f5b69b3-b392-4769-acea-e0cfb8d1d3ed. Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e4d1233-ebb3-411b-afed-410faac9bfa8'] Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:56.229475 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.113 (abd0d375-a1a5-431c-87cb-bb77902fe3dc) with port e638ef34-6ca1-49f2-8ada-7febf4785532 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1f5b69b3-b392-4769-acea-e0cfb8d1d3ed. Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e4d1233-ebb3-411b-afed-410faac9bfa8'] Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Returning 400 to user: Cannot associate floating IP 172.25.9.113 (abd0d375-a1a5-431c-87cb-bb77902fe3dc) with port e638ef34-6ca1-49f2-8ada-7febf4785532 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1f5b69b3-b392-4769-acea-e0cfb8d1d3ed. Oct 27 10:16:56.233695 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-3e4d1233-ebb3-411b-afed-410faac9bfa8'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:56.236478 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f370e9c-fe14-440b-b57a-bef5e1e496ea tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action" status: 400 len: 381 microversion: 2.1 time: 0.502288 Oct 27 10:16:56.236478 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1124/2123] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:16:55 2022] POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action => generated 381 bytes in 507 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:16:56.236704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:56.236809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4ca433e-58f2-4d7b-9633-7fb64d1e56ef tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '.version_select at 0x7f6d638b7ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:56.236948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:56.246029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:56.246029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:56.246352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:56.246930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:56.247383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:56.247834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:56.629371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:56.639523 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c3dd8a7-e37b-4796-9d81-c851ea4113b5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1317 microversion: 2.1 time: 0.416227 Oct 27 10:16:56.653686 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1000/2124] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:56 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:16:56.664149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:56.665018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:56.673039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:56.674583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:56.676118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:56.677178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:56.678158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:56.678812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:56.979980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:56.990811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:56.992649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:56.996810 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0447474-a80e-4d6a-8abf-a88705e71ffa tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.341511 Oct 27 10:16:56.997706 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1001/2125] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:56 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:57.004273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a90365ce-4f4d-4341-979c-130dcbc1e9c5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d637a1b80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:57.060118 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a90365ce-4f4d-4341-979c-130dcbc1e9c5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.061008 Oct 27 10:16:57.061229 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1002/2126] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:56 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:57.069331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:57.070608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:57.089191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.089991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.090959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.092380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.096731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.100149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.220837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:57.240119 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af5bff85-cb8e-4df3-8053-e4e101834394 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1269 microversion: 2.1 time: 0.176077 Oct 27 10:16:57.241259 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1003/2127] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:57 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:57.255862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:57.257532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:57.268868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.270553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.271245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.272772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.294772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.295600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.357029 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4ca433e-58f2-4d7b-9633-7fb64d1e56ef tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/abd0d375-a1a5-431c-87cb-bb77902fe3dc" status: 202 len: 0 microversion: 2.1 time: 1.132617 Oct 27 10:16:57.358852 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1125/2128] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:16:56 2022] DELETE /compute/v2.1/os-floating-ips/abd0d375-a1a5-431c-87cb-bb77902fe3dc => generated 0 bytes in 1135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:16:57.367984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:57.368787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:57.375775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.376339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.376819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.377537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.378043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.378571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.412557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:16:57.498053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f972a5c34e294e63b10e7c97ba23739f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686cacfed6704a9585df56d80cb7273f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:57.508278 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-51c8e767-a706-43e1-b60f-129c777f9a19 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 200 len: 1472 microversion: 2.1 time: 0.265138 Oct 27 10:16:57.509009 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1004/2129] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:57 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:57.528570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.29"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:57.551870 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65f6f60c-09ff-4ddc-ab2f-2c15b130ab7f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "DELETE /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 204 len: 0 microversion: 2.1 time: 0.190064 Oct 27 10:16:57.553026 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1126/2130] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:16:57 2022] DELETE /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:16:57.562291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cbe298ab-3de8-4aab-b152-5f15a0347c4f req-f7a125f8-6902-4ace-80ba-52bd3d0cdd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe2d6b4-731c-4567-9abb-a7924c8dd43b", "name": "network-vif-deleted", "tag": "ef734916-25b8-4e1e-8214-27785b87cd71"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:57.575174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cbe298ab-3de8-4aab-b152-5f15a0347c4f req-f7a125f8-6902-4ace-80ba-52bd3d0cdd11 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.575802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cbe298ab-3de8-4aab-b152-5f15a0347c4f req-f7a125f8-6902-4ace-80ba-52bd3d0cdd11 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.576377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cbe298ab-3de8-4aab-b152-5f15a0347c4f req-f7a125f8-6902-4ace-80ba-52bd3d0cdd11 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.593387 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cbe298ab-3de8-4aab-b152-5f15a0347c4f req-f7a125f8-6902-4ace-80ba-52bd3d0cdd11 service nova] Creating event network-vif-deleted:ef734916-25b8-4e1e-8214-27785b87cd71 for instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b on n-h2-854663-10 Oct 27 10:16:57.599768 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cbe298ab-3de8-4aab-b152-5f15a0347c4f req-f7a125f8-6902-4ace-80ba-52bd3d0cdd11 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044283 Oct 27 10:16:57.601146 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1127/2131] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:57.615588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:57.616288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:57.623594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.624216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.624697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.625657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.626114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.626557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.690849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:57.697575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.698064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.698505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.699226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.699680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.700106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.855850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:57.869235 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e3e7354-476d-4842-bc3a-56a3257c317d tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1485 microversion: 2.1 time: 0.264143 Oct 27 10:16:57.882272 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1128/2132] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:57 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1485 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:57.893843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:57.894518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:57.902047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.902872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.903581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:57.904320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:57.905128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:57.905748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:58.474076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:16:58.475209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquired lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:16:58.781947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:58.802366 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c046c605-d900-42a9-b887-93d1055a9660 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1317 microversion: 2.1 time: 0.912542 Oct 27 10:16:58.803978 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1129/2133] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:57 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1317 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:58.822727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:58.823874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:58.842962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:58.844583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:58.854026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:58.855973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:58.857573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:58.858632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:59.263543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:59.272250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:59.274064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:59.276080 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ae114bf-0c91-47a2-b95c-3c1805182a66 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.469175 Oct 27 10:16:59.289329 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1130/2134] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:16:58 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:16:59.301980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90d330ee-fa16-458b-aff0-c8f0d965c176 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d63948af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:59.354122 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90d330ee-fa16-458b-aff0-c8f0d965c176 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.063055 Oct 27 10:16:59.363989 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1131/2135] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:16:59 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:59.370352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:59.371189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:59.379198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:59.379922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:59.380517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:59.381650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:59.382750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:59.383857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:59.589983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:59.606909 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa8d51b4-c0f5-4021-ad8d-c4a9d5532ca1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1275 microversion: 2.1 time: 0.241485 Oct 27 10:16:59.610098 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1132/2136] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:59 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:59.623548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:59.624488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] [instance: ffe2d6b4-731c-4567-9abb-a7924c8dd43b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:59.637581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:59.638082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:59.638605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:59.639329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:59.639789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:59.640218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:59.684886 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] HTTP exception thrown: Instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b could not be found. Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Request method failure captured: Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b HTTP/1.1 Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlolEfayIW_AoXGh_QFaF08ropDDD-j3c-KFiCSTUvDUGLJIVMMivCHwivJ9ljFUw0Zt9JTHj0l1F7vYkraXwLClmhXsbAmgz2PaeIITeMbw8k6LijnMukbxZdWVEPXtKhv9ihtrf5b75Q8DJ6urMJOAFBF-tKYEpJuEyrGTdJQg4L0 Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 686cacfed6704a9585df56d80cb7273f Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerTestJSON-1485835016 Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:16:59.687108 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/686cacfed6704a9585df56d80cb7273f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/686cacfed6704a9585df56d80cb7273f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_686cacfed6704a9585df56d80cb7273f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/686cacfed6704a9585df56d80cb7273f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerTestJSON-1485835016 Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 686cacfed6704a9585df56d80cb7273f Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1485835016 Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerTestJSON-1485835016-project Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: f972a5c34e294e63b10e7c97ba23739f Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerTestJSON-1485835016-project Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b could not be found. Oct 27 10:16:59.688961 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ffe2d6b4-731c-4567-9abb-a7924c8dd43b'} Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b could not be found. Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:59.690078 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b could not be found. Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b could not be found. Oct 27 10:16:59.691589 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:16:59.692970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] Returning 404 to user: Instance ffe2d6b4-731c-4567-9abb-a7924c8dd43b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:59.692970 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68f51486-340e-4d9e-97c8-fe63614b1022 tempest-ImagesOneServerTestJSON-1485835016 tempest-ImagesOneServerTestJSON-1485835016-project] 10.222.0.76 "GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b" status: 404 len: 111 microversion: 2.1 time: 0.076445 Oct 27 10:16:59.692970 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1133/2137] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:59 2022] GET /compute/v2.1/servers/ffe2d6b4-731c-4567-9abb-a7924c8dd43b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:16:59.703520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:59.704147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:59.711801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:59.712740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:59.713570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:59.730888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:59.731396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:59.737000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:59.907923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:59.930516 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-889f4929-39c1-4dc6-8fc5-a8deb660cf1f tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 200 len: 1281 microversion: 2.1 time: 0.235353 Oct 27 10:16:59.934189 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1134/2138] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:59 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 1281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:59.949492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-34a532a5-5dc1-4099-8c08-98290e3e1596 req-68a1b0b6-efda-4dc5-82c7-3137f8af186a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04509dd-1faf-474a-a02d-fc408bf96fe2", "name": "network-vif-plugged", "status": "completed", "tag": "77a3d39c-827a-4840-98c9-d82e01a85658"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:59.976626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-34a532a5-5dc1-4099-8c08-98290e3e1596 req-68a1b0b6-efda-4dc5-82c7-3137f8af186a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:59.977712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-34a532a5-5dc1-4099-8c08-98290e3e1596 req-68a1b0b6-efda-4dc5-82c7-3137f8af186a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:59.978157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-34a532a5-5dc1-4099-8c08-98290e3e1596 req-68a1b0b6-efda-4dc5-82c7-3137f8af186a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:00.047064 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-34a532a5-5dc1-4099-8c08-98290e3e1596 req-68a1b0b6-efda-4dc5-82c7-3137f8af186a service nova] Creating event network-vif-plugged:77a3d39c-827a-4840-98c9-d82e01a85658 for instance d04509dd-1faf-474a-a02d-fc408bf96fe2 on n-h1-854663-10 Oct 27 10:17:00.072098 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-34a532a5-5dc1-4099-8c08-98290e3e1596 req-68a1b0b6-efda-4dc5-82c7-3137f8af186a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135801 Oct 27 10:17:00.073482 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1135/2139] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:00.106805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-93b1a4cc-c3de-4b2e-85c7-9f64138df1a4 req-85cdd56c-e667-4557-9f16-54bd63961c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7232d0b5-da9e-42f8-b828-2fe18f89e60c", "name": "network-vif-unplugged", "status": "completed", "tag": "445e30db-5e71-4997-b764-66abde871cfd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:00.121171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-93b1a4cc-c3de-4b2e-85c7-9f64138df1a4 req-85cdd56c-e667-4557-9f16-54bd63961c79 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:00.121999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-93b1a4cc-c3de-4b2e-85c7-9f64138df1a4 req-85cdd56c-e667-4557-9f16-54bd63961c79 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:00.123491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-93b1a4cc-c3de-4b2e-85c7-9f64138df1a4 req-85cdd56c-e667-4557-9f16-54bd63961c79 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:00.151016 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-93b1a4cc-c3de-4b2e-85c7-9f64138df1a4 req-85cdd56c-e667-4557-9f16-54bd63961c79 service nova] Creating event network-vif-unplugged:445e30db-5e71-4997-b764-66abde871cfd for instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c on n-h2-854663-10 Oct 27 10:17:00.158826 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-93b1a4cc-c3de-4b2e-85c7-9f64138df1a4 req-85cdd56c-e667-4557-9f16-54bd63961c79 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079144 Oct 27 10:17:00.159917 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1136/2140] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:00.177311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:00.178323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:00.188039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:00.188927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:00.190281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:00.191367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:00.192062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:00.192745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:00.454395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Building network info cache for instance {{(pid=120719) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:17:00.540199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:00.554254 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-085145c5-cb18-404b-a35f-85f8812f2005 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1317 microversion: 2.1 time: 0.392869 Oct 27 10:17:00.571207 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1137/2141] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:00 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:00.571207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:00.571207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:00.601043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:00.607954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:00.608473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:00.609700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:00.611170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:00.613863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:00.901497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:00.914407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:00.936052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:00.939376 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d773714-2e91-4ad8-bf07-4c0cf600f76a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.381762 Oct 27 10:17:00.965706 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1138/2142] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:00 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:00.981330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-239f3f68-e4c1-413c-bdcd-7634ba2b2394 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d63948430>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:01.063350 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-239f3f68-e4c1-413c-bdcd-7634ba2b2394 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.095991 Oct 27 10:17:01.064265 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1139/2143] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:00 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:01.076092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c8fa4049-bc14-4d39-a39a-4f31d781b997 req-d3e083d4-628a-4074-8f38-cccbaf0f8e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3773dce-56b1-44be-bc19-4e5bdc5ff072", "tag": "e638ef34-6ca1-49f2-8ada-7febf4785532"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:01.110592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c8fa4049-bc14-4d39-a39a-4f31d781b997 req-d3e083d4-628a-4074-8f38-cccbaf0f8e28 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:01.111435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c8fa4049-bc14-4d39-a39a-4f31d781b997 req-d3e083d4-628a-4074-8f38-cccbaf0f8e28 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:01.112334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c8fa4049-bc14-4d39-a39a-4f31d781b997 req-d3e083d4-628a-4074-8f38-cccbaf0f8e28 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:01.138253 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c8fa4049-bc14-4d39-a39a-4f31d781b997 req-d3e083d4-628a-4074-8f38-cccbaf0f8e28 service nova] Creating event network-changed:e638ef34-6ca1-49f2-8ada-7febf4785532 for instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 on n-h1-854663-10 Oct 27 10:17:01.151743 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c8fa4049-bc14-4d39-a39a-4f31d781b997 req-d3e083d4-628a-4074-8f38-cccbaf0f8e28 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079249 Oct 27 10:17:01.170529 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1140/2144] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:01.182524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:01.184989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:01.199868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:01.200775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:01.201382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:01.202260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:01.202881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:01.203474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:01.369681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:01.389529 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1bfe873b-7612-4aeb-ba29-b2250da765e3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1275 microversion: 2.1 time: 0.206928 Oct 27 10:17:01.390986 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1141/2145] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:01 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:01.402746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:01.410399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: fbcd2b3d-58b7-4b23-81b1-b055a3366dea] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:01.450741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:01.451251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:01.451688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:01.452649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:01.453136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:01.453723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:01.495962 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] HTTP exception thrown: Instance fbcd2b3d-58b7-4b23-81b1-b055a3366dea could not be found. Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Request method failure captured: Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea HTTP/1.1 Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWli886LgLJebOrqEGu5OQKeMdg-g9g74XkvzRnuVHl0YART7Y27YsyAi2tQDgwO0fkq1ljumZnbE2L_xQKPuiuXFnhFv37vSYcuTHmVrudD8hQIAY52cFjk0ZIn5dJMeEVrJnRBMCeBGXFnIKiMIqBgNqVBuQ_wKonQD2tsRriR_RNM Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: bda464c030cc4b3bb14a81d9a83261aa Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-LiveMigrationTest-1960045742 Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:01.497897 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bda464c030cc4b3bb14a81d9a83261aa", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-LiveMigrationTest-1960045742 Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: bda464c030cc4b3bb14a81d9a83261aa Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-LiveMigrationTest-1960045742 Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-LiveMigrationTest-1960045742-project Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5db106c72e8745de8266a3ab7a5fe531 Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-LiveMigrationTest-1960045742-project Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance fbcd2b3d-58b7-4b23-81b1-b055a3366dea could not be found. Oct 27 10:17:01.499778 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'fbcd2b3d-58b7-4b23-81b1-b055a3366dea'} Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcd2b3d-58b7-4b23-81b1-b055a3366dea could not be found. Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:01.500924 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcd2b3d-58b7-4b23-81b1-b055a3366dea could not be found. Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcd2b3d-58b7-4b23-81b1-b055a3366dea could not be found. Oct 27 10:17:01.502661 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:01.505043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Returning 404 to user: Instance fbcd2b3d-58b7-4b23-81b1-b055a3366dea could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:01.506144 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e47a4e9-6e62-4e76-9a40-020a604d24f5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea" status: 404 len: 111 microversion: 2.1 time: 0.113963 Oct 27 10:17:01.511924 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1142/2146] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:01 2022] GET /compute/v2.1/servers/fbcd2b3d-58b7-4b23-81b1-b055a3366dea => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:17:01.520222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:01.529809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:01.542695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:01.546426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:01.553522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:01.554490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:01.554904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:01.555379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:01.594625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:01.614372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:17:01.811432 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe578224-ebaa-42be-973f-ecde8d109af7 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 204 len: 0 microversion: 2.1 time: 0.295054 Oct 27 10:17:01.812316 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1143/2147] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:17:01 2022] DELETE /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:17:01.820125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:01.824418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:01.838118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:01.841055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:01.841865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:01.842899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:01.843607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:01.844264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.014596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Updating instance_info_cache with network_info: [{"id": "e638ef34-6ca1-49f2-8ada-7febf4785532", "address": "fa:16:3e:4c:ca:02", "network": {"id": "92ce5af8-13b4-4c3c-9c98-0e84f065a9ea", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-766299972-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "50dd8d17dbe24743a91623359e7ab3ea", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape638ef34-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120719) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:17:02.059444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Releasing lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:17:02.061498 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fbe8bbb1-2cb7-44b5-9efe-94e49c09e30f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action" status: 202 len: 0 microversion: 2.1 time: 4.538391 Oct 27 10:17:02.065238 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1005/2148] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:16:57 2022] POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action => generated 0 bytes in 4556 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 10:17:02.085809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:02.087662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:02.105597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.107840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.109348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.110592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.111436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.113572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.192654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:02.205657 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e6e7d90-36de-40ad-8f54-e9ad42790bdd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1317 microversion: 2.1 time: 0.391683 Oct 27 10:17:02.208880 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1144/2149] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:01 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:02.226029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:02.226721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:02.248653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.249492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.250203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.251614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.254576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.255428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.493416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:02.503840 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-feb84991-fc57-4d04-9cd8-8b5d1e4c0eff tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1499 microversion: 2.1 time: 0.437164 Oct 27 10:17:02.507632 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1006/2150] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:02 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1499 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:02.525326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8a68c908-18c8-4818-9052-99d85f8dce54 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '.version_select at 0x7f6d5b750f70>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:02.559756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:02.575554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:02.578966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:02.584304 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb06c125-8137-450d-ab31-68e69a800fc7 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.374138 Oct 27 10:17:02.597703 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1145/2151] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:02 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:02.620427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d531063-66f6-4bfe-94c5-18877498fdfc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d63948f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:02.705224 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4d531063-66f6-4bfe-94c5-18877498fdfc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.106182 Oct 27 10:17:02.713619 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1146/2152] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:02 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:02.713619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a00257be-2020-4937-9256-f79a1a3cd2a9 req-5b325059-8e9e-4915-b284-32313a6078a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2ecebf-5910-45cc-a64b-46987db5e3e7", "name": "network-vif-plugged", "status": "completed", "tag": "47847440-7b60-4683-a35e-007be8b78338"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:02.740358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a00257be-2020-4937-9256-f79a1a3cd2a9 req-5b325059-8e9e-4915-b284-32313a6078a6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.740882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a00257be-2020-4937-9256-f79a1a3cd2a9 req-5b325059-8e9e-4915-b284-32313a6078a6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.741369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a00257be-2020-4937-9256-f79a1a3cd2a9 req-5b325059-8e9e-4915-b284-32313a6078a6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.767322 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a00257be-2020-4937-9256-f79a1a3cd2a9 req-5b325059-8e9e-4915-b284-32313a6078a6 service nova] Creating event network-vif-plugged:47847440-7b60-4683-a35e-007be8b78338 for instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 on n-h1-854663-10 Oct 27 10:17:02.786811 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a00257be-2020-4937-9256-f79a1a3cd2a9 req-5b325059-8e9e-4915-b284-32313a6078a6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078917 Oct 27 10:17:02.787883 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1147/2153] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:02.797268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0f1c36cc-f869-4139-849d-8c21aa69b432 req-52cb630f-a82a-4795-9757-f3d2baced9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcd2b3d-58b7-4b23-81b1-b055a3366dea", "name": "network-vif-deleted", "tag": "f4524ae2-f0ff-40b9-bc49-e05a0706b1e0"}, {"name": "network-changed", "server_uuid": "7232d0b5-da9e-42f8-b828-2fe18f89e60c", "tag": "445e30db-5e71-4997-b764-66abde871cfd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:02.818068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0f1c36cc-f869-4139-849d-8c21aa69b432 req-52cb630f-a82a-4795-9757-f3d2baced9f4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.818561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0f1c36cc-f869-4139-849d-8c21aa69b432 req-52cb630f-a82a-4795-9757-f3d2baced9f4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.819055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0f1c36cc-f869-4139-849d-8c21aa69b432 req-52cb630f-a82a-4795-9757-f3d2baced9f4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.854591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0f1c36cc-f869-4139-849d-8c21aa69b432 req-52cb630f-a82a-4795-9757-f3d2baced9f4 service nova] Creating event network-vif-deleted:f4524ae2-f0ff-40b9-bc49-e05a0706b1e0 for instance fbcd2b3d-58b7-4b23-81b1-b055a3366dea on n-h2-854663-10 Oct 27 10:17:02.855283 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0f1c36cc-f869-4139-849d-8c21aa69b432 req-52cb630f-a82a-4795-9757-f3d2baced9f4 service nova] Creating event network-changed:445e30db-5e71-4997-b764-66abde871cfd for instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c on n-h2-854663-10 Oct 27 10:17:02.866122 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0f1c36cc-f869-4139-849d-8c21aa69b432 req-52cb630f-a82a-4795-9757-f3d2baced9f4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076832 Oct 27 10:17:02.869010 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1148/2154] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:02.880623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:02.883273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:02.898671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.904136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.906053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.908233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.908979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.911678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:03.268613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:03.279895 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-852c2a75-35b1-4acf-bb25-b9199c57a41d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1317 microversion: 2.1 time: 0.409211 Oct 27 10:17:03.290222 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1149/2155] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:02 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:03.303832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:03.317646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:03.337927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:03.343475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:03.344705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:03.347734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:03.348497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:03.349131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:03.478295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:03.794445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:03.807889 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32aa128e-83be-431c-b67d-af7c5292117c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1508 microversion: 2.1 time: 0.511093 Oct 27 10:17:03.809565 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1150/2156] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:03 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1508 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:03.835980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:03.837209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:03.845255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:03.846123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:03.846800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:03.848646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:03.849706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:03.850984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:04.106198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:04.123199 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-006082ad-327f-4c20-8628-57223c667c46 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1499 microversion: 2.1 time: 0.292320 Oct 27 10:17:04.126637 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1151/2157] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:03 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1499 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:04.136448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:04.138919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:04.161768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:04.162266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:04.162704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:04.163427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:04.163881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:04.164307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:04.428590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:04.626163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:04.658958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:04.667632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:04.674124 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8e5d7aa5-37dc-4202-bbe3-e75d4f94bc7d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.544771 Oct 27 10:17:04.676139 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1152/2158] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:04 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:04.696590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f1e1bf9-aced-42dc-b3eb-5e692c6f06ac tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ba5fd30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:04.727351 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8a68c908-18c8-4818-9052-99d85f8dce54 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/e06a21cb-1004-43e1-9771-58b14e545197" status: 202 len: 0 microversion: 2.1 time: 2.215440 Oct 27 10:17:04.728173 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1007/2159] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:17:02 2022] DELETE /compute/v2.1/os-floating-ips/e06a21cb-1004-43e1-9771-58b14e545197 => generated 0 bytes in 2217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:17:04.733697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:04.734421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:04.764350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:04.765021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:04.765488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:04.769102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:04.769597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:04.770038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:04.802151 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f1e1bf9-aced-42dc-b3eb-5e692c6f06ac tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.124562 Oct 27 10:17:04.804631 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1153/2160] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:04 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:05.028732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:05.037427 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50790b1c-fd67-49c6-8401-66bda3da5efc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1508 microversion: 2.1 time: 0.308026 Oct 27 10:17:05.040761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1008/2161] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:04 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:05.047678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:05.048301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:05.054984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.055719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.056392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.057543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.058206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.058889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.112674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e359f829-914f-4671-98ab-a47ad3139582 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Action: 'create', calling method: .version_select at 0x7f6d639a8160>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUnO6WxpGva5GTs1tRqExtTIACORoVA6pyJ2A4we3eF3UrwGPGDxnALtTwxi4PTI6NISXAQInwSOr4v5kNAakQvU32nXn38I1IlGfH7OIDq5EIDSwf5l1XcAsvmHys4aQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:05.123936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e359f829-914f-4671-98ab-a47ad3139582 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Request method failure captured: Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 257 Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlqfm4cZgeeKEwwjB72AHXLFclj6axDPm36e3mq0Xo0lIT0HIIC5rTTi8WZOwqyy8KoOywqzwucYu8d3gNLYN5EfqejP_CH3tQ377bKftbiV8d-e3z7UGIkYnNoLuLrfWtOrB1VtsUGN6F5kM4JCbkfNY1p5azR3z7xxJ8cRZa6wqgM Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:05.128197 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e1e38c51e6f4d77bca56538bb4c55fd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:17:05.130250 n-d-854663-10 devstack@n-api.service[120720]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUnO6WxpGva5GTs1tRqExtTIACORoVA6pyJ2A4we3eF3UrwGPGDxnALtTwxi4PTI6NISXAQInwSOr4v5kNAakQvU32nXn38I1IlGfH7OIDq5EIDSwf5l1XcAsvmHys4aQ=="}} Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUnO6WxpGva5GTs1tRqExtTIACORoVA6pyJ2A4we3eF3UrwGPGDxnALtTwxi4PTI6NISXAQInwSOr4v5kNAakQvU32nXn38I1IlGfH7OIDq5EIDSwf5l1XcAsvmHys4aQ=='}}} Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.131341 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:05.132966 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:17:05.135059 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:17:05.136962 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 10:17:05.136962 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.140071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e359f829-914f-4671-98ab-a47ad3139582 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:05.142731 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e359f829-914f-4671-98ab-a47ad3139582 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.336560 Oct 27 10:17:05.143515 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1154/2162] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:17:04 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 338 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:17:05.162642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf0eccb7-6a00-4633-8fc9-da8b9776f050 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf0eccb7-6a00-4633-8fc9-da8b9776f050 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Request method failure captured: Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action HTTP/1.1 Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 34 Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlpsZuU1blQVvOQU2wvxRwcn8XrVQhlyim8KOYrwN5zqWvkwAkxI2F0aLBMNmtaaQGlPErXqR0trgIGxMHuPBFsuZZHaY1LPbra-AtoweQflgpQxGYtg6soYNnd1p9xe06Xh5Zhau_rJu5oyMYorFsN52Qapde093Oq6rl29Ua3YvWE Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:05.167088 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_50dd8d17dbe24743a91623359e7ab3ea", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 1e81a5a542844654a4b517d4c13de3c3 Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: {"addFloatingIp": {"address": ""}} Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:17:05.169116 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'c3773dce-56b1-44be-bc19-4e5bdc5ff072', 'body': {'addFloatingIp': {'address': ''}}} Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '' Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:05.170255 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:17:05.172138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:17:05.174084 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 10:17:05.174084 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.176555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf0eccb7-6a00-4633-8fc9-da8b9776f050 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:05.177722 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf0eccb7-6a00-4633-8fc9-da8b9776f050 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action" status: 400 len: 142 microversion: 2.1 time: 0.031716 Oct 27 10:17:05.179228 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1155/2163] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:17:05 2022] POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action => generated 142 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:17:05.209821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:05.214027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:05.228590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.229631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.230328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.231299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.231926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.232522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.360344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:05.370022 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6991aa3f-91a3-4d28-add7-04032b2c65a7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1317 microversion: 2.1 time: 0.327282 Oct 27 10:17:05.370697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1009/2164] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:05 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:05.375946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8542a83f-9e41-4090-96f6-eb1a20548132 req-aae70e22-31b8-4ecd-87bf-ffa4fb6eee41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef114f37-a4a0-47b8-b0a0-5d75c05d0968", "tag": "c7ee09b9-5c53-4520-8a18-fa1dcdb22fb2"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:05.404290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8542a83f-9e41-4090-96f6-eb1a20548132 req-aae70e22-31b8-4ecd-87bf-ffa4fb6eee41 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.405050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8542a83f-9e41-4090-96f6-eb1a20548132 req-aae70e22-31b8-4ecd-87bf-ffa4fb6eee41 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.405751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8542a83f-9e41-4090-96f6-eb1a20548132 req-aae70e22-31b8-4ecd-87bf-ffa4fb6eee41 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.407282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:17:05.413629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:17:05.417320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:17:05.418057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:17:05.418603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:17:05.424183 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8542a83f-9e41-4090-96f6-eb1a20548132 req-aae70e22-31b8-4ecd-87bf-ffa4fb6eee41 service nova] Creating event network-changed:c7ee09b9-5c53-4520-8a18-fa1dcdb22fb2 for instance ef114f37-a4a0-47b8-b0a0-5d75c05d0968 on n-h1-854663-10 Oct 27 10:17:05.429614 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8542a83f-9e41-4090-96f6-eb1a20548132 req-aae70e22-31b8-4ecd-87bf-ffa4fb6eee41 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057346 Oct 27 10:17:05.430880 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1010/2165] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:05.437032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:05.437951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:05.447025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.447864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.448291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.449058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.449755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.450378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.552017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db106c72e8745de8266a3ab7a5fe531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda464c030cc4b3bb14a81d9a83261aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:05.565358 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e7002a5-d05f-41a3-9e69-a23ac24555d5 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 200 len: 1457 microversion: 2.1 time: 0.131603 Oct 27 10:17:05.566869 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1011/2166] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:05 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 1457 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:05.595423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc532ea0-1fcf-4b84-bcac-7c1a60ad2697 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Action: 'create', calling method: .version_select at 0x7f6d63974280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-55800539", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:05.635075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:05.667480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.670059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.672692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.678310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.682922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.686334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.689684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-cc532ea0-1fcf-4b84-bcac-7c1a60ad2697 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:05.717189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-cc532ea0-1fcf-4b84-bcac-7c1a60ad2697 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for user 5d03c70eefb848cfaca224cf69db35f6 and project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:05.798863 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9e958bd-a6d2-4035-a9c2-ef382ba44684 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "POST /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2/action" status: 202 len: 1110 microversion: 2.1 time: 0.616177 Oct 27 10:17:05.799404 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-cc532ea0-1fcf-4b84-bcac-7c1a60ad2697 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:05.805341 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1156/2167] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:17:05 2022] POST /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2/action => generated 1110 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 10:17:05.830696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:05.839959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc532ea0-1fcf-4b84-bcac-7c1a60ad2697 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Request method failure captured: Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 2165 Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlqfm4cZgeeKEwwjB72AHXLFclj6axDPm36e3mq0Xo0lIT0HIIC5rTTi8WZOwqyy8KoOywqzwucYu8d3gNLYN5EfqejP_CH3tQ377bKftbiV8d-e3z7UGIkYnNoLuLrfWtOrB1VtsUGN6F5kM4JCbkfNY1p5azR3z7xxJ8cRZa6wqgM Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e1e38c51e6f4d77bca56538bb4c55fd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-55800539", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:17:05.848103 n-d-854663-10 devstack@n-api.service[120719]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-55800539', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:05.852162 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc532ea0-1fcf-4b84-bcac-7c1a60ad2697 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc532ea0-1fcf-4b84-bcac-7c1a60ad2697 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.290640 Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1012/2168] 10.222.0.76 () {60 vars in 1160 bytes} [Thu Oct 27 10:17:05 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:05.938107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:05.943789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.943789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.945659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.948476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.951409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.953657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.963157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.967065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.967625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.968407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.972403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.981690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:06.010597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:17:06.011364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquired lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:17:06.436392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Releasing lock "refresh_cache-c3773dce-56b1-44be-bc19-4e5bdc5ff072" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:17:06.437332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] HTTP exception thrown: floating IP not found Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Request method failure captured: Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action HTTP/1.1 Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 41 Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlpsZuU1blQVvOQU2wvxRwcn8XrVQhlyim8KOYrwN5zqWvkwAkxI2F0aLBMNmtaaQGlPErXqR0trgIGxMHuPBFsuZZHaY1LPbra-AtoweQflgpQxGYtg6soYNnd1p9xe06Xh5Zhau_rJu5oyMYorFsN52Qapde093Oq6rl29Ua3YvWE Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_50dd8d17dbe24743a91623359e7ab3ea", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 1e81a5a542844654a4b517d4c13de3c3 Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: exception: floating IP not found Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'c3773dce-56b1-44be-bc19-4e5bdc5ff072', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 27 10:17:06.439684 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:06.443797 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:06.443797 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:06.443797 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:06.443797 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:06.443797 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:06.443797 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:06.443797 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:06.443797 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 27 10:17:06.443797 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:06.445595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Returning 404 to user: floating IP not found {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:06.446625 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0668f02-b1f1-471d-b15c-4648d168dedf tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action" status: 404 len: 67 microversion: 2.1 time: 0.639965 Oct 27 10:17:06.447355 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1157/2169] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:17:05 2022] POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action => generated 67 bytes in 641 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:17:06.460289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a01d80a1-dcec-41e5-9723-9f48e147ae84 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d63937ca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:06.512583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:06.531626 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a01d80a1-dcec-41e5-9723-9f48e147ae84 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.077004 Oct 27 10:17:06.532763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:06.535172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:06.536735 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f760a37-094e-4e90-b642-4d3f7a9dfb8d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.674407 Oct 27 10:17:06.537833 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1013/2170] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:05 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:06.540787 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1158/2171] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:06 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:06.545073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:06.545892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-738ea4a6-ef4b-4c8a-a7e2-b7f362ebf611 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Action: 'create', calling method: .version_select at 0x7f6d63849160>, body: {"keypair": {"name": "tempest-keypair-1067484892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFMh3Bfhc0Sp/+sdGClYkgvlzLUWeS8Szlk9ssphcs1YTc6xCf3bzUdr7SU9YQJpgtXTj7Ja5zaTeCgGX/P+l3Gok2xHnjqnO/dlT4zIz9ZQGqqNcyB4e2KX5ZxumCWqg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:06.546160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:06.553863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:06.554622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:06.555302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:06.556995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:06.557893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:06.558728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:06.583426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-738ea4a6-ef4b-4c8a-a7e2-b7f362ebf611 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:06.601220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-738ea4a6-ef4b-4c8a-a7e2-b7f362ebf611 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for user 5d03c70eefb848cfaca224cf69db35f6 and project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:06.673163 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-738ea4a6-ef4b-4c8a-a7e2-b7f362ebf611 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130912 Oct 27 10:17:06.675438 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1159/2172] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:17:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:06.687850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:06.688956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:06.704512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:06.710495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:06.713456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:06.714252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:06.715216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:06.718583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:06.719179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:06.918411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:06.931414 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c019f990-0f17-473b-a691-ee557ea6af6f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.392308 Oct 27 10:17:06.932955 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1014/2173] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:06 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:06.938770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-814873e0-7596-4b13-ad25-b6f6becc62ee tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:07.010786 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-814873e0-7596-4b13-ad25-b6f6becc62ee tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-814873e0-7596-4b13-ad25-b6f6becc62ee tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Request method failure captured: Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action HTTP/1.1 Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 44 Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlpsZuU1blQVvOQU2wvxRwcn8XrVQhlyim8KOYrwN5zqWvkwAkxI2F0aLBMNmtaaQGlPErXqR0trgIGxMHuPBFsuZZHaY1LPbra-AtoweQflgpQxGYtg6soYNnd1p9xe06Xh5Zhau_rJu5oyMYorFsN52Qapde093Oq6rl29Ua3YvWE Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_50dd8d17dbe24743a91623359e7ab3ea", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1e81a5a542844654a4b517d4c13de3c3 Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: exception: Floating IP not found for address 0.0.0.0. Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'c3773dce-56b1-44be-bc19-4e5bdc5ff072', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 27 10:17:07.013228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 27 10:17:07.016394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.017998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-814873e0-7596-4b13-ad25-b6f6becc62ee tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:07.019186 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-814873e0-7596-4b13-ad25-b6f6becc62ee tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action" status: 404 len: 88 microversion: 2.1 time: 0.085032 Oct 27 10:17:07.020264 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1015/2174] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:17:06 2022] POST /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072/action => generated 88 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:17:07.028951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:07.031415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] [instance: e8d33774-5dae-4e3e-8ebe-25d783fd65c8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:07.046523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:07.049347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.050014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.050582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.052221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.053918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.054531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.056328 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d75dddb-ef7e-4e34-a9bc-93392a0ce94d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1317 microversion: 2.1 time: 0.377775 Oct 27 10:17:07.058352 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1160/2175] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:06 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:07.065140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8574e501-0e62-483e-9a14-11ed465f05c5 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Action: 'create', calling method: .version_select at 0x7f6d63845e50>, body: {"keypair": {"name": "tempest-keypair-1067484892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFEnhyCUXZahhdndVnLioHKUpvAaonxibba7gxLSN4x4GKi0Bt8NoTr+M1Q5Bkgzcs5l+PR08SF/trdGo/GXE3bwfsDNiy7i5ihyI69YnsbLjhu9/jIh8U8tRGMiE81nw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:07.084891 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] HTTP exception thrown: Instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 could not be found. Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Request method failure captured: Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 HTTP/1.1 Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWli886LgLJebOrqEGu5OQKeMdg-g9g74XkvzRnuVHl0YART7Y27YsyAi2tQDgwO0fkq1ljumZnbE2L_xQKPuiuXFnhFv37vSYcuTHmVrudD8hQIAY52cFjk0ZIn5dJMeEVrJnRBMCeBGXFnIKiMIqBgNqVBuQ_wKonQD2tsRriR_RNM Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: bda464c030cc4b3bb14a81d9a83261aa Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-LiveMigrationTest-1960045742 Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bda464c030cc4b3bb14a81d9a83261aa", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bda464c030cc4b3bb14a81d9a83261aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-LiveMigrationTest-1960045742 Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: bda464c030cc4b3bb14a81d9a83261aa Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-LiveMigrationTest-1960045742 Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-LiveMigrationTest-1960045742-project Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5db106c72e8745de8266a3ab7a5fe531 Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-LiveMigrationTest-1960045742-project Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 could not be found. Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e8d33774-5dae-4e3e-8ebe-25d783fd65c8'} Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 could not be found. Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 could not be found. Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.086474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.090417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.090417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.090417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.090417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:07.090417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:07.090417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 could not be found. Oct 27 10:17:07.090417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.090417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] Returning 404 to user: Instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:07.090417 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d93130cc-fd52-4ed2-8f93-f82bb75715c1 tempest-LiveMigrationTest-1960045742 tempest-LiveMigrationTest-1960045742-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8" status: 404 len: 111 microversion: 2.1 time: 0.066203 Oct 27 10:17:07.096299 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1016/2176] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:07 2022] GET /compute/v2.1/servers/e8d33774-5dae-4e3e-8ebe-25d783fd65c8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:17:07.098032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8574e501-0e62-483e-9a14-11ed465f05c5 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:07.108791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:07.109812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8574e501-0e62-483e-9a14-11ed465f05c5 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for user 5d03c70eefb848cfaca224cf69db35f6 and project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:07.110583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:07.127352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.133040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.133040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.133040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.133040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.133040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.233856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:17:07.239997 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-8574e501-0e62-483e-9a14-11ed465f05c5 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] HTTP exception thrown: Key pair 'tempest-keypair-1067484892' already exists. Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8574e501-0e62-483e-9a14-11ed465f05c5 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Request method failure captured: Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 273 Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlqfm4cZgeeKEwwjB72AHXLFclj6axDPm36e3mq0Xo0lIT0HIIC5rTTi8WZOwqyy8KoOywqzwucYu8d3gNLYN5EfqejP_CH3tQ377bKftbiV8d-e3z7UGIkYnNoLuLrfWtOrB1VtsUGN6F5kM4JCbkfNY1p5azR3z7xxJ8cRZa6wqgM Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e1e38c51e6f4d77bca56538bb4c55fd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: {"keypair": {"name": "tempest-keypair-1067484892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFEnhyCUXZahhdndVnLioHKUpvAaonxibba7gxLSN4x4GKi0Bt8NoTr+M1Q5Bkgzcs5l+PR08SF/trdGo/GXE3bwfsDNiy7i5ihyI69YnsbLjhu9/jIh8U8tRGMiE81nw=="}} Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: exception: Key pair 'tempest-keypair-1067484892' already exists. Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1067484892', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFEnhyCUXZahhdndVnLioHKUpvAaonxibba7gxLSN4x4GKi0Bt8NoTr+M1Q5Bkgzcs5l+PR08SF/trdGo/GXE3bwfsDNiy7i5ihyI69YnsbLjhu9/jIh8U8tRGMiE81nw=='}}} Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result.read() Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '5d03c70eefb848cfaca224cf69db35f6-tempest-keypair-1067484892' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 27 10:17:07.324319 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result.read() Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 10:17:07.327346 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '5d03c70eefb848cfaca224cf69db35f6-tempest-keypair-1067484892' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 10, 17, 7, 216253), 'updated_at': None, 'name': 'tempest-keypair-1067484892', 'user_id': '5d03c70eefb848cfaca224cf69db35f6', 'fingerprint': 'd3:23:53:ea:db:28:13:79:28:3e:65:c2:2a:2f:2a:b5', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFEnhyCUXZahhdndVnLioHKUpvAaonxibba7gxLSN4x4GKi0Bt8NoTr+M1Q5Bkgzcs5l+PR08SF/trdGo/GXE3bwfsDNiy7i5ihyI69YnsbLjhu9/jIh8U8tRGMiE81nw==', 'type': 'ssh'}] Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi keypair.create() Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._create() Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1067484892' already exists. Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 27 10:17:07.329920 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1067484892' already exists. Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1067484892' already exists. Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8574e501-0e62-483e-9a14-11ed465f05c5 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Returning 409 to user: Key pair 'tempest-keypair-1067484892' already exists. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8574e501-0e62-483e-9a14-11ed465f05c5 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.267671 Oct 27 10:17:07.332452 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1161/2177] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:17:07 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 272 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:17:07.340372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b610c6b9-76b6-487c-9dc4-e1e8aa8d1416 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Calling method '.version_select at 0x7f6d5bc4be50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:07.388770 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b70ff9c-8b27-4b3e-9d8d-ff0d9acfe7f1 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 204 len: 0 microversion: 2.1 time: 0.290134 Oct 27 10:17:07.389489 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b610c6b9-76b6-487c-9dc4-e1e8aa8d1416 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067484892" status: 202 len: 0 microversion: 2.1 time: 0.053436 Oct 27 10:17:07.394745 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1017/2178] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:17:07 2022] DELETE /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:07.396714 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1162/2179] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067484892 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:17:07.402679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-49fffeb5-f24a-45e5-aab3-c06f61d6ad68 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Action: 'create', calling method: .version_select at 0x7f6d60314040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6U4Ko8O7QJIQP284zwu6emYRCPF7E36Cf6nJZnyp3/6husKhRlHDi0ZDCGjeDNTU+spO1FDGyi6Z4pl2g1x/0SnOWRkKDW3Gcklz8m9t8Q8HK81D91Uz4S9Uaz3HHBMg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-49fffeb5-f24a-45e5-aab3-c06f61d6ad68 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Request method failure captured: Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 247 Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlqfm4cZgeeKEwwjB72AHXLFclj6axDPm36e3mq0Xo0lIT0HIIC5rTTi8WZOwqyy8KoOywqzwucYu8d3gNLYN5EfqejP_CH3tQ377bKftbiV8d-e3z7UGIkYnNoLuLrfWtOrB1VtsUGN6F5kM4JCbkfNY1p5azR3z7xxJ8cRZa6wqgM Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e1e38c51e6f4d77bca56538bb4c55fd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6U4Ko8O7QJIQP284zwu6emYRCPF7E36Cf6nJZnyp3/6husKhRlHDi0ZDCGjeDNTU+spO1FDGyi6Z4pl2g1x/0SnOWRkKDW3Gcklz8m9t8Q8HK81D91Uz4S9Uaz3HHBMg=="}} Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6U4Ko8O7QJIQP284zwu6emYRCPF7E36Cf6nJZnyp3/6husKhRlHDi0ZDCGjeDNTU+spO1FDGyi6Z4pl2g1x/0SnOWRkKDW3Gcklz8m9t8Q8HK81D91Uz4S9Uaz3HHBMg=='}}} Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '' Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:17:07.406501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-49fffeb5-f24a-45e5-aab3-c06f61d6ad68 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-49fffeb5-f24a-45e5-aab3-c06f61d6ad68 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009800 Oct 27 10:17:07.410392 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1163/2180] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:17:07 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:17:07.422951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:07.423353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4eed1541-1da7-48c1-9cd6-c7b504b55aad tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Action: 'create', calling method: .version_select at 0x7f6d5ba86a60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1876417918", "public_key": " "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:07.423658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:07.430268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.430754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.431377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.432069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.432753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.433317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.439813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-4eed1541-1da7-48c1-9cd6-c7b504b55aad tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:07.451004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-4eed1541-1da7-48c1-9cd6-c7b504b55aad tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for user 5d03c70eefb848cfaca224cf69db35f6 and project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:07.483552 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4eed1541-1da7-48c1-9cd6-c7b504b55aad tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4eed1541-1da7-48c1-9cd6-c7b504b55aad tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Request method failure captured: Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 95 Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlqfm4cZgeeKEwwjB72AHXLFclj6axDPm36e3mq0Xo0lIT0HIIC5rTTi8WZOwqyy8KoOywqzwucYu8d3gNLYN5EfqejP_CH3tQ377bKftbiV8d-e3z7UGIkYnNoLuLrfWtOrB1VtsUGN6F5kM4JCbkfNY1p5azR3z7xxJ8cRZa6wqgM Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e1e38c51e6f4d77bca56538bb4c55fd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1876417918", "public_key": " "}} Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1876417918', 'public_key': ' '}}} Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.486169 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4eed1541-1da7-48c1-9cd6-c7b504b55aad tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:07.489407 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4eed1541-1da7-48c1-9cd6-c7b504b55aad tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.068193 Oct 27 10:17:07.497271 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1164/2181] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Oct 27 10:17:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:17:07.502668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1deb609b-8763-43b6-b773-966833403b1e tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Action: 'create', calling method: .version_select at 0x7f6d5baf3550>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUNmROirQu4YYUQG0eKyiUC8EtzgodovEbkEe6d7vSHGqz44xO+tcyr4oc+JKtcrqFj8WlAb6Do9OWIA79LoI5YFohaUzW1enDtCcOYWGjBxA2RlQs44l/QX5txpSKorA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1deb609b-8763-43b6-b773-966833403b1e tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Request method failure captured: Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 507 Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlqfm4cZgeeKEwwjB72AHXLFclj6axDPm36e3mq0Xo0lIT0HIIC5rTTi8WZOwqyy8KoOywqzwucYu8d3gNLYN5EfqejP_CH3tQ377bKftbiV8d-e3z7UGIkYnNoLuLrfWtOrB1VtsUGN6F5kM4JCbkfNY1p5azR3z7xxJ8cRZa6wqgM Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e1e38c51e6f4d77bca56538bb4c55fd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUNmROirQu4YYUQG0eKyiUC8EtzgodovEbkEe6d7vSHGqz44xO+tcyr4oc+JKtcrqFj8WlAb6Do9OWIA79LoI5YFohaUzW1enDtCcOYWGjBxA2RlQs44l/QX5txpSKorA=="}} Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUNmROirQu4YYUQG0eKyiUC8EtzgodovEbkEe6d7vSHGqz44xO+tcyr4oc+JKtcrqFj8WlAb6Do9OWIA79LoI5YFohaUzW1enDtCcOYWGjBxA2RlQs44l/QX5txpSKorA=='}}} Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 27 10:17:07.507516 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1deb609b-8763-43b6-b773-966833403b1e tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:07.509895 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1deb609b-8763-43b6-b773-966833403b1e tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010605 Oct 27 10:17:07.515422 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1165/2182] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:17:07 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:17:07.521424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1c8bc9c-dcfa-449d-9498-046afe12576a tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Action: 'create', calling method: .version_select at 0x7f6d5baf3dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1037321060", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:07.545721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d1c8bc9c-dcfa-449d-9498-046afe12576a tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:07.551461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d1c8bc9c-dcfa-449d-9498-046afe12576a tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Getting quotas for user 5d03c70eefb848cfaca224cf69db35f6 and project 7e1e38c51e6f4d77bca56538bb4c55fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:07.570585 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-d1c8bc9c-dcfa-449d-9498-046afe12576a tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1c8bc9c-dcfa-449d-9498-046afe12576a tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Request method failure captured: Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 118 Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlqfm4cZgeeKEwwjB72AHXLFclj6axDPm36e3mq0Xo0lIT0HIIC5rTTi8WZOwqyy8KoOywqzwucYu8d3gNLYN5EfqejP_CH3tQ377bKftbiV8d-e3z7UGIkYnNoLuLrfWtOrB1VtsUGN6F5kM4JCbkfNY1p5azR3z7xxJ8cRZa6wqgM Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e1e38c51e6f4d77bca56538bb4c55fd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1037321060", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1037321060', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 27 10:17:07.572835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 10:17:07.576192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:07.584539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1c8bc9c-dcfa-449d-9498-046afe12576a tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:07.585591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1c8bc9c-dcfa-449d-9498-046afe12576a tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.068362 Oct 27 10:17:07.593959 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1166/2183] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:17:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:17:07.600824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e9aab6b1-05dc-45de-8dbf-60c430996fee req-ffff4e1d-ec0d-438d-b93c-d4b5bf8e48ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d33774-5dae-4e3e-8ebe-25d783fd65c8", "name": "network-vif-deleted", "tag": "409267d5-e4ab-444d-9925-abd53434f4dc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:07.615258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e9aab6b1-05dc-45de-8dbf-60c430996fee req-ffff4e1d-ec0d-438d-b93c-d4b5bf8e48ac service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.616098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e9aab6b1-05dc-45de-8dbf-60c430996fee req-ffff4e1d-ec0d-438d-b93c-d4b5bf8e48ac service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.616929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e9aab6b1-05dc-45de-8dbf-60c430996fee req-ffff4e1d-ec0d-438d-b93c-d4b5bf8e48ac service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.641891 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e9aab6b1-05dc-45de-8dbf-60c430996fee req-ffff4e1d-ec0d-438d-b93c-d4b5bf8e48ac service nova] Creating event network-vif-deleted:409267d5-e4ab-444d-9925-abd53434f4dc for instance e8d33774-5dae-4e3e-8ebe-25d783fd65c8 on n-h2-854663-10 Oct 27 10:17:07.651419 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e9aab6b1-05dc-45de-8dbf-60c430996fee req-ffff4e1d-ec0d-438d-b93c-d4b5bf8e48ac service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055828 Oct 27 10:17:07.653173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1167/2184] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:07.661131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0bfff34-7bdb-4e6a-8b38-39b58ab89df3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ba86ca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:07.722586 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0bfff34-7bdb-4e6a-8b38-39b58ab89df3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.067392 Oct 27 10:17:07.731818 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1168/2185] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:07 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:07.736983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:07.737733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:07.746499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.746990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.747425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.748315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.748940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.749512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:08.219370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:08.233625 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b951050b-7bca-4575-8f2c-02c312b5282f tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1540 microversion: 2.1 time: 0.822122 Oct 27 10:17:08.249175 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1018/2186] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:07 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1540 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:08.258688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac572576-f037-458d-aeee-9e5bbec49392 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Calling method '.version_select at 0x7f6d5ad15820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:08.275576 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ac572576-f037-458d-aeee-9e5bbec49392 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-116059332 not found for user 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac572576-f037-458d-aeee-9e5bbec49392 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Request method failure captured: Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-116059332 HTTP/1.1 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlqfm4cZgeeKEwwjB72AHXLFclj6axDPm36e3mq0Xo0lIT0HIIC5rTTi8WZOwqyy8KoOywqzwucYu8d3gNLYN5EfqejP_CH3tQ377bKftbiV8d-e3z7UGIkYnNoLuLrfWtOrB1VtsUGN6F5kM4JCbkfNY1p5azR3z7xxJ8cRZa6wqgM Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e1e38c51e6f4d77bca56538bb4c55fd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e1e38c51e6f4d77bca56538bb4c55fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 7e1e38c51e6f4d77bca56538bb4c55fd Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2117749933 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2117749933-project Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: exception: Keypair tempest-keypair-non-existent-116059332 not found for user 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'tempest-keypair-non-existent-116059332'} Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-116059332 not found for user 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.278483 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-116059332 not found for user 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-116059332 not found for user 5d03c70eefb848cfaca224cf69db35f6 Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.282642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac572576-f037-458d-aeee-9e5bbec49392 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] Returning 404 to user: Keypair tempest-keypair-non-existent-116059332 not found for user 5d03c70eefb848cfaca224cf69db35f6 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:08.285962 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac572576-f037-458d-aeee-9e5bbec49392 tempest-KeyPairsNegativeTestJSON-2117749933 tempest-KeyPairsNegativeTestJSON-2117749933-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-116059332" status: 404 len: 144 microversion: 2.1 time: 0.035365 Oct 27 10:17:08.295092 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1019/2187] 10.222.0.76 () {58 vars in 1257 bytes} [Thu Oct 27 10:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-116059332 => generated 144 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:17:08.305255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:08.306286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:08.316425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:08.317470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:08.318072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:08.319140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:08.319774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:08.320405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:08.597877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:08.607593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:08.609059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:08.613994 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd2b5b7d-1382-43a6-9762-8b6f9959305d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.884070 Oct 27 10:17:08.621705 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1169/2188] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:07 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:08.626794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:08.636526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:08.643083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:08.643783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:08.644361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:08.645246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:08.655212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:08.655708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:08.748969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:08.762149 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d8d5339-3577-49cb-abaf-3661e1d7eaff tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.462035 Oct 27 10:17:08.762926 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1020/2189] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:08 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:08.778092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5ac7d70-4851-4cfd-9492-a1719abcfc35 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5abac280>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:08.861241 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5ac7d70-4851-4cfd-9492-a1719abcfc35 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.095879 Oct 27 10:17:08.862626 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1021/2190] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:08 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:08.967364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:08.979768 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52cf4812-bb27-4bbe-9cc9-cb82f5afe628 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1317 microversion: 2.1 time: 0.356633 Oct 27 10:17:08.993479 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1170/2191] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:08 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:09.268038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:09.271638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:09.282225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:09.283697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:09.284354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:09.285433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:09.286137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:09.286822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:09.626123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:09.639840 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d232a5f3-9fe8-448d-868e-2692401f4573 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1540 microversion: 2.1 time: 0.381795 Oct 27 10:17:09.652881 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1022/2192] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:09 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1540 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:09.665970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:09.667064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:09.675649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:09.676136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:09.676650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:09.677808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:09.678520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:09.679357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:09.791022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:09.792092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:09.811887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:09.813112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:09.813947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:09.820118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:09.821113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:09.822939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:10.358034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:10.369348 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a876a84d-10e5-4138-89af-6476aa218096 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.583878 Oct 27 10:17:10.371476 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1023/2193] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:09 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:10.378750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f923bc47-c8b1-4c55-94a5-1b081019dff5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b750040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:10.394791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:10.427793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:10.490562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:10.492216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:10.496363 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58c373a1-c374-4ca0-91d9-bdcbebd60fd0 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.835166 Oct 27 10:17:10.498235 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1171/2194] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:09 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:10.508137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:10.515296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:10.521967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f923bc47-c8b1-4c55-94a5-1b081019dff5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.149359 Oct 27 10:17:10.529346 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1024/2195] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:10 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:10.548503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:10.549316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:10.553601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:10.555806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:10.556428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:10.557440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:10.668733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:10.669365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:10.683492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:10.684005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:10.684451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:10.685221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:10.685674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:10.686095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:11.243335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:11.257595 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af008e75-707e-4351-866c-065ba6eb6d1a tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1540 microversion: 2.1 time: 0.589913 Oct 27 10:17:11.258230 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1025/2196] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:10 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1540 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:11.325812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:11.344045 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eef32ac2-8096-4376-9a53-b4a78fe9de46 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1317 microversion: 2.1 time: 0.844388 Oct 27 10:17:11.344646 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1172/2197] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:10 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1317 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:11.405072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:11.406520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:11.427128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:11.427809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:11.429043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:11.429912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:11.430496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:11.431103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:11.529354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:11.531356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:11.554742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:11.555776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:11.556253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:11.557696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:11.561477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:11.571347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:11.803574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:11.852406 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-40c4c0d6-65fa-4046-b989-4a855db418b7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.448586 Oct 27 10:17:11.865255 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1026/2198] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:11 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:11.881451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a168a82b-86c5-4ac6-ba0d-b9a83a9678f0 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b571a60>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:11.992688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a168a82b-86c5-4ac6-ba0d-b9a83a9678f0 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.124491 Oct 27 10:17:11.993973 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1027/2199] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:11 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:12.154009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:12.166265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:12.171262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:12.175090 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c41e4a0a-f605-4d0b-afa9-95a253962c60 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1486 microversion: 2.25 time: 0.651043 Oct 27 10:17:12.188698 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1173/2200] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:11 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1486 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:12.282401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:12.283017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:12.304174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:12.308965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:12.309840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:12.311132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:12.312837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:12.314862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:12.344981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9aaf3f0a-e152-4c5c-86d0-41099f0ef146 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Action: 'create', calling method: .version_select at 0x7f6d5b4ee940>, body: {"keypair": {"name": "tempest-keypair-666823941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxPpHaO+y256cgXN+8Ix8TJcLqyNqOLVFYrFgWkqBgVaHi7PsuAorzleSPGkkm+3nftJmYM2d1vPXRGW4cC9CvqlPwtxKKqZ3u621ooJ+JhZOIK9nd20tuKWQpr31zwXA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:12.383151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-9aaf3f0a-e152-4c5c-86d0-41099f0ef146 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:12.406340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-9aaf3f0a-e152-4c5c-86d0-41099f0ef146 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for user ec031da78d104bcab7477a7ca43444aa and project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:12.482893 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9aaf3f0a-e152-4c5c-86d0-41099f0ef146 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.419619 Oct 27 10:17:12.485082 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1028/2201] 10.222.0.76 () {62 vars in 1199 bytes} [Thu Oct 27 10:17:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 434 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 27 10:17:12.485676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:12.503673 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-903b2f6a-9b46-4b41-b421-823a713c40d6 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1498 microversion: 2.1 time: 0.222131 Oct 27 10:17:12.504992 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1174/2202] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:12 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1498 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:17:12.522411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:12.523781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:12.528252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a2157c9-1618-45b4-a70c-90b8b5b6f6f8 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5ba5ff70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:12.544809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:12.545759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:12.546407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:12.547393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:12.550219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:12.550940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:12.563668 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a2157c9-1618-45b4-a70c-90b8b5b6f6f8 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "GET /compute/v2.1/os-keypairs/tempest-keypair-666823941" status: 200 len: 512 microversion: 2.2 time: 0.051440 Oct 27 10:17:12.567470 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1175/2203] 10.222.0.76 () {60 vars in 1255 bytes} [Thu Oct 27 10:17:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-666823941 => generated 512 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:12.584859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a60b12c5-2342-4721-bdcc-a47f6c49528c tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5baba700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:12.621361 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a60b12c5-2342-4721-bdcc-a47f6c49528c tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-666823941" status: 204 len: 0 microversion: 2.2 time: 0.047132 Oct 27 10:17:12.624253 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1176/2204] 10.222.0.76 () {60 vars in 1258 bytes} [Thu Oct 27 10:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-666823941 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:12.638932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39abae77-5a16-4046-a953-de02f96b74f0 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Action: 'create', calling method: .version_select at 0x7f6d5bab1160>, body: {"keypair": {"name": "tempest-keypair-1136506276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKy4pEj73KxtxO+F+yM1cFfxqoYFz/AREx1uAc9lVsWdW1QoOl+J2qsftgrQ4e+dgk9azH6zdXOSCa29HDtCcXah8c9vjfvOrlFyFKJxZYYaU2tdprBCsv5WvvhXHmicQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:12.686076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-39abae77-5a16-4046-a953-de02f96b74f0 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:12.696183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-39abae77-5a16-4046-a953-de02f96b74f0 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for user ec031da78d104bcab7477a7ca43444aa and project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:12.760680 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39abae77-5a16-4046-a953-de02f96b74f0 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.125210 Oct 27 10:17:12.762696 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1177/2205] 10.222.0.76 () {62 vars in 1199 bytes} [Thu Oct 27 10:17:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 27 10:17:12.774868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3a7fc43-00e4-4bde-8411-bd2f634ba20b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5bab1700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:12.840711 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3a7fc43-00e4-4bde-8411-bd2f634ba20b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136506276" status: 204 len: 0 microversion: 2.2 time: 0.070765 Oct 27 10:17:12.855390 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1178/2206] 10.222.0.76 () {60 vars in 1261 bytes} [Thu Oct 27 10:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136506276 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:12.873786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9324a9de-1658-4197-85c3-68999acdc90e tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Action: 'create', calling method: .version_select at 0x7f6d5bafd0d0>, body: {"keypair": {"name": "tempest-keypair-288619986", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:12.927112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-9324a9de-1658-4197-85c3-68999acdc90e tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:12.943970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-9324a9de-1658-4197-85c3-68999acdc90e tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for user ec031da78d104bcab7477a7ca43444aa and project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:12.954876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:12.966588 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c52cac9-bc9d-4576-91cb-d3d94228c422 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1317 microversion: 2.1 time: 0.479715 Oct 27 10:17:12.974936 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1029/2207] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:12 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:13.008791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:13.009423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:13.029714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.031059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.032039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.033362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.034122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.034694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.040867 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9324a9de-1658-4197-85c3-68999acdc90e tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.178202 Oct 27 10:17:13.044855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1179/2208] 10.222.0.76 () {62 vars in 1199 bytes} [Thu Oct 27 10:17:12 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 183 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 10:17:13.053203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7610f867-1a9f-4b9d-836a-5c0758c97f51 req-ea284b61-9c27-4a32-bf83-016d897ee233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3773dce-56b1-44be-bc19-4e5bdc5ff072", "name": "network-vif-deleted", "tag": "e638ef34-6ca1-49f2-8ada-7febf4785532"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:13.083775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7610f867-1a9f-4b9d-836a-5c0758c97f51 req-ea284b61-9c27-4a32-bf83-016d897ee233 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.084836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7610f867-1a9f-4b9d-836a-5c0758c97f51 req-ea284b61-9c27-4a32-bf83-016d897ee233 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.087503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7610f867-1a9f-4b9d-836a-5c0758c97f51 req-ea284b61-9c27-4a32-bf83-016d897ee233 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.117700 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7610f867-1a9f-4b9d-836a-5c0758c97f51 req-ea284b61-9c27-4a32-bf83-016d897ee233 service nova] Creating event network-vif-deleted:e638ef34-6ca1-49f2-8ada-7febf4785532 for instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 on n-h1-854663-10 Oct 27 10:17:13.137858 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7610f867-1a9f-4b9d-836a-5c0758c97f51 req-ea284b61-9c27-4a32-bf83-016d897ee233 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091225 Oct 27 10:17:13.150869 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1180/2209] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:13.157166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4ad889c-a08f-4f54-9cbe-d34d42c497bb tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5baba3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:13.239643 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4ad889c-a08f-4f54-9cbe-d34d42c497bb tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.086915 Oct 27 10:17:13.244300 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1181/2210] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:13 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:13.269959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c68ab8d-7989-4389-a87f-296c965e4d93 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d603144c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:13.342133 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c68ab8d-7989-4389-a87f-296c965e4d93 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288619986" status: 204 len: 0 microversion: 2.2 time: 0.082458 Oct 27 10:17:13.352419 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1182/2211] 10.222.0.76 () {60 vars in 1258 bytes} [Thu Oct 27 10:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288619986 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:13.352419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:13.352419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:13.373637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.374137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.374572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.377156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.377156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.380818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.426435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:13.440128 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-454372dc-2343-46e6-9132-73b9c60e6ebb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.440405 Oct 27 10:17:13.440923 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1030/2212] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:12 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:13.463304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-94b707d4-dae5-4d92-857e-402d2fff405e tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Action: 'create', calling method: .version_select at 0x7f6d6375e8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1957956259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIS8FghuhXB3i9QR0XyMlN7pzu7jMt5EbNCN9pvGVt+AXH4EZcIdrB203t3oREdB1QkUaXch3xBLUoZr0mVpdHgxJ6srcqhWZ9xc9k1iSjL2kTy9/TZog6zGJh0ClXO9CA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:13.483715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-94b707d4-dae5-4d92-857e-402d2fff405e tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:13.490986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:13.492691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-94b707d4-dae5-4d92-857e-402d2fff405e tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for user ec031da78d104bcab7477a7ca43444aa and project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:13.536534 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-94b707d4-dae5-4d92-857e-402d2fff405e tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.078500 Oct 27 10:17:13.537448 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1031/2213] 10.222.0.76 () {62 vars in 1199 bytes} [Thu Oct 27 10:17:13 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 10:17:13.543213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:13.544058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:13.551181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.551842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.552280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.553082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.553527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.553946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.669916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:13.679444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.680162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.680275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:13.680906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.681510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lazy-loading 'fault' on Instance uuid c3773dce-56b1-44be-bc19-4e5bdc5ff072 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:17:13.681933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:13.688588 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9f1ed50-1d4e-4680-a117-41a3768dd9f5 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1476 microversion: 2.25 time: 0.338488 Oct 27 10:17:13.689624 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1183/2214] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:13 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1476 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:13.708501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-37b699aa-a774-4a13-a729-25f2b4fa1039 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Action: 'create', calling method: .version_select at 0x7f6d60314670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1807245759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYuQ1ov8kdzPRgMAlHJG1Mgo6uMvb4AWJ3EjF/vh7vSJUWmMFkzIIe7tllDejXlkwkC1tjw36gIJ2cMu44H2kcVyEu2FCh+IRWaU+oFpFFaqfLtCyEht91WStQd+IJWXg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:13.753963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e81a5a542844654a4b517d4c13de3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dd8d17dbe24743a91623359e7ab3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:13.756684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-37b699aa-a774-4a13-a729-25f2b4fa1039 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:13.761936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-37b699aa-a774-4a13-a729-25f2b4fa1039 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for user ec031da78d104bcab7477a7ca43444aa and project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:13.763674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:13.776136 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-061284a7-7b3c-4b64-830f-c4f9ae988084 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 200 len: 1321 microversion: 2.1 time: 0.234794 Oct 27 10:17:13.776786 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1032/2215] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:13 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:13.783320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1caefbec-2b6f-4675-89cc-1f81a7909b5d tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '.version_select at 0x7f6d5b513670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:13.787325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1caefbec-2b6f-4675-89cc-1f81a7909b5d tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.787907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1caefbec-2b6f-4675-89cc-1f81a7909b5d tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.788350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1caefbec-2b6f-4675-89cc-1f81a7909b5d tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.801609 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1caefbec-2b6f-4675-89cc-1f81a7909b5d tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.25 time: 0.023734 Oct 27 10:17:13.802255 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1033/2216] 10.222.0.76 () {60 vars in 1184 bytes} [Thu Oct 27 10:17:13 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:13.827945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:13.828546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:13.839108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.840870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.841693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.842623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.843749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.843915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.851423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:13.880124 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-37b699aa-a774-4a13-a729-25f2b4fa1039 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.189235 Oct 27 10:17:13.880780 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1184/2217] 10.222.0.76 () {62 vars in 1199 bytes} [Thu Oct 27 10:17:13 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 10:17:13.904873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fa0db01-fc80-436e-b23d-0f5df4ae0b47 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Action: 'create', calling method: .version_select at 0x7f6d5bcf5940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-599215263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIeME97zWXb0fiWUk0bRnWwYZTTkvppopeOSd7ReFvzjiOW5zYl9dd+kULXiCqfySK31Ze6+gaAmhuq72QMv712yidLQR3ZKL0uUnwKZU7W//cP+CYxli4eKVVw6Zbo0A=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:13.956807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5fa0db01-fc80-436e-b23d-0f5df4ae0b47 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:13.973540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5fa0db01-fc80-436e-b23d-0f5df4ae0b47 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for user ec031da78d104bcab7477a7ca43444aa and project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:14.028228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] Lazy-loading 'services' on Instance uuid 7232d0b5-da9e-42f8-b828-2fe18f89e60c {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:17:14.043164 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-542f635d-580b-4b79-89d5-863c1a647747 tempest-LiveAutoBlockMigrationV225Test-925858993 tempest-LiveAutoBlockMigrationV225Test-925858993-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1970 microversion: 2.25 time: 0.227909 Oct 27 10:17:14.043772 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1034/2218] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:13 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1970 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:17:14.049245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:14.064632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:14.088294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.094323 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5fa0db01-fc80-436e-b23d-0f5df4ae0b47 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.198574 Oct 27 10:17:14.097177 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1185/2219] 10.222.0.76 () {62 vars in 1199 bytes} [Thu Oct 27 10:17:13 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 10:17:14.097316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.097316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.097316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.097316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.097657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.100350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:14.100350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:14.114663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.115206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.115662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.116417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.116902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.117334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.221929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:17:14.384864 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd7b1c31-40a9-4aed-9cd6-051255f0828d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 204 len: 0 microversion: 2.25 time: 0.288533 Oct 27 10:17:14.386015 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1186/2220] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:17:14 2022] DELETE /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:17:14.392347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30a36aa4-815e-4b3e-9460-07dd07b7914f tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5bcf5d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:14.397990 n-d-854663-10 devstack@n-api.service[120720]: WARNING oslo_db.sqlalchemy.utils [None req-30a36aa4-815e-4b3e-9460-07dd07b7914f tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 10:17:14.406651 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30a36aa4-815e-4b3e-9460-07dd07b7914f tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.018990 Oct 27 10:17:14.409640 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1187/2221] 10.222.0.76 () {60 vars in 1177 bytes} [Thu Oct 27 10:17:14 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:14.418006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1abefb4-97ae-4615-88f6-e79ffc7ade34 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d61524940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:14.492553 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1abefb4-97ae-4615-88f6-e79ffc7ade34 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.081581 Oct 27 10:17:14.499157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1188/2222] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:14 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:14.513481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:14.514236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:14.532589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.533770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.534502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.542080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.545220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.545924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.568406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:14.583503 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2babd438-e1a3-4064-abc1-15fb88481318 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1317 microversion: 2.1 time: 0.538417 Oct 27 10:17:14.584100 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1035/2223] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:14 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:14.600227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cebdb010-14ef-4d1f-9f0e-eaa132661489 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5b5175e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:14.647393 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cebdb010-14ef-4d1f-9f0e-eaa132661489 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-599215263" status: 204 len: 0 microversion: 2.2 time: 0.059992 Oct 27 10:17:14.651978 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1036/2224] 10.222.0.76 () {60 vars in 1318 bytes} [Thu Oct 27 10:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-599215263 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:14.673713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:14.673713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:14.690729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.691169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.691616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.692372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.707295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.709065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.804755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:14.817158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:14.818657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:14.819989 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c55a6ee1-e56d-4705-a666-0dd3ceb8ff3a tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1482 microversion: 2.25 time: 0.317454 Oct 27 10:17:14.822194 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1189/2225] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:14 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1482 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:14.846503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d2826d24-989f-4a13-9a3e-cb3e8b30d793 req-3545e7f6-4b16-4b1a-be61-109184a29606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef114f37-a4a0-47b8-b0a0-5d75c05d0968", "name": "network-vif-plugged", "status": "completed", "tag": "c7ee09b9-5c53-4520-8a18-fa1dcdb22fb2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:14.875114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d2826d24-989f-4a13-9a3e-cb3e8b30d793 req-3545e7f6-4b16-4b1a-be61-109184a29606 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.875972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d2826d24-989f-4a13-9a3e-cb3e8b30d793 req-3545e7f6-4b16-4b1a-be61-109184a29606 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.876630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d2826d24-989f-4a13-9a3e-cb3e8b30d793 req-3545e7f6-4b16-4b1a-be61-109184a29606 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.906719 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d2826d24-989f-4a13-9a3e-cb3e8b30d793 req-3545e7f6-4b16-4b1a-be61-109184a29606 service nova] Creating event network-vif-plugged:c7ee09b9-5c53-4520-8a18-fa1dcdb22fb2 for instance ef114f37-a4a0-47b8-b0a0-5d75c05d0968 on n-h1-854663-10 Oct 27 10:17:14.919891 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d2826d24-989f-4a13-9a3e-cb3e8b30d793 req-3545e7f6-4b16-4b1a-be61-109184a29606 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087912 Oct 27 10:17:14.923892 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1190/2226] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:14.937227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c11a34bb-594a-40d9-a943-0f241f8ee6ec tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d639a8940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:14.989313 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c11a34bb-594a-40d9-a943-0f241f8ee6ec tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1807245759" status: 204 len: 0 microversion: 2.2 time: 0.063938 Oct 27 10:17:14.990541 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1191/2227] 10.222.0.76 () {60 vars in 1321 bytes} [Thu Oct 27 10:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1807245759 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:14.998923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:15.001551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] [instance: c3773dce-56b1-44be-bc19-4e5bdc5ff072] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:15.019977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:15.021737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:15.023993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:15.025683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:15.028173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:15.034224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:15.058676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:15.069355 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c31f7e08-8eb2-474f-b464-1e1e2dfd7fdb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.408132 Oct 27 10:17:15.080440 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1037/2228] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:14 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:15.096065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e61b1795-c1dd-40ee-9d4d-58d6369d27d1 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5ab53430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:15.103475 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] HTTP exception thrown: Instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 could not be found. Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Request method failure captured: Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 HTTP/1.1 Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlpsZuU1blQVvOQU2wvxRwcn8XrVQhlyim8KOYrwN5zqWvkwAkxI2F0aLBMNmtaaQGlPErXqR0trgIGxMHuPBFsuZZHaY1LPbra-AtoweQflgpQxGYtg6soYNnd1p9xe06Xh5Zhau_rJu5oyMYorFsN52Qapde093Oq6rl29Ua3YvWE Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_50dd8d17dbe24743a91623359e7ab3ea", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50dd8d17dbe24743a91623359e7ab3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 50dd8d17dbe24743a91623359e7ab3ea Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 1e81a5a542844654a4b517d4c13de3c3 Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 could not be found. Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'c3773dce-56b1-44be-bc19-4e5bdc5ff072'} Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 could not be found. Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 could not be found. Oct 27 10:17:15.107825 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.110874 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:15.110874 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.110874 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:15.110874 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:15.110874 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:15.110874 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:15.110874 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:15.110874 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 could not be found. Oct 27 10:17:15.110874 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.113665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] Returning 404 to user: Instance c3773dce-56b1-44be-bc19-4e5bdc5ff072 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:15.114912 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd1aa18c-6bba-44fd-ac33-5d641a24c824 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395 tempest-FloatingIPsAssociationNegativeTestJSON-1737663395-project] 10.222.0.76 "GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072" status: 404 len: 111 microversion: 2.1 time: 0.123122 Oct 27 10:17:15.115996 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1192/2229] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:14 2022] GET /compute/v2.1/servers/c3773dce-56b1-44be-bc19-4e5bdc5ff072 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:17:15.167959 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e61b1795-c1dd-40ee-9d4d-58d6369d27d1 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1957956259" status: 204 len: 0 microversion: 2.2 time: 0.086139 Oct 27 10:17:15.169329 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1038/2230] 10.222.0.76 () {60 vars in 1321 bytes} [Thu Oct 27 10:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1957956259 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:15.181469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-596129ea-391e-4444-b52b-ccf085e2ef76 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Action: 'create', calling method: .version_select at 0x7f6d5b7fc790>, body: {"keypair": {"name": "tempest-keypair-1369280169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKF/f/fXBHzTfXktKXdkfXQQRZoR9XGysSPIAAIPcV1tjaf7BboZSC/KbGuLCXfgxxyXLSiAliRwiRGl9RX+EeRkQKCke7ZwM32p1jiOecls6DWIDQN9nKObj8gh+julw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:15.238441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-596129ea-391e-4444-b52b-ccf085e2ef76 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:15.257047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-596129ea-391e-4444-b52b-ccf085e2ef76 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for user ec031da78d104bcab7477a7ca43444aa and project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:15.322870 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-596129ea-391e-4444-b52b-ccf085e2ef76 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.145789 Oct 27 10:17:15.325180 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1193/2231] 10.222.0.76 () {62 vars in 1199 bytes} [Thu Oct 27 10:17:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 10:17:15.337398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e8758a4-485c-4b44-9194-2f3bdc5d3771 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d63974550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:15.351645 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e8758a4-485c-4b44-9194-2f3bdc5d3771 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "GET /compute/v2.1/os-keypairs/tempest-keypair-1369280169" status: 200 len: 513 microversion: 2.2 time: 0.017354 Oct 27 10:17:15.355191 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1039/2232] 10.222.0.76 () {60 vars in 1258 bytes} [Thu Oct 27 10:17:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1369280169 => generated 513 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:15.366625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f46b236-29b4-4df8-8cee-f35a538b24f2 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5ba5f8b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:15.372723 n-d-854663-10 devstack@n-api.service[120720]: WARNING oslo_db.sqlalchemy.utils [None req-2f46b236-29b4-4df8-8cee-f35a538b24f2 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 10:17:15.406531 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f46b236-29b4-4df8-8cee-f35a538b24f2 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.044290 Oct 27 10:17:15.413330 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1194/2233] 10.222.0.76 () {60 vars in 1177 bytes} [Thu Oct 27 10:17:15 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:15.425341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-97a9182b-4a7f-49f1-b769-cd9c3a43d2b5 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5b468670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:15.492321 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-97a9182b-4a7f-49f1-b769-cd9c3a43d2b5 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369280169" status: 204 len: 0 microversion: 2.2 time: 0.070990 Oct 27 10:17:15.492956 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1040/2234] 10.222.0.76 () {60 vars in 1261 bytes} [Thu Oct 27 10:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369280169 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:15.503352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Action: 'create', calling method: .version_select at 0x7f6d60314040>, body: {"keypair": {"name": "tempest-keypair-2065544118", "type": "x509"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:15.514281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-74e5764f-7668-4624-925b-02839e620e54 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b4004c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:15.557491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:15.586153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for user ec031da78d104bcab7477a7ca43444aa and project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:15.612927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.processutils [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpl8iubnnq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpl8iubnnq/temp.key -subj /CN=ec031da78d104bcab7477a7ca43444aa -extensions v3_req_client {{(pid=120720) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 27 10:17:15.638294 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-74e5764f-7668-4624-925b-02839e620e54 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.126673 Oct 27 10:17:15.639432 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1041/2235] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:15 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:15.656628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:15.657450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:15.666928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:15.667423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:15.667952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:15.668732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:15.669184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:15.669615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:15.971118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.processutils [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpl8iubnnq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpl8iubnnq/temp.key -subj /CN=ec031da78d104bcab7477a7ca43444aa -extensions v3_req_client" returned: 0 in 0.359s {{(pid=120720) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 27 10:17:15.973743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.processutils [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpl8iubnnq/temp.key -password pass: {{(pid=120720) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 27 10:17:16.049873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.processutils [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpl8iubnnq/temp.key -password pass:" returned: 0 in 0.075s {{(pid=120720) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 27 10:17:16.125186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:16.136158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Getting quotas for user ec031da78d104bcab7477a7ca43444aa and project 43b10728cef54fbabf0a4be2c65022cb. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:16.158990 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b34a9a28-0193-4a80-9eed-94c53c99e85b tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.659494 Oct 27 10:17:16.160677 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1195/2236] 10.222.0.76 () {62 vars in 1198 bytes} [Thu Oct 27 10:17:15 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 662 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:16.168923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:16.173727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:16.174682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:16.180896 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-90aa1abe-5949-479f-8974-66ef07408d9a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1317 microversion: 2.1 time: 0.528880 Oct 27 10:17:16.183862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:16.184689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:16.185376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:16.186347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:16.187020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:16.187633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:16.189090 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1042/2237] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:15 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:16.194047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:16.211475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:16.236994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:16.237968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:16.238607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:16.239667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:16.240324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:16.240988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:16.326612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:16.343411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:16.350825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:16.352288 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6897ac4-cbb7-4ae8-a75b-a9b46f5b3c6f tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1440 microversion: 2.25 time: 0.190303 Oct 27 10:17:16.353044 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1196/2238] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:16 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1440 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:16.364135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd3e1405-aebf-4cf0-b41b-8b4123d35721 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5bab13a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:16.386193 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd3e1405-aebf-4cf0-b41b-8b4123d35721 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "GET /compute/v2.1/os-keypairs/tempest-keypair-2065544118" status: 200 len: 1534 microversion: 2.2 time: 0.031914 Oct 27 10:17:16.387140 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1197/2239] 10.222.0.76 () {60 vars in 1258 bytes} [Thu Oct 27 10:17:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2065544118 => generated 1534 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:16.405384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-253bdf41-3565-4ada-ba41-75e7c11dee60 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5ba5ff70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:16.409965 n-d-854663-10 devstack@n-api.service[120720]: WARNING oslo_db.sqlalchemy.utils [None req-253bdf41-3565-4ada-ba41-75e7c11dee60 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 10:17:16.432727 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-253bdf41-3565-4ada-ba41-75e7c11dee60 tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.034364 Oct 27 10:17:16.434133 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1198/2240] 10.222.0.76 () {60 vars in 1177 bytes} [Thu Oct 27 10:17:16 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:17:16.449783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9951bcee-ae0d-4512-9c03-32ad7e841cbd tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] Calling method '.version_select at 0x7f6d5baf3ca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:16.509724 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9951bcee-ae0d-4512-9c03-32ad7e841cbd tempest-KeyPairsV22TestJSON-723793221 tempest-KeyPairsV22TestJSON-723793221-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065544118" status: 204 len: 0 microversion: 2.2 time: 0.068655 Oct 27 10:17:16.511599 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1199/2241] 10.222.0.76 () {60 vars in 1261 bytes} [Thu Oct 27 10:17:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065544118 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:17:16.635646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:16.655365 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-477cb835-9b5d-4900-a4ab-f768d0dc9fd5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.464451 Oct 27 10:17:16.656016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60e7a33b-f110-4a0c-b189-33b19cb101a3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5bafdca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:16.658326 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1043/2242] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:16 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:16.756743 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60e7a33b-f110-4a0c-b189-33b19cb101a3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.105720 Oct 27 10:17:16.757641 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1200/2243] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:16 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:16.925277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-892a851d-02e4-4591-aa24-fb42de5820c9 req-83340c72-9f4a-4084-b983-8a1b08ef08d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7232d0b5-da9e-42f8-b828-2fe18f89e60c", "name": "network-vif-deleted", "tag": "445e30db-5e71-4997-b764-66abde871cfd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:16.949289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-892a851d-02e4-4591-aa24-fb42de5820c9 req-83340c72-9f4a-4084-b983-8a1b08ef08d8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:16.950229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-892a851d-02e4-4591-aa24-fb42de5820c9 req-83340c72-9f4a-4084-b983-8a1b08ef08d8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:16.950897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-892a851d-02e4-4591-aa24-fb42de5820c9 req-83340c72-9f4a-4084-b983-8a1b08ef08d8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:16.984736 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-892a851d-02e4-4591-aa24-fb42de5820c9 req-83340c72-9f4a-4084-b983-8a1b08ef08d8 service nova] Creating event network-vif-deleted:445e30db-5e71-4997-b764-66abde871cfd for instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c on n-h1-854663-10 Oct 27 10:17:17.002076 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-892a851d-02e4-4591-aa24-fb42de5820c9 req-83340c72-9f4a-4084-b983-8a1b08ef08d8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080350 Oct 27 10:17:17.002966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1044/2244] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:17.208887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:17.209760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:17.233377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:17.240645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:17.241278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:17.242113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:17.242618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:17.243058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:17.382919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:17.383667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:17.420832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:17.421342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:17.421788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:17.422517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:17.422972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:17.423397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:18.534925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:18.554840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:18.556343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:18.561214 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b52295d1-594a-4705-a0bd-182ff43331fb tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1265 microversion: 2.25 time: 1.181314 Oct 27 10:17:18.567611 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1045/2245] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:17 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1265 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:17:18.580126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:18.583288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:18.596566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:18.598920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:18.615109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:18.617456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:18.620773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:18.621515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:18.755044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:18.782310 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffe700e2-61b3-47e5-87aa-396e1215e923 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1317 microversion: 2.1 time: 1.578513 Oct 27 10:17:18.782930 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1201/2246] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:17 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1317 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:18.787839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f09ce4a-ef78-4587-ba68-1c2419b204e4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5bf9c8b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:18.905165 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f09ce4a-ef78-4587-ba68-1c2419b204e4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.120886 Oct 27 10:17:18.908578 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1202/2247] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:18 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:19.106625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:19.115680 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3c1e7bd9-3a40-464e-a08b-87b655b20544 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.546028 Oct 27 10:17:19.125004 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1046/2248] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:18 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:19.592298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:19.592993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:19.614203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:19.626745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:19.627750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:19.628536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:19.630683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:19.631120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:19.806940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:19.807720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:19.821093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:19.824654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:19.825380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:19.826410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:19.827689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:19.828840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:19.858052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:19.878262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:19.886743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:19.892001 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38b39d56-33a0-4a7c-9726-6c99acae5969 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1265 microversion: 2.25 time: 0.304921 Oct 27 10:17:19.893414 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1203/2249] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:19 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:19.922039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38c6e5a7-64a1-4a78-bccc-8125d983ecd0 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5bafd0d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:20.010123 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38c6e5a7-64a1-4a78-bccc-8125d983ecd0 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.092899 Oct 27 10:17:20.011321 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1204/2250] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:19 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:20.148093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:20.149182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:20.170548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:20.180876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:20.181572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:20.182586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:20.188854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:20.190086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:20.546717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:20.556389 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87491922-a301-4452-9558-b3812876faa9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1466 microversion: 2.1 time: 0.754604 Oct 27 10:17:20.561186 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1047/2251] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:19 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1466 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:20.586862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-159097f3-9e07-402f-ada5-d006d3c9d7fa tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:20.587790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-159097f3-9e07-402f-ada5-d006d3c9d7fa tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:20.598386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-159097f3-9e07-402f-ada5-d006d3c9d7fa tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:20.601701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-159097f3-9e07-402f-ada5-d006d3c9d7fa tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:20.602292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-159097f3-9e07-402f-ada5-d006d3c9d7fa tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:20.607130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-159097f3-9e07-402f-ada5-d006d3c9d7fa tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:20.607959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-159097f3-9e07-402f-ada5-d006d3c9d7fa tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:20.608553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-159097f3-9e07-402f-ada5-d006d3c9d7fa tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:20.729459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:20.766445 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72df6e9a-934e-4a3b-8b43-79cd1329b1c0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.619381 Oct 27 10:17:20.767860 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1205/2252] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:20 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:20.920607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:20.921383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:20.936565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:20.939213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:20.939681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:20.940511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:20.941171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:20.941601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:21.177787 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-159097f3-9e07-402f-ada5-d006d3c9d7fa tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1619 microversion: 2.1 time: 0.594075 Oct 27 10:17:21.182162 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1048/2253] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:20 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1619 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:17:21.199985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:21.206282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5df52e1d-01e6-4526-944b-f97d4d87afbf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d6375e5e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:21.244937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:21.252209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:21.255630 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b53815e-0f00-4e46-bc8f-050be50a1931 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1265 microversion: 2.25 time: 0.339766 Oct 27 10:17:21.259808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1206/2254] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:20 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1265 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:17:21.347707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5df52e1d-01e6-4526-944b-f97d4d87afbf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.164134 Oct 27 10:17:21.359688 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1049/2255] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:21 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:21.580620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-180467764", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a3771f18-a29a-4d03-97cf-1e23ec142e87"]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:21.725726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:17:21.794871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:21.795569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:21.816399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:21.817634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:21.819003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:21.820795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:21.821565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:21.822156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:22.643185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:22.700401 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d4c6266e-6237-4691-a492-cf943099cc9b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.909417 Oct 27 10:17:22.717394 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1050/2256] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:21 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:17:22.728350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:22.744252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:22.745528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Searching by: {'deleted': False, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:17:22.754523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:22.756476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:22.758506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:22.761085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:22.764355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:22.765025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:22.835626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:17:22.928018 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb297573-3aed-44aa-91e8-15ba4730eb07 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.203606 Oct 27 10:17:22.940999 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1051/2257] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:17:22 2022] GET /compute/v2.1/servers => generated 344 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:22.952912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:22.956401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:22.968447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:22.977207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:22.977755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:22.978518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:22.979010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:22.979442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:23.218721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:17:23.219751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:17:23.220380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:17:23.221511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:17:23.222096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:17:23.244108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:23.248351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:23.248936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:23.249801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:23.250296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:23.250732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:23.314058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:23.334325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:23.347621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:23.388246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:17:23.393160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:17:23.414681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:23.433877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:23.442855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:23.447096 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4dbd0f8a-ce7c-4aca-8ec9-6984240e5eaf tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1265 microversion: 2.25 time: 0.504624 Oct 27 10:17:23.452043 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1052/2258] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:22 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1265 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:23.476040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-524e26ce-55fe-4791-8d0d-3a9660af993a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d6375e5e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:23.506669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:23.512589 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0185ae0e-5e1e-4c53-a7a6-8fba5c093081 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.936789 Oct 27 10:17:23.524855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1207/2259] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:17:23.545095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:23.553598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:23.555037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Searching by: {'deleted': False, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:17:23.586059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:23.586803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:23.587476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:23.589544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:23.592610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:23.593386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:23.603175 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-524e26ce-55fe-4791-8d0d-3a9660af993a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1452 microversion: 2.1 time: 0.144830 Oct 27 10:17:23.614978 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1053/2260] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:23 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:23.621327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b18aff58-27ca-4c75-984c-02bcfbc70e93 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:23.622491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b18aff58-27ca-4c75-984c-02bcfbc70e93 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:23.749247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:17:23.911351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b18aff58-27ca-4c75-984c-02bcfbc70e93 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:23.931839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b18aff58-27ca-4c75-984c-02bcfbc70e93 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1216 microversion: 2.1 time: 0.309510 Oct 27 10:17:23.938904 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1054/2261] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:23 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1216 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:23.956719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:23.965773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:23.972009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:23.999688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:24.000202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:24.000655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:24.005634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:24.006266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:24.006374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:24.006726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:24.006952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:24.007434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:24.728337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:24.736914 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9130bebd-11ce-42ef-857b-a0fd38b66a60 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.796774 Oct 27 10:17:24.740859 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1055/2262] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:23 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:24.752879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:24.754156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:24.774373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:24.776182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:24.781179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:24.782127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:24.783806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:24.787178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.030482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:25.043446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:25.052704 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-afbc5ec5-991e-445e-9981-4eb2b9e9b6f9 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.526155 Oct 27 10:17:25.053286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:25.053648 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1208/2263] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:17:23 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:25.065034 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a07c08bd-7569-41e1-8166-54140803c27b tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1265 microversion: 2.25 time: 0.312645 Oct 27 10:17:25.065350 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1056/2264] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:24 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:25.069133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cc3e835-3973-4efb-9342-6c3349c7f8cc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d63937af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:25.084204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:25.085176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:25.095774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.098436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.099080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.103255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.104007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.104616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.152033 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8cc3e835-3973-4efb-9342-6c3349c7f8cc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1461 microversion: 2.1 time: 0.097026 Oct 27 10:17:25.156934 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1209/2265] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:25 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1461 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:25.165077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2937631-59b0-4601-889c-745d4a9a703e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:25.189495 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2937631-59b0-4601-889c-745d4a9a703e tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028258 Oct 27 10:17:25.191146 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1210/2266] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:17:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:25.202617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ced6fb03-e191-4667-b6ee-502b8e0d452b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5bab19d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:25.224796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:25.235592 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b2807022-01e5-4d88-b774-964ab8c5d536 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1268 microversion: 2.1 time: 0.169032 Oct 27 10:17:25.238441 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1057/2267] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:25 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:25.307355 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ced6fb03-e191-4667-b6ee-502b8e0d452b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 200 len: 1461 microversion: 2.1 time: 0.114915 Oct 27 10:17:25.319723 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1211/2268] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:25 2022] GET /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 1461 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:25.337819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:25.340411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:25.355444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.356325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.357497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.358599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.370937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.371462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.501623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:25.502567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:25.510208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.511044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.511681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.512722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.513734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.514658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.602060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:17:25.616251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:25.731351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:25.736097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:25.779745 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72e1befc-f41d-4221-82e1-36cc01acae17 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1465 microversion: 2.1 time: 0.447501 Oct 27 10:17:25.783908 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1058/2269] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:25 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1465 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:25.790574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:25.791439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:25.802660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.805068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.807236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.809502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.813359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.814029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.816984 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56bb1af2-ffc6-4e14-9ad6-3872a99864dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 204 len: 0 microversion: 2.1 time: 0.321399 Oct 27 10:17:25.823365 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1212/2270] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:17:25 2022] DELETE /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:25.847785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a31ddb8f-f86b-4da7-bef7-4f06b6cdef62 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-667152577"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:25.854769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a31ddb8f-f86b-4da7-bef7-4f06b6cdef62 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:25.876112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31ddb8f-f86b-4da7-bef7-4f06b6cdef62 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.876875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31ddb8f-f86b-4da7-bef7-4f06b6cdef62 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.877360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31ddb8f-f86b-4da7-bef7-4f06b6cdef62 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.878157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31ddb8f-f86b-4da7-bef7-4f06b6cdef62 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.878625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31ddb8f-f86b-4da7-bef7-4f06b6cdef62 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.879053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a31ddb8f-f86b-4da7-bef7-4f06b6cdef62 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:26.204048 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a31ddb8f-f86b-4da7-bef7-4f06b6cdef62 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "POST /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe/action" status: 202 len: 0 microversion: 2.1 time: 0.379026 Oct 27 10:17:26.217072 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1213/2271] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:17:25 2022] POST /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:17:26.225280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:26.226237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:26.236229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:26.239791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:26.240525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:26.241608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:26.243094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:26.245421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:26.715083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:26.726761 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e54e9e38-1558-4503-81cc-259e1a0d3e31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.941044 Oct 27 10:17:26.729077 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1059/2272] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:25 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:26.747161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:26.748065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:26.758236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:26.759402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:26.760532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:26.763439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:26.765523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:26.766838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:26.918133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:26.946942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:26.953408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:26.953938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:26.955449 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-860695ac-989f-42e4-8c31-5bcdcd8e9ccd tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 200 len: 1265 microversion: 2.25 time: 0.224326 Oct 27 10:17:26.958023 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1060/2273] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:26 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:26.967204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70ad4d41-7de4-4ab2-b34a-61a3d1b9851d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b501d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:26.968923 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c460af3-4626-4218-a370-fcbf2a0c9fa7 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1608 microversion: 2.1 time: 0.749988 Oct 27 10:17:26.971016 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1214/2274] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:26 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1608 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:26.987538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:26.989825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:27.010130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:27.011841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:27.012973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:27.014040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:27.015125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:27.015845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:27.083363 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-70ad4d41-7de4-4ab2-b34a-61a3d1b9851d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.124057 Oct 27 10:17:27.083939 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1061/2275] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:26 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:27.126683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:27.171711 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-629aa493-ab12-41e2-bfec-2ff643731c18 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1274 microversion: 2.1 time: 0.199228 Oct 27 10:17:27.187919 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1215/2276] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:26 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:27.755617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:27.756264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:27.776253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:27.776779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:27.777395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:27.778390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:27.781022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:27.781641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:27.990733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:27.992286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 7232d0b5-da9e-42f8-b828-2fe18f89e60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:28.001761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:28.002490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:28.003086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:28.003952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:28.004831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:28.005750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:28.025031 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] HTTP exception thrown: Instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c could not be found. Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Request method failure captured: Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c HTTP/1.1 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWli5Oz5iuH7dVjFcTU7njmE4y9cZkWr37csWaCX7X1YGOv-T5bwlSoJO7cJ2BpUte4Jq9cMJ5_ADAgg9FDFVX94yY0sozYPG3txo2iKkt6T0piJiY8xcBZYnedKlCEelnRihKf4V9u2NgKjr-sdlDeWReFWzBAMe87I54Zakd1uTvCg Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 8e2d013afa6544b3972160d82f111127 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e2d013afa6544b3972160d82f111127"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8e2d013afa6544b3972160d82f111127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8e2d013afa6544b3972160d82f111127", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e2d013afa6544b3972160d82f111127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 8e2d013afa6544b3972160d82f111127 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-LiveAutoBlockMigrationV225Test-1335644460-project Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: dd2f7b7849014a6bae41317a3e68426e Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460-project Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c could not be found. Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '7232d0b5-da9e-42f8-b828-2fe18f89e60c'} Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c could not be found. Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c could not be found. Oct 27 10:17:28.027462 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:28.031375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:28.031375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:28.031375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:28.031375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:28.031375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:28.031375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:28.031375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:28.031375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c could not be found. Oct 27 10:17:28.031375 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:28.033038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Returning 404 to user: Instance 7232d0b5-da9e-42f8-b828-2fe18f89e60c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:28.033449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:28.034082 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90392911-c7ae-4eff-8dc6-e5bfcc7c722d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c" status: 404 len: 111 microversion: 2.25 time: 0.052138 Oct 27 10:17:28.034835 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1216/2277] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:27 2022] GET /compute/v2.1/servers/7232d0b5-da9e-42f8-b828-2fe18f89e60c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:17:28.045788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:28.046878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:28.052849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d93933e-cb63-49f8-8443-8c71c9fa6314 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 0.301863 Oct 27 10:17:28.053698 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1062/2278] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:27 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:28.071330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:28.071839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:28.072301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:28.073068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:28.073514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:28.073931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:28.099847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41b39a0a-8323-4495-ac47-7a9a2745a811 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ad15820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:28.186853 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41b39a0a-8323-4495-ac47-7a9a2745a811 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.091207 Oct 27 10:17:28.187820 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1063/2279] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:28 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:28.204588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:28.205635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:28.222607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:28.223632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:28.224307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:28.225296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:28.225978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:28.226607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:28.326897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:28.339936 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d1c6686f-89e4-4cbd-b141-69ce3d274b42 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1274 microversion: 2.1 time: 0.142380 Oct 27 10:17:28.344817 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1064/2280] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:28 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:28.351115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-cee66449-8c1c-44a4-bf2c-a924b739b5e4 req-0edd869a-9b02-4fb0-a9d1-030679ab16e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2ecebf-5910-45cc-a64b-46987db5e3e7", "name": "network-vif-unplugged", "status": "completed", "tag": "47847440-7b60-4683-a35e-007be8b78338"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:28.367837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cee66449-8c1c-44a4-bf2c-a924b739b5e4 req-0edd869a-9b02-4fb0-a9d1-030679ab16e0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:28.369162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cee66449-8c1c-44a4-bf2c-a924b739b5e4 req-0edd869a-9b02-4fb0-a9d1-030679ab16e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:28.371142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cee66449-8c1c-44a4-bf2c-a924b739b5e4 req-0edd869a-9b02-4fb0-a9d1-030679ab16e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:28.385213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-cee66449-8c1c-44a4-bf2c-a924b739b5e4 req-0edd869a-9b02-4fb0-a9d1-030679ab16e0 service nova] Creating event network-vif-unplugged:47847440-7b60-4683-a35e-007be8b78338 for instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 on n-h1-854663-10 Oct 27 10:17:28.397432 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-cee66449-8c1c-44a4-bf2c-a924b739b5e4 req-0edd869a-9b02-4fb0-a9d1-030679ab16e0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053693 Oct 27 10:17:28.400833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:28.410571 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe031116-061f-4d4b-8cf8-b8789580459f tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1608 microversion: 2.1 time: 0.374419 Oct 27 10:17:28.410895 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1065/2281] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:28.418859 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1217/2282] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:28 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1608 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:29.081877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:29.082825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:29.096397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:29.098127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:29.104038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:29.105166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:29.105848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:29.106514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:29.204268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5ba4f43-fc15-4c63-b628-ea81a6b5bbae tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ae71f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:29.286102 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5ba4f43-fc15-4c63-b628-ea81a6b5bbae tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.085647 Oct 27 10:17:29.303194 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1218/2283] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:29 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:29.368812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:29.369715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:29.415985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:29.416647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:29.417306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:29.418397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:29.433249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:29.433880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:30.839760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:30.850444 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e9fa5ce-ac7c-4507-a24b-f2fccc8d01a5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 1.774427 Oct 27 10:17:30.864821 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1066/2284] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:29 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:30.864821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:30.870490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:30.888555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:30.898483 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87dc784b-763d-4b77-904c-88a016561b31 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 1.533407 Oct 27 10:17:30.899521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:30.900264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:30.901312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:30.902279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:30.902866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:30.903428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:30.909601 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1219/2285] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:29 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:17:30.923585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a87289a5-414e-4d9f-ac34-6b479b0383b4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ae294c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:31.039257 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a87289a5-414e-4d9f-ac34-6b479b0383b4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.128108 Oct 27 10:17:31.040243 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1220/2286] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:30 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:31.173716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:31.183322 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d14ceab6-3da9-4dd3-9331-a20c19fe0a8d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1540 microversion: 2.1 time: 0.327509 Oct 27 10:17:31.183911 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1067/2287] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:30 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1540 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:31.882406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:31.883236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:31.916547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:31.924737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:31.925581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-46446d14-d98b-493d-847d-09f06f12f855 req-2418fe67-b81c-40e9-b048-11d65d656cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4608367-69ad-4d48-9fba-b7affe4d5167", "name": "network-vif-deleted", "tag": "85ebd7c9-da7f-4bed-beb9-ad9438b98979"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:31.926940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:31.930687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:31.934422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:31.939615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:31.961193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-46446d14-d98b-493d-847d-09f06f12f855 req-2418fe67-b81c-40e9-b048-11d65d656cfd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:31.962103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-46446d14-d98b-493d-847d-09f06f12f855 req-2418fe67-b81c-40e9-b048-11d65d656cfd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:31.966934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-46446d14-d98b-493d-847d-09f06f12f855 req-2418fe67-b81c-40e9-b048-11d65d656cfd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:32.020370 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-46446d14-d98b-493d-847d-09f06f12f855 req-2418fe67-b81c-40e9-b048-11d65d656cfd service nova] Creating event network-vif-deleted:85ebd7c9-da7f-4bed-beb9-ad9438b98979 for instance c4608367-69ad-4d48-9fba-b7affe4d5167 on n-h2-854663-10 Oct 27 10:17:32.039789 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-46446d14-d98b-493d-847d-09f06f12f855 req-2418fe67-b81c-40e9-b048-11d65d656cfd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115731 Oct 27 10:17:32.042516 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1068/2288] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:32.067213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:32.073741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:32.117200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:32.117735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:32.118178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:32.118929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:32.119384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:32.119806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:32.781824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:33.213290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:33.235311 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-464a9ea1-0818-4db1-9bd6-88baed4706ed tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1515 microversion: 2.1 time: 1.356372 Oct 27 10:17:33.238019 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1221/2289] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:31 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1515 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:33.256624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-37cbd3e9-4dde-4c08-b6cb-6833f7785b8b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d60381af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:33.266969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:33.284005 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-26c45a95-5bc7-47b2-81ec-7ca09c224f51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 1.225896 Oct 27 10:17:33.288205 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1069/2290] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:32 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:33.325102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:33.333925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:33.364631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:33.365149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:33.365583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:33.366294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:33.366740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:33.382619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:33.413549 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-37cbd3e9-4dde-4c08-b6cb-6833f7785b8b tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.172261 Oct 27 10:17:33.425002 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1222/2291] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:33 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:33.870432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:33.882116 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fa17f75-386f-45ed-8c50-a56dce82c108 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1252 microversion: 2.1 time: 0.589823 Oct 27 10:17:33.892647 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1070/2292] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:33 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1252 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:34.101077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:34.103807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=52 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:34.109507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f98cbf92-3edd-473d-a99d-8f5cd3fa9d3f req-40d1a065-15c0-4432-b691-3daf861e2a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede6f4e8-6d53-490c-bbed-1fd10073a329", "tag": "b224ea12-edab-4ba5-8bf7-5617d73b0b2f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:34.171000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f98cbf92-3edd-473d-a99d-8f5cd3fa9d3f req-40d1a065-15c0-4432-b691-3daf861e2a84 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:34.171808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f98cbf92-3edd-473d-a99d-8f5cd3fa9d3f req-40d1a065-15c0-4432-b691-3daf861e2a84 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:34.177346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f98cbf92-3edd-473d-a99d-8f5cd3fa9d3f req-40d1a065-15c0-4432-b691-3daf861e2a84 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:34.223670 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f98cbf92-3edd-473d-a99d-8f5cd3fa9d3f req-40d1a065-15c0-4432-b691-3daf861e2a84 service nova] Creating event network-changed:b224ea12-edab-4ba5-8bf7-5617d73b0b2f for instance ede6f4e8-6d53-490c-bbed-1fd10073a329 on n-h1-854663-10 Oct 27 10:17:34.242896 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f98cbf92-3edd-473d-a99d-8f5cd3fa9d3f req-40d1a065-15c0-4432-b691-3daf861e2a84 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142335 Oct 27 10:17:34.251752 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1223/2293] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:34.260108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:34.260969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:34.263130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:34.286587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:34.306112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:34.310811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:34.311905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:34.316091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:34.316798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:34.317783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:34.322634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:34.333473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:34.334205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:34.334794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:34.337910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:34.338667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:34.339284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:35.054787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:35.078823 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f0dc681-9f93-4f97-835e-c32c102c4d81 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 0.764436 Oct 27 10:17:35.079913 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1224/2294] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:34 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:35.099701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ce4255e-b560-4bac-8880-dab1cfbed425 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b6830d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:35.233324 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ce4255e-b560-4bac-8880-dab1cfbed425 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.149873 Oct 27 10:17:35.238304 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1225/2295] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:35 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:35.244397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:35.245124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:35.277453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:35.277953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:35.278389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:35.297424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:35.297932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:35.298380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:35.484875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:35.494782 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6eff96fb-0223-4761-90da-dbf8dc460194 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1252 microversion: 2.1 time: 0.255121 Oct 27 10:17:35.502227 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1226/2296] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:35 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1252 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:35.528093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:35.542262 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc97acab-9dcd-4986-ab36-21ae5fee0971 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1521 microversion: 2.1 time: 1.286289 Oct 27 10:17:35.542835 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1071/2297] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:34 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1521 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:36.102383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:36.103010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:36.127716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:36.128207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:36.128643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:36.129446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:36.129895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:36.130323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:36.249599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0cac0c2a-fa0d-4b84-ab83-424b70ee1aae tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b501160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:36.332757 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0cac0c2a-fa0d-4b84-ab83-424b70ee1aae tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.087224 Oct 27 10:17:36.333910 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1072/2298] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:36 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:17:36.674575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a9cef92-e798-4696-bfa5-ba4c75be7403 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Calling method '.version_select at 0x7f6d6375e5e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:36.881995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4a9cef92-e798-4696-bfa5-ba4c75be7403 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/f76bc38deee1496095751cb29814ffa2" status: 200 len: 371 microversion: 2.1 time: 0.518290 Oct 27 10:17:36.885595 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1073/2299] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 10:17:36 2022] GET /compute/v2.1/os-quota-sets/f76bc38deee1496095751cb29814ffa2 => generated 371 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:36.896628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:36.897321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:36.933569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:36.937587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:36.943870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:36.961594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:36.962329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:36.962923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:37.207094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:37.217795 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8c346dd-a663-48d7-ac2e-efff0b4c9ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 1.119359 Oct 27 10:17:37.228623 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1227/2300] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:36 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:37.245877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:37.256069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:37.282467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:37.282966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:37.288240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:37.289023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:37.289487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:37.293909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:37.338990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:37.357041 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df733a71-e895-4fe9-a675-b56b91f97516 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1252 microversion: 2.1 time: 0.465459 Oct 27 10:17:37.362594 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1074/2301] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:36 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1252 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:37.385091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e0dca60-74ac-46b5-a4a0-a1de5126f32e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5b855ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:37.559680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e0dca60-74ac-46b5-a4a0-a1de5126f32e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:37.560285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e0dca60-74ac-46b5-a4a0-a1de5126f32e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:37.561333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e0dca60-74ac-46b5-a4a0-a1de5126f32e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:37.571819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e0dca60-74ac-46b5-a4a0-a1de5126f32e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:37.574979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e0dca60-74ac-46b5-a4a0-a1de5126f32e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:37.575896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e0dca60-74ac-46b5-a4a0-a1de5126f32e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:37.703000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:37.751690 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e0dca60-74ac-46b5-a4a0-a1de5126f32e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/f76bc38deee1496095751cb29814ffa2" status: 200 len: 328 microversion: 2.1 time: 0.387744 Oct 27 10:17:37.760695 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1075/2302] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:17:37 2022] PUT /compute/v2.1/os-quota-sets/f76bc38deee1496095751cb29814ffa2 => generated 328 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:37.775302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:37.776487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:37.806261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:37.807988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:37.809267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:37.813146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:37.814370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:37.816006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:37.896718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:17:38.047354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:38.062744 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a94c6f78-b9a4-486c-8cd8-be3d5a36e4a2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1521 microversion: 2.1 time: 0.828987 Oct 27 10:17:38.070553 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1228/2303] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:37 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1521 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:38.089473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24952048-1333-4efa-ad9c-687b7a1357d9 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b75c1f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:38.168676 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe4bf768-2c81-4335-9593-d695c37091f4 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 204 len: 0 microversion: 2.25 time: 0.406212 Oct 27 10:17:38.169221 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1076/2304] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:17:37 2022] DELETE /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:17:38.203643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-104eb99d-2375-4fe0-82ab-3e223b4aa56e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:38.203893 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24952048-1333-4efa-ad9c-687b7a1357d9 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.132097 Oct 27 10:17:38.209080 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1229/2305] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:38 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:38.244475 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-104eb99d-2375-4fe0-82ab-3e223b4aa56e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-quota-sets/f76bc38deee1496095751cb29814ffa2" status: 202 len: 0 microversion: 2.1 time: 0.066519 Oct 27 10:17:38.245171 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1077/2306] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:17:38 2022] DELETE /compute/v2.1/os-quota-sets/f76bc38deee1496095751cb29814ffa2 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:17:38.251638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-213b9823-add7-437e-a097-c990226b10da req-0ca19b68-c189-4042-a7ac-fc3cfc183461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04509dd-1faf-474a-a02d-fc408bf96fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "77a3d39c-827a-4840-98c9-d82e01a85658"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:38.269830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:38.270643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:38.310858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:38.314455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:38.315894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:38.318003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:38.318735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:38.319946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:38.327420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-213b9823-add7-437e-a097-c990226b10da req-0ca19b68-c189-4042-a7ac-fc3cfc183461 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:38.327937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-213b9823-add7-437e-a097-c990226b10da req-0ca19b68-c189-4042-a7ac-fc3cfc183461 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:38.328380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-213b9823-add7-437e-a097-c990226b10da req-0ca19b68-c189-4042-a7ac-fc3cfc183461 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:38.370756 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-213b9823-add7-437e-a097-c990226b10da req-0ca19b68-c189-4042-a7ac-fc3cfc183461 service nova] Creating event network-vif-unplugged:77a3d39c-827a-4840-98c9-d82e01a85658 for instance d04509dd-1faf-474a-a02d-fc408bf96fe2 on n-h1-854663-10 Oct 27 10:17:38.381646 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-213b9823-add7-437e-a097-c990226b10da req-0ca19b68-c189-4042-a7ac-fc3cfc183461 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153735 Oct 27 10:17:38.383146 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1230/2307] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:38.417933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ff0681d-de7a-4854-b969-af615108ef76 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Calling method '.version_select at 0x7f6d5b75caf0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:38.628922 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ff0681d-de7a-4854-b969-af615108ef76 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/f76bc38deee1496095751cb29814ffa2" status: 200 len: 371 microversion: 2.1 time: 0.233930 Oct 27 10:17:38.631369 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1231/2308] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 10:17:38 2022] GET /compute/v2.1/os-quota-sets/f76bc38deee1496095751cb29814ffa2 => generated 371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:38.643417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:38.649311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:38.676434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:38.679763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:38.680264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:38.681050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:38.681511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:38.681934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:38.891561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:38.919892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:38.927926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:38.936205 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55ebd7e1-c6c6-48d5-baf8-191ab14d11dc tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1733 microversion: 2.25 time: 0.688901 Oct 27 10:17:38.939191 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1078/2309] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:38 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1733 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:38.952143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:38.966064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:38.986250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:38.987081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:38.987741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:38.989607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:38.990330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:38.990978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:39.125223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:39.139190 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f857ae94-07ea-44ef-a31a-a61a43a27a36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 0.505428 Oct 27 10:17:39.141077 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1232/2310] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:38 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:39.202907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:39.218291 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1c9dd9f-cbab-4e8f-8b1a-8bcea4d2c01c tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1252 microversion: 2.1 time: 0.276192 Oct 27 10:17:39.241855 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1079/2311] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:38 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1252 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:39.249496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-04c05b96-c104-4ae9-a424-a448b40dc1fd tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Calling method '.version_select at 0x7f6d5b855ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:39.691202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e314960-d7e2-4b77-9f2b-67028934b78e tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Action: 'create', calling method: .version_select at 0x7f6d5b458160>, body: {"keypair": {"name": "tempest-keypair-1638784853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1QiXG84XWIZxHT2Xw9MF1zaOh4D68MV3aI5dUTnvsLPuK2A3sKxcHYGr02UelcXzG+39FWb4Nn1Q1Rz+Hh8vEbZsXaHjNgs7/fZZ4zjI76kbNC5ygOksQvFL1vdG6NuA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:39.722768 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-04c05b96-c104-4ae9-a424-a448b40dc1fd tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/4367d156d0024469aaf7da6d47f3fced/defaults" status: 200 len: 371 microversion: 2.1 time: 0.479218 Oct 27 10:17:39.730685 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1080/2312] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:17:39 2022] GET /compute/v2.1/os-quota-sets/4367d156d0024469aaf7da6d47f3fced/defaults => generated 371 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:39.736959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:39.746484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:39.767050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7e314960-d7e2-4b77-9f2b-67028934b78e tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Getting quotas for project 7bda1ec06fb9422bba099a7ced95a2a7. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:39.775654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:39.777158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:39.780129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:39.785809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:39.786830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:39.786830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:39.793190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7e314960-d7e2-4b77-9f2b-67028934b78e tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Getting quotas for user 47ee58dbbf0d423bacf779e114c5b08e and project 7bda1ec06fb9422bba099a7ced95a2a7. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:39.878142 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e314960-d7e2-4b77-9f2b-67028934b78e tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.730364 Oct 27 10:17:39.890911 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1233/2313] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:17:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:39.903466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7811129-c153-47c3-b4a2-075325cf0d50 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d61524f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:39.988407 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7811129-c153-47c3-b4a2-075325cf0d50 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.094016 Oct 27 10:17:39.992204 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1234/2314] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:39 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:40.001338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:40.002561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:40.023127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:40.027460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:40.032397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:40.034674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:40.035338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:40.035986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:40.525139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:40.528198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:40.536975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6651a065-f10b-4704-b787-a0399e82bab1 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1521 microversion: 2.1 time: 0.810097 Oct 27 10:17:40.537694 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1081/2315] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:39 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1521 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:40.584436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:40.589285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:40.615746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:40.616250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:40.616758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:40.625442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:40.625977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:40.626439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:40.987349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:41.007218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:41.017410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:41.020294 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc40b822-3949-46c6-bbc3-c4acc23e0c6d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1733 microversion: 2.25 time: 1.026768 Oct 27 10:17:41.048828 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1235/2316] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:39 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1733 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:41.059029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63638166-7f00-4d56-8dd1-d4db8fb2fe9e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5b753af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:41.413660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:41.421917 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c134e44c-4082-4557-8edc-e075a87c73ef tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 0.855604 Oct 27 10:17:41.428556 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1082/2317] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:40 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:41.452577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:41.453256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:41.474953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63638166-7f00-4d56-8dd1-d4db8fb2fe9e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:41.483527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63638166-7f00-4d56-8dd1-d4db8fb2fe9e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:41.484462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:41.484794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63638166-7f00-4d56-8dd1-d4db8fb2fe9e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:41.485544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:41.486186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:41.486865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63638166-7f00-4d56-8dd1-d4db8fb2fe9e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:41.487358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63638166-7f00-4d56-8dd1-d4db8fb2fe9e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:41.487801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63638166-7f00-4d56-8dd1-d4db8fb2fe9e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:41.487919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:41.488593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:41.489216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:41.655977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:41.670517 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b8774963-a76e-481c-8bda-b5a4f450381d tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1252 microversion: 2.1 time: 0.240525 Oct 27 10:17:41.686173 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63638166-7f00-4d56-8dd1-d4db8fb2fe9e tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/55b13f494bb04465bc36061967ad3fd7" status: 200 len: 328 microversion: 2.1 time: 0.623880 Oct 27 10:17:41.686387 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1083/2318] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:41 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1252 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:41.691266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-525703a2-84dc-4d15-8fc8-4673386906ef tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b310a60>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:41.691568 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1236/2319] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:17:41 2022] PUT /compute/v2.1/os-quota-sets/55b13f494bb04465bc36061967ad3fd7 => generated 328 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:41.704827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:41.711135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:41.745424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:41.746299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:41.747423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:41.753896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:41.755236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:41.756431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:41.812983 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-525703a2-84dc-4d15-8fc8-4673386906ef tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.135250 Oct 27 10:17:41.816971 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1084/2320] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:41 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:41.821214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:41.840375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e56423de-cb05-4435-8086-592519c035c3 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Calling method '.version_select at 0x7f6d5b4748b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:41.949754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e56423de-cb05-4435-8086-592519c035c3 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:41.965433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e56423de-cb05-4435-8086-592519c035c3 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:41.965897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e56423de-cb05-4435-8086-592519c035c3 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:41.966786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e56423de-cb05-4435-8086-592519c035c3 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:41.967304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e56423de-cb05-4435-8086-592519c035c3 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:41.967745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e56423de-cb05-4435-8086-592519c035c3 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:42.027495 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e56423de-cb05-4435-8086-592519c035c3 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/55b13f494bb04465bc36061967ad3fd7/detail" status: 200 len: 916 microversion: 2.1 time: 0.205041 Oct 27 10:17:42.028926 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1085/2321] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:17:41 2022] GET /compute/v2.1/os-quota-sets/55b13f494bb04465bc36061967ad3fd7/detail => generated 916 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:42.051397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:42.052287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:42.066575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:42.069279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:42.069963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:42.077014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:42.079661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:42.080336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:42.480920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:42.511620 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28aaef14-985a-40cf-afa3-dd665252f2d4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1521 microversion: 2.1 time: 0.818412 Oct 27 10:17:42.516137 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1237/2322] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:41 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1521 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:42.543137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5b458ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:42.705320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:42.706866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:42.707592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:42.708677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:42.709787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:42.710458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:42.864717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:42.865789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:42.867126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:42.869895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:42.871284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:42.873241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:42.880367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:42.899014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:42.900687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:42.901960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d9e0df2f-27c3-43f7-9cf4-b8a2e769adb3 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1733 microversion: 2.25 time: 0.854959 Oct 27 10:17:42.909263 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1086/2323] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:42 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1733 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:17:42.932172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:42.958242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:42.970621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:42.973099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:42.975271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:42.984622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:42.985874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:42.986581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:43.042141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:43.125059 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48c1888b-e878-40be-b010-56c5c5a72d12 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/55b13f494bb04465bc36061967ad3fd7?user_id=c92c5a7cc02f4f96aad77047246c78d3" status: 200 len: 328 microversion: 2.1 time: 0.604944 Oct 27 10:17:43.126501 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1238/2324] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:17:42 2022] PUT /compute/v2.1/os-quota-sets/55b13f494bb04465bc36061967ad3fd7?user_id=c92c5a7cc02f4f96aad77047246c78d3 => generated 328 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:43.137303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:43.138158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:43.194053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:43.195095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:43.196067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:43.198346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:43.198346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:43.198346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:44.111157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:44.125301 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb36b024-dc10-499f-a75b-7f42fae5b4f3 tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1252 microversion: 2.1 time: 0.997320 Oct 27 10:17:44.147435 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1239/2325] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:43 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1252 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:44.152613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7862b1e7-3b81-4163-8c99-8e16ccfe1f12 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d639a89d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:44.155699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:44.168730 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f0570c58-d143-4c52-bc5b-ca5a327b6aca tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 1.257712 Oct 27 10:17:44.170196 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1087/2326] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:42 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:44.179221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b252152-28d6-46d2-914b-0795d0963b1c tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Calling method '.version_select at 0x7f6d5b2d54c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:44.268106 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7862b1e7-3b81-4163-8c99-8e16ccfe1f12 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.119333 Oct 27 10:17:44.273816 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1240/2327] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:44 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:44.284429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5952afe6-9d5c-4c45-b9d5-9b4641e7e4d4 req-23954fa2-1798-4add-afd2-45203442b4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c30935-9c9d-4098-bb50-beeb93a1edbe", "name": "network-vif-plugged", "status": "completed", "tag": "1b3185dc-06ff-479d-8971-a9d01cf40ea7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:44.349670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5952afe6-9d5c-4c45-b9d5-9b4641e7e4d4 req-23954fa2-1798-4add-afd2-45203442b4ca service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:44.352457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5952afe6-9d5c-4c45-b9d5-9b4641e7e4d4 req-23954fa2-1798-4add-afd2-45203442b4ca service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:44.353738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5952afe6-9d5c-4c45-b9d5-9b4641e7e4d4 req-23954fa2-1798-4add-afd2-45203442b4ca service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:44.393064 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5952afe6-9d5c-4c45-b9d5-9b4641e7e4d4 req-23954fa2-1798-4add-afd2-45203442b4ca service nova] Creating event network-vif-plugged:1b3185dc-06ff-479d-8971-a9d01cf40ea7 for instance 45c30935-9c9d-4098-bb50-beeb93a1edbe on n-h1-854663-10 Oct 27 10:17:44.414693 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5952afe6-9d5c-4c45-b9d5-9b4641e7e4d4 req-23954fa2-1798-4add-afd2-45203442b4ca service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138786 Oct 27 10:17:44.419828 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1241/2328] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:44.434639 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b252152-28d6-46d2-914b-0795d0963b1c tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/55b13f494bb04465bc36061967ad3fd7?user_id=c92c5a7cc02f4f96aad77047246c78d3" status: 200 len: 370 microversion: 2.1 time: 0.263075 Oct 27 10:17:44.441050 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1088/2329] 10.222.0.76 () {58 vars in 1323 bytes} [Thu Oct 27 10:17:44 2022] GET /compute/v2.1/os-quota-sets/55b13f494bb04465bc36061967ad3fd7?user_id=c92c5a7cc02f4f96aad77047246c78d3 => generated 370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:44.458371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:44.459209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:44.459952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:44.460569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:44.474112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:44.474876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:44.475470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:44.478184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:44.480238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:44.482566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:44.482970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:44.483162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:44.483759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:44.490214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:44.490787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:44.491227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:44.997029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:45.021656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:45.033542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:45.044605 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2dfd2fcc-b25a-42e3-b791-d05e86c28875 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1665 microversion: 2.25 time: 0.594998 Oct 27 10:17:45.053104 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1089/2330] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:44 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1665 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:45.150117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:45.151085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:45.165764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:45.167084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:45.168579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:45.170578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:45.173320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:45.179394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:45.549411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cbe7895b4f47deb85d169990050d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc167a3f85d6418a81b90bcca09977d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:45.573224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef7d1c23-9942-43e1-8c60-0b8535aa14dd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 200 len: 1252 microversion: 2.1 time: 0.425971 Oct 27 10:17:45.589220 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1090/2331] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:45 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 1252 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:17:45.601920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:45.602605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:45.629969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:45.635959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:45.636521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:45.640583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:45.645780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:45.646290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:45.706370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:45.721383 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57de57f9-b05c-453b-8793-e1cd3005d1d0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1521 microversion: 2.1 time: 1.299388 Oct 27 10:17:45.774248 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1242/2332] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:44 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1521 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:45.790297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0e14c5c-d2dc-4a3a-b545-939a3386523f tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5bc4b310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:45.925923 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0e14c5c-d2dc-4a3a-b545-939a3386523f tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.148830 Oct 27 10:17:45.927517 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1243/2333] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:45 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:45.942586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b65a479-1028-4bac-8448-3e32c258bc5b tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Calling method '.version_select at 0x7f6d5ba5fd30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:46.315322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:46.362790 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-982eaae7-4109-416a-aaf7-8066b09ee9f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 0.779977 Oct 27 10:17:46.383527 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1091/2334] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:45 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:46.399292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:46.404940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:46.417031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.418200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.418867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.420127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.421743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.422512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.578112 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b65a479-1028-4bac-8448-3e32c258bc5b tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/4367d156d0024469aaf7da6d47f3fced/defaults" status: 200 len: 371 microversion: 2.1 time: 0.648870 Oct 27 10:17:46.585857 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1244/2335] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:17:45 2022] GET /compute/v2.1/os-quota-sets/4367d156d0024469aaf7da6d47f3fced/defaults => generated 371 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:46.593728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6545a5ea-111b-44a9-a858-c2c6f4021d97 req-c26113f3-2839-46d2-9dc9-6e88c0fc6f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04509dd-1faf-474a-a02d-fc408bf96fe2", "name": "network-vif-plugged", "status": "completed", "tag": "77a3d39c-827a-4840-98c9-d82e01a85658"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:46.608126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6545a5ea-111b-44a9-a858-c2c6f4021d97 req-c26113f3-2839-46d2-9dc9-6e88c0fc6f51 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.608765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6545a5ea-111b-44a9-a858-c2c6f4021d97 req-c26113f3-2839-46d2-9dc9-6e88c0fc6f51 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.610125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6545a5ea-111b-44a9-a858-c2c6f4021d97 req-c26113f3-2839-46d2-9dc9-6e88c0fc6f51 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.621058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:46.639121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:46.642350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:46.646410 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-63cf8cd6-adab-4654-96f9-29d378b72d0d tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 200 len: 1665 microversion: 2.25 time: 0.260081 Oct 27 10:17:46.656740 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1092/2336] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:46 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 1665 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:17:46.657231 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6545a5ea-111b-44a9-a858-c2c6f4021d97 req-c26113f3-2839-46d2-9dc9-6e88c0fc6f51 service nova] Creating event network-vif-plugged:77a3d39c-827a-4840-98c9-d82e01a85658 for instance d04509dd-1faf-474a-a02d-fc408bf96fe2 on n-h1-854663-10 Oct 27 10:17:46.660556 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6545a5ea-111b-44a9-a858-c2c6f4021d97 req-c26113f3-2839-46d2-9dc9-6e88c0fc6f51 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079567 Oct 27 10:17:46.661426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-239b9db7-ff88-404a-8faa-084af1d23322 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5acd5f70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:46.668699 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1245/2337] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:46.680273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:46.685042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] [instance: c4608367-69ad-4d48-9fba-b7affe4d5167] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:46.704382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.705919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.706718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.708247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.709406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.710403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.739199 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] HTTP exception thrown: Instance c4608367-69ad-4d48-9fba-b7affe4d5167 could not be found. Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Request method failure captured: Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 HTTP/1.1 Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlomNVoR6GI5VWfMdtKw3XMYQGZR8QlvTWe01G9I9yfsBfCmxAHgBZZYIe-LAZUdnDCUEfVc_UroAHtrY3HhbTf7WkjK6ghuFj4PmgkqSrYdL1OZgs4L6Orqq0pkOJyglbT1IRL-B09K4xWk58DJ3Dkbc0Dhnu-YwOP6tQCPzJ2m0cc Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: cc167a3f85d6418a81b90bcca09977d3 Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestBootFromVolume-967465807 Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cc167a3f85d6418a81b90bcca09977d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cc167a3f85d6418a81b90bcca09977d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cc167a3f85d6418a81b90bcca09977d3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cc167a3f85d6418a81b90bcca09977d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestBootFromVolume-967465807 Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: cc167a3f85d6418a81b90bcca09977d3 Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestBootFromVolume-967465807 Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestBootFromVolume-967465807-project Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: a5cbe7895b4f47deb85d169990050d3d Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestBootFromVolume-967465807-project Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance c4608367-69ad-4d48-9fba-b7affe4d5167 could not be found. Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'c4608367-69ad-4d48-9fba-b7affe4d5167'} Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4608367-69ad-4d48-9fba-b7affe4d5167 could not be found. Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4608367-69ad-4d48-9fba-b7affe4d5167 could not be found. Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:46.748148 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:46.752610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:46.752610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:46.752610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:46.752610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:46.752610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:46.752610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4608367-69ad-4d48-9fba-b7affe4d5167 could not be found. Oct 27 10:17:46.752610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:46.756310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Returning 404 to user: Instance c4608367-69ad-4d48-9fba-b7affe4d5167 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:46.759384 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fbd67e3-83e2-4f02-8274-20f12aa2f8fd tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167" status: 404 len: 111 microversion: 2.1 time: 0.088737 Oct 27 10:17:46.765034 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1246/2338] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:46 2022] GET /compute/v2.1/servers/c4608367-69ad-4d48-9fba-b7affe4d5167 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:17:46.771101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6caa13a7-6465-4d5e-b400-5105905d77b0 req-1d4d8fcd-dc48-47d4-9022-9ebd45a5e36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029ff781-574b-48de-9033-cd8e69e64ec2", "name": "network-vif-deleted", "tag": "9d537db4-55a5-4b36-81b4-2f467d976981"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:46.784375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6caa13a7-6465-4d5e-b400-5105905d77b0 req-1d4d8fcd-dc48-47d4-9022-9ebd45a5e36e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.786118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6caa13a7-6465-4d5e-b400-5105905d77b0 req-1d4d8fcd-dc48-47d4-9022-9ebd45a5e36e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.787133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6caa13a7-6465-4d5e-b400-5105905d77b0 req-1d4d8fcd-dc48-47d4-9022-9ebd45a5e36e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.805438 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6caa13a7-6465-4d5e-b400-5105905d77b0 req-1d4d8fcd-dc48-47d4-9022-9ebd45a5e36e service nova] Creating event network-vif-deleted:9d537db4-55a5-4b36-81b4-2f467d976981 for instance 029ff781-574b-48de-9033-cd8e69e64ec2 on n-h1-854663-10 Oct 27 10:17:46.831370 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6caa13a7-6465-4d5e-b400-5105905d77b0 req-1d4d8fcd-dc48-47d4-9022-9ebd45a5e36e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048387 Oct 27 10:17:46.832961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-239b9db7-ff88-404a-8faa-084af1d23322 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.835117 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1247/2339] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:46.839137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-239b9db7-ff88-404a-8faa-084af1d23322 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.840347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-239b9db7-ff88-404a-8faa-084af1d23322 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.843842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-239b9db7-ff88-404a-8faa-084af1d23322 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.847244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-239b9db7-ff88-404a-8faa-084af1d23322 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.847881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-239b9db7-ff88-404a-8faa-084af1d23322 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.860063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:46.863485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:46.890759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.892227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.892691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.897457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.897940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.901740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:47.494826 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-239b9db7-ff88-404a-8faa-084af1d23322 tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/4367d156d0024469aaf7da6d47f3fced" status: 200 len: 329 microversion: 2.1 time: 0.842290 Oct 27 10:17:47.503042 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1093/2340] 10.222.0.76 () {60 vars in 1263 bytes} [Thu Oct 27 10:17:46 2022] PUT /compute/v2.1/os-quota-sets/4367d156d0024469aaf7da6d47f3fced => generated 329 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:47.509801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4311be6-f306-404e-910b-f13464fbec0b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] Calling method '.version_select at 0x7f6d5b4ee310>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:47.518890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:47.527819 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bec6b19-9cb1-4f85-98b1-8073c40272dc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1521 microversion: 2.1 time: 0.688973 Oct 27 10:17:47.534502 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1248/2341] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:46 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1521 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:47.551300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d8a00e9-1f43-4795-8b3d-d01af54ae5fc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b683700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:47.593376 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4311be6-f306-404e-910b-f13464fbec0b tempest-ServersTestBootFromVolume-967465807 tempest-ServersTestBootFromVolume-967465807-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-969432771" status: 202 len: 0 microversion: 2.1 time: 0.095339 Oct 27 10:17:47.593935 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1094/2342] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-969432771 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:17:47.601829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:47.602446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:47.631004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:47.631465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:47.631901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:47.632699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:47.633086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:47.633505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:47.652073 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d8a00e9-1f43-4795-8b3d-d01af54ae5fc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.116473 Oct 27 10:17:47.652916 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1249/2343] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:47 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:47.675210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5aade600-2a38-4b02-9efa-cf842b0857cc tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5b7fc310>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:47.835984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5aade600-2a38-4b02-9efa-cf842b0857cc tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:47.836620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5aade600-2a38-4b02-9efa-cf842b0857cc tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:47.837001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5aade600-2a38-4b02-9efa-cf842b0857cc tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:47.837617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5aade600-2a38-4b02-9efa-cf842b0857cc tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:47.838231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5aade600-2a38-4b02-9efa-cf842b0857cc tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:47.838800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5aade600-2a38-4b02-9efa-cf842b0857cc tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:48.760744 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5aade600-2a38-4b02-9efa-cf842b0857cc tempest-QuotasAdminTestJSON-1826968978 tempest-QuotasAdminTestJSON-1826968978-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-sets/4367d156d0024469aaf7da6d47f3fced" status: 200 len: 329 microversion: 2.1 time: 1.090763 Oct 27 10:17:48.766363 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1250/2344] 10.222.0.76 () {60 vars in 1263 bytes} [Thu Oct 27 10:17:47 2022] PUT /compute/v2.1/os-quota-sets/4367d156d0024469aaf7da6d47f3fced => generated 329 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:48.788781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:48.791535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 029ff781-574b-48de-9033-cd8e69e64ec2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:48.817639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:48.821924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:48.824075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:48.825040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:48.826770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:48.828509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:48.873512 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] HTTP exception thrown: Instance 029ff781-574b-48de-9033-cd8e69e64ec2 could not be found. Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Request method failure captured: Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 HTTP/1.1 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWli5Oz5iuH7dVjFcTU7njmE4y9cZkWr37csWaCX7X1YGOv-T5bwlSoJO7cJ2BpUte4Jq9cMJ5_ADAgg9FDFVX94yY0sozYPG3txo2iKkt6T0piJiY8xcBZYnedKlCEelnRihKf4V9u2NgKjr-sdlDeWReFWzBAMe87I54Zakd1uTvCg Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 8e2d013afa6544b3972160d82f111127 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e2d013afa6544b3972160d82f111127"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8e2d013afa6544b3972160d82f111127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8e2d013afa6544b3972160d82f111127", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e2d013afa6544b3972160d82f111127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 8e2d013afa6544b3972160d82f111127 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-LiveAutoBlockMigrationV225Test-1335644460-project Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: dd2f7b7849014a6bae41317a3e68426e Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460-project Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 029ff781-574b-48de-9033-cd8e69e64ec2 could not be found. Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '029ff781-574b-48de-9033-cd8e69e64ec2'} Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029ff781-574b-48de-9033-cd8e69e64ec2 could not be found. Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029ff781-574b-48de-9033-cd8e69e64ec2 could not be found. Oct 27 10:17:48.880629 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:48.884796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:48.884796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:48.884796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:48.884796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:48.884796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:48.884796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:48.884796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:48.884796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029ff781-574b-48de-9033-cd8e69e64ec2 could not be found. Oct 27 10:17:48.884796 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:17:48.890466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Returning 404 to user: Instance 029ff781-574b-48de-9033-cd8e69e64ec2 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:48.892559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa2469ae-3ca6-4ec5-a736-f536e3fe7e08 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2" status: 404 len: 111 microversion: 2.25 time: 0.122901 Oct 27 10:17:48.896007 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1251/2345] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:17:48 2022] GET /compute/v2.1/servers/029ff781-574b-48de-9033-cd8e69e64ec2 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:17:48.912351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "3b0e5151-25af-4a67-a87f-df86b9b3e73f"}], "security_groups": [{"name": "tempest-securitygroup--143224759"}], "key_name": "tempest-keypair-1638784853", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:48.976266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:49.002865 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c822caab-41da-416b-95e7-aebd34947610 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 1.404534 Oct 27 10:17:49.003650 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1095/2346] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:47 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:49.009977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:49.019678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:49.048182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:49.057212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:49.059793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:49.064322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:49.065153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:49.065912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:49.312729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] validate_networks() for [('3b0e5151-25af-4a67-a87f-df86b9b3e73f', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:17:49.852317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:49.873288 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0f12a13-0fce-4eab-9039-10a757d2dd1a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1521 microversion: 2.1 time: 0.868418 Oct 27 10:17:49.877549 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1096/2347] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:49 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1521 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:49.893886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e8124549-90e3-4a4b-830f-2db726b21d0a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b2fe3a0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:49.993399 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e8124549-90e3-4a4b-830f-2db726b21d0a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.106238 Oct 27 10:17:49.998139 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1097/2348] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:49 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:50.009343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef26cb25-e48a-4e40-8cbd-4721a11923c1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '.version_select at 0x7f6d6375e160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:50.059595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=14 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:50.115989 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef26cb25-e48a-4e40-8cbd-4721a11923c1 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353544103" status: 204 len: 0 microversion: 2.25 time: 0.116518 Oct 27 10:17:50.120220 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1098/2349] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:17:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353544103 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:17:50.133054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-d0e2f4b0-93bf-44e3-a01d-0223157d793d req-13ce2528-7658-4a4f-89dc-d85f4f3b5e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede6f4e8-6d53-490c-bbed-1fd10073a329", "name": "network-vif-plugged", "status": "completed", "tag": "b224ea12-edab-4ba5-8bf7-5617d73b0b2f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:50.169977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d0e2f4b0-93bf-44e3-a01d-0223157d793d req-13ce2528-7658-4a4f-89dc-d85f4f3b5e04 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:50.170639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d0e2f4b0-93bf-44e3-a01d-0223157d793d req-13ce2528-7658-4a4f-89dc-d85f4f3b5e04 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:50.171100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d0e2f4b0-93bf-44e3-a01d-0223157d793d req-13ce2528-7658-4a4f-89dc-d85f4f3b5e04 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:50.210045 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-d0e2f4b0-93bf-44e3-a01d-0223157d793d req-13ce2528-7658-4a4f-89dc-d85f4f3b5e04 service nova] Creating event network-vif-plugged:b224ea12-edab-4ba5-8bf7-5617d73b0b2f for instance ede6f4e8-6d53-490c-bbed-1fd10073a329 on n-h1-854663-10 Oct 27 10:17:50.227656 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-d0e2f4b0-93bf-44e3-a01d-0223157d793d req-13ce2528-7658-4a4f-89dc-d85f4f3b5e04 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103257 Oct 27 10:17:50.228384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1099/2350] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:50.234342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:50.240438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:50.252351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:50.256247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:50.256926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:50.257824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:50.258458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:50.261269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:50.924870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:50.939971 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8fd47be9-79d4-48fd-92d0-77891339ea7c tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1316 microversion: 2.1 time: 0.710232 Oct 27 10:17:50.949067 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1100/2351] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:50 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1316 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:50.963878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:50.964516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:50.994364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:50.995541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:51.001579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:51.003533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:51.004230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:51.004873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:51.769511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:51.798180 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be40388a-fc30-4203-8749-c989b1ede525 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1506 microversion: 2.1 time: 0.847806 Oct 27 10:17:51.799114 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1101/2352] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:50 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1506 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:51.825706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f20124d-8a31-4145-82ff-43a9c6f3431c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b4171f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:51.913151 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f20124d-8a31-4145-82ff-43a9c6f3431c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.109228 Oct 27 10:17:51.922186 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1102/2353] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:51 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:51.934054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:51.934956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:51.950136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:51.951137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:51.951784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:51.954607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:51.955770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:51.957523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:52.862574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:17:52.863070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:17:52.863494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:17:52.863908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:17:52.864325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:17:52.888195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:52.888719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:52.889168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:52.899227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:52.899734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:52.900187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:52.903654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:52.914075 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71fe0bff-7eb6-4655-97e5-7c0877582d31 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 200 len: 1506 microversion: 2.1 time: 0.990451 Oct 27 10:17:52.934094 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1103/2354] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:51 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 1506 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:52.934915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:52.960690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:52.976856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:52.989722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Getting quotas for project 7bda1ec06fb9422bba099a7ced95a2a7. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:52.993395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:52.999772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:53.002088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:53.003865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:53.010053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:53.011452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Getting quotas for user 47ee58dbbf0d423bacf779e114c5b08e and project 7bda1ec06fb9422bba099a7ced95a2a7. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:53.014156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:53.066912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:17:53.084331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:17:53.250658 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7aa362e5-c8bf-480f-bf72-98ddc03a7521 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.349553 Oct 27 10:17:53.254831 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1252/2355] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:17:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 4357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:17:53.921434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59ec4b89-7b4b-40cb-aab0-4df195b8a96b tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Action: 'create', calling method: .version_select at 0x7f6d5bab19d0>, body: {"pool": null} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:53.965635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:53.990871 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0295f73-e924-4dfb-b1e3-1f94e6227a0b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1465 microversion: 2.1 time: 1.048084 Oct 27 10:17:53.993105 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1104/2356] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:52 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1465 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:54.016347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59e64711-6ae4-4ae3-880e-8043d9119cf7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b468550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:54.136865 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59e64711-6ae4-4ae3-880e-8043d9119cf7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.137074 Oct 27 10:17:54.137905 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1105/2357] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:17:53 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:54.162135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:54.163996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:54.181699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:54.183667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:54.184689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:54.185850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:54.186869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:54.187755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:54.279415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:17:54.315353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:54.537598 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0c92619-25d5-469d-bcf9-d1fd1016a349 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 204 len: 0 microversion: 2.1 time: 0.395900 Oct 27 10:17:54.543032 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1106/2358] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:17:54 2022] DELETE /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:54.613966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:54.613966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:54.708971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:54.708971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:54.708971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:54.708971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:54.708971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:54.708971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:55.797498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:55.809732 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bdf63b8a-ac4a-4f03-90b8-c18b9f6fe37c tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1230 microversion: 2.1 time: 1.222300 Oct 27 10:17:55.828179 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1107/2359] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:54 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1230 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:55.838493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8a64df47-80c9-444c-b6a1-d061a552cc95 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:55.843990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a64df47-80c9-444c-b6a1-d061a552cc95 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:55.863933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a64df47-80c9-444c-b6a1-d061a552cc95 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:55.864733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a64df47-80c9-444c-b6a1-d061a552cc95 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:55.865379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a64df47-80c9-444c-b6a1-d061a552cc95 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:55.866277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a64df47-80c9-444c-b6a1-d061a552cc95 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:55.866921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a64df47-80c9-444c-b6a1-d061a552cc95 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:55.867518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a64df47-80c9-444c-b6a1-d061a552cc95 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:56.895725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:56.910440 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8a64df47-80c9-444c-b6a1-d061a552cc95 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1618 microversion: 2.1 time: 1.080560 Oct 27 10:17:56.913036 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1108/2360] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:55 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1618 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:56.930492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:56.931276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:56.953908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:56.955238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:56.956838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:56.978772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:56.979719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:56.987667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:57.130337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:17:57.479405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=50 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:57.486711 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-63b3f39b-7bcb-4cb2-9c7c-d83cc5cd45ba tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 204 len: 0 microversion: 2.25 time: 0.571998 Oct 27 10:17:57.493754 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1109/2361] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:17:56 2022] DELETE /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:17:57.507081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1688960803", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "a083a069-1c5f-4798-ae6e-612bd2e50580"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:57.705666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] validate_networks() for [('a083a069-1c5f-4798-ae6e-612bd2e50580', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:18:00.248409 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59ec4b89-7b4b-40cb-aab0-4df195b8a96b tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.992199 Oct 27 10:18:00.255235 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1253/2362] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:17:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:00.272708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d09a89a-1bca-4e19-bdd1-128aa3bb8259 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b4500d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:00.403828 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d09a89a-1bca-4e19-bdd1-128aa3bb8259 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.146646 Oct 27 10:18:00.406388 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1254/2363] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:00 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:00.417163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:00.418073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:00.429053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:00.429815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:00.430453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:00.431882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:00.432555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:00.433457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:00.791767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:00.792711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:00.793360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:00.793912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:00.794468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:00.826315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:00.826822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:00.827263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:00.827996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:00.828513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:00.833362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:00.942028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Getting quotas for project e24ab6322c834c3c8444cf403aca0825. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:18:00.954453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:00.966344 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8221b4cd-bca8-4c45-87fe-39008905d178 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1351 microversion: 2.1 time: 0.554189 Oct 27 10:18:00.969277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Getting quotas for user 7f2b5253b841436588fa27532e0491d8 and project e24ab6322c834c3c8444cf403aca0825. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:18:00.970473 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1255/2364] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:00 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1351 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:00.981745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-949586854", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a3771f18-a29a-4d03-97cf-1e23ec142e87"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:01.007446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:18:01.010408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:18:01.094184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:18:01.168849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d6ff5f78-65be-4e8a-b0a1-4fea3461d2b4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.654775 Oct 27 10:18:01.173135 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1110/2365] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:18:01.178904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:01.179765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:01.191228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:01.192478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:01.193105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:01.194504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:01.195111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:01.195685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:01.247784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:01.248512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:01.249141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:01.249743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lazy-loading 'fault' on Instance uuid 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:01.965465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:01.973603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:01.975430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:01.976642 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8189d17a-687e-4a2a-a96a-1a97b4e204d2 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 200 len: 1436 microversion: 2.25 time: 0.802444 Oct 27 10:18:01.989171 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1111/2366] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:01 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 1436 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:02.103005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-257331438", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": "none"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:02.213316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:02.214147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:02.214909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:02.215528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:02.216371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:02.236205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:02.238506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:02.239214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:02.240668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:02.241581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:02.242286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:02.275524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Getting quotas for project c85d3e042a1443fc9959ee0666c88b18. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:18:02.306715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Getting quotas for user 0e60d09942504fdb9ac8b8c037a0f992 and project c85d3e042a1443fc9959ee0666c88b18. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:18:02.338437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:18:02.340923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:18:02.418268 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9a9dff8-070e-43fc-8cf3-2934b9b46af0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.429090 Oct 27 10:18:02.419470 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1112/2367] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:18:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:18:02.424756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-af2a0046-8e5b-48aa-909e-fe26df80484c req-17f17f99-d3aa-4bc9-950e-b94b4ca270a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04509dd-1faf-474a-a02d-fc408bf96fe2", "name": "network-vif-deleted", "tag": "77a3d39c-827a-4840-98c9-d82e01a85658"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:02.436595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-af2a0046-8e5b-48aa-909e-fe26df80484c req-17f17f99-d3aa-4bc9-950e-b94b4ca270a6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:02.437339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-af2a0046-8e5b-48aa-909e-fe26df80484c req-17f17f99-d3aa-4bc9-950e-b94b4ca270a6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:02.438146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-af2a0046-8e5b-48aa-909e-fe26df80484c req-17f17f99-d3aa-4bc9-950e-b94b4ca270a6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:02.465169 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-af2a0046-8e5b-48aa-909e-fe26df80484c req-17f17f99-d3aa-4bc9-950e-b94b4ca270a6 service nova] Creating event network-vif-deleted:77a3d39c-827a-4840-98c9-d82e01a85658 for instance d04509dd-1faf-474a-a02d-fc408bf96fe2 on n-h1-854663-10 Oct 27 10:18:02.471652 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-af2a0046-8e5b-48aa-909e-fe26df80484c req-17f17f99-d3aa-4bc9-950e-b94b4ca270a6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050523 Oct 27 10:18:02.472952 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1113/2368] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:02.479453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b51700a0-5751-45ff-b67b-b891d1f98d64 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Action: 'create', calling method: .version_select at 0x7f6d5b5139d0>, body: {"pool": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:02.926986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=11 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:02.987060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:02.987795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:02.988453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:02.989465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:02.990160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:03.022927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:03.028241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:03.031533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:03.034327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:03.040312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:03.042688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:03.094404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:18:03.123597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Getting quotas for user 9685331306514f73a2d834a0bf5a77a3 and project 88e242ed84c14a5eaabf74309f00b689. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:18:03.184484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:18:03.187194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:18:03.312715 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-754866fa-2934-43be-a061-e01ceee9d982 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.340679 Oct 27 10:18:03.314044 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1256/2369] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:18:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:18:03.325916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:03.331223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:03.348031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:03.348818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:03.349274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:03.350015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:03.350456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:03.350875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:03.655141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:03.668955 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce90d71c-7f99-4418-a8de-7fb1b4822d0f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1270 microversion: 2.1 time: 0.348967 Oct 27 10:18:03.670746 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1257/2370] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:03 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1270 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:03.676013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5b7eccd-30e4-42ee-ad33-aff372442fc5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d602600d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:03.783639 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5b7eccd-30e4-42ee-ad33-aff372442fc5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1452 microversion: 2.1 time: 0.111335 Oct 27 10:18:03.784951 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1258/2371] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:03 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:03.792959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:03.801791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:03.817287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:03.818064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:03.822865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:03.824100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:03.824966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:03.825715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.273580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:04.298516 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e108f9ac-b935-49f2-a04a-188c434c9ddf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1351 microversion: 2.1 time: 0.511760 Oct 27 10:18:04.302781 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1259/2372] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:03 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1351 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:04.313277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:04.326305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:04.339687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:04.346174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:04.346837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.347746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:04.348325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:04.348809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.532051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:04.554235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:04.565666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:04.574537 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7e57c9e-bad4-4b82-8b60-9c26ec9afe03 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "PUT /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1362 microversion: 2.75 time: 0.268357 Oct 27 10:18:04.587014 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1260/2373] 10.222.0.76 () {62 vars in 1297 bytes} [Thu Oct 27 10:18:04 2022] PUT /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:04.602335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:04.603041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:04.620647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:04.621444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:04.622118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.623058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:04.623793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:04.624448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.652696 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] HTTP exception thrown: Instance 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 could not be found. Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Request method failure captured: Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 HTTP/1.1 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWli5Oz5iuH7dVjFcTU7njmE4y9cZkWr37csWaCX7X1YGOv-T5bwlSoJO7cJ2BpUte4Jq9cMJ5_ADAgg9FDFVX94yY0sozYPG3txo2iKkt6T0piJiY8xcBZYnedKlCEelnRihKf4V9u2NgKjr-sdlDeWReFWzBAMe87I54Zakd1uTvCg Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 8e2d013afa6544b3972160d82f111127 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e2d013afa6544b3972160d82f111127"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8e2d013afa6544b3972160d82f111127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8e2d013afa6544b3972160d82f111127", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e2d013afa6544b3972160d82f111127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 8e2d013afa6544b3972160d82f111127 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-LiveAutoBlockMigrationV225Test-1335644460-project Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: dd2f7b7849014a6bae41317a3e68426e Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460-project Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 could not be found. Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '9f892e7c-e0d0-47f8-a486-fdfbfc1fd264'} Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 could not be found. Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 could not be found. Oct 27 10:18:04.654518 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:04.659819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:04.659819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:04.659819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:04.659819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:04.659819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:04.659819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:04.659819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:04.659819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 could not be found. Oct 27 10:18:04.659819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:04.661577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Returning 404 to user: Instance 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:04.662605 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f04f3a4-cba1-4367-8d7e-bd6f3cb02a82 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264" status: 404 len: 111 microversion: 2.25 time: 0.071819 Oct 27 10:18:04.663672 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1261/2374] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:04 2022] GET /compute/v2.1/servers/9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:18:04.669506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:04.671639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:04.685452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:04.687849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:04.689328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.690371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:04.691687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:04.693338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.770707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:04.783334 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ead2aac-10e6-42b9-ae65-661b57f15ee7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1220 microversion: 2.1 time: 0.118380 Oct 27 10:18:04.786990 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1262/2375] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:04 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:04.792276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:04.792909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:04.813845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:04.814625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:04.815133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.816179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:04.816553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:04.817090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.906660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:04.923204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:04.926550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:04.936838 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d887788-e310-47c5-9155-67b571a96f65 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1410 microversion: 2.75 time: 0.148479 Oct 27 10:18:04.937758 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1263/2376] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:04 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1410 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:04.943502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8857559c-6c8d-4d0a-9956-60f59cb6f176 req-67a8a905-94cc-43fa-a22e-574c715acc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f892e7c-e0d0-47f8-a486-fdfbfc1fd264", "name": "network-vif-deleted", "tag": "7937b0d8-fb5a-48f7-870e-5a6a3ddc6866"}, {"name": "network-changed", "server_uuid": "5c54fce1-7397-4e02-a66b-f5d0d8ba8e09", "tag": "9b851bf0-1e9b-417a-833d-ebc6a5b707e4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:04.957295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8857559c-6c8d-4d0a-9956-60f59cb6f176 req-67a8a905-94cc-43fa-a22e-574c715acc57 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:04.957782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8857559c-6c8d-4d0a-9956-60f59cb6f176 req-67a8a905-94cc-43fa-a22e-574c715acc57 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:04.958372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8857559c-6c8d-4d0a-9956-60f59cb6f176 req-67a8a905-94cc-43fa-a22e-574c715acc57 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:04.995268 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8857559c-6c8d-4d0a-9956-60f59cb6f176 req-67a8a905-94cc-43fa-a22e-574c715acc57 service nova] Creating event network-vif-deleted:7937b0d8-fb5a-48f7-870e-5a6a3ddc6866 for instance 9f892e7c-e0d0-47f8-a486-fdfbfc1fd264 on n-h2-854663-10 Oct 27 10:18:04.998405 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8857559c-6c8d-4d0a-9956-60f59cb6f176 req-67a8a905-94cc-43fa-a22e-574c715acc57 service nova] Creating event network-changed:9b851bf0-1e9b-417a-833d-ebc6a5b707e4 for instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 on n-h2-854663-10 Oct 27 10:18:05.008127 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8857559c-6c8d-4d0a-9956-60f59cb6f176 req-67a8a905-94cc-43fa-a22e-574c715acc57 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068487 Oct 27 10:18:05.009349 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1264/2377] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:05.035202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:05.037935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:05.048387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:05.049276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:05.049897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:05.050884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:05.051506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:05.052122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:05.085346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:05.165101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:05.219213 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c8f400e-2e27-4bec-b35a-26ef628a9b62 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 204 len: 0 microversion: 2.25 time: 0.207873 Oct 27 10:18:05.220794 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1265/2378] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:18:05 2022] DELETE /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:18:05.230090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:05.230968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:05.239332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:05.240332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:05.241063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:05.241862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:05.242324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:05.242809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:05.539830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:05.549602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c20fc156-3c73-4aa0-bde2-ffd7007e05bc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1318 microversion: 2.1 time: 0.327323 Oct 27 10:18:05.553556 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1266/2379] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:05 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:05.558345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd257f58-ae3c-41b8-a8bf-83a49ab7adc4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ba861f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:05.605864 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b51700a0-5751-45ff-b67b-b891d1f98d64 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.131304 Oct 27 10:18:05.607084 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1114/2380] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:18:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:05.612624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:05.617353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:05.632623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:05.633593 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd257f58-ae3c-41b8-a8bf-83a49ab7adc4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1461 microversion: 2.1 time: 0.078924 Oct 27 10:18:05.634347 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1267/2381] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:05 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1461 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:05.640786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:05.641467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:05.642276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:05.642774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:05.643207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:05.646684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:05.647568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:05.664871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:05.665725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:05.666371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:05.667409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:05.671350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:05.672055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:05.956165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:05.970067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:05.970328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:05.971650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:05.972927 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ebb28fb-8516-4907-9362-7c04af672aed tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1563 microversion: 2.25 time: 0.364379 Oct 27 10:18:05.973733 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1115/2382] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:05 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1563 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:05.979092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ceb3a2fb-bf84-44f0-847c-7e23152fb9eb tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Action: 'create', calling method: .version_select at 0x7f6d5b2eb310>, body: {"pool": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:05.996383 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4b99e23-f57b-44b8-9536-ef6be27e95e5 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1351 microversion: 2.1 time: 0.360729 Oct 27 10:18:06.010090 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1268/2383] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:05 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1351 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:06.020041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a8c1072-dfd8-48a2-ab7c-bca5793d9044 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b72b1f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:06.084765 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a8c1072-dfd8-48a2-ab7c-bca5793d9044 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 200 len: 1461 microversion: 2.1 time: 0.073159 Oct 27 10:18:06.091004 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1269/2384] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:06 2022] GET /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 1461 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:06.098637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:06.099265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:06.105595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:06.106141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:06.106933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:06.108605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:06.109119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:06.110284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:06.199914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:06.209964 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98dd3107-5422-47d9-96ad-9cf6a49e6d9f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1268 microversion: 2.1 time: 0.117652 Oct 27 10:18:06.211037 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1270/2385] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:06 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1268 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:06.231096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:06.232072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:06.240515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:06.241463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:06.242205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:06.243072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:06.243821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:06.244568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:06.352560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:06.371868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:06.374711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:06.395198 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1212e7f-5d3a-4409-b524-29f935dbe97b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1416 microversion: 2.75 time: 0.182222 Oct 27 10:18:06.395796 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1271/2386] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:06 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1416 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:06.401661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:06.402606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:06.411413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:06.412178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:06.412999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:06.416076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:06.417184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:06.417885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:06.678837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:06.703640 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4486575d-af81-4429-b35c-b6a3cfaf00af tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1467 microversion: 2.1 time: 0.301015 Oct 27 10:18:06.705173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1272/2387] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:06 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1467 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:06.716615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:06.722358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:06.747063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:06.761307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:06.762387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:06.766984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:06.767778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:06.769144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:07.342869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:07.357832 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b658f3f5-084d-498c-8a90-8cbd8244d52e tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1318 microversion: 2.1 time: 0.644430 Oct 27 10:18:07.359088 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1273/2388] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:06 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:07.366321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b45fb25-ad11-48d3-894d-61584d5df744 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1883551559"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:07.370349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b45fb25-ad11-48d3-894d-61584d5df744 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:07.377708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b45fb25-ad11-48d3-894d-61584d5df744 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:07.378468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b45fb25-ad11-48d3-894d-61584d5df744 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:07.379879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b45fb25-ad11-48d3-894d-61584d5df744 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:07.380996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b45fb25-ad11-48d3-894d-61584d5df744 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:07.382056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b45fb25-ad11-48d3-894d-61584d5df744 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:07.382668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b45fb25-ad11-48d3-894d-61584d5df744 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:07.687219 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b45fb25-ad11-48d3-894d-61584d5df744 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "POST /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7/action" status: 202 len: 0 microversion: 2.1 time: 0.325383 Oct 27 10:18:07.688852 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1274/2389] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:18:07 2022] POST /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:18:07.695135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:07.695960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:07.705915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:07.706709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:07.707352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:07.708347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:07.709030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:07.709736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:07.867170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:07.878925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:07.880407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2f7b7849014a6bae41317a3e68426e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2d013afa6544b3972160d82f111127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:07.881740 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db0ba87a-1a5c-4c3f-9973-d1cd891be788 tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 200 len: 1521 microversion: 2.25 time: 0.191508 Oct 27 10:18:07.882305 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1275/2390] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:07 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:07.888927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:07.889474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:07.896214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:07.896772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:07.897227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:07.897914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:07.898357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:07.899163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:08.098300 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ceb3a2fb-bf84-44f0-847c-7e23152fb9eb tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.123046 Oct 27 10:18:08.107632 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1116/2391] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:18:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:08.113949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-41936368-da1a-4bc5-b869-11e4c45d2dec req-cfbc9853-bedb-45f8-994b-f99b403a40b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef41d153-9311-4d5a-a975-e82b7d7c2165", "tag": "2eb156a1-7133-48c1-89fe-956de9ca524e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:08.133309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-41936368-da1a-4bc5-b869-11e4c45d2dec req-cfbc9853-bedb-45f8-994b-f99b403a40b9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:08.134399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-41936368-da1a-4bc5-b869-11e4c45d2dec req-cfbc9853-bedb-45f8-994b-f99b403a40b9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:08.134972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-41936368-da1a-4bc5-b869-11e4c45d2dec req-cfbc9853-bedb-45f8-994b-f99b403a40b9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:08.159117 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-41936368-da1a-4bc5-b869-11e4c45d2dec req-cfbc9853-bedb-45f8-994b-f99b403a40b9 service nova] Creating event network-changed:2eb156a1-7133-48c1-89fe-956de9ca524e for instance ef41d153-9311-4d5a-a975-e82b7d7c2165 on n-h1-854663-10 Oct 27 10:18:08.165880 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-41936368-da1a-4bc5-b869-11e4c45d2dec req-cfbc9853-bedb-45f8-994b-f99b403a40b9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056559 Oct 27 10:18:08.167239 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1117/2392] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:08.177140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:08.191353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:08.205164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:08.205982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:08.206815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:08.208449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:08.209177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:08.209814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:08.319445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:08.328464 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75288722-47b5-4774-8b20-6df315edafa2 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1351 microversion: 2.1 time: 0.445020 Oct 27 10:18:08.329546 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1276/2393] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:07 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1351 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:08.335099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:08.335782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:08.351971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:08.352473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:08.352957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:08.353817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:08.354407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:08.354965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:08.380643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:08.390729 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54fb2dda-4c7f-49dc-958c-27f30b2bc17f tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1274 microversion: 2.1 time: 0.221608 Oct 27 10:18:08.421776 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1118/2394] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:08 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:08.435523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9dd4d075-4145-48b3-882d-92c7428fb65d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ad62700>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:08.485365 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9dd4d075-4145-48b3-882d-92c7428fb65d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.059973 Oct 27 10:18:08.485996 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1119/2395] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:08 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:08.490884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be12cd37-8a1c-44a2-a15c-8760713f907c tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Action: 'create', calling method: .version_select at 0x7f6d5acbf3a0>, body: {"pool": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:08.544317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:08.555770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:08.559696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:08.569899 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a393f01-44df-476d-be2b-0c9a39c447fc tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1437 microversion: 2.75 time: 0.239009 Oct 27 10:18:08.574647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1277/2396] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:08 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1437 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:08.583865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-27bc95fe-8db7-4812-a453-bda3c46dc21c req-5b765345-bf69-4a27-b44c-17e2c33995ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c30935-9c9d-4098-bb50-beeb93a1edbe", "name": "network-vif-unplugged", "status": "completed", "tag": "1b3185dc-06ff-479d-8971-a9d01cf40ea7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:08.623790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-27bc95fe-8db7-4812-a453-bda3c46dc21c req-5b765345-bf69-4a27-b44c-17e2c33995ba service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:08.624611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-27bc95fe-8db7-4812-a453-bda3c46dc21c req-5b765345-bf69-4a27-b44c-17e2c33995ba service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:08.625691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-27bc95fe-8db7-4812-a453-bda3c46dc21c req-5b765345-bf69-4a27-b44c-17e2c33995ba service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:08.645811 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-27bc95fe-8db7-4812-a453-bda3c46dc21c req-5b765345-bf69-4a27-b44c-17e2c33995ba service nova] Creating event network-vif-unplugged:1b3185dc-06ff-479d-8971-a9d01cf40ea7 for instance 45c30935-9c9d-4098-bb50-beeb93a1edbe on n-h1-854663-10 Oct 27 10:18:08.652208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-27bc95fe-8db7-4812-a453-bda3c46dc21c req-5b765345-bf69-4a27-b44c-17e2c33995ba service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075783 Oct 27 10:18:08.653582 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1278/2397] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:08.660434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:08.662058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:08.672362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:08.674296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:08.675121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:08.676182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:08.677385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:08.678041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:09.315927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:09.326604 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90f3ec18-cdf2-47ee-aa51-c2e033b1e63d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1318 microversion: 2.1 time: 0.671566 Oct 27 10:18:09.341858 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1279/2398] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:08 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:09.351286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:09.354944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:09.362444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:09.363090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:09.363624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:09.364427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:09.365109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:09.365632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:09.464653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:09.465336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:09.465887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:09.466565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:09.467033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:09.565226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:09.584106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:09.586017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:09.586553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:09.587382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:09.587802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:09.588235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:09.787683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:09.797126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:09.799409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:09.808642 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b752b64-d047-436e-8ca5-9a1f53046dc0 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "POST /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a/action" status: 202 len: 1494 microversion: 2.75 time: 0.464195 Oct 27 10:18:09.822095 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1280/2399] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:18:09 2022] POST /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a/action => generated 1494 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 10:18:09.840835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:09.841886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] [instance: 1be88582-e288-4713-bdbb-c7771e2af40b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:09.849777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:09.850628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:09.851311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:09.852262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:09.853018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:09.854008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:09.872363 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] HTTP exception thrown: Instance 1be88582-e288-4713-bdbb-c7771e2af40b could not be found. Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Request method failure captured: Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b HTTP/1.1 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWli5Oz5iuH7dVjFcTU7njmE4y9cZkWr37csWaCX7X1YGOv-T5bwlSoJO7cJ2BpUte4Jq9cMJ5_ADAgg9FDFVX94yY0sozYPG3txo2iKkt6T0piJiY8xcBZYnedKlCEelnRihKf4V9u2NgKjr-sdlDeWReFWzBAMe87I54Zakd1uTvCg Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 8e2d013afa6544b3972160d82f111127 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e2d013afa6544b3972160d82f111127"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8e2d013afa6544b3972160d82f111127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8e2d013afa6544b3972160d82f111127", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e2d013afa6544b3972160d82f111127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 8e2d013afa6544b3972160d82f111127 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460 Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-LiveAutoBlockMigrationV225Test-1335644460-project Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: dd2f7b7849014a6bae41317a3e68426e Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1335644460-project Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 1be88582-e288-4713-bdbb-c7771e2af40b could not be found. Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1be88582-e288-4713-bdbb-c7771e2af40b'} Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be88582-e288-4713-bdbb-c7771e2af40b could not be found. Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be88582-e288-4713-bdbb-c7771e2af40b could not be found. Oct 27 10:18:09.874870 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:09.879051 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:09.879051 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:09.879051 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:09.879051 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:09.879051 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:09.879051 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:09.879051 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:09.879051 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be88582-e288-4713-bdbb-c7771e2af40b could not be found. Oct 27 10:18:09.879051 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:09.881760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] Returning 404 to user: Instance 1be88582-e288-4713-bdbb-c7771e2af40b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:09.883305 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1cead1bd-f7fc-48e1-a02c-431f5981116c tempest-LiveAutoBlockMigrationV225Test-1335644460 tempest-LiveAutoBlockMigrationV225Test-1335644460-project] 10.222.0.76 "GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b" status: 404 len: 111 microversion: 2.25 time: 0.059427 Oct 27 10:18:09.884578 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1281/2400] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:09 2022] GET /compute/v2.1/servers/1be88582-e288-4713-bdbb-c7771e2af40b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:18:09.890387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:09.891812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:09.898827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:09.899823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:09.901523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:09.902752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:09.903411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:09.904181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:09.910508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:10.399938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:10.422735 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-acfea7d0-a06c-428a-a076-6fe5a35080bc tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1351 microversion: 2.1 time: 0.536004 Oct 27 10:18:10.424118 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1282/2401] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:09 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1351 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:10.432713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:10.433615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:10.448134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:10.448961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:10.450027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:10.451141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:10.451732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:10.452314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:10.755830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:10.802250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1b85560-f5ce-4faa-aa89-66f6ed69ea9d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1316 microversion: 2.1 time: 0.376200 Oct 27 10:18:10.805369 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1283/2402] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:10 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:10.811897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b4de1cf-d5fd-47b8-942c-ec0f484a23cf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b458820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:10.923457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b4de1cf-d5fd-47b8-942c-ec0f484a23cf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.115345 Oct 27 10:18:10.926141 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1284/2403] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:10 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:10.934630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:10.937949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:10.948427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:10.950267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:10.950894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:10.952149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:10.952855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:10.953457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:11.151940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:11.161602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:11.163042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:11.165901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:11.169450 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-06f67f50-b6bd-4f70-a4d8-fecf2628d8cd tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.240528 Oct 27 10:18:11.182091 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1285/2404] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:10 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:11.197557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-90fd7a31-4e61-40ba-bbf3-24da2d921def req-c675fad5-03fa-4fe9-ad19-3819f0cca519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be88582-e288-4713-bdbb-c7771e2af40b", "name": "network-vif-deleted", "tag": "85249995-24f5-4745-9051-333609fd2ea1"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:11.210786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-90fd7a31-4e61-40ba-bbf3-24da2d921def req-c675fad5-03fa-4fe9-ad19-3819f0cca519 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:11.211159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-90fd7a31-4e61-40ba-bbf3-24da2d921def req-c675fad5-03fa-4fe9-ad19-3819f0cca519 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:11.211642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-90fd7a31-4e61-40ba-bbf3-24da2d921def req-c675fad5-03fa-4fe9-ad19-3819f0cca519 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:11.225236 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-90fd7a31-4e61-40ba-bbf3-24da2d921def req-c675fad5-03fa-4fe9-ad19-3819f0cca519 service nova] Creating event network-vif-deleted:85249995-24f5-4745-9051-333609fd2ea1 for instance 1be88582-e288-4713-bdbb-c7771e2af40b on n-h2-854663-10 Oct 27 10:18:11.235770 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-90fd7a31-4e61-40ba-bbf3-24da2d921def req-c675fad5-03fa-4fe9-ad19-3819f0cca519 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053086 Oct 27 10:18:11.236505 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1286/2405] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:11.249232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:11.250087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:11.266664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:11.269615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:11.269806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:11.270771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:11.270975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:11.273839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:11.670738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:11.698779 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e20d1b8-05a0-48f8-865f-f789f2ac5098 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1318 microversion: 2.1 time: 0.460907 Oct 27 10:18:11.699837 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1287/2406] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:11 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:11.721400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-86ef4634-b8b5-4df4-9b1f-337db2428e17 req-9cbaf221-1bea-4d78-8f62-1b528b1e5623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c54fce1-7397-4e02-a66b-f5d0d8ba8e09", "name": "network-vif-plugged", "status": "completed", "tag": "9b851bf0-1e9b-417a-833d-ebc6a5b707e4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:11.735009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-86ef4634-b8b5-4df4-9b1f-337db2428e17 req-9cbaf221-1bea-4d78-8f62-1b528b1e5623 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:11.735666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-86ef4634-b8b5-4df4-9b1f-337db2428e17 req-9cbaf221-1bea-4d78-8f62-1b528b1e5623 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:11.736445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-86ef4634-b8b5-4df4-9b1f-337db2428e17 req-9cbaf221-1bea-4d78-8f62-1b528b1e5623 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:11.753125 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-86ef4634-b8b5-4df4-9b1f-337db2428e17 req-9cbaf221-1bea-4d78-8f62-1b528b1e5623 service nova] Creating event network-vif-plugged:9b851bf0-1e9b-417a-833d-ebc6a5b707e4 for instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 on n-h2-854663-10 Oct 27 10:18:11.772054 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be12cd37-8a1c-44a2-a15c-8760713f907c tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.280198 Oct 27 10:18:11.773724 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1120/2407] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:18:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:11.780213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:11.791519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:11.798649 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-86ef4634-b8b5-4df4-9b1f-337db2428e17 req-9cbaf221-1bea-4d78-8f62-1b528b1e5623 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082619 Oct 27 10:18:11.800966 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1288/2408] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:11.811534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1533a05c-c5d4-41d1-855e-640b6b2c0a1f tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Calling method '.version_select at 0x7f6d5b450e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:11.826306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:11.826809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:11.827239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:11.827963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:11.828415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:11.841417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:12.185361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:12.192876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1533a05c-c5d4-41d1-855e-640b6b2c0a1f tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "GET /compute/v2.1/os-floating-ips/69ac11bc-4c6b-4b08-a8a9-f2b0e9404d24" status: 200 len: 141 microversion: 2.1 time: 0.385291 Oct 27 10:18:12.200046 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1289/2409] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:18:11 2022] GET /compute/v2.1/os-floating-ips/69ac11bc-4c6b-4b08-a8a9-f2b0e9404d24 => generated 141 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:12.206549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:12.213888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-500d813a-7bf5-404a-af1f-7045fd10dfac tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1351 microversion: 2.1 time: 0.438772 Oct 27 10:18:12.214326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:12.218631 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1121/2410] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:11 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1351 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:12.224885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:12.225667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:12.226392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:12.227286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:12.227945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:12.228630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:12.236453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31108717-9d2f-46d1-ae3f-ecd16aed398d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5acbf310>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:12.253739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:12.307212 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31108717-9d2f-46d1-ae3f-ecd16aed398d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.087033 Oct 27 10:18:12.307963 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1122/2411] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:12 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:12.324194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:12.325268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:12.335725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:12.340058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:12.340986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:12.341826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:12.342848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:12.343520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:12.344141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:12.537277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:12.549337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:12.551194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:12.557422 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1669a11e-a37d-4214-b4c7-059406b5d56d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.247994 Oct 27 10:18:12.558748 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1123/2412] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:12 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:12.565231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-faa12eff-d575-481a-a3d5-6362fc625bc6 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Calling method '.version_select at 0x7f6d5acbf430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:12.774563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:12.785150 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8be370a5-5d88-4eb8-bf04-b1916ccfa6bb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1316 microversion: 2.1 time: 0.582599 Oct 27 10:18:12.801760 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1290/2413] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:12 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:12.808346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8fc15df5-c431-4251-a4d0-b7c98d76a64d req-75b06331-761c-4504-8483-e0741e13c755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba1bb9f-3333-46b3-be74-35a44309bccb", "tag": "4088419e-9209-49d2-af92-4903edac81d7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:12.821347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8fc15df5-c431-4251-a4d0-b7c98d76a64d req-75b06331-761c-4504-8483-e0741e13c755 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:12.822115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8fc15df5-c431-4251-a4d0-b7c98d76a64d req-75b06331-761c-4504-8483-e0741e13c755 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:12.822799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8fc15df5-c431-4251-a4d0-b7c98d76a64d req-75b06331-761c-4504-8483-e0741e13c755 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:12.836142 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8fc15df5-c431-4251-a4d0-b7c98d76a64d req-75b06331-761c-4504-8483-e0741e13c755 service nova] Creating event network-changed:4088419e-9209-49d2-af92-4903edac81d7 for instance 7ba1bb9f-3333-46b3-be74-35a44309bccb on n-h2-854663-10 Oct 27 10:18:12.842069 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8fc15df5-c431-4251-a4d0-b7c98d76a64d req-75b06331-761c-4504-8483-e0741e13c755 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038951 Oct 27 10:18:12.843396 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1291/2414] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:12.849792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:12.850859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:12.858303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:12.859173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:12.859856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:12.860883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:12.861986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:12.862635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:13.069381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:13.158872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=72 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:13.664392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:13.677177 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9664348b-8e82-437e-9a97-7527829e56fb tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1318 microversion: 2.1 time: 0.831019 Oct 27 10:18:13.689821 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1292/2415] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:12 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1318 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:13.692108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:13.693284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:13.705392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:13.705963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:13.706427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:13.707138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:13.707586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:13.708004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:14.010221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:14.028272 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3ee9a38-a0ae-4f1c-b56d-0e40302c2fbd tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1540 microversion: 2.1 time: 0.344377 Oct 27 10:18:14.031764 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1293/2416] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:13 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1540 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:14.044195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84976651-4347-436b-9f30-bcc2c5841eb9 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b497ca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:14.140993 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-84976651-4347-436b-9f30-bcc2c5841eb9 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.107828 Oct 27 10:18:14.142365 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1294/2417] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:14 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:14.161353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:14.162384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:14.177450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:14.178480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:14.182275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:14.183291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:14.183909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:14.184480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:14.449906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:14.480386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:14.484188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:14.501367 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f3f7555-954d-4789-a1c7-6f57dbb93159 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.357747 Oct 27 10:18:14.507664 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1295/2418] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:14 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:14.526612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:14.532044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:14.549485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:14.553405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:14.559478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:14.562545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:14.564119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:14.566512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:15.864499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:15.878993 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d865eb1-5ceb-4674-958f-aee06bae01b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1316 microversion: 2.1 time: 1.365803 Oct 27 10:18:15.882465 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1296/2419] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:14 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1316 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:15.899988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9e7161c-d917-4835-ba8b-6ab1efef2faf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:15.900869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9e7161c-d917-4835-ba8b-6ab1efef2faf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:15.913016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7161c-d917-4835-ba8b-6ab1efef2faf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:15.917646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7161c-d917-4835-ba8b-6ab1efef2faf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:15.918442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7161c-d917-4835-ba8b-6ab1efef2faf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:15.919364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7161c-d917-4835-ba8b-6ab1efef2faf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:15.919966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7161c-d917-4835-ba8b-6ab1efef2faf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:15.926665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7161c-d917-4835-ba8b-6ab1efef2faf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:16.035947 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-faa12eff-d575-481a-a3d5-6362fc625bc6 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/69ac11bc-4c6b-4b08-a8a9-f2b0e9404d24" status: 202 len: 0 microversion: 2.1 time: 3.475485 Oct 27 10:18:16.036608 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1124/2420] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:18:12 2022] DELETE /compute/v2.1/os-floating-ips/69ac11bc-4c6b-4b08-a8a9-f2b0e9404d24 => generated 0 bytes in 3477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:18:16.047315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:16.048945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:16.065798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:16.066906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:16.068696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:16.073154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:16.076091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:16.076967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:16.219567 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9e7161c-d917-4835-ba8b-6ab1efef2faf tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.333828 Oct 27 10:18:16.221842 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1297/2421] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:18:15 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:16.227128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d322aba-850d-4e63-bd4f-172d5e4e8681 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ae54160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:16.310732 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d322aba-850d-4e63-bd4f-172d5e4e8681 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.087205 Oct 27 10:18:16.311817 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1298/2422] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:16 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:16.318696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:16.319826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:16.329494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:16.331837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:16.332575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:16.333667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:16.334349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:16.335089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:16.641862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:16.651119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:16.661415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:16.683625 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de312315-8dfa-4a89-8017-b5805c60c17b tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.370079 Oct 27 10:18:16.684686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1299/2423] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:16 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:16.696391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8cf74f56-69ab-46be-a86c-f2db1ee00368 req-ade0f900-ce10-4af9-a83f-30e5661ebd58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef41d153-9311-4d5a-a975-e82b7d7c2165", "name": "network-vif-plugged", "status": "completed", "tag": "2eb156a1-7133-48c1-89fe-956de9ca524e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:16.718272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8cf74f56-69ab-46be-a86c-f2db1ee00368 req-ade0f900-ce10-4af9-a83f-30e5661ebd58 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:16.722192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8cf74f56-69ab-46be-a86c-f2db1ee00368 req-ade0f900-ce10-4af9-a83f-30e5661ebd58 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:16.722884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8cf74f56-69ab-46be-a86c-f2db1ee00368 req-ade0f900-ce10-4af9-a83f-30e5661ebd58 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:16.755282 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8cf74f56-69ab-46be-a86c-f2db1ee00368 req-ade0f900-ce10-4af9-a83f-30e5661ebd58 service nova] Creating event network-vif-plugged:2eb156a1-7133-48c1-89fe-956de9ca524e for instance ef41d153-9311-4d5a-a975-e82b7d7c2165 on n-h1-854663-10 Oct 27 10:18:16.768582 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8cf74f56-69ab-46be-a86c-f2db1ee00368 req-ade0f900-ce10-4af9-a83f-30e5661ebd58 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081884 Oct 27 10:18:16.769718 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1300/2424] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:16.775142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d8288c9-ed6e-4945-8dd7-33482087c4b6 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Calling method '.version_select at 0x7f6d5b7535e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:16.949084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:16.959572 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cfb25f91-c5df-4f91-87a9-2b0c51899dde tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1318 microversion: 2.1 time: 0.916296 Oct 27 10:18:16.960167 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1125/2425] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:16 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1318 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:16.985560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:16.989473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:17.012063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:17.012309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:17.018883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:17.022154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:17.027121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:17.028226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:17.868576 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d8288c9-ed6e-4945-8dd7-33482087c4b6 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.097534 Oct 27 10:18:17.870475 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1301/2426] 10.222.0.76 () {58 vars in 1164 bytes} [Thu Oct 27 10:18:16 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:18:17.875940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ae3b8c9-73b5-4bdf-a280-3f5887056a93 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5aeb2040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:17.950997 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ae3b8c9-73b5-4bdf-a280-3f5887056a93 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.079005 Oct 27 10:18:17.961080 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1302/2427] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:17 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:17.973128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:17.974690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:17.993034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:17.994462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:17.995122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:18.002590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:18.003315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:18.004565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:18.214110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:18.230386 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8eef056-42c4-4ed7-8fbf-cc308e405187 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1316 microversion: 2.1 time: 1.258895 Oct 27 10:18:18.232020 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1126/2428] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:16 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1316 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:18.253016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3c737754-cbe7-40af-aa2c-4670d10eef25 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Calling method '.version_select at 0x7f6d5b2a5b80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:18.353390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:18.372282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:18.378406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:18.396138 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a2f30f0-6b03-4748-9059-09e3d049ee8d tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.433557 Oct 27 10:18:18.397444 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1303/2429] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:17 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:18.413227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:18.417631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:18.440086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:18.443853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:18.447729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:18.448899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:18.449615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:18.465798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:19.821717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:19.833791 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ed9cba6-d9b8-4d8f-ac7a-bbde0faf9a13 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1318 microversion: 2.1 time: 1.434963 Oct 27 10:18:19.850198 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1304/2430] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:18 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1318 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:19.855842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05678f4a-7dd1-47e1-bc4d-a9920ee563f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b458af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:19.907595 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05678f4a-7dd1-47e1-bc4d-a9920ee563f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.055678 Oct 27 10:18:19.909208 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1305/2431] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:19 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:19.914649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f7f76c84-6e7a-4bc4-85e7-cb81865639c8 req-b0647f86-26bc-4c55-aac1-139fc7229e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2ecebf-5910-45cc-a64b-46987db5e3e7", "name": "network-vif-plugged", "status": "completed", "tag": "47847440-7b60-4683-a35e-007be8b78338"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:19.926558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f7f76c84-6e7a-4bc4-85e7-cb81865639c8 req-b0647f86-26bc-4c55-aac1-139fc7229e88 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:19.927324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f7f76c84-6e7a-4bc4-85e7-cb81865639c8 req-b0647f86-26bc-4c55-aac1-139fc7229e88 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:19.927929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f7f76c84-6e7a-4bc4-85e7-cb81865639c8 req-b0647f86-26bc-4c55-aac1-139fc7229e88 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:19.942586 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f7f76c84-6e7a-4bc4-85e7-cb81865639c8 req-b0647f86-26bc-4c55-aac1-139fc7229e88 service nova] Creating event network-vif-plugged:47847440-7b60-4683-a35e-007be8b78338 for instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 on n-h1-854663-10 Oct 27 10:18:19.949789 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f7f76c84-6e7a-4bc4-85e7-cb81865639c8 req-b0647f86-26bc-4c55-aac1-139fc7229e88 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038992 Oct 27 10:18:19.950752 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1306/2432] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:20.209959 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3c737754-cbe7-40af-aa2c-4670d10eef25 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.976407 Oct 27 10:18:20.214154 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1127/2433] 10.222.0.76 () {58 vars in 1149 bytes} [Thu Oct 27 10:18:18 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:20.216151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:20.216809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:20.226308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1952999184", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "dc939e88-5ec8-4233-ac75-c11868429d8b"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:20.226550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:20.239540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:20.244021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:20.244553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:20.245385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:20.245858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:20.246288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:20.341936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] validate_networks() for [('dc939e88-5ec8-4233-ac75-c11868429d8b', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:18:21.041326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:21.057729 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f987062-96fc-483e-b9be-304829727858 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1316 microversion: 2.1 time: 0.840017 Oct 27 10:18:21.060095 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1128/2434] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:20 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1316 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:21.070879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:21.072749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:21.089091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:21.089772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:21.091288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:21.092186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:21.092824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:21.093400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:21.212637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:21.248470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:21.250601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:21.276315 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3c40867a-3425-4262-926b-e44d02e26422 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.214853 Oct 27 10:18:21.281811 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1129/2435] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:21 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:21.288601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec0df65b-9ef7-4a40-81c9-28c517374b04 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Calling method '.version_select at 0x7f6d5b2d54c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:21.466755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:21.467314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:21.467652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:21.468067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:21.468485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:21.506368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:21.507232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:21.507823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:21.508809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:21.517093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:21.517973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:21.578895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Getting quotas for project 88021b77b6844cc9957e424317dd8783. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:18:21.600263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Getting quotas for user bd16d723e9f548bdab55559643df2712 and project 88021b77b6844cc9957e424317dd8783. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:18:21.637998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:18:21.646013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:18:21.792337 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17229ee5-80f5-45bd-86c1-991fb32a817e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.840130 Oct 27 10:18:21.796002 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1307/2436] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:18:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:18:21.811628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:21.812536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:21.831855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:21.832394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:21.832880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:21.833586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:21.838267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:21.840172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:22.909662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:22.926329 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d0cd00f8-4923-4485-9c61-cd73cc2b67d5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1508 microversion: 2.1 time: 1.122535 Oct 27 10:18:22.933842 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1308/2437] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:21 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1508 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:22.938954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-513469d1-6b40-463d-ac09-51eb23ff131c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b450c10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:23.053125 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-513469d1-6b40-463d-ac09-51eb23ff131c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.117810 Oct 27 10:18:23.054360 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1309/2438] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:22 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:23.071173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:23.076111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:23.102525 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec0df65b-9ef7-4a40-81c9-28c517374b04 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/26295b19-fada-4f96-b368-3fc10ab81ac1" status: 202 len: 0 microversion: 2.1 time: 1.812608 Oct 27 10:18:23.103600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.104468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.112785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:23.113741 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1130/2439] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:18:21 2022] DELETE /compute/v2.1/os-floating-ips/26295b19-fada-4f96-b368-3fc10ab81ac1 => generated 0 bytes in 1831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:18:23.115522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.116439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.117133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:23.126853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ba624a99-5c3f-45dc-94f1-81a921bba045 req-fb27ff17-2432-488c-abb2-660c28e5e346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba1bb9f-3333-46b3-be74-35a44309bccb", "name": "network-vif-plugged", "status": "completed", "tag": "4088419e-9209-49d2-af92-4903edac81d7"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:23.165804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ba624a99-5c3f-45dc-94f1-81a921bba045 req-fb27ff17-2432-488c-abb2-660c28e5e346 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.168696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ba624a99-5c3f-45dc-94f1-81a921bba045 req-fb27ff17-2432-488c-abb2-660c28e5e346 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.169152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ba624a99-5c3f-45dc-94f1-81a921bba045 req-fb27ff17-2432-488c-abb2-660c28e5e346 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:23.184725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:23.188517 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ba624a99-5c3f-45dc-94f1-81a921bba045 req-fb27ff17-2432-488c-abb2-660c28e5e346 service nova] Creating event network-vif-plugged:4088419e-9209-49d2-af92-4903edac81d7 for instance 7ba1bb9f-3333-46b3-be74-35a44309bccb on n-h2-854663-10 Oct 27 10:18:23.197294 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ba624a99-5c3f-45dc-94f1-81a921bba045 req-fb27ff17-2432-488c-abb2-660c28e5e346 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080977 Oct 27 10:18:23.198457 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1131/2440] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:23.204491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:23.206999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:23.218331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.219678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.220442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:23.221575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.222252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.223355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:23.439125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:23.454180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:23.458974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:23.470262 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01876d85-50f3-424d-b030-4d566f8f3501 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1266 microversion: 2.26 time: 0.414125 Oct 27 10:18:23.473451 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1310/2441] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:23 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1266 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:23.480879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-00d7acf2-1edf-444f-bc2f-f2c4e82ab48e req-5b3e6413-ea36-4b84-abb9-a94703b91b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c54fce1-7397-4e02-a66b-f5d0d8ba8e09", "tag": "9b851bf0-1e9b-417a-833d-ebc6a5b707e4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:23.528434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-00d7acf2-1edf-444f-bc2f-f2c4e82ab48e req-5b3e6413-ea36-4b84-abb9-a94703b91b6a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.528948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-00d7acf2-1edf-444f-bc2f-f2c4e82ab48e req-5b3e6413-ea36-4b84-abb9-a94703b91b6a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.529366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-00d7acf2-1edf-444f-bc2f-f2c4e82ab48e req-5b3e6413-ea36-4b84-abb9-a94703b91b6a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:23.556992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:23.601131 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-00d7acf2-1edf-444f-bc2f-f2c4e82ab48e req-5b3e6413-ea36-4b84-abb9-a94703b91b6a service nova] Creating event network-changed:9b851bf0-1e9b-417a-833d-ebc6a5b707e4 for instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 on n-h2-854663-10 Oct 27 10:18:23.617185 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-00d7acf2-1edf-444f-bc2f-f2c4e82ab48e req-5b3e6413-ea36-4b84-abb9-a94703b91b6a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139777 Oct 27 10:18:23.625482 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1311/2442] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:23.642725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:23.643681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:23.688109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.688808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.691088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:23.692777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.694469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.697253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:23.842669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:23.857398 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76923e06-261d-4fd6-96a2-22adaf049525 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1316 microversion: 2.1 time: 0.654243 Oct 27 10:18:23.858013 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1132/2443] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:23 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:23.877587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:23.878778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:23.902124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.902403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.902833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:23.908646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:23.909155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:23.909594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:24.047621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:24.065584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:24.067429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:24.088833 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f0dc1bf-589e-4e60-a67e-07734cc0e69a tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.461288 Oct 27 10:18:24.098518 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1312/2444] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:23 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:24.109325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1296a155-7a4c-442e-8793-b80aa7d8b6b5 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Calling method '.version_select at 0x7f6d5ae9cd30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:24.901768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:24.919676 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-32146f08-53fc-490c-b6b5-faba1bc16c5d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1508 microversion: 2.1 time: 1.058566 Oct 27 10:18:24.937776 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1133/2445] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:23 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1508 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:24.953808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c1124069-4f22-47aa-bb1b-b54aa0a88300 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b400310>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:25.026689 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c1124069-4f22-47aa-bb1b-b54aa0a88300 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.087471 Oct 27 10:18:25.029534 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1134/2446] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:24 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:25.043699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:25.044603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:25.061711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:25.062486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:25.063119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:25.064856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:25.067133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:25.068317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:25.336013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:25.351092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:25.352824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:25.354139 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b5435b47-ef81-41b4-b310-a91af8d36910 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1320 microversion: 2.26 time: 0.322277 Oct 27 10:18:25.372695 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1135/2447] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:25 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:25.380943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:25.380943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:25.398734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:25.403791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:25.404332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:25.406345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:25.406826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:25.409641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:25.842872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:25.855247 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2421af7a-21af-40f9-841e-69f2263634eb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1466 microversion: 2.1 time: 0.492028 Oct 27 10:18:25.856210 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1136/2448] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:25 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1466 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:25.874264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aed22b83-c3c6-4940-9621-daacfb827c83 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:25.881848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aed22b83-c3c6-4940-9621-daacfb827c83 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:25.899004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed22b83-c3c6-4940-9621-daacfb827c83 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:25.899566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed22b83-c3c6-4940-9621-daacfb827c83 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:25.899986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed22b83-c3c6-4940-9621-daacfb827c83 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:25.900715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed22b83-c3c6-4940-9621-daacfb827c83 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:25.901164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed22b83-c3c6-4940-9621-daacfb827c83 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:25.901585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed22b83-c3c6-4940-9621-daacfb827c83 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:26.140189 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aed22b83-c3c6-4940-9621-daacfb827c83 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "PUT /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1080 microversion: 2.1 time: 0.281898 Oct 27 10:18:26.152880 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1137/2449] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 10:18:25 2022] PUT /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1080 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:26.154133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:26.156513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:26.167451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:26.167941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:26.168375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:26.169118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:26.169564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:26.169981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:26.313260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:26.325875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:26.329733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:26.341379 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5a2ae8f7-cfa4-456d-9fff-75f88553b8f6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.196733 Oct 27 10:18:26.343169 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1138/2450] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:26 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:26.351774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82649c72-58fa-4443-90fe-cd175fc86072 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:26.352868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-82649c72-58fa-4443-90fe-cd175fc86072 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:26.366216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82649c72-58fa-4443-90fe-cd175fc86072 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:26.367388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82649c72-58fa-4443-90fe-cd175fc86072 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:26.368228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82649c72-58fa-4443-90fe-cd175fc86072 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:26.372159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82649c72-58fa-4443-90fe-cd175fc86072 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:26.372896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82649c72-58fa-4443-90fe-cd175fc86072 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:26.373629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82649c72-58fa-4443-90fe-cd175fc86072 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:26.575448 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1296a155-7a4c-442e-8793-b80aa7d8b6b5 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/f9902d69-71a0-493d-9ec4-2afbee2ce350" status: 202 len: 0 microversion: 2.1 time: 2.475618 Oct 27 10:18:26.577120 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1313/2451] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:18:24 2022] DELETE /compute/v2.1/os-floating-ips/f9902d69-71a0-493d-9ec4-2afbee2ce350 => generated 0 bytes in 2478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:18:26.591551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d594751-e505-4802-9898-a0103c1bee63 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b4a6940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:26.683008 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d594751-e505-4802-9898-a0103c1bee63 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.103853 Oct 27 10:18:26.683598 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1314/2452] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:26 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:26.691707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:26.700215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:26.714509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:26.717306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:26.717930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:26.718662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:26.719170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:26.719540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:26.773158 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82649c72-58fa-4443-90fe-cd175fc86072 tempest-ServersOnMultiNodesTest-1035913171 tempest-ServersOnMultiNodesTest-1035913171-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1619 microversion: 2.1 time: 0.422757 Oct 27 10:18:26.774507 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1139/2453] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:26 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1619 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:26.784807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:26.795523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:26.810485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:26.811193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:26.811779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:26.812737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:26.813285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:26.813901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:26.956498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:26.988056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:26.992117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:26.995741 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b13a22de-6f1c-4651-814f-de5c8d5696f6 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1320 microversion: 2.26 time: 0.217669 Oct 27 10:18:26.999087 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1140/2454] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:26 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1320 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:27.004649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13bc0552-64f8-439a-9eaf-929e9a5d9993 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] Calling method '.version_select at 0x7f6d5ad62430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:27.254816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:27.267736 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40d9bfec-87b6-4f59-a920-7399f0c8556b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1506 microversion: 2.1 time: 0.579736 Oct 27 10:18:27.268537 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1315/2455] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:26 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:27.273737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:27.275234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:27.290057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:27.293860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:27.294578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:27.302297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:27.304531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:27.308131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:27.361588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:27.605019 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5d366e9-0c81-4ef6-b6c1-9a468818a2b9 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 204 len: 0 microversion: 2.1 time: 0.334738 Oct 27 10:18:27.605716 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1316/2456] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:27 2022] DELETE /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:27.638225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:27.638960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:27.669330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:27.669841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:27.670283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:27.678238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:27.678737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:27.679184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:28.074103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:28.083451 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6616d383-c95f-49b8-90c8-8a436de78a01 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1506 microversion: 2.1 time: 0.461951 Oct 27 10:18:28.091193 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1317/2457] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:27 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:28.098786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:28.099402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:28.132509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:28.136123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:28.136897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:28.137866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:28.141477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:28.142150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:28.438182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:28.449386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:28.451060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:28.458559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36d1ca0e-0d16-4e74-b484-f67cc0254d8e tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.366129 Oct 27 10:18:28.459766 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1318/2458] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:28 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:28.470738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:28.471635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:28.479808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:28.480497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:28.482210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:28.483611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:28.484413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:28.485042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:28.991514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:29.007827 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e076178e-37c8-4c43-a5cf-14bed1a23540 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1472 microversion: 2.1 time: 0.546625 Oct 27 10:18:29.011671 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1319/2459] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:28 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1472 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:29.024932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1075905-5f29-44f3-bdd7-283a3ed2eb6c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5bafd9d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:29.039030 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13bc0552-64f8-439a-9eaf-929e9a5d9993 tempest-FloatingIPDetailsTestJSON-1619059032 tempest-FloatingIPDetailsTestJSON-1619059032-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/f4cce6d4-3201-4fe2-8469-3e4293492595" status: 202 len: 0 microversion: 2.1 time: 2.038683 Oct 27 10:18:29.040261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1141/2460] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:18:26 2022] DELETE /compute/v2.1/os-floating-ips/f4cce6d4-3201-4fe2-8469-3e4293492595 => generated 0 bytes in 2041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:18:29.047478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:29.048327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:29.070345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.071364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.072045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.073120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.077423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.078121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.120831 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1075905-5f29-44f3-bdd7-283a3ed2eb6c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.107513 Oct 27 10:18:29.122049 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1320/2461] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:29 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:29.127534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:29.135331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:29.148017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.148854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.149530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.150445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.151416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.152253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.305645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:29.323154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:29.323709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:29.326971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:29.326971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:29.482751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:29.494241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.497124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.498051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.500044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.501892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.502364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.553939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:29.576407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:29.580040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:29.583565 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-99b14faf-f913-41b1-8d62-0aeda6139fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1362 microversion: 2.26 time: 0.539893 Oct 27 10:18:29.586165 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1142/2462] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:29 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1362 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:29.591716 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50e10f66-f913-444d-9ce7-c8e1bab01168 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "POST /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165/action" status: 202 len: 1112 microversion: 2.1 time: 0.468354 Oct 27 10:18:29.592352 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1321/2463] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:18:29 2022] POST /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165/action => generated 1112 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 10:18:29.603204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:29.606797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:29.621290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:29.622123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:29.631551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.634373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.637372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.640479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.640630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.641112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.641696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.644053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.648160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.649117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.649688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.650593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.982592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:29.997075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:30.000390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:30.018681 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc69ad72-cfce-4d38-810e-342ccbbda8a5 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.429089 Oct 27 10:18:30.021475 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1143/2464] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:29 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:30.044443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:30.046442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:30.060827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:30.062423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:30.063940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:30.068991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:30.069967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:30.071300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:30.148638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:30.168119 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d0ce360-39eb-4f72-a145-2aad04151539 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.550546 Oct 27 10:18:30.169003 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1322/2465] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:29 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:30.196578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20692e2e-1ce0-4a80-bbcc-ddda2292dad0 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b4a5820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:30.290340 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20692e2e-1ce0-4a80-bbcc-ddda2292dad0 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.106620 Oct 27 10:18:30.291674 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1323/2466] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:30 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:30.511932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:30.523491 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0bf5510d-4f38-4f39-be2b-9ffffc8db493 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1472 microversion: 2.1 time: 0.484593 Oct 27 10:18:30.524228 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1144/2467] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:30 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:30.615144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:30.615774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:30.649322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:30.650554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:30.651276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:30.653698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:30.671955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:30.675677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.083294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2be75c8d-d70e-4bd5-ad89-705ca07087f5 req-40c4a190-7c71-4ab5-8018-5695f7c00a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df81441a-4602-46a5-8388-01be10aa1bbf", "tag": "7f8d46de-55e3-462e-bd1d-03058084d257"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:31.106700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2be75c8d-d70e-4bd5-ad89-705ca07087f5 req-40c4a190-7c71-4ab5-8018-5695f7c00a3d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.107905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:31.111643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2be75c8d-d70e-4bd5-ad89-705ca07087f5 req-40c4a190-7c71-4ab5-8018-5695f7c00a3d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.114306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2be75c8d-d70e-4bd5-ad89-705ca07087f5 req-40c4a190-7c71-4ab5-8018-5695f7c00a3d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.118592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:31.127321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:31.130130 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30b64a54-5fcb-4053-bba0-18da43975fe8 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1362 microversion: 2.26 time: 0.520301 Oct 27 10:18:31.132858 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1324/2468] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:30 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1362 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:31.146702 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2be75c8d-d70e-4bd5-ad89-705ca07087f5 req-40c4a190-7c71-4ab5-8018-5695f7c00a3d service nova] Creating event network-changed:7f8d46de-55e3-462e-bd1d-03058084d257 for instance df81441a-4602-46a5-8388-01be10aa1bbf on n-h1-854663-10 Oct 27 10:18:31.149581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:31.151605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:31.166252 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2be75c8d-d70e-4bd5-ad89-705ca07087f5 req-40c4a190-7c71-4ab5-8018-5695f7c00a3d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.540084 Oct 27 10:18:31.167741 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1145/2469] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:31.183285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.183862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.184596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.185540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.187175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.187977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.198069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:31.199070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:31.212887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.214655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.216000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.218384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.219532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.225646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.444355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:31.457137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:31.458997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:31.490250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c66b036f-f810-46f1-b772-fbbbe2d6e034 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.352957 Oct 27 10:18:31.493019 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1325/2470] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:31 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:31.502686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d9931a7-708f-437d-925e-84c63931300d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ab39430>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:31.553282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:31.605170 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d9931a7-708f-437d-925e-84c63931300d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.108652 Oct 27 10:18:31.605765 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1326/2471] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:31 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:31.615529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:31.628640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:31.643995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:31.646227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.647113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.650406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.651401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.652278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.654004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.736420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.739583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.742171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.742900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lazy-loading 'fault' on Instance uuid 7ba1bb9f-3333-46b3-be74-35a44309bccb {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:31.972189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:31.983087 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-93ec6166-04cf-45ce-a38b-c8be43f4d82b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 200 len: 1306 microversion: 2.1 time: 0.371917 Oct 27 10:18:32.001309 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1327/2472] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:31 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 1306 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:32.009107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:32.023726 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9053db74-495c-4bdc-8c77-8acd1f5e755a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.830691 Oct 27 10:18:32.024335 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1146/2473] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:31 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:32.160834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:32.174267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:32.182471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:32.184235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:32.184859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:32.185484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:32.187333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:32.188533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:32.189173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:32.530882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:32.532782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:32.541642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:32.542526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:32.543233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:32.544150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:32.547195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:32.548039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:32.679111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:32.688650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:32.689976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:32.692402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:32.699907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:32.701821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:32.702663 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87529d15-a4bb-4e93-90e2-5cfed985d2ef tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.182011 Oct 27 10:18:32.703249 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1147/2474] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:32 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:32.703393 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ab8a1e2-7534-4a41-9dbc-65121b916035 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1362 microversion: 2.26 time: 0.548842 Oct 27 10:18:32.717188 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1328/2475] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:32 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1362 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:18:32.724693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5e7cc90-6da6-4b02-afd8-88e7610d42b6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5babae50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:32.817605 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5e7cc90-6da6-4b02-afd8-88e7610d42b6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.103448 Oct 27 10:18:32.818195 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1329/2476] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:32 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:33.014535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:33.015476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 7ba1bb9f-3333-46b3-be74-35a44309bccb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:33.033521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.034581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.035588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.037604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.038365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.039147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.062285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:33.062983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:33.067742 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] HTTP exception thrown: Instance 7ba1bb9f-3333-46b3-be74-35a44309bccb could not be found. Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Request method failure captured: Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb HTTP/1.1 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWloQLxHnNNSLyqIv1uUr-kKL7BMS9PuVcRRRiotWz6QYTSAM3KSU19rVpCcTtDx06Tod0KE4fGhrG7wtj42fltNjNjrtqmOah2uw0IXRdSCux0nZhTvRGDBbcJ8a7kSiBRtXcDxRJAb2hVz3gprkrUEfnYCf7h7Q6sJAW26p4tAfnys Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88e242ed84c14a5eaabf74309f00b689", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9685331306514f73a2d834a0bf5a77a3 Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 7ba1bb9f-3333-46b3-be74-35a44309bccb could not be found. Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '7ba1bb9f-3333-46b3-be74-35a44309bccb'} Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba1bb9f-3333-46b3-be74-35a44309bccb could not be found. Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba1bb9f-3333-46b3-be74-35a44309bccb could not be found. Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:33.071122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:33.074723 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:33.074723 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:33.074723 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:33.074723 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:33.074723 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:33.074723 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba1bb9f-3333-46b3-be74-35a44309bccb could not be found. Oct 27 10:18:33.074723 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:33.074723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Returning 404 to user: Instance 7ba1bb9f-3333-46b3-be74-35a44309bccb could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:33.074723 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee410a7b-011b-4a32-8c57-ef4e13227bb7 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb" status: 404 len: 111 microversion: 2.1 time: 0.062121 Oct 27 10:18:33.075256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.076996 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1148/2477] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:33 2022] GET /compute/v2.1/servers/7ba1bb9f-3333-46b3-be74-35a44309bccb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:18:33.079853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.081151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.083738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.086839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.089556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.093582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:33.094199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:33.106443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.106941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.107677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.116967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.117848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.118531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.130867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:33.178453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:33.271752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:33.401102 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-566b58a7-e4f3-4117-85a4-d01505a48b51 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 204 len: 0 microversion: 2.1 time: 0.316287 Oct 27 10:18:33.407496 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1149/2478] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:33 2022] DELETE /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:33.414549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-68514277-f27a-45be-9345-b4fcc112fe04 req-6983257b-09fd-4343-8320-3994f1a449c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba1bb9f-3333-46b3-be74-35a44309bccb", "name": "network-vif-deleted", "tag": "4088419e-9209-49d2-af92-4903edac81d7"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:33.426954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-68514277-f27a-45be-9345-b4fcc112fe04 req-6983257b-09fd-4343-8320-3994f1a449c2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.427455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-68514277-f27a-45be-9345-b4fcc112fe04 req-6983257b-09fd-4343-8320-3994f1a449c2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.427888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-68514277-f27a-45be-9345-b4fcc112fe04 req-6983257b-09fd-4343-8320-3994f1a449c2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.449836 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-68514277-f27a-45be-9345-b4fcc112fe04 req-6983257b-09fd-4343-8320-3994f1a449c2 service nova] Creating event network-vif-deleted:4088419e-9209-49d2-af92-4903edac81d7 for instance 7ba1bb9f-3333-46b3-be74-35a44309bccb on n-h2-854663-10 Oct 27 10:18:33.468397 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-68514277-f27a-45be-9345-b4fcc112fe04 req-6983257b-09fd-4343-8320-3994f1a449c2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058042 Oct 27 10:18:33.468397 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1150/2479] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:33.488224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:33.489261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:33.499849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.501705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.502341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.503245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.503965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.506219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.531375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:33.552193 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05aa6916-73a9-4ab0-88ce-1523c08ebea0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.501096 Oct 27 10:18:33.559302 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1330/2480] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:33 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:33.735860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:33.736930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:33.764448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.767047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.768388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.772406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.774800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.776959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.790359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:33.803929 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf815e74-bf96-48f7-92d7-231a462474f4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1471 microversion: 2.1 time: 0.334896 Oct 27 10:18:33.805469 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1151/2481] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:33 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1471 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:33.818454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:33.819508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:33.827711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.828553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.829644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.830886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.832327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.833448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:34.074885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:34.102492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:34.113694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:34.137307 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5c4f128-5067-4b0b-9c02-880a8aef4190 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.330576 Oct 27 10:18:34.152690 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1152/2482] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:33 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:34.168924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ddcdfeb-5cc5-4561-b4f2-e19ab3c5ea42 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b2a6430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:34.197752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:34.207865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:34.217466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:34.219267 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3e9f2ff-9638-4e1f-ae53-35b2d2da1136 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1362 microversion: 2.26 time: 0.487819 Oct 27 10:18:34.220492 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1331/2483] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:33 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:34.275443 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ddcdfeb-5cc5-4561-b4f2-e19ab3c5ea42 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.122917 Oct 27 10:18:34.276426 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1153/2484] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:34 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:34.583832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:34.585098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:34.598782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:34.601777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:34.602362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:34.603268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:34.604642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:34.605250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:34.818137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:34.831162 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cc0005ab-76c0-4b9a-b74d-bc8ba9c784d7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.251603 Oct 27 10:18:34.832505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:34.834127 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1332/2485] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:34 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:34.864166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:34.884099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:34.887338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:34.887876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:34.888697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:34.891290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:34.892007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:35.143859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:35.153706 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-44d786aa-0159-4e38-a6b6-bc7c84bb1da0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1471 microversion: 2.1 time: 0.328569 Oct 27 10:18:35.154759 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1154/2486] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:34 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:35.177252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a3b3025-4d94-48de-8d08-9f441b88d598 tempest-QuotaClassesAdminTestJSON-1313871317 tempest-QuotaClassesAdminTestJSON-1313871317-project-admin] Calling method '.version_select at 0x7f6d5ab394c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:35.180454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:35.181775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:35.190914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:35.191849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:35.192302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:35.193055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:35.193505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:35.194094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:35.196595 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a3b3025-4d94-48de-8d08-9f441b88d598 tempest-QuotaClassesAdminTestJSON-1313871317 tempest-QuotaClassesAdminTestJSON-1313871317-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.254576 Oct 27 10:18:35.205278 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1333/2487] 10.222.0.76 () {58 vars in 1185 bytes} [Thu Oct 27 10:18:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:35.210693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8094559a-4e04-4d21-ab25-faa97f4b25e3 tempest-QuotaClassesAdminTestJSON-1313871317 tempest-QuotaClassesAdminTestJSON-1313871317-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5b497820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:35.278719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:35.291244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:35.294811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:35.314645 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5125b0c9-f1c2-4f62-a1da-e9a93dcaf5e9 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1446 microversion: 2.75 time: 0.141616 Oct 27 10:18:35.315716 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1155/2488] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:35 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:35.321261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:35.321788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:35.337588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:35.338120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:35.338551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:35.339306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:35.339759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:35.340175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:35.619739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:35.643094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:35.646853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:35.652507 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0bd6da9f-54ce-4ad6-a528-f6d1bfb88e8a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1362 microversion: 2.26 time: 0.333122 Oct 27 10:18:35.656807 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1156/2489] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:35 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:35.670806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-613ba6bd-15b9-4c02-a084-5f6e8a9de9a3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b2d59d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:35.735587 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8094559a-4e04-4d21-ab25-faa97f4b25e3 tempest-QuotaClassesAdminTestJSON-1313871317 tempest-QuotaClassesAdminTestJSON-1313871317-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.528615 Oct 27 10:18:35.736741 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1334/2490] 10.222.0.76 () {60 vars in 1206 bytes} [Thu Oct 27 10:18:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:35.751137 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-613ba6bd-15b9-4c02-a084-5f6e8a9de9a3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.093636 Oct 27 10:18:35.760675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae589822-53c5-468c-8268-7e7d934058d7 tempest-QuotaClassesAdminTestJSON-1313871317 tempest-QuotaClassesAdminTestJSON-1313871317-project-admin] Calling method '.version_select at 0x7f6d5aeb2040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:35.762522 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1157/2491] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:35 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:35.791507 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae589822-53c5-468c-8268-7e7d934058d7 tempest-QuotaClassesAdminTestJSON-1313871317 tempest-QuotaClassesAdminTestJSON-1313871317-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.046263 Oct 27 10:18:35.792170 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1335/2492] 10.222.0.76 () {58 vars in 1185 bytes} [Thu Oct 27 10:18:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:18:35.808781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f802c5d-c809-425f-8202-0873ec421c1f tempest-QuotaClassesAdminTestJSON-1313871317 tempest-QuotaClassesAdminTestJSON-1313871317-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5b2a5670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:35.858455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:35.859283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:35.873628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:35.875971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:35.876427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:35.881414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:35.885251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:35.885863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:36.042484 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f802c5d-c809-425f-8202-0873ec421c1f tempest-QuotaClassesAdminTestJSON-1313871317 tempest-QuotaClassesAdminTestJSON-1313871317-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.240444 Oct 27 10:18:36.043784 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1158/2493] 10.222.0.76 () {60 vars in 1206 bytes} [Thu Oct 27 10:18:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:36.198234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:36.200911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:36.226170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:36.226752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:36.227873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:36.234686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:36.237605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:36.240890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:36.552276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:36.595975 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b90331ce-7380-49a1-9b4c-4f672d2e5884 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.741187 Oct 27 10:18:36.599748 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1336/2494] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:35 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:36.607827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:36.609016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:36.621543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:36.629546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:36.630066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:36.630691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:36.631586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:36.633492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:36.634141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:36.647975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46197adb-d578-4628-bdde-e652f10e0022 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1429 microversion: 2.1 time: 0.470258 Oct 27 10:18:36.652114 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1159/2495] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:36 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1429 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:36.688612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:36.719015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:36.719015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:36.719015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:36.722529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:36.723600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:36.724098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:36.724520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:36.868696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:36.884650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:36.886991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:36.895122 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-27696475-566c-4197-b0c2-5d0cd6ead1bb tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1464 microversion: 2.75 time: 0.294065 Oct 27 10:18:36.919145 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1337/2496] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:36 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1464 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:36.929602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3723b5a7-404b-4e36-bddc-90dbbc4d42db req-221d5e52-16b2-4a17-9642-33aea24cef6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede6f4e8-6d53-490c-bbed-1fd10073a329", "name": "network-vif-deleted", "tag": "b224ea12-edab-4ba5-8bf7-5617d73b0b2f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:36.944086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3723b5a7-404b-4e36-bddc-90dbbc4d42db req-221d5e52-16b2-4a17-9642-33aea24cef6f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:36.945512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3723b5a7-404b-4e36-bddc-90dbbc4d42db req-221d5e52-16b2-4a17-9642-33aea24cef6f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:36.946559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3723b5a7-404b-4e36-bddc-90dbbc4d42db req-221d5e52-16b2-4a17-9642-33aea24cef6f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:36.989686 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3723b5a7-404b-4e36-bddc-90dbbc4d42db req-221d5e52-16b2-4a17-9642-33aea24cef6f service nova] Creating event network-vif-deleted:b224ea12-edab-4ba5-8bf7-5617d73b0b2f for instance ede6f4e8-6d53-490c-bbed-1fd10073a329 on n-h1-854663-10 Oct 27 10:18:36.998720 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3723b5a7-404b-4e36-bddc-90dbbc4d42db req-221d5e52-16b2-4a17-9642-33aea24cef6f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077053 Oct 27 10:18:37.007390 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1338/2497] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:37.017240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11651083-618b-4e3f-a63d-1f714e789a8a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ab14f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:37.113782 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11651083-618b-4e3f-a63d-1f714e789a8a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.102899 Oct 27 10:18:37.116498 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1339/2498] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:37 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:37.183592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:37.195488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:37.200266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:37.206401 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46e5eaae-5817-48da-9592-37fc4c29987a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1362 microversion: 2.26 time: 0.519395 Oct 27 10:18:37.208108 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1160/2499] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:36 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:18:37.622634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:37.623377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:37.634558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:37.648703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:37.649269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:37.650106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:37.650697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:37.651363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:37.675207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:37.676179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:37.685412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:37.690098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:37.690662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:37.691655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:37.692294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:37.692850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:37.764814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=13 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:37.769657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:37.770294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:37.770887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:37.771409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lazy-loading 'fault' on Instance uuid ede6f4e8-6d53-490c-bbed-1fd10073a329 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:38.063788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:38.089662 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13c20510-cda4-4cc7-b579-95caeec8c907 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 200 len: 1306 microversion: 2.1 time: 0.418304 Oct 27 10:18:38.091006 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1161/2500] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:37 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 1306 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:38.096549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:38.097744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:38.114949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:38.116035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:38.117020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:38.119820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:38.120751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:38.121334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:38.326450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:38.341915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:38.345654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:38.354371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:38.369748 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48a0fdab-50c6-476d-93fb-b457c55f16be tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.752748 Oct 27 10:18:38.372617 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1340/2501] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:37 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:38.374405 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0baa9a6-883e-4024-98c1-94e2b5d4dd8f tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1452 microversion: 2.75 time: 0.280106 Oct 27 10:18:38.378397 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1162/2502] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:38 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1452 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:38.392383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bea5c22a-e710-4b3c-94b1-24cf4fdd964e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ab14af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:38.397674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:38.398976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:38.429438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:38.432263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:38.432810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:38.433488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:38.433957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:38.434817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:38.512276 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bea5c22a-e710-4b3c-94b1-24cf4fdd964e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1453 microversion: 2.1 time: 0.136975 Oct 27 10:18:38.513299 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1341/2503] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:38 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:38.765974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:38.775567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:38.777209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:38.779052 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f45eb330-a343-441d-b419-8825476710a7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1362 microversion: 2.26 time: 0.398163 Oct 27 10:18:38.779957 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1163/2504] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:38 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:39.117582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:39.118298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ede6f4e8-6d53-490c-bbed-1fd10073a329] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:39.138490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.139690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.140404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.141177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.141627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.142044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.160959 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] HTTP exception thrown: Instance ede6f4e8-6d53-490c-bbed-1fd10073a329 could not be found. Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Request method failure captured: Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 HTTP/1.1 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWloQLxHnNNSLyqIv1uUr-kKL7BMS9PuVcRRRiotWz6QYTSAM3KSU19rVpCcTtDx06Tod0KE4fGhrG7wtj42fltNjNjrtqmOah2uw0IXRdSCux0nZhTvRGDBbcJ8a7kSiBRtXcDxRJAb2hVz3gprkrUEfnYCf7h7Q6sJAW26p4tAfnys Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88e242ed84c14a5eaabf74309f00b689", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9685331306514f73a2d834a0bf5a77a3 Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance ede6f4e8-6d53-490c-bbed-1fd10073a329 could not be found. Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ede6f4e8-6d53-490c-bbed-1fd10073a329'} Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede6f4e8-6d53-490c-bbed-1fd10073a329 could not be found. Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede6f4e8-6d53-490c-bbed-1fd10073a329 could not be found. Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:39.163192 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:39.167139 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:39.167139 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:39.167139 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:39.167139 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:39.167139 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:39.167139 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede6f4e8-6d53-490c-bbed-1fd10073a329 could not be found. Oct 27 10:18:39.167139 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:39.168637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Returning 404 to user: Instance ede6f4e8-6d53-490c-bbed-1fd10073a329 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:39.170425 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae781fd0-3802-465e-a3f1-d0e92926f1d1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329" status: 404 len: 111 microversion: 2.1 time: 0.056948 Oct 27 10:18:39.180932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:39.181926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:39.197855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1342/2505] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:39 2022] GET /compute/v2.1/servers/ede6f4e8-6d53-490c-bbed-1fd10073a329 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:18:39.203221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.203711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.204154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.204967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.209531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.210006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.261639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:39.396788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:39.397284 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-071fe232-4a02-4162-8556-b5e6ef313ead tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 204 len: 0 microversion: 2.1 time: 0.220846 Oct 27 10:18:39.397623 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1164/2506] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:39 2022] DELETE /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:39.399018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:39.410881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:39.411585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:39.418515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.419351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.420057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.420882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.421610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.423214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.427446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.432559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.433120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.433836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.434298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.434723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.541108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:39.555945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:39.558375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:39.566947 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c7623b18-5c97-47b2-8486-e8ccdc5ce121 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1437 microversion: 2.75 time: 0.160505 Oct 27 10:18:39.577006 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1165/2507] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:39 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1437 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:39.584692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:39.586880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:39.594320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.594840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.595311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.596023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.596499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.596946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.611856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:39.626871 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f48ac4e-c845-490b-b4b1-775eca8f9fbd tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.234776 Oct 27 10:18:39.639964 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1343/2508] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:39 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:39.639964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a07028c7-5ffd-45b9-9da0-9a187935816f tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b4a50d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:39.691743 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a07028c7-5ffd-45b9-9da0-9a187935816f tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1462 microversion: 2.1 time: 0.062596 Oct 27 10:18:39.693069 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1344/2509] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:39 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1462 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:39.774850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:39.782972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-127ef4b6-6670-4b95-bd92-d824914fd611 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1472 microversion: 2.1 time: 0.214406 Oct 27 10:18:39.783769 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1166/2510] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:39 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:39.794060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe750b39-120e-490a-8163-ae287ff5c31e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ad67670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:39.845588 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe750b39-120e-490a-8163-ae287ff5c31e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 200 len: 1462 microversion: 2.1 time: 0.060590 Oct 27 10:18:39.846182 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1167/2511] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:39 2022] GET /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 1462 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:39.859027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:39.860060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:39.866733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.867209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.867634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.868493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.869256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.870116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.990399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:39.994898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:40.003629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.004759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.005336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.006287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.006744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.007661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.019334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:40.022684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:40.035756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:40.035756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:40.035756 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ccf2e21-f237-402a-9fdc-c19238b49ae4 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1362 microversion: 2.26 time: 0.188493 Oct 27 10:18:40.036223 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1168/2512] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:39 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:40.041737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:40.042497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:40.048756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.049248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.049685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.050418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.050868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.051404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.114058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:40.114744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:40.115333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:40.115740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:40.116311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:40.198151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:40.205643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.206514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.207391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.208300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.210374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.211415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.216388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:40.225911 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-06cad99b-4b33-4827-8f60-36dc2952993c tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1465 microversion: 2.1 time: 0.188569 Oct 27 10:18:40.226647 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1169/2513] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:40 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1465 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:40.252609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a69b43f8-8695-42ef-acd8-4a30b76e2589 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b855c10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:40.341740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:40.370272 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e833679a-2bf0-4cad-bdca-5913a3f32dff tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a/action" status: 202 len: 1942 microversion: 2.75 time: 0.675494 Oct 27 10:18:40.380840 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1345/2514] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:18:39 2022] POST /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a/action => generated 1942 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 10:18:40.397774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:40.399129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:40.407121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.407917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.408588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.409562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.410261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.411101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.418307 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a69b43f8-8695-42ef-acd8-4a30b76e2589 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images?changes-since=2022-10-27T10%3A16%3A16Z" status: 200 len: 1902 microversion: 2.1 time: 0.168373 Oct 27 10:18:40.419765 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1170/2515] 10.222.0.76 () {58 vars in 1199 bytes} [Thu Oct 27 10:18:40 2022] GET /compute/v2.1/images?changes-since=2022-10-27T10%3A16%3A16Z => generated 1902 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:40.434007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-23362ed4-0fe2-4b8e-ae6f-65ac62797be7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ac0fc10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:40.516266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:40.535748 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-23362ed4-0fe2-4b8e-ae6f-65ac62797be7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1043282051" status: 200 len: 485 microversion: 2.1 time: 0.103054 Oct 27 10:18:40.539708 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1171/2516] 10.222.0.76 () {58 vars in 1231 bytes} [Thu Oct 27 10:18:40 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1043282051 => generated 485 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:18:40.543971 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b7ee86d-0559-46d0-9856-f01ea869651e tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.150099 Oct 27 10:18:40.544547 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1346/2517] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:40 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:40.560484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e66eab6-5b3f-4c37-b4c9-fca890319ee7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ab48550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:40.695954 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e66eab6-5b3f-4c37-b4c9-fca890319ee7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images?server=6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 957 microversion: 2.1 time: 0.145554 Oct 27 10:18:40.697632 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1172/2518] 10.222.0.76 () {58 vars in 1209 bytes} [Thu Oct 27 10:18:40 2022] GET /compute/v2.1/images?server=6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 957 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:40.713740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:40.714689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:40.724269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.726202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.726837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.727759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.728541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.730130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.815730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1006024841", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:40.886624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:18:40.940686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:40.948596 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a053b09-26c2-4494-bd23-78e57eb4f32c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.249481 Oct 27 10:18:40.949260 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1173/2519] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:40 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:40.954206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76ed541e-71fe-41a3-8d45-014e5d96e364 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d63778940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:41.012626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76ed541e-71fe-41a3-8d45-014e5d96e364 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.76%2Fcompute%2Fv2.1%2Fservers%2F45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 484 microversion: 2.1 time: 0.062253 Oct 27 10:18:41.013335 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1174/2520] 10.222.0.76 () {58 vars in 1317 bytes} [Thu Oct 27 10:18:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.76%2Fcompute%2Fv2.1%2Fservers%2F45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 484 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:41.020914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:41.021874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:41.028867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.029602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.029999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.030885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.031331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.031775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.321116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:41.331143 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c2f2e6c-e23c-41b7-a686-66222251c436 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1472 microversion: 2.1 time: 0.316561 Oct 27 10:18:41.331305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:41.332356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:41.333692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:41.334738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:41.336798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:41.352605 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1175/2521] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:41 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:41.357315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.358049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.358873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.361324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.361974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.362709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.386569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Getting quotas for project 056256e66fac49e4ba491807ec69861f. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:18:41.392585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Getting quotas for user 3b64e7f20ecd42fbbc0eab74d40aa90f and project 056256e66fac49e4ba491807ec69861f. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:18:41.436006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:18:41.445963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0b7edf40-2a62-481c-a02e-ae5090b8b53f req-0f9e180f-063a-4e71-b718-704402388e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df81441a-4602-46a5-8388-01be10aa1bbf", "name": "network-vif-plugged", "status": "completed", "tag": "7f8d46de-55e3-462e-bd1d-03058084d257"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:41.454926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:18:41.457758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0b7edf40-2a62-481c-a02e-ae5090b8b53f req-0f9e180f-063a-4e71-b718-704402388e68 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.458326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0b7edf40-2a62-481c-a02e-ae5090b8b53f req-0f9e180f-063a-4e71-b718-704402388e68 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.458836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0b7edf40-2a62-481c-a02e-ae5090b8b53f req-0f9e180f-063a-4e71-b718-704402388e68 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.473125 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0b7edf40-2a62-481c-a02e-ae5090b8b53f req-0f9e180f-063a-4e71-b718-704402388e68 service nova] Creating event network-vif-plugged:7f8d46de-55e3-462e-bd1d-03058084d257 for instance df81441a-4602-46a5-8388-01be10aa1bbf on n-h1-854663-10 Oct 27 10:18:41.479190 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0b7edf40-2a62-481c-a02e-ae5090b8b53f req-0f9e180f-063a-4e71-b718-704402388e68 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125137 Oct 27 10:18:41.480310 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1176/2522] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:41.489431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68bcc266-896c-4c23-a634-e4828de297bd tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ab484c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:41.540208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee9a2e96-035a-4445-b4a9-83763e3cd79f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898628 Oct 27 10:18:41.541182 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1347/2523] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:18:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:18:41.546093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:41.546894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:41.561933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=12,nova_api:INSERT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:41.576685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.580445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.581776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.583452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.597510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.598083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.604548 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-68bcc266-896c-4c23-a634-e4828de297bd tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.76%2Fcompute%2Fservers%2F45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 484 microversion: 2.1 time: 0.121603 Oct 27 10:18:41.606122 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1177/2524] 10.222.0.76 () {58 vars in 1303 bytes} [Thu Oct 27 10:18:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.76%2Fcompute%2Fservers%2F45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 484 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:41.619831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a9f2b246-2468-4b11-9156-dfd5ac217378 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:41.622069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a9f2b246-2468-4b11-9156-dfd5ac217378 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:41.693030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9f2b246-2468-4b11-9156-dfd5ac217378 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:41.704866 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a9f2b246-2468-4b11-9156-dfd5ac217378 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1223 microversion: 2.1 time: 0.097291 Oct 27 10:18:41.705651 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1178/2525] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:41 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:41.713342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:41.714139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:41.725917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.726906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.727504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.729416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.730387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.731089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.928945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:41.964470 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ad7d9a7-b8dd-434c-8cb1-dadf3a75354b tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.257210 Oct 27 10:18:41.979466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:41.989773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:41.994291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:41.995258 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1179/2526] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:41 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:42.001350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-135675d8-81a1-4e02-a725-49553a1ba007 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5bc038b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.003476 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1daff4d-ddc1-490f-87bd-0d42b62c62b3 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1362 microversion: 2.26 time: 0.461071 Oct 27 10:18:42.004287 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1348/2527] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:41 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:42.010430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-59dba29d-9b17-4c54-82b2-70b573096d29 req-b2ea2846-0029-4d6e-b691-80e88f80b62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef114f37-a4a0-47b8-b0a0-5d75c05d0968", "name": "network-vif-deleted", "tag": "c7ee09b9-5c53-4520-8a18-fa1dcdb22fb2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:42.026254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-59dba29d-9b17-4c54-82b2-70b573096d29 req-b2ea2846-0029-4d6e-b691-80e88f80b62b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.026739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-59dba29d-9b17-4c54-82b2-70b573096d29 req-b2ea2846-0029-4d6e-b691-80e88f80b62b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.027176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-59dba29d-9b17-4c54-82b2-70b573096d29 req-b2ea2846-0029-4d6e-b691-80e88f80b62b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.048084 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-59dba29d-9b17-4c54-82b2-70b573096d29 req-b2ea2846-0029-4d6e-b691-80e88f80b62b service nova] Creating event network-vif-deleted:c7ee09b9-5c53-4520-8a18-fa1dcdb22fb2 for instance ef114f37-a4a0-47b8-b0a0-5d75c05d0968 on n-h1-854663-10 Oct 27 10:18:42.054286 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-59dba29d-9b17-4c54-82b2-70b573096d29 req-b2ea2846-0029-4d6e-b691-80e88f80b62b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048497 Oct 27 10:18:42.058326 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1349/2528] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:42.066600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.067620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:42.088418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.089483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.089957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.090937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.091392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.092351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.241970 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-135675d8-81a1-4e02-a725-49553a1ba007 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.244655 Oct 27 10:18:42.242634 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1180/2529] 10.222.0.76 () {58 vars in 1149 bytes} [Thu Oct 27 10:18:41 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:42.262124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-033d08fd-a423-4bff-b048-edcef8e19705 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ad67040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.315483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:42.327410 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba158b87-4291-4466-82b5-508c4165ee22 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.266898 Oct 27 10:18:42.327994 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1350/2530] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:42.359577 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-033d08fd-a423-4bff-b048-edcef8e19705 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.102356 Oct 27 10:18:42.359978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.364828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:42.364983 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1181/2531] 10.222.0.76 () {58 vars in 1149 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:42.371635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.372124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.372559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.377816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ac2822c-0af9-4b7a-80aa-5e86281a1ca4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b2a6940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.380127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.380624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.381228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.431620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.432350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.433003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.433697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lazy-loading 'fault' on Instance uuid ef114f37-a4a0-47b8-b0a0-5d75c05d0968 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:42.499762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:42.510700 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3107f53-a694-402f-bb01-64dd89d692b3 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 200 len: 1307 microversion: 2.1 time: 0.155119 Oct 27 10:18:42.512107 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1351/2532] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:42.517958 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ac2822c-0af9-4b7a-80aa-5e86281a1ca4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.146082 Oct 27 10:18:42.518643 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1182/2533] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:18:42.552709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2796e08e-a2a0-4efb-b03b-1d31c21dbdd2 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ab39d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.701226 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2796e08e-a2a0-4efb-b03b-1d31c21dbdd2 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/detail?changes-since=2022-10-27T10%3A16%3A10Z" status: 200 len: 6328 microversion: 2.1 time: 0.158022 Oct 27 10:18:42.701925 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1352/2534] 10.222.0.76 () {58 vars in 1220 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-27T10%3A16%3A10Z => generated 6328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:42.723905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-850fbfae-b194-4ec3-af8a-d26d9b3b274a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b2ebee0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.732107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.732931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:42.744903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.745987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.746437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.747155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.747616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.748049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.795960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:42.805928 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-850fbfae-b194-4ec3-af8a-d26d9b3b274a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1043282051" status: 200 len: 665 microversion: 2.1 time: 0.085973 Oct 27 10:18:42.820261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1183/2535] 10.222.0.76 () {58 vars in 1252 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1043282051 => generated 665 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:42.828584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f588cb6a-bee1-4847-9353-480b0f5cb67f tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ad67280>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.869114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:42.884288 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4de023b9-41ed-4987-8b0e-cb9bc7fa0814 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1219 microversion: 2.1 time: 0.157173 Oct 27 10:18:42.885958 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1353/2536] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:42.910214 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f588cb6a-bee1-4847-9353-480b0f5cb67f tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.76%2Fcompute%2Fv2.1%2Fservers%2F45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1464 microversion: 2.1 time: 0.088311 Oct 27 10:18:42.922085 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1184/2537] 10.222.0.76 () {58 vars in 1338 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.76%2Fcompute%2Fv2.1%2Fservers%2F45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1464 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:42.927741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72aeae91-c67c-49ec-ba29-46d139013ea3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5aeb0940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.995848 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72aeae91-c67c-49ec-ba29-46d139013ea3 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.76%2Fcompute%2Fservers%2F45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1464 microversion: 2.1 time: 0.073260 Oct 27 10:18:42.996433 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1354/2538] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.76%2Fcompute%2Fservers%2F45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1464 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:43.008693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.009596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:43.021923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77b4a165-0a97-4e2c-8fd7-ad46883e5699 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ae9c790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.023210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.023882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.024480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.025372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.025993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.026555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.179887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:43.195356 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77b4a165-0a97-4e2c-8fd7-ad46883e5699 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.185353 Oct 27 10:18:43.196977 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1355/2539] 10.222.0.76 () {58 vars in 1170 bytes} [Thu Oct 27 10:18:43 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:43.202068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.202788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:43.211243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.211894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.212617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.213588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.214491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.215155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.223195 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b09e0286-1d96-44f5-bdac-6f422c10ddf5 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.227394 Oct 27 10:18:43.223913 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1185/2540] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:43.229730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f455d32a-cfda-430c-b035-bdb986ebb9d6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ace8940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.363491 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f455d32a-cfda-430c-b035-bdb986ebb9d6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.136974 Oct 27 10:18:43.364740 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1186/2541] 10.222.0.76 () {58 vars in 1170 bytes} [Thu Oct 27 10:18:43 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:43.393089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.394786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:43.399750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:43.405276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.406034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.406793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.407720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.409066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.410496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:43.412211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:43.413973 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d721c53a-7ca6-45e3-84a5-45368e670fee tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1547 microversion: 2.26 time: 0.215527 Oct 27 10:18:43.414428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.414978 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1356/2542] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:43 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1547 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:43.432615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3aad68b7-f612-453a-956e-4947800356e4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5aae61f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.509754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3aad68b7-f612-453a-956e-4947800356e4 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/e360a591-87a4-48a1-b578-afd9703b636a" status: 200 len: 784 microversion: 2.1 time: 0.093346 Oct 27 10:18:43.510433 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1357/2543] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:18:43 2022] GET /compute/v2.1/images/e360a591-87a4-48a1-b578-afd9703b636a => generated 784 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:43.523182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5baf3040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.544956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.545453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.545898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.558529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:43.570823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.573538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.574000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.574748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.577474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.577904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.659199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.660150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.662333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.663805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:43.678653 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4315817b-9394-4c2a-bf95-fbc43feb08ee tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.293883 Oct 27 10:18:43.679512 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1187/2544] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:43 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:43.687964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68afaf03-a8e6-407c-8388-a562a1e7e735 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ad67310>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.728328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.728858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.729459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.758320 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-68afaf03-a8e6-407c-8388-a562a1e7e735 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.076222 Oct 27 10:18:43.759154 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1188/2545] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:18:43 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:43.785936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:43.791043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.793167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: ef114f37-a4a0-47b8-b0a0-5d75c05d0968] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:43.808619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.809483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.810059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.811614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.812070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.812497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.833262 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] HTTP exception thrown: Instance ef114f37-a4a0-47b8-b0a0-5d75c05d0968 could not be found. Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Request method failure captured: Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 HTTP/1.1 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWloQLxHnNNSLyqIv1uUr-kKL7BMS9PuVcRRRiotWz6QYTSAM3KSU19rVpCcTtDx06Tod0KE4fGhrG7wtj42fltNjNjrtqmOah2uw0IXRdSCux0nZhTvRGDBbcJ8a7kSiBRtXcDxRJAb2hVz3gprkrUEfnYCf7h7Q6sJAW26p4tAfnys Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88e242ed84c14a5eaabf74309f00b689", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9685331306514f73a2d834a0bf5a77a3 Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance ef114f37-a4a0-47b8-b0a0-5d75c05d0968 could not be found. Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'ef114f37-a4a0-47b8-b0a0-5d75c05d0968'} Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef114f37-a4a0-47b8-b0a0-5d75c05d0968 could not be found. Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef114f37-a4a0-47b8-b0a0-5d75c05d0968 could not be found. Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:43.836214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef114f37-a4a0-47b8-b0a0-5d75c05d0968 could not be found. Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Returning 404 to user: Instance ef114f37-a4a0-47b8-b0a0-5d75c05d0968 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-09db23e5-e69b-450e-8f5e-9c025672fcf0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968" status: 404 len: 111 microversion: 2.1 time: 0.058653 Oct 27 10:18:43.840554 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1189/2546] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:43 2022] GET /compute/v2.1/servers/ef114f37-a4a0-47b8-b0a0-5d75c05d0968 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:18:43.847852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-931e6dca-b50d-4eaa-ad1f-8099acdb0975 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b2d5af0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.860108 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b9ba150-489e-47ca-8b3e-8b26653e6b66 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-1852594443" status: 201 len: 0 microversion: 2.26 time: 0.348498 Oct 27 10:18:43.861255 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1358/2547] 10.222.0.76 () {62 vars in 1380 bytes} [Thu Oct 27 10:18:43 2022] PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-1852594443 => generated 0 bytes in 350 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 10:18:43.878356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:43.879295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2b9e146-ce04-4819-953d-f1e4c7e53bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:43.904447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.905091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.905620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.925954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:43.932554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:43.937899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:43.988935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2b9e146-ce04-4819-953d-f1e4c7e53bbf] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:44.109574 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f33f7e97-3837-4dc8-bd2a-5f635170331d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf" status: 204 len: 0 microversion: 2.1 time: 0.246926 Oct 27 10:18:44.110177 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1359/2548] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:43 2022] DELETE /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:44.116779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f627ef88-1214-495a-8c1c-2aacc952409d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5ae9c790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.142762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f627ef88-1214-495a-8c1c-2aacc952409d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.143643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f627ef88-1214-495a-8c1c-2aacc952409d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.144249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f627ef88-1214-495a-8c1c-2aacc952409d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.157528 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f627ef88-1214-495a-8c1c-2aacc952409d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-1852594443" status: 204 len: 0 microversion: 2.26 time: 0.045948 Oct 27 10:18:44.161954 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1360/2549] 10.222.0.76 () {60 vars in 1361 bytes} [Thu Oct 27 10:18:44 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-1852594443 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:18:44.168217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.169088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:44.177826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.178596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.179314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.180265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.180932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.181546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.259067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:44.267718 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08b89fa9-7415-49de-b878-39438c6c9c3d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1281 microversion: 2.1 time: 0.105504 Oct 27 10:18:44.281535 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1361/2550] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:44 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1281 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:44.296983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.297944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:44.306008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.309659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.310180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.310996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.311603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.312135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.346973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:44.457243 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8eb1a403-f9dd-4504-8ab6-9360ca956491 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 204 len: 0 microversion: 2.1 time: 0.174094 Oct 27 10:18:44.457862 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1362/2551] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:44 2022] DELETE /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:44.463442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d637cf310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.475917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.476770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.477380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.478573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:44.485293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.485855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.486360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.487903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.488568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.489057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.514629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.515214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.515214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.534523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:44.553535 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0037a9ad-b0c4-4803-8a49-8571ae0f969a tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 204 len: 0 microversion: 2.26 time: 0.094237 Oct 27 10:18:44.555348 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1363/2552] 10.222.0.76 () {60 vars in 1295 bytes} [Thu Oct 27 10:18:44 2022] DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:18:44.560131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.560928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:44.567935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.568410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.568870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.569670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.570145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.570587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.630043 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-931e6dca-b50d-4eaa-ad1f-8099acdb0975 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "DELETE /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588" status: 204 len: 0 microversion: 2.1 time: 0.786989 Oct 27 10:18:44.630757 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1190/2553] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:43 2022] DELETE /compute/v2.1/images/0a0abdcf-8002-4250-9d4e-fcd2dad12588 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:44.639584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.640485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2b9e146-ce04-4819-953d-f1e4c7e53bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:44.648456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.649518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.650176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.651108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.653806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.654637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.664964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:44.699537 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f538247-e6d4-43d8-ad66-9a7dd7a257b2 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.140893 Oct 27 10:18:44.712711 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1364/2554] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:44 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:44.712711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bf18a87-aa79-42ac-b618-0c20accd7b8b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5ab39700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.717226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bf18a87-aa79-42ac-b618-0c20accd7b8b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.717822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bf18a87-aa79-42ac-b618-0c20accd7b8b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.718437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bf18a87-aa79-42ac-b618-0c20accd7b8b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.736103 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9bf18a87-aa79-42ac-b618-0c20accd7b8b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 200 len: 12 microversion: 2.26 time: 0.032372 Oct 27 10:18:44.736103 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1365/2555] 10.222.0.76 () {60 vars in 1292 bytes} [Thu Oct 27 10:18:44 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:44.746986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05d71842-c7be-4ff3-b866-f9ff37005679 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5b450c10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.895794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:44.913766 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-962e5216-8eaf-4a39-bd38-414235129f4b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf" status: 200 len: 1474 microversion: 2.1 time: 0.277209 Oct 27 10:18:44.932046 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1191/2556] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:44 2022] GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf => generated 1474 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:44.945575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.946259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:44.955395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.955890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.956372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.957505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.958226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.958752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.202776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:45.216524 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-beeb81d1-8459-4137-816d-dd9a3e297d8a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.281650 Oct 27 10:18:45.217337 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1192/2557] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:44 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:45.241091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5ad674c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:45.254213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.255146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.255714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.256673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:45.265798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.266795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.267936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.269732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.270908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.271517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.372049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.383452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.384694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.442708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.443507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.444122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.510010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:45.513547 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05d71842-c7be-4ff3-b866-f9ff37005679 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "DELETE /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d" status: 204 len: 0 microversion: 2.1 time: 0.770869 Oct 27 10:18:45.514168 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1366/2558] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:44 2022] DELETE /compute/v2.1/images/21be95cd-319a-4514-8a72-2fde89ddb49d => generated 0 bytes in 778 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:45.520017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1c55d4dc-ec26-49ef-a051-74021a3e3977 req-e859f971-f084-4537-8191-4ca3d0fe359f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2ecebf-5910-45cc-a64b-46987db5e3e7", "name": "network-vif-unplugged", "status": "completed", "tag": "47847440-7b60-4683-a35e-007be8b78338"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:45.545513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1c55d4dc-ec26-49ef-a051-74021a3e3977 req-e859f971-f084-4537-8191-4ca3d0fe359f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.546022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1c55d4dc-ec26-49ef-a051-74021a3e3977 req-e859f971-f084-4537-8191-4ca3d0fe359f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.546483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1c55d4dc-ec26-49ef-a051-74021a3e3977 req-e859f971-f084-4537-8191-4ca3d0fe359f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.554728 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d1ba7259-6e2b-43a1-a805-2bb856f7372e tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-1988245547" status: 201 len: 0 microversion: 2.26 time: 0.327310 Oct 27 10:18:45.555578 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1193/2559] 10.222.0.76 () {62 vars in 1380 bytes} [Thu Oct 27 10:18:45 2022] PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-1988245547 => generated 0 bytes in 338 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 10:18:45.565579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:45.568441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:45.570932 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1c55d4dc-ec26-49ef-a051-74021a3e3977 req-e859f971-f084-4537-8191-4ca3d0fe359f service nova] Creating event network-vif-unplugged:47847440-7b60-4683-a35e-007be8b78338 for instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 on n-h1-854663-10 Oct 27 10:18:45.581727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.584278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.584987 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1c55d4dc-ec26-49ef-a051-74021a3e3977 req-e859f971-f084-4537-8191-4ca3d0fe359f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068281 Oct 27 10:18:45.586182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.586975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.587434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.588049 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1367/2560] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:45.593695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c36cbde-477e-437a-8441-f3a061510876 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5ab395e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:45.594532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.376423 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c36cbde-477e-437a-8441-f3a061510876 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "DELETE /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554" status: 204 len: 0 microversion: 2.1 time: 0.787047 Oct 27 10:18:46.377158 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1368/2561] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:45 2022] DELETE /compute/v2.1/images/5b04e0bc-a3e6-442b-bd31-cc97de099554 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:46.384316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88d3f0b2-86d0-406b-8898-18a3c6df9ee5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5aae6550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:46.397111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88d3f0b2-86d0-406b-8898-18a3c6df9ee5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.397968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88d3f0b2-86d0-406b-8898-18a3c6df9ee5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.398677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88d3f0b2-86d0-406b-8898-18a3c6df9ee5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.421243 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-88d3f0b2-86d0-406b-8898-18a3c6df9ee5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 200 len: 36 microversion: 2.26 time: 0.042671 Oct 27 10:18:46.422225 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1369/2562] 10.222.0.76 () {60 vars in 1292 bytes} [Thu Oct 27 10:18:46 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 36 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:46.433359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:46.434598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:46.441749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.442632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.443302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.444319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.444980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.445579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.622528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:46.666618 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-117b5167-cb15-4857-8096-50a268331edb tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.242930 Oct 27 10:18:46.682028 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1370/2563] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:46 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:46.695475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:46.696469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2b9e146-ce04-4819-953d-f1e4c7e53bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:46.705517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.706398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.707194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.709057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.709866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.710498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.717123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2,nova_cell1:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:46.733402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:46.741515 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2d141f18-752e-49ba-9792-aed9f77a2035 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1323 microversion: 2.1 time: 1.183175 Oct 27 10:18:46.749959 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1194/2564] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:45 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1323 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:46.754960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:46.755616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:46.771627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.772718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.775286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.776625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.777172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.777909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.831254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:46.843253 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1451db19-bf4f-43a1-a936-48c93fb6179b tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf" status: 200 len: 1432 microversion: 2.1 time: 0.159608 Oct 27 10:18:46.862619 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1371/2565] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:46 2022] GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf => generated 1432 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:46.876720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:46.877242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:46.906684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.910685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.917518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.918603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.919325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.920034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.954135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:47.164767 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-914fe238-dede-43a1-b051-1ee8b34c6efc tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "DELETE /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 204 len: 0 microversion: 2.1 time: 0.300481 Oct 27 10:18:47.165401 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1372/2566] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:46 2022] DELETE /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:47.176213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5aa16040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:47.198428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.199206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.201684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.204186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:47.221523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.222739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.223475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.224854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.225578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.226396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.229229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:47.237306 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c4ff0a0-cee3-4199-8bf3-25eaa4fa964d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.486169 Oct 27 10:18:47.237899 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1195/2567] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:46 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:47.266472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:47.267108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:47.278852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.279221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.281606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.289618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.290053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.290498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.294687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.295177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.295619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.337666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:47.377247 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1e706d6-7a8a-49c0-877c-b9f0522e4568 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-1988245547" status: 204 len: 0 microversion: 2.26 time: 0.210140 Oct 27 10:18:47.387742 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1373/2568] 10.222.0.76 () {60 vars in 1364 bytes} [Thu Oct 27 10:18:47 2022] DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-1988245547 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:18:47.421215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-eb92fb78-6330-40cf-937d-89c58a28d7ef req-3ebafb14-3233-4b00-8505-d885b199ec00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b9e146-ce04-4819-953d-f1e4c7e53bbf", "name": "network-vif-deleted", "tag": "84dcab08-a68b-4fe0-8dc6-00d5b6e2d967"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:47.457855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eb92fb78-6330-40cf-937d-89c58a28d7ef req-3ebafb14-3233-4b00-8505-d885b199ec00 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.457855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eb92fb78-6330-40cf-937d-89c58a28d7ef req-3ebafb14-3233-4b00-8505-d885b199ec00 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.461884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eb92fb78-6330-40cf-937d-89c58a28d7ef req-3ebafb14-3233-4b00-8505-d885b199ec00 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.498112 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-eb92fb78-6330-40cf-937d-89c58a28d7ef req-3ebafb14-3233-4b00-8505-d885b199ec00 service nova] Creating event network-vif-deleted:84dcab08-a68b-4fe0-8dc6-00d5b6e2d967 for instance c2b9e146-ce04-4819-953d-f1e4c7e53bbf on n-h1-854663-10 Oct 27 10:18:47.517115 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-eb92fb78-6330-40cf-937d-89c58a28d7ef req-3ebafb14-3233-4b00-8505-d885b199ec00 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127939 Oct 27 10:18:47.520096 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1374/2569] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:47.546410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a7bf446-7939-401e-8b36-62824efee7e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5aa40ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:47.561532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a7bf446-7939-401e-8b36-62824efee7e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.570547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a7bf446-7939-401e-8b36-62824efee7e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.571346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a7bf446-7939-401e-8b36-62824efee7e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.596637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a7bf446-7939-401e-8b36-62824efee7e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 200 len: 12 microversion: 2.26 time: 0.074930 Oct 27 10:18:47.602892 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1375/2570] 10.222.0.76 () {60 vars in 1292 bytes} [Thu Oct 27 10:18:47 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 12 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:47.614167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5b4a6ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:47.624060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.624717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.625368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.626120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:47.639126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.639669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.641109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.643897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.644841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.646853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.702636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.703440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.704060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.721337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:47.741350 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77206cdc-4681-455f-a9a6-5b2f19a876ef tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 204 len: 0 microversion: 2.26 time: 0.132006 Oct 27 10:18:47.742996 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1376/2571] 10.222.0.76 () {60 vars in 1295 bytes} [Thu Oct 27 10:18:47 2022] DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:18:47.753787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:47.754674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:47.768831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.769647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.770586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.772570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.773570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.774272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.932252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:47.938826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:47.949633 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ecc68ac-258c-4bc0-aad5-980277a51e83 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1473 microversion: 2.1 time: 0.688326 Oct 27 10:18:47.962942 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1196/2572] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:47 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1473 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:47.964007 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4eae76f8-562f-4dcd-b226-dc41f96d2069 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.219368 Oct 27 10:18:47.974285 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1377/2573] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:47 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:47.980482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d639644c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:47.991480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.992198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.992393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:47.993424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.994825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:48.014254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:48.031233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.032221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.034271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.034946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.037066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.039047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.040402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.040924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.041210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.041679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.042139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.044545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.100767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.104408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.105859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.142700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.144463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.146984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.153748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:48.206264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:48.256900 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4547488-2fa4-4ec7-b5d2-b5e7dc21058d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-2063506263" status: 201 len: 0 microversion: 2.26 time: 0.283354 Oct 27 10:18:48.257855 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1197/2574] 10.222.0.76 () {62 vars in 1380 bytes} [Thu Oct 27 10:18:47 2022] PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-2063506263 => generated 0 bytes in 285 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 10:18:48.271941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:48.276443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2b9e146-ce04-4819-953d-f1e4c7e53bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:48.291870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.292364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.292889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.293707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.294151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.294566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.557187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:48.568806 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-33e376e1-e838-4dad-a262-4611b02e0e0d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf" status: 200 len: 1432 microversion: 2.1 time: 0.306988 Oct 27 10:18:48.569847 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1198/2575] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:48 2022] GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf => generated 1432 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:48.586200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:48.593870 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df330d40-6a65-4af6-bb11-38a294cdba94 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1323 microversion: 2.1 time: 0.618240 Oct 27 10:18:48.597248 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1378/2576] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:47 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1323 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:48.613130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9d8ef062-9db0-41f4-b4f9-3c80e75c8155 req-1bb34a81-c1b2-4bc0-9249-20712a27d328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d1def7-512a-42be-8a51-eafdc75b0fed", "name": "network-vif-deleted", "tag": "0921a48e-bbf8-4fc8-9fb5-f8abeef0fa1b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:48.619042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:48.621979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:48.643162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9d8ef062-9db0-41f4-b4f9-3c80e75c8155 req-1bb34a81-c1b2-4bc0-9249-20712a27d328 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.643734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9d8ef062-9db0-41f4-b4f9-3c80e75c8155 req-1bb34a81-c1b2-4bc0-9249-20712a27d328 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.644269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9d8ef062-9db0-41f4-b4f9-3c80e75c8155 req-1bb34a81-c1b2-4bc0-9249-20712a27d328 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.645908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.647671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.650865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.652582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.654422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.656213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.690332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9d8ef062-9db0-41f4-b4f9-3c80e75c8155 req-1bb34a81-c1b2-4bc0-9249-20712a27d328 service nova] Creating event network-vif-deleted:0921a48e-bbf8-4fc8-9fb5-f8abeef0fa1b for instance c2d1def7-512a-42be-8a51-eafdc75b0fed on n-h2-854663-10 Oct 27 10:18:48.716073 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9d8ef062-9db0-41f4-b4f9-3c80e75c8155 req-1bb34a81-c1b2-4bc0-9249-20712a27d328 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108492 Oct 27 10:18:48.716958 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1379/2577] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:48.732439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5aa74790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:48.767242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.769800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.770505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.771491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:48.779605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.780394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.781208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.782287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.782946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.783574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.836203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.836979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.838279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.871703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.874130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.874576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.926418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:48.949136 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1271a592-e021-47c3-8cf4-adaf2636ff53 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-801874999" status: 201 len: 0 microversion: 2.26 time: 0.230934 Oct 27 10:18:48.950256 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1380/2578] 10.222.0.76 () {62 vars in 1377 bytes} [Thu Oct 27 10:18:48 2022] PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-801874999 => generated 0 bytes in 233 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 27 10:18:48.964643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5aa16040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:48.977928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.978618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.979183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.979768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:48.987675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.988415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.989200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.990190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.991011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.991513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.019487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.022002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.022736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.044444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:49.072131 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-348929e1-96e1-4906-b176-10f4f5d28b85 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 204 len: 0 microversion: 2.26 time: 0.114643 Oct 27 10:18:49.076258 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1381/2579] 10.222.0.76 () {60 vars in 1295 bytes} [Thu Oct 27 10:18:48 2022] DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:18:49.080151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.080801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:49.088379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.088898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.089377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.090087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.090532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.091064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.162230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:49.177428 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1169ce00-6453-4616-8ca6-1d4928413587 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.573986 Oct 27 10:18:49.178031 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1199/2580] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:48 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:49.184646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.185281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:49.198505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.211247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.212040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.214560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.215411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.217017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.338468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:49.375556 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e15c59f2-3555-4317-b872-854db7349f7a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.194287 Oct 27 10:18:49.376410 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1200/2581] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:49 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:49.380529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:49.392118 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c49a4cc8-15dc-4923-b2f3-fb92ea68ac7d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1473 microversion: 2.1 time: 0.317332 Oct 27 10:18:49.405672 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1382/2582] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:49 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1473 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:49.408213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-498ee68e-4ac0-42aa-aca3-54e9c9865668 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5ab5b670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.421684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-498ee68e-4ac0-42aa-aca3-54e9c9865668 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.422261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-498ee68e-4ac0-42aa-aca3-54e9c9865668 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.422727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-498ee68e-4ac0-42aa-aca3-54e9c9865668 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.422834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.423529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:49.433102 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-498ee68e-4ac0-42aa-aca3-54e9c9865668 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 200 len: 12 microversion: 2.26 time: 0.055088 Oct 27 10:18:49.434405 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1201/2583] 10.222.0.76 () {60 vars in 1292 bytes} [Thu Oct 27 10:18:49 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 12 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:49.434522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.435094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.435634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.436431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.436916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.437340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.447083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5ab5b430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.458797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.459604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.460256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.461248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:49.469046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.470471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.471118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.472447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.473168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.473800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.478329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:49.484178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:49.509840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.511317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.513115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.534504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:49.558278 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ca6c3326-2d0d-42c0-9720-3afabefb24f2 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 204 len: 0 microversion: 2.26 time: 0.117507 Oct 27 10:18:49.559278 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1202/2584] 10.222.0.76 () {60 vars in 1295 bytes} [Thu Oct 27 10:18:49 2022] DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:18:49.582306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5ac0fee0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.619794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.621087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.621694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.624796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:49.639389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.641364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:49.645437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.646389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.647493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.648411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.649033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.671912 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-348c5f6b-2c19-4dd8-b9c5-09154a3db5b7 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 204 len: 0 microversion: 2.1 time: 0.261944 Oct 27 10:18:49.673115 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1383/2585] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:49 2022] DELETE /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:49.678244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7f69633a-a98a-4c4d-8639-0b7c04970456 req-ba9c848f-eb26-4e3a-8e15-9a3bbde658b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea5db905-0732-4b38-bcce-966944a8a897", "tag": "ea88e1c2-60b1-4b3b-b1fc-4a22a6fb8c12"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:49.697993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f69633a-a98a-4c4d-8639-0b7c04970456 req-ba9c848f-eb26-4e3a-8e15-9a3bbde658b5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.698476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f69633a-a98a-4c4d-8639-0b7c04970456 req-ba9c848f-eb26-4e3a-8e15-9a3bbde658b5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.698906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f69633a-a98a-4c4d-8639-0b7c04970456 req-ba9c848f-eb26-4e3a-8e15-9a3bbde658b5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.726896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.727411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.727934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.733614 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7f69633a-a98a-4c4d-8639-0b7c04970456 req-ba9c848f-eb26-4e3a-8e15-9a3bbde658b5 service nova] Creating event network-changed:ea88e1c2-60b1-4b3b-b1fc-4a22a6fb8c12 for instance ea5db905-0732-4b38-bcce-966944a8a897 on n-h2-854663-10 Oct 27 10:18:49.742795 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7f69633a-a98a-4c4d-8639-0b7c04970456 req-ba9c848f-eb26-4e3a-8e15-9a3bbde658b5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068568 Oct 27 10:18:49.744387 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1384/2586] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:49.756440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.756952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.757391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.762765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.763666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2b9e146-ce04-4819-953d-f1e4c7e53bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:49.789587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.790260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.790823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.791547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.791993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.792418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.830380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:49.843806 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] HTTP exception thrown: Instance c2b9e146-ce04-4819-953d-f1e4c7e53bbf could not be found. Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Request method failure captured: Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf HTTP/1.1 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWloQLxHnNNSLyqIv1uUr-kKL7BMS9PuVcRRRiotWz6QYTSAM3KSU19rVpCcTtDx06Tod0KE4fGhrG7wtj42fltNjNjrtqmOah2uw0IXRdSCux0nZhTvRGDBbcJ8a7kSiBRtXcDxRJAb2hVz3gprkrUEfnYCf7h7Q6sJAW26p4tAfnys Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88e242ed84c14a5eaabf74309f00b689", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9685331306514f73a2d834a0bf5a77a3 Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance c2b9e146-ce04-4819-953d-f1e4c7e53bbf could not be found. Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'c2b9e146-ce04-4819-953d-f1e4c7e53bbf'} Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b9e146-ce04-4819-953d-f1e4c7e53bbf could not be found. Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b9e146-ce04-4819-953d-f1e4c7e53bbf could not be found. Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:49.845517 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b9e146-ce04-4819-953d-f1e4c7e53bbf could not be found. Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Returning 404 to user: Instance c2b9e146-ce04-4819-953d-f1e4c7e53bbf could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e71e6e3a-c049-4f99-afd2-7cad916f7ccd tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf" status: 404 len: 111 microversion: 2.1 time: 0.100868 Oct 27 10:18:49.849616 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1385/2587] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:49 2022] GET /compute/v2.1/servers/c2b9e146-ce04-4819-953d-f1e4c7e53bbf => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:18:49.859968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.860583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:49.866406 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e498575-22ca-42d9-9c35-68186ea83734 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-845279882" status: 201 len: 0 microversion: 2.26 time: 0.296598 Oct 27 10:18:49.867674 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1203/2588] 10.222.0.76 () {62 vars in 1377 bytes} [Thu Oct 27 10:18:49 2022] PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-845279882 => generated 0 bytes in 299 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 27 10:18:49.877523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.878945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.880641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.880915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:49.883285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.884197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.886290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.886915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.895402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.896142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.896761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.900347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.902066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.902648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.255855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:50.266541 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aab837a7-7938-44b9-839e-aea93567eb7b tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1664 microversion: 2.1 time: 0.397430 Oct 27 10:18:50.267128 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1204/2589] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:49 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1664 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:50.271797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:50.272399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: c2d1def7-512a-42be-8a51-eafdc75b0fed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:50.279476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.280199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.280862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.281738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.282949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.283550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.298530 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] HTTP exception thrown: Instance c2d1def7-512a-42be-8a51-eafdc75b0fed could not be found. Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Request method failure captured: Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed HTTP/1.1 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWloQLxHnNNSLyqIv1uUr-kKL7BMS9PuVcRRRiotWz6QYTSAM3KSU19rVpCcTtDx06Tod0KE4fGhrG7wtj42fltNjNjrtqmOah2uw0IXRdSCux0nZhTvRGDBbcJ8a7kSiBRtXcDxRJAb2hVz3gprkrUEfnYCf7h7Q6sJAW26p4tAfnys Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88e242ed84c14a5eaabf74309f00b689", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9685331306514f73a2d834a0bf5a77a3 Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance c2d1def7-512a-42be-8a51-eafdc75b0fed could not be found. Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'c2d1def7-512a-42be-8a51-eafdc75b0fed'} Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d1def7-512a-42be-8a51-eafdc75b0fed could not be found. Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d1def7-512a-42be-8a51-eafdc75b0fed could not be found. Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:50.300035 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d1def7-512a-42be-8a51-eafdc75b0fed could not be found. Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Returning 404 to user: Instance c2d1def7-512a-42be-8a51-eafdc75b0fed could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5141fdbb-5de9-4c57-97bd-827923870dd0 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed" status: 404 len: 111 microversion: 2.1 time: 0.033669 Oct 27 10:18:50.303858 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1205/2590] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:50 2022] GET /compute/v2.1/servers/c2d1def7-512a-42be-8a51-eafdc75b0fed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:18:50.310046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5bb73820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:50.312108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:50.320883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.321138 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d4a24c0-068e-4c38-8cb3-b576f90702ff tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1323 microversion: 2.1 time: 0.472443 Oct 27 10:18:50.321360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.321789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.322119 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1386/2591] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:49 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:50.322303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:50.327076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:50.327770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:50.327935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.328566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.329159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.330024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.330644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.331226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.334751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.335315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.335820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.336619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.337307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.337708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.375234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.375723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.376171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.390219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.390943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.391380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.429679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:50.449030 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86b6ccd7-025b-41df-a194-8bcd717da58f tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-748429526" status: 201 len: 0 microversion: 2.26 time: 0.145260 Oct 27 10:18:50.454418 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1206/2592] 10.222.0.76 () {62 vars in 1377 bytes} [Thu Oct 27 10:18:50 2022] PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags/tempest-tag-748429526 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 27 10:18:50.458352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4aad62e-e32c-488a-a291-f1ab0e62b2fc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:50.502052 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4aad62e-e32c-488a-a291-f1ab0e62b2fc tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/00172b71-74b7-47e3-a29d-bf0868c6b155" status: 204 len: 0 microversion: 2.1 time: 0.047503 Oct 27 10:18:50.502856 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1207/2593] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:18:50 2022] DELETE /compute/v2.1/os-server-groups/00172b71-74b7-47e3-a29d-bf0868c6b155 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:50.512919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:50.514354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:50.519630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:50.521488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.522324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.522910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.524033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.524931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.525522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.541133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:50.553347 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d85f22ca-af28-4920-86ec-0090a58c383b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.229785 Oct 27 10:18:50.554508 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1387/2594] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:50 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:50.565060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:50.565875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:50.573178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.573988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.574614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.577533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.578014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.578462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.618136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:50.625972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.626451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.626878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.627337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lazy-loading 'fault' on Instance uuid 45c30935-9c9d-4098-bb50-beeb93a1edbe {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:50.641875 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a26265f-d04d-4928-917c-d4fabc682b61 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.137569 Oct 27 10:18:50.650633 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1208/2595] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:50 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:50.650633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Action: 'update_all', calling method: .version_select at 0x7f6d5b2a6160>, body: {"tags": ["tempest-tag-869366307", "tempest-tag-1403623719"]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:50.662688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.675018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.676171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.680069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:50.684702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:50.687435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.687925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.688359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.689252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.689720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.690200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.699949 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5eac1a6d-b8e2-4255-bf43-e612a6183ce7 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 200 len: 1307 microversion: 2.1 time: 0.143913 Oct 27 10:18:50.700452 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1388/2596] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:50 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 1307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:50.720451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.721137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.721580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.721903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:50.722694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:50.728882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.729488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.729990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.730797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.731340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.731821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.734165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:50.747423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:50.762469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:50.764700 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3e479297-2d74-4340-aa09-cb7bcb027ac5 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 200 len: 61 microversion: 2.26 time: 0.120631 Oct 27 10:18:50.765727 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1209/2597] 10.222.0.76 () {62 vars in 1312 bytes} [Thu Oct 27 10:18:50 2022] PUT /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 61 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:50.822707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2108630647", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9817231a-6843-4f63-80f8-30528217ef12"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:50.856137 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54994874-5af3-4227-a80d-cbf3f8df44d4 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 204 len: 0 microversion: 2.1 time: 0.141862 Oct 27 10:18:50.856904 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1389/2598] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:50 2022] DELETE /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:50.862641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c39738ec-395c-4ba6-ad24-cdbb07b62643 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5aa58ca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:50.870752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c39738ec-395c-4ba6-ad24-cdbb07b62643 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.871247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c39738ec-395c-4ba6-ad24-cdbb07b62643 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.872061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c39738ec-395c-4ba6-ad24-cdbb07b62643 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.881611 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c39738ec-395c-4ba6-ad24-cdbb07b62643 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 200 len: 61 microversion: 2.26 time: 0.023321 Oct 27 10:18:50.882225 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1390/2599] 10.222.0.76 () {60 vars in 1292 bytes} [Thu Oct 27 10:18:50 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 61 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:50.886841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:50.887318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:50.887660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] validate_networks() for [('9817231a-6843-4f63-80f8-30528217ef12', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:18:50.893852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.894581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.895503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.896520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.897178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.897784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.927851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:51.024316 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9e7ba89-6faf-44ad-96b1-063bba3e256e tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 204 len: 0 microversion: 2.1 time: 0.140660 Oct 27 10:18:51.025579 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1391/2600] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:50 2022] DELETE /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:51.033807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '.version_select at 0x7f6d5aa580d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:51.045688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.046766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.047356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.048483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:51.055272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.055954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.056525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.057533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.058257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.058816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.088160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.089066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.089707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.112156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lazy-loading 'flavor' on Instance uuid df81441a-4602-46a5-8388-01be10aa1bbf {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:51.133090 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a50f1f8-00cc-47c5-bd00-546bfb9a7721 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags" status: 204 len: 0 microversion: 2.26 time: 0.105879 Oct 27 10:18:51.137432 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1392/2601] 10.222.0.76 () {60 vars in 1295 bytes} [Thu Oct 27 10:18:51 2022] DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf/tags => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:18:51.138771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:51.139293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:51.145504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.146373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.146815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.147496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.147938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.148355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.372190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:51.401017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=7 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:51.533275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:51.542465 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-88e77a71-154a-45d3-9ced-d85a9141cb70 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 200 len: 1473 microversion: 2.1 time: 0.407685 Oct 27 10:18:51.543349 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1393/2602] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:51 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 1473 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:51.547704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:51.548281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:51.555638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.556197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.556710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.557470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.558143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.558819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.589527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:51.654714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:51.697737 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0535a9b7-6bf1-4122-8e6d-719b4a371baa tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 204 len: 0 microversion: 2.26 time: 0.153250 Oct 27 10:18:51.698686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1394/2603] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:18:51 2022] DELETE /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:18:51.699906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:51.705280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:51.705993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:51.713085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.713576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.714011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.714726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:51.715178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:51.715597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.996567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:51.997220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:51.997678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:51.998328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:51.998932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:52.022957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.023847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.024520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.025319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.026290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.026290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.047277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:18:52.053024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for user 8074ee4104864f7b8010104133bd2fef and project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:18:52.066923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:18:52.069836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:18:52.120436 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec0f3b21-9cc4-437c-89f6-a12a9b356190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353548 Oct 27 10:18:52.121207 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1210/2604] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:18:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:18:52.126490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:52.127411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:52.135622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.136484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.137190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.138138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.139086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.139725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.161326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:52.171417 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23edbea4-e124-4f75-866a-4965a8a3d782 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1664 microversion: 2.1 time: 0.471438 Oct 27 10:18:52.188684 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1395/2605] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:51 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1664 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:52.192959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:52.193585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:52.206736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.207020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.207367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.208170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.208730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.209161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.556839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:52.568843 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78c8c54a-7301-4ec3-ba22-80d0f6974d44 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1517 microversion: 2.1 time: 0.390858 Oct 27 10:18:52.569584 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1396/2606] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:52 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1517 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:52.575988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:52.576923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:52.586452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.587706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.587909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.588899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.589453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.590026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.625186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:52.635783 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f6ccfaa7-f794-461b-800b-c69b6e1f63c4 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1323 microversion: 2.1 time: 0.513031 Oct 27 10:18:52.637932 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1211/2607] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:52 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1323 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:52.643372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:52.656371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:52.679065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.679562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.681162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.681959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.682587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.683011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.721556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:52.742969 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b048a0b-6649-43b8-b1a5-de5a00b85885 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.171621 Oct 27 10:18:52.743623 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1397/2608] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:52 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:52.749423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:52.750251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 45c30935-9c9d-4098-bb50-beeb93a1edbe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:52.758110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.758794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.759368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.760476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.761112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.761676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.782986 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] HTTP exception thrown: Instance 45c30935-9c9d-4098-bb50-beeb93a1edbe could not be found. Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Request method failure captured: Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe HTTP/1.1 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlppFQezKbb1RUY4P_Hsaupsaa6wMvOMSCKYgvN06APrsqkxzqMUqiegOa9YxHLcjDp1nJlO9EBQY85PiS7J_2jy50PasrCZRS1yRrAUzYKpfXrUs1vTf_4fE4ve7V-rz1Kgtd96hlnfz105H_YTqbkIduADk35zEm_aFNwqQ814V8g Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 496dab6d3c584e328de368214c3d5189 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ListImageFiltersTestJSON-854299882 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/496dab6d3c584e328de368214c3d5189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/496dab6d3c584e328de368214c3d5189"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_496dab6d3c584e328de368214c3d5189", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/496dab6d3c584e328de368214c3d5189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ListImageFiltersTestJSON-854299882 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 496dab6d3c584e328de368214c3d5189 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-854299882 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ListImageFiltersTestJSON-854299882-project Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e4a9982da0949a2b255e743864962a4 Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ListImageFiltersTestJSON-854299882-project Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 45c30935-9c9d-4098-bb50-beeb93a1edbe could not be found. Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '45c30935-9c9d-4098-bb50-beeb93a1edbe'} Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c30935-9c9d-4098-bb50-beeb93a1edbe could not be found. Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c30935-9c9d-4098-bb50-beeb93a1edbe could not be found. Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:52.784640 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c30935-9c9d-4098-bb50-beeb93a1edbe could not be found. Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Returning 404 to user: Instance 45c30935-9c9d-4098-bb50-beeb93a1edbe could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b03d8aac-7cc8-4bf0-ac12-a35d2545b58d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe" status: 404 len: 111 microversion: 2.1 time: 0.041434 Oct 27 10:18:52.789122 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1398/2609] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:52 2022] GET /compute/v2.1/servers/45c30935-9c9d-4098-bb50-beeb93a1edbe => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:18:52.791938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1de1c338-cacb-4741-82ce-9266aeb35339 req-139cec5b-cb04-41ab-bc5b-3bad1de40a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c30935-9c9d-4098-bb50-beeb93a1edbe", "name": "network-vif-deleted", "tag": "1b3185dc-06ff-479d-8971-a9d01cf40ea7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:52.801895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1de1c338-cacb-4741-82ce-9266aeb35339 req-139cec5b-cb04-41ab-bc5b-3bad1de40a90 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.802439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1de1c338-cacb-4741-82ce-9266aeb35339 req-139cec5b-cb04-41ab-bc5b-3bad1de40a90 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.802872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1de1c338-cacb-4741-82ce-9266aeb35339 req-139cec5b-cb04-41ab-bc5b-3bad1de40a90 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.815496 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1de1c338-cacb-4741-82ce-9266aeb35339 req-139cec5b-cb04-41ab-bc5b-3bad1de40a90 service nova] Creating event network-vif-deleted:1b3185dc-06ff-479d-8971-a9d01cf40ea7 for instance 45c30935-9c9d-4098-bb50-beeb93a1edbe on n-h1-854663-10 Oct 27 10:18:52.821522 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1de1c338-cacb-4741-82ce-9266aeb35339 req-139cec5b-cb04-41ab-bc5b-3bad1de40a90 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033230 Oct 27 10:18:52.822345 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1399/2610] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:52.831510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:52.832378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:52.839254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.839816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.840309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.841127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.841636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.842118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.936624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:52.949320 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-766ff397-04de-434e-9bf3-fbb26ea0f026 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1212 microversion: 2.1 time: 0.125577 Oct 27 10:18:52.950537 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1400/2611] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:52 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1212 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:52.956018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:52.957155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:52.966814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.967436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.968888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:52.969977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:52.970436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:52.970860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.013197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:53.027325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:53.034466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:53.042688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f7087e7-e6bf-4d31-a337-913091365519 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1553 microversion: 2.26 time: 0.402808 Oct 27 10:18:53.043488 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1212/2612] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:52 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1553 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:53.061787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:53.064317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:53.072006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.072862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.073603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.074471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.075103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.075674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.143224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:53.334995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc69221a-8429-42b2-839e-c8f95e0ff90e tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 204 len: 0 microversion: 2.1 time: 0.290061 Oct 27 10:18:53.335835 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1213/2613] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:53 2022] DELETE /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:53.346407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a3b501e9-2c35-4684-bdb5-5c70694e9afb req-f8cca2c4-bc9a-46fa-80fd-c80fd967acb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea5db905-0732-4b38-bcce-966944a8a897", "name": "network-vif-plugged", "status": "completed", "tag": "ea88e1c2-60b1-4b3b-b1fc-4a22a6fb8c12"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:53.371777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a3b501e9-2c35-4684-bdb5-5c70694e9afb req-f8cca2c4-bc9a-46fa-80fd-c80fd967acb3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.372256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a3b501e9-2c35-4684-bdb5-5c70694e9afb req-f8cca2c4-bc9a-46fa-80fd-c80fd967acb3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.372692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a3b501e9-2c35-4684-bdb5-5c70694e9afb req-f8cca2c4-bc9a-46fa-80fd-c80fd967acb3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.383014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:53.392086 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-671275b8-b8ce-4672-b3d5-a4422035d5a2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 200 len: 1473 microversion: 2.1 time: 0.440016 Oct 27 10:18:53.392702 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1401/2614] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:52 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 1473 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:53.395187 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a3b501e9-2c35-4684-bdb5-5c70694e9afb req-f8cca2c4-bc9a-46fa-80fd-c80fd967acb3 service nova] Creating event network-vif-plugged:ea88e1c2-60b1-4b3b-b1fc-4a22a6fb8c12 for instance ea5db905-0732-4b38-bcce-966944a8a897 on n-h2-854663-10 Oct 27 10:18:53.400597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:53.401254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:53.402348 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a3b501e9-2c35-4684-bdb5-5c70694e9afb req-f8cca2c4-bc9a-46fa-80fd-c80fd967acb3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064954 Oct 27 10:18:53.403677 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1214/2615] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:53.423947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:53.427092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:53.448366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.449055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.449203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.449729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.450190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.450937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.451522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.452049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.461974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.462963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.464857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.465417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.670050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:53.680514 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b8bd555-05ae-4618-9521-fb31ed121601 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1597 microversion: 2.1 time: 0.286742 Oct 27 10:18:53.701218 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1402/2616] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:53 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1597 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:53.706401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:53.707546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:53.716121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.721556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.722293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.723068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.723524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.723945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.845185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:53.856990 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3a7a2fd6-979e-49d1-b521-563a4ab22d8d tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1471 microversion: 2.1 time: 0.451889 Oct 27 10:18:53.857598 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1215/2617] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:53 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:53.868544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:53.869504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:53.886408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.886900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.887335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:53.888111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:53.888573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:53.889206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.054376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:54.068220 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-477be350-7780-4024-bf68-e8abcdac495d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1535 microversion: 2.1 time: 0.365241 Oct 27 10:18:54.071199 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1403/2618] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:53 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1535 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:54.085344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:54.086295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:54.104410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.109585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.110421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.111405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.112440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.113107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.178086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:54.187194 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b3ff34e5-a697-4757-8b71-7b6c15f3549d tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1323 microversion: 2.1 time: 0.328380 Oct 27 10:18:54.187778 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1216/2619] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:53 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:54.204349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:54.205439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:54.218116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.221061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.221542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.222289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.222747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.223234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.262028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:54.288241 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d87e1f6e-3d28-4477-b60d-4b5eff9c7568 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.213590 Oct 27 10:18:54.304708 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1404/2620] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:54 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:54.304708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c5a0c7fe-231b-49f7-9ace-5c0fa58a09a0 req-1dcba4f2-dcb5-45ae-a2e9-a8c8e5ba827d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c54fce1-7397-4e02-a66b-f5d0d8ba8e09", "name": "network-vif-deleted", "tag": "9b851bf0-1e9b-417a-833d-ebc6a5b707e4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:54.320186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:54.326574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a0c7fe-231b-49f7-9ace-5c0fa58a09a0 req-1dcba4f2-dcb5-45ae-a2e9-a8c8e5ba827d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.327834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a0c7fe-231b-49f7-9ace-5c0fa58a09a0 req-1dcba4f2-dcb5-45ae-a2e9-a8c8e5ba827d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.328538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a0c7fe-231b-49f7-9ace-5c0fa58a09a0 req-1dcba4f2-dcb5-45ae-a2e9-a8c8e5ba827d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.333194 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5751b0b2-319f-41a9-a619-291c6aff0604 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1212 microversion: 2.1 time: 0.140486 Oct 27 10:18:54.341099 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1217/2621] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:54 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1212 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:54.343089 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c5a0c7fe-231b-49f7-9ace-5c0fa58a09a0 req-1dcba4f2-dcb5-45ae-a2e9-a8c8e5ba827d service nova] Creating event network-vif-deleted:9b851bf0-1e9b-417a-833d-ebc6a5b707e4 for instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 on n-h2-854663-10 Oct 27 10:18:54.348910 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c5a0c7fe-231b-49f7-9ace-5c0fa58a09a0 req-1dcba4f2-dcb5-45ae-a2e9-a8c8e5ba827d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056159 Oct 27 10:18:54.349681 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1405/2622] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:54.356983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:54.357656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:54.377152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.377652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.378252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.378970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.379644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.380117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.420716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:54.421781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:54.428613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.429430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.430387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.430520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.430977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.431398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.558993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:54.570817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:54.572841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:54.574303 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d16dfd1b-b8c7-4b25-9134-946e4bf3e451 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1553 microversion: 2.26 time: 0.232169 Oct 27 10:18:54.575440 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1218/2623] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:54 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:54.615222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:54.623099 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60feff73-a2c0-48e1-847b-286db8fe7b2a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 200 len: 1473 microversion: 2.1 time: 0.207144 Oct 27 10:18:54.624469 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1406/2624] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:54 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 1473 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:54.707823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:54.708467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:54.714943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.715392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.715817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.716504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.717011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.717450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.752985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.753467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.753898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.754381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lazy-loading 'fault' on Instance uuid 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:54.796844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee58dbbf0d423bacf779e114c5b08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bda1ec06fb9422bba099a7ced95a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:54.805023 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0a6d45b-a08c-477a-9bc0-58d9f3d6fb97 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 200 len: 1316 microversion: 2.1 time: 0.101244 Oct 27 10:18:54.805836 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1219/2625] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:54 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 1316 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:54.881404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:54.882019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:54.888471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.889417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.890494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:54.891237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:54.891687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:54.892554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.042157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.050194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4cc8629f-e71f-4815-a8a3-1ca3eb5f199a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1471 microversion: 2.1 time: 0.174550 Oct 27 10:18:55.050774 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1407/2626] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:54 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:55.098255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.098867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.105193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.105680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.106136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.106816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.107257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.107672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.210691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.211324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.217896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.218387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.218819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.219496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.220160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.220579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.255570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.264816 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c79cbc4b-e13d-4b23-a1c8-0b6935645145 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1535 microversion: 2.1 time: 0.170547 Oct 27 10:18:55.265687 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1220/2627] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:55 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1535 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:55.324989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.325685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.334385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.334889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.335317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.336002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.336438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.336884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.424977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.434027 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3e3d524-daef-490c-b9bb-1a776c04efe5 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1472 microversion: 2.1 time: 0.227089 Oct 27 10:18:55.441621 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1408/2628] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:55 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:55.451368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.453735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.465324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.466634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.467070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.470306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.471460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.473646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.477459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:55.496257 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af930a8d-531d-44a6-80f1-679a9706cb42 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.174924 Oct 27 10:18:55.509339 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1221/2629] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:55 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:18:55.523173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1844101b-7b2d-40f4-9ecb-66feb57e1421 req-673e69b2-15a2-43c6-b98b-405a72698448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef41d153-9311-4d5a-a975-e82b7d7c2165", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb156a1-7133-48c1-89fe-956de9ca524e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:55.534259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1844101b-7b2d-40f4-9ecb-66feb57e1421 req-673e69b2-15a2-43c6-b98b-405a72698448 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.535007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1844101b-7b2d-40f4-9ecb-66feb57e1421 req-673e69b2-15a2-43c6-b98b-405a72698448 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.535438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1844101b-7b2d-40f4-9ecb-66feb57e1421 req-673e69b2-15a2-43c6-b98b-405a72698448 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.547833 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1844101b-7b2d-40f4-9ecb-66feb57e1421 req-673e69b2-15a2-43c6-b98b-405a72698448 service nova] Creating event network-vif-unplugged:2eb156a1-7133-48c1-89fe-956de9ca524e for instance ef41d153-9311-4d5a-a975-e82b7d7c2165 on n-h1-854663-10 Oct 27 10:18:55.553214 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1844101b-7b2d-40f4-9ecb-66feb57e1421 req-673e69b2-15a2-43c6-b98b-405a72698448 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042353 Oct 27 10:18:55.554121 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1222/2630] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:55.559553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.559866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.566498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.566995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.567599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.568331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.568819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.569238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.571060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.582332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35bd00d7-70ac-4a83-a64e-2ce7f1bd7442 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1212 microversion: 2.1 time: 0.146628 Oct 27 10:18:55.583297 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1409/2631] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:55 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1212 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:55.592385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Request method failure captured: Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897/diagnostics HTTP/1.1 Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlr_mE5MEbEd8ObXA0KnvsE5ZJpUbhZnZFO4l6R_nsIydhuqp1ZZIq29_ZAypG4xQl0vSLzSpMYOFOqr21_7fm87aok9mZcywY_Bj7VfYeouwUz-YozD2CPexmk1G61z9Z_6TKESdvZmmk1_hcBH_dSTvyc9BCP1NoWizp96a67QdoY Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 056256e66fac49e4ba491807ec69861f Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1941379761 Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/056256e66fac49e4ba491807ec69861f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/056256e66fac49e4ba491807ec69861f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_056256e66fac49e4ba491807ec69861f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/056256e66fac49e4ba491807ec69861f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1941379761 Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 056256e66fac49e4ba491807ec69861f Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1941379761 Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerDiagnosticsNegativeTest-1941379761-project Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3b64e7f20ecd42fbbc0eab74d40aa90f Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1941379761-project Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'server_id': 'ea5db905-0732-4b38-bcce-966944a8a897'} Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:55.599568 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:55.603233 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:55.603233 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:55.603233 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:18:55.603233 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:18:55.603233 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 10:18:55.603233 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:55.603233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:55.603617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.603701 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-280169f9-aa47-42d0-a19b-d0c28fa90714 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.045810 Oct 27 10:18:55.603771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.603866 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1223/2632] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:18:55 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897/diagnostics => generated 117 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:18:55.608957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.609448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.609883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.610576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.611024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.611153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.611444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.611645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.620007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.620495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.620946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.621646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.622092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.622511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.658782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:18:55.706762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:55.740441 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3512d58a-5f6c-4984-bbdc-e4e2747e8cb7 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 204 len: 0 microversion: 2.1 time: 0.132701 Oct 27 10:18:55.741281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1224/2633] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:18:55 2022] DELETE /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:18:55.746540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.747232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.755132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.755633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.756065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.756813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.757241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.757662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.768306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.788244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.792955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.794189 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4685f10-c6fc-4f75-8cf2-e1c25978872d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1553 microversion: 2.26 time: 0.197345 Oct 27 10:18:55.807757 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1410/2634] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:55 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:18:55.807757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.807757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.808248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.808421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.808885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.809577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.810805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.811584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.956896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.965631 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-564fccdb-4d20-481e-af26-2137f267f325 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 200 len: 1473 microversion: 2.1 time: 0.223405 Oct 27 10:18:55.966185 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1225/2635] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:55 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 1473 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:55.970684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:55.971274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] [instance: 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:55.977312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.977740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.978171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.978868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:55.979314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:55.979729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:55.983125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:55.991039 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ccd3b35-b813-4fb1-95c6-996f8a404109 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1478 microversion: 2.1 time: 0.195036 Oct 27 10:18:55.991615 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1411/2636] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:55 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1478 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:55.997825 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] HTTP exception thrown: Instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 could not be found. Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Request method failure captured: Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 HTTP/1.1 Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlrCOJFOhwKYYUboxJsJAPjXAVz3UWeye-Avr_MkA0u3ifXk4BQL_PIJLulkCYI4DqyNZdpfdtRkW02tCxKyhxW3Coz3BV0-GXyxkOjlV1kYHQbWITWw7_FtkM_umpIQaza6UIIHYpUiM7-PNV4gC2EiXPRf5hNZxDIIeOTihAA2ZbU Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 7bda1ec06fb9422bba099a7ced95a2a7 Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestFqdnHostnames-110517466 Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7bda1ec06fb9422bba099a7ced95a2a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7bda1ec06fb9422bba099a7ced95a2a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7bda1ec06fb9422bba099a7ced95a2a7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7bda1ec06fb9422bba099a7ced95a2a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestFqdnHostnames-110517466 Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 7bda1ec06fb9422bba099a7ced95a2a7 Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-110517466 Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestFqdnHostnames-110517466-project Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 47ee58dbbf0d423bacf779e114c5b08e Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestFqdnHostnames-110517466-project Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 could not be found. Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '5c54fce1-7397-4e02-a66b-f5d0d8ba8e09'} Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 could not be found. Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 could not be found. Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:55.999474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 could not be found. Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Returning 404 to user: Instance 5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e2ed8a20-6f3d-4344-ae47-8b73d9be4ca0 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09" status: 404 len: 111 microversion: 2.1 time: 0.033736 Oct 27 10:18:56.003394 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1226/2637] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:55 2022] GET /compute/v2.1/servers/5c54fce1-7397-4e02-a66b-f5d0d8ba8e09 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:18:56.009508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-574b10fd-ab56-4f29-aa5a-ee03991ff934 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] Calling method '.version_select at 0x7f6d5aa40a60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:56.030073 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-574b10fd-ab56-4f29-aa5a-ee03991ff934 tempest-ServersTestFqdnHostnames-110517466 tempest-ServersTestFqdnHostnames-110517466-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638784853" status: 202 len: 0 microversion: 2.1 time: 0.024212 Oct 27 10:18:56.030683 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1412/2638] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:18:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638784853 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:18:56.078824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:56.079424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:56.085660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.086141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.086570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.087261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.087706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.088129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.266629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:56.276054 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a4bf1a4-3c6c-45ff-8017-843402b764fe tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1471 microversion: 2.1 time: 0.200865 Oct 27 10:18:56.277158 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1227/2639] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:56 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:56.293722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:56.294335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:56.302497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.302976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.303402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.304091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.304498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.305298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.439579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:56.442094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:56.450378 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8baf91a6-221d-47c4-8f55-2972a7a77fc4 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1523 microversion: 2.1 time: 0.161602 Oct 27 10:18:56.450968 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1413/2640] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:56 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:56.528476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:56.529052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:56.535020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.535489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.535982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.536693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.537120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.537540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.609191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:56.611326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:56.612541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:56.618861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.619539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.620127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.621271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.621426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.622100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.636145 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30aa0652-2e87-42c6-be00-0c25ae567ae0 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.111315 Oct 27 10:18:56.637235 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1228/2641] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:56 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:56.691589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:56.700244 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba2539c4-a8a5-4a2e-bde4-b4f556c62be7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1204 microversion: 2.1 time: 0.097806 Oct 27 10:18:56.700849 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1414/2642] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:56 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:56.819974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:56.820501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:56.826789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.827294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.827740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.828429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:56.828926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:56.829361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:56.962959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:56.972552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:56.974149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:56.975327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8303dc68-9c04-4297-8c4b-80d0f548b80b tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1553 microversion: 2.26 time: 0.159683 Oct 27 10:18:56.976306 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1229/2643] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:56 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:56.995542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:56.996753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:57.004859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.005384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.005913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.006606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.007052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.007468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.014422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:57.015765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:57.022597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.023172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.023616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.024321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.024801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.025223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.215596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:57.224051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:57.224531 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1354522e-335f-4968-9b6e-5c55cf59ab68 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 200 len: 1473 microversion: 2.1 time: 0.234245 Oct 27 10:18:57.240699 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1415/2644] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:56 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 1473 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:57.240902 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07b58221-f3fc-4816-9b6e-663b96cd7f30 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1478 microversion: 2.1 time: 0.223488 Oct 27 10:18:57.240902 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1230/2645] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:57 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1478 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:57.301412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:57.302202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:57.310634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.311212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.311704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.312421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.312929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.313355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.453123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:57.462045 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26c94054-e401-4341-b87d-453aadcb92f6 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1471 microversion: 2.1 time: 0.164645 Oct 27 10:18:57.462628 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1416/2646] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:57 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:57.474187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:57.475124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:57.481634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.482215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.482731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.483524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.484047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.484468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.633378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:57.642784 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d740679-8f5e-445a-a5a6-dc1e37665979 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1523 microversion: 2.1 time: 0.172596 Oct 27 10:18:57.654343 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1231/2647] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:57 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:57.665606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:57.666233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:57.672331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.672852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.673284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.673971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.674415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.674834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.725888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:57.726659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:57.733059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.733562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.734000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.734693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:57.735136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:57.735553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:57.763467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:57.781212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:57.783458 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d96600c-4537-461c-bde4-c576f1049049 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.121758 Oct 27 10:18:57.803375 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1417/2648] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:57 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:57.807580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:57.816347 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ddb012b7-161d-4a73-9986-9f8c1520680c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1260 microversion: 2.1 time: 0.096628 Oct 27 10:18:57.817192 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1232/2649] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:57 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1260 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:58.006274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:58.006860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:58.013629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.014188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.014565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.015224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.015671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.016092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.155982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:58.165177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:58.166704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:58.168031 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ceb422c6-f119-45a9-8c03-2fc777d27a6d tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1553 microversion: 2.26 time: 0.166203 Oct 27 10:18:58.168687 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1418/2650] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:58 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:58.247691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:58.248330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:58.256161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.256640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.257113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.257806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.258028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:58.258250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.258665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.259055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:58.265678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.266604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.267138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.268293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.268978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.269501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.362646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b64e7f20ecd42fbbc0eab74d40aa90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056256e66fac49e4ba491807ec69861f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:58.374091 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b04d6f1-0471-43a4-8810-6c5bf42a5c09 tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 200 len: 1436 microversion: 2.1 time: 0.121350 Oct 27 10:18:58.375316 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1419/2651] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:58 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 1436 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:58.442041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:58.460910 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-415739ad-fb02-4617-be05-8a587467437a tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 200 len: 1473 microversion: 2.1 time: 0.217129 Oct 27 10:18:58.462988 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1233/2652] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:58 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 1473 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:58.488953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:58.490006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:58.499104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.499311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.499988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.501449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.501449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.502338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.511860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-dc030b97-37d7-45ea-8e5b-ed41c9c09cdd req-f003c609-0544-4e82-94cf-facb1401a99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea5db905-0732-4b38-bcce-966944a8a897", "name": "network-vif-deleted", "tag": "ea88e1c2-60b1-4b3b-b1fc-4a22a6fb8c12"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:58.522924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dc030b97-37d7-45ea-8e5b-ed41c9c09cdd req-f003c609-0544-4e82-94cf-facb1401a99c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.523399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dc030b97-37d7-45ea-8e5b-ed41c9c09cdd req-f003c609-0544-4e82-94cf-facb1401a99c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.523886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dc030b97-37d7-45ea-8e5b-ed41c9c09cdd req-f003c609-0544-4e82-94cf-facb1401a99c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.538767 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-dc030b97-37d7-45ea-8e5b-ed41c9c09cdd req-f003c609-0544-4e82-94cf-facb1401a99c service nova] Creating event network-vif-deleted:ea88e1c2-60b1-4b3b-b1fc-4a22a6fb8c12 for instance ea5db905-0732-4b38-bcce-966944a8a897 on n-h2-854663-10 Oct 27 10:18:58.562463 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-dc030b97-37d7-45ea-8e5b-ed41c9c09cdd req-f003c609-0544-4e82-94cf-facb1401a99c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054519 Oct 27 10:18:58.563948 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1234/2653] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:58.669113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:58.670029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:58.688508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.689144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.689660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.693003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.693555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.695296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.872748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:58.883294 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bffd2582-98ea-45ad-a43f-42a939f5a522 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1471 microversion: 2.1 time: 0.399480 Oct 27 10:18:58.884359 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1420/2654] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:58 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1471 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:58.900885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:58.901737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:58.927256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.927530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.927971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.929111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.929569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.930283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.936950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:58.946537 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aaf7b43b-68fd-46ed-9759-733906205503 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1523 microversion: 2.1 time: 0.282322 Oct 27 10:18:58.947989 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1235/2655] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:58 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:58.953653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:58.954599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:58.977874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.980156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.980913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:58.984633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:58.985355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:58.986011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.071338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:59.122363 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7356cfc6-c60a-4a2b-933a-c0260439cf08 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.235568 Oct 27 10:18:59.124160 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1421/2656] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:58 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:59.139445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:59.149749 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6203aec8-5959-425b-92e4-10271d7c57c1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1260 microversion: 2.1 time: 0.200463 Oct 27 10:18:59.166223 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1236/2657] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:58 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:59.195226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:59.195937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:59.205152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.209355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.212490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.213476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.216106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.216732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.367314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3817edc3-6064-47e3-856d-0f49d455e5b9 req-1c809ddc-a2f0-4e77-9faf-80e74389d0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8466938a-c392-46e1-a1d1-611553fc1dbc", "name": "network-vif-unplugged", "status": "completed", "tag": "93c54aa8-0c1f-44c8-a95f-50938f87be5d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:59.384848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3817edc3-6064-47e3-856d-0f49d455e5b9 req-1c809ddc-a2f0-4e77-9faf-80e74389d0eb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.394164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3817edc3-6064-47e3-856d-0f49d455e5b9 req-1c809ddc-a2f0-4e77-9faf-80e74389d0eb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.398775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3817edc3-6064-47e3-856d-0f49d455e5b9 req-1c809ddc-a2f0-4e77-9faf-80e74389d0eb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.429787 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3817edc3-6064-47e3-856d-0f49d455e5b9 req-1c809ddc-a2f0-4e77-9faf-80e74389d0eb service nova] Creating event network-vif-unplugged:93c54aa8-0c1f-44c8-a95f-50938f87be5d for instance 8466938a-c392-46e1-a1d1-611553fc1dbc on n-h1-854663-10 Oct 27 10:18:59.444286 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3817edc3-6064-47e3-856d-0f49d455e5b9 req-1c809ddc-a2f0-4e77-9faf-80e74389d0eb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078240 Oct 27 10:18:59.445571 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1237/2658] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:59.455788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:59.456500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] [instance: ea5db905-0732-4b38-bcce-966944a8a897] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:59.470873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.471361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.471797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.477542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.478936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.483052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.521527 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] HTTP exception thrown: Instance ea5db905-0732-4b38-bcce-966944a8a897 could not be found. Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Request method failure captured: Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 HTTP/1.1 Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlr_mE5MEbEd8ObXA0KnvsE5ZJpUbhZnZFO4l6R_nsIydhuqp1ZZIq29_ZAypG4xQl0vSLzSpMYOFOqr21_7fm87aok9mZcywY_Bj7VfYeouwUz-YozD2CPexmk1G61z9Z_6TKESdvZmmk1_hcBH_dSTvyc9BCP1NoWizp96a67QdoY Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 056256e66fac49e4ba491807ec69861f Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1941379761 Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/056256e66fac49e4ba491807ec69861f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/056256e66fac49e4ba491807ec69861f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_056256e66fac49e4ba491807ec69861f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/056256e66fac49e4ba491807ec69861f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1941379761 Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 056256e66fac49e4ba491807ec69861f Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1941379761 Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerDiagnosticsNegativeTest-1941379761-project Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3b64e7f20ecd42fbbc0eab74d40aa90f Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1941379761-project Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance ea5db905-0732-4b38-bcce-966944a8a897 could not be found. Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'ea5db905-0732-4b38-bcce-966944a8a897'} Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea5db905-0732-4b38-bcce-966944a8a897 could not be found. Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea5db905-0732-4b38-bcce-966944a8a897 could not be found. Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:59.523242 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:18:59.526625 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:59.526625 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:18:59.526625 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:18:59.526625 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:18:59.526625 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:18:59.526625 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:18:59.526625 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea5db905-0732-4b38-bcce-966944a8a897 could not be found. Oct 27 10:18:59.526625 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:18:59.526625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] Returning 404 to user: Instance ea5db905-0732-4b38-bcce-966944a8a897 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:18:59.527107 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df630366-93f2-4b56-a1d1-c454b594bc7f tempest-ServerDiagnosticsNegativeTest-1941379761 tempest-ServerDiagnosticsNegativeTest-1941379761-project] 10.222.0.76 "GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897" status: 404 len: 111 microversion: 2.1 time: 0.079947 Oct 27 10:18:59.527680 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1238/2659] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:59 2022] GET /compute/v2.1/servers/ea5db905-0732-4b38-bcce-966944a8a897 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:18:59.543706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:59.549194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:59.558591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:59.563640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:59.567973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:59.571483 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-174669b4-a772-4ca5-9849-9ef1c2dcc9e9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1553 microversion: 2.26 time: 0.379956 Oct 27 10:18:59.574052 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1422/2660] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:18:59 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1553 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:18:59.574418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.575468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.576190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.577108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.577730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.578322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.620803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:59.623624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.626282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.627083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.627761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lazy-loading 'fault' on Instance uuid 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:18:59.702596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:59.713433 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3b05cf84-01ac-4cb1-af6e-f78ffa616202 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 200 len: 1308 microversion: 2.1 time: 0.184550 Oct 27 10:18:59.729883 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1239/2661] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:59 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:59.913056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:59.913947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:59.921595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.922387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.923010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.924268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.925077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.926768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.973394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:59.974046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:59.987769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.988449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.989481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:59.990582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:59.994061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:59.994501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:00.569190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:00.595668 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eba45c29-482e-49bf-b1e5-92ff64f9f19a tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1471 microversion: 2.1 time: 0.688014 Oct 27 10:19:00.610143 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1423/2662] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:59 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1471 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:00.626315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:00.636183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:00.645274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:00.646966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:00.647639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:00.648580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:00.649613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:00.650197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:00.671275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:00.685381 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5eb4ffe-b5db-43e4-a874-c814c330b2e2 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1523 microversion: 2.1 time: 0.717686 Oct 27 10:19:00.698032 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1240/2663] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:59 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1523 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:00.719068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:00.721824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:00.734555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:00.735153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:00.735470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:00.741073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:00.741795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:00.742252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:00.883100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:00.911901 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e152f084-bf24-4009-a6b4-878b50b39799 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.300177 Oct 27 10:19:00.913205 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1424/2664] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:00 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:00.934496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:00.935380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:00.955796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:00.956295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:00.956771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:00.957487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:00.957972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:00.958397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:00.988158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:01.007451 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3de4d627-85ee-4a18-a4fb-7ddebfa44362 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1266 microversion: 2.1 time: 0.309706 Oct 27 10:19:01.012697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1241/2665] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:00 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:01.021175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:01.026339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 6871d90b-e5ff-4ed9-9d3b-dab2493aa564] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:01.037393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.037888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.039116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:01.040217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.042801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.043313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:01.067960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] HTTP exception thrown: Instance 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 could not be found. Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Request method failure captured: Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 HTTP/1.1 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWloQLxHnNNSLyqIv1uUr-kKL7BMS9PuVcRRRiotWz6QYTSAM3KSU19rVpCcTtDx06Tod0KE4fGhrG7wtj42fltNjNjrtqmOah2uw0IXRdSCux0nZhTvRGDBbcJ8a7kSiBRtXcDxRJAb2hVz3gprkrUEfnYCf7h7Q6sJAW26p4tAfnys Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88e242ed84c14a5eaabf74309f00b689", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9685331306514f73a2d834a0bf5a77a3 Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 could not be found. Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '6871d90b-e5ff-4ed9-9d3b-dab2493aa564'} Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 could not be found. Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 could not be found. Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:01.072720 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:01.076229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:01.076229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:01.076229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:01.076229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:01.076229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:01.076229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 could not be found. Oct 27 10:19:01.076229 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:01.076229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Returning 404 to user: Instance 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:01.076765 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b2abff55-a002-460c-9181-11b522246a06 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564" status: 404 len: 111 microversion: 2.1 time: 0.062971 Oct 27 10:19:01.081142 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1242/2666] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:01 2022] GET /compute/v2.1/servers/6871d90b-e5ff-4ed9-9d3b-dab2493aa564 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:01.088024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c526116d-ec74-401d-92f0-4928159874ff req-9cfbdd8e-17ea-440b-9f11-3cf851453e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6871d90b-e5ff-4ed9-9d3b-dab2493aa564", "name": "network-vif-deleted", "tag": "0b1720a9-d828-407b-b675-46ba50b25eb9"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:01.099956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c526116d-ec74-401d-92f0-4928159874ff req-9cfbdd8e-17ea-440b-9f11-3cf851453e4b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.100706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c526116d-ec74-401d-92f0-4928159874ff req-9cfbdd8e-17ea-440b-9f11-3cf851453e4b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.101324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c526116d-ec74-401d-92f0-4928159874ff req-9cfbdd8e-17ea-440b-9f11-3cf851453e4b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:01.116496 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c526116d-ec74-401d-92f0-4928159874ff req-9cfbdd8e-17ea-440b-9f11-3cf851453e4b service nova] Creating event network-vif-deleted:0b1720a9-d828-407b-b675-46ba50b25eb9 for instance 6871d90b-e5ff-4ed9-9d3b-dab2493aa564 on n-h1-854663-10 Oct 27 10:19:01.122792 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c526116d-ec74-401d-92f0-4928159874ff req-9cfbdd8e-17ea-440b-9f11-3cf851453e4b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040097 Oct 27 10:19:01.123867 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1243/2667] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:01.130536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:01.131857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:01.141456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.141456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.141761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:01.142431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.142890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.143398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:01.168280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:01.202238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:01.214661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:01.216873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd16d723e9f548bdab55559643df2712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88021b77b6844cc9957e424317dd8783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:01.218308 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb038898-0a01-41c7-a14d-1be8ebccc1e7 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 200 len: 1511 microversion: 2.26 time: 0.303935 Oct 27 10:19:01.219051 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1425/2668] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:00 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:01.264408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:01.293908 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21a8b4b2-1328-42d0-bb7d-b95dbdef9e4d tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1431 microversion: 2.1 time: 0.154145 Oct 27 10:19:01.300897 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1244/2669] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:01 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1431 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:01.473479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1f7df49e-11a4-49f1-a11d-11ce3e4a3abb req-90a6d8e5-1cf5-4997-a5f4-cec606766281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df81441a-4602-46a5-8388-01be10aa1bbf", "name": "network-vif-unplugged", "status": "completed", "tag": "7f8d46de-55e3-462e-bd1d-03058084d257"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:01.493837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f7df49e-11a4-49f1-a11d-11ce3e4a3abb req-90a6d8e5-1cf5-4997-a5f4-cec606766281 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.494559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f7df49e-11a4-49f1-a11d-11ce3e4a3abb req-90a6d8e5-1cf5-4997-a5f4-cec606766281 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.525193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f7df49e-11a4-49f1-a11d-11ce3e4a3abb req-90a6d8e5-1cf5-4997-a5f4-cec606766281 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:01.609187 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1f7df49e-11a4-49f1-a11d-11ce3e4a3abb req-90a6d8e5-1cf5-4997-a5f4-cec606766281 service nova] Creating event network-vif-unplugged:7f8d46de-55e3-462e-bd1d-03058084d257 for instance df81441a-4602-46a5-8388-01be10aa1bbf on n-h1-854663-10 Oct 27 10:19:01.624984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:01.625630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:01.631597 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1f7df49e-11a4-49f1-a11d-11ce3e4a3abb req-90a6d8e5-1cf5-4997-a5f4-cec606766281 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159452 Oct 27 10:19:01.633843 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1426/2670] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:01.641739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.642439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.653477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:01.655861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.657570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.658172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:01.721615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:01.722140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:01.743550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.744056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.752604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:01.753461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:01.755335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:01.757972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.036552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:02.061037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:02.131719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4a9982da0949a2b255e743864962a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dab6d3c584e328de368214c3d5189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:02.146737 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da47cd99-edc6-42c7-8623-3df023387410 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 200 len: 1302 microversion: 2.1 time: 0.524943 Oct 27 10:19:02.149467 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1245/2671] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:01 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 1302 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:02.160199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:02.166741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:02.185812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:02.187480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:02.187945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.188696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:02.194590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:02.197610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.351352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:02.400975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c9255f8-b3e9-4df8-8c33-a9037b9411ec tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.250113 Oct 27 10:19:02.429879 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1246/2672] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:02 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:02.445897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:02.454605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:02.465432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:02.472233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:02.472763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:02.473293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.474135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:02.474619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:02.475222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.478457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc2baa10-c903-4b23-bc7e-de02b6037597 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1523 microversion: 2.1 time: 0.765507 Oct 27 10:19:02.483762 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1427/2673] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:01 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1523 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:02.489454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:02.490435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] [instance: df81441a-4602-46a5-8388-01be10aa1bbf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:02.514693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:02.515461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:02.516124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.517143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:02.517977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:02.519203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.543027 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] HTTP exception thrown: Instance df81441a-4602-46a5-8388-01be10aa1bbf could not be found. Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Request method failure captured: Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf HTTP/1.1 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlrrusEhb18exVzmViFfZBauYDnx_y70UTLVPmfrP8GwUUFgGXCpTZDgJm3H3u1HyCu2BcjyiHu4DVZxVRpFgPpcztoH2ro9YjumSDdulC4B9B4Zt3RLjmFon0LpcJkUz1PR-kIuo8PvdAIHeHig2yVsrZD2gTSeK6ynLTMj02E3QzA Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.26 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 88021b77b6844cc9957e424317dd8783 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerTagsTestJSON-633629230 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88021b77b6844cc9957e424317dd8783"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88021b77b6844cc9957e424317dd8783"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88021b77b6844cc9957e424317dd8783", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88021b77b6844cc9957e424317dd8783"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerTagsTestJSON-633629230 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 88021b77b6844cc9957e424317dd8783 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerTagsTestJSON-633629230 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerTagsTestJSON-633629230-project Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: bd16d723e9f548bdab55559643df2712 Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerTagsTestJSON-633629230-project Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance df81441a-4602-46a5-8388-01be10aa1bbf could not be found. Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'df81441a-4602-46a5-8388-01be10aa1bbf'} Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df81441a-4602-46a5-8388-01be10aa1bbf could not be found. Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df81441a-4602-46a5-8388-01be10aa1bbf could not be found. Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:02.547548 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:02.552019 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:02.552019 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:02.552019 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:02.552019 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:02.552019 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:02.552019 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df81441a-4602-46a5-8388-01be10aa1bbf could not be found. Oct 27 10:19:02.552019 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:02.554004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] Returning 404 to user: Instance df81441a-4602-46a5-8388-01be10aa1bbf could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:02.556371 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb767d0d-c340-403b-91f7-f408e10866f9 tempest-ServerTagsTestJSON-633629230 tempest-ServerTagsTestJSON-633629230-project] 10.222.0.76 "GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf" status: 404 len: 111 microversion: 2.26 time: 0.071028 Oct 27 10:19:02.560135 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1428/2674] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:02 2022] GET /compute/v2.1/servers/df81441a-4602-46a5-8388-01be10aa1bbf => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:19:02.565957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:02.567252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:02.575341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:02.576183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:02.577417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.578335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:02.579075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:02.580208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.626738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:02.627364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:02.628019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:02.628748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lazy-loading 'fault' on Instance uuid 8466938a-c392-46e1-a1d1-611553fc1dbc {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:02.827473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:02.836997 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d022ec4-43a6-4e40-a709-da983ead1ffb tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 200 len: 1308 microversion: 2.1 time: 0.275563 Oct 27 10:19:02.845261 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1429/2675] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:02 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:03.038051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:03.048514 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9cdd938-fa6c-4e6f-b133-994bfa8709ee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1308 microversion: 2.1 time: 0.615926 Oct 27 10:19:03.049396 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1247/2676] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:02 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1308 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:03.172808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:03.173426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] [instance: 6f2ecebf-5910-45cc-a64b-46987db5e3e7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:03.190732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:03.191477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:03.192093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:03.193098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:03.193909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:03.194539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:03.210954 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] HTTP exception thrown: Instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 could not be found. Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Request method failure captured: Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 HTTP/1.1 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlppFQezKbb1RUY4P_Hsaupsaa6wMvOMSCKYgvN06APrsqkxzqMUqiegOa9YxHLcjDp1nJlO9EBQY85PiS7J_2jy50PasrCZRS1yRrAUzYKpfXrUs1vTf_4fE4ve7V-rz1Kgtd96hlnfz105H_YTqbkIduADk35zEm_aFNwqQ814V8g Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 496dab6d3c584e328de368214c3d5189 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ListImageFiltersTestJSON-854299882 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/496dab6d3c584e328de368214c3d5189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/496dab6d3c584e328de368214c3d5189"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_496dab6d3c584e328de368214c3d5189", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/496dab6d3c584e328de368214c3d5189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ListImageFiltersTestJSON-854299882 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 496dab6d3c584e328de368214c3d5189 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-854299882 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ListImageFiltersTestJSON-854299882-project Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e4a9982da0949a2b255e743864962a4 Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ListImageFiltersTestJSON-854299882-project Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 could not be found. Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '6f2ecebf-5910-45cc-a64b-46987db5e3e7'} Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 could not be found. Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 could not be found. Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:03.212618 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:03.216014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:03.216014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:03.216014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:03.216014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:03.216014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:03.216014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 could not be found. Oct 27 10:19:03.216014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:03.217868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Returning 404 to user: Instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:03.223075 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4310e664-6bf1-4e27-9ccf-ce7886db21bf tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7" status: 404 len: 111 microversion: 2.1 time: 0.054121 Oct 27 10:19:03.224225 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1430/2677] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:03 2022] GET /compute/v2.1/servers/6f2ecebf-5910-45cc-a64b-46987db5e3e7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:03.232605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0cbcf5e9-da3e-4993-b769-7139e2cd0eb5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5a97cd30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:03.303386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cf5566db-5437-498a-a40d-03a4b7357dde req-1e016064-da62-4137-b41e-6de22f6b8778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df81441a-4602-46a5-8388-01be10aa1bbf", "name": "network-vif-deleted", "tag": "7f8d46de-55e3-462e-bd1d-03058084d257"}, {"server_uuid": "6f2ecebf-5910-45cc-a64b-46987db5e3e7", "name": "network-vif-deleted", "tag": "47847440-7b60-4683-a35e-007be8b78338"}, {"server_uuid": "8466938a-c392-46e1-a1d1-611553fc1dbc", "name": "network-vif-deleted", "tag": "93c54aa8-0c1f-44c8-a95f-50938f87be5d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:03.351043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cf5566db-5437-498a-a40d-03a4b7357dde req-1e016064-da62-4137-b41e-6de22f6b8778 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:03.352728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cf5566db-5437-498a-a40d-03a4b7357dde req-1e016064-da62-4137-b41e-6de22f6b8778 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:03.353177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cf5566db-5437-498a-a40d-03a4b7357dde req-1e016064-da62-4137-b41e-6de22f6b8778 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:03.361651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:03.385562 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cf5566db-5437-498a-a40d-03a4b7357dde req-1e016064-da62-4137-b41e-6de22f6b8778 service nova] Creating event network-vif-deleted:7f8d46de-55e3-462e-bd1d-03058084d257 for instance df81441a-4602-46a5-8388-01be10aa1bbf on n-h1-854663-10 Oct 27 10:19:03.386065 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cf5566db-5437-498a-a40d-03a4b7357dde req-1e016064-da62-4137-b41e-6de22f6b8778 service nova] Creating event network-vif-deleted:47847440-7b60-4683-a35e-007be8b78338 for instance 6f2ecebf-5910-45cc-a64b-46987db5e3e7 on n-h1-854663-10 Oct 27 10:19:03.386558 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cf5566db-5437-498a-a40d-03a4b7357dde req-1e016064-da62-4137-b41e-6de22f6b8778 service nova] Creating event network-vif-deleted:93c54aa8-0c1f-44c8-a95f-50938f87be5d for instance 8466938a-c392-46e1-a1d1-611553fc1dbc on n-h1-854663-10 Oct 27 10:19:03.407925 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cf5566db-5437-498a-a40d-03a4b7357dde req-1e016064-da62-4137-b41e-6de22f6b8778 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.108397 Oct 27 10:19:03.419331 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1431/2678] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:03.446217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:03.447765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:03.471074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:03.476525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:03.477319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:03.479909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:03.482994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:03.483707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:03.649392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:03.697630 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15f9acf1-8175-4a68-bbed-3a6a23cbe01f tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.267877 Oct 27 10:19:03.723796 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1432/2679] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:03 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:03.737032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:03.738021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:03.750772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:03.759113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:03.760313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:03.763001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:03.763876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:03.764690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:04.240213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:04.255278 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22ae2c49-d7ed-476e-8ffd-63c9cd4e44ba tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1523 microversion: 2.1 time: 0.530038 Oct 27 10:19:04.256163 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1433/2680] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:03 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1523 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:04.281110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-10d45bbe-f680-4155-91fe-54ee80e6d196 req-91331513-42c7-4046-92bf-7e1b0f148aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef41d153-9311-4d5a-a975-e82b7d7c2165", "name": "network-vif-plugged", "status": "completed", "tag": "2eb156a1-7133-48c1-89fe-956de9ca524e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:04.294043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-10d45bbe-f680-4155-91fe-54ee80e6d196 req-91331513-42c7-4046-92bf-7e1b0f148aec service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:04.294777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-10d45bbe-f680-4155-91fe-54ee80e6d196 req-91331513-42c7-4046-92bf-7e1b0f148aec service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:04.295550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-10d45bbe-f680-4155-91fe-54ee80e6d196 req-91331513-42c7-4046-92bf-7e1b0f148aec service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:04.310001 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-10d45bbe-f680-4155-91fe-54ee80e6d196 req-91331513-42c7-4046-92bf-7e1b0f148aec service nova] Creating event network-vif-plugged:2eb156a1-7133-48c1-89fe-956de9ca524e for instance ef41d153-9311-4d5a-a975-e82b7d7c2165 on n-h1-854663-10 Oct 27 10:19:04.317593 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-10d45bbe-f680-4155-91fe-54ee80e6d196 req-91331513-42c7-4046-92bf-7e1b0f148aec service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051135 Oct 27 10:19:04.318921 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1434/2681] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:04.324744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:04.325744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: 8466938a-c392-46e1-a1d1-611553fc1dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:04.332486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:04.333413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:04.334052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:04.334955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:04.335621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:04.336261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:04.354635 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] HTTP exception thrown: Instance 8466938a-c392-46e1-a1d1-611553fc1dbc could not be found. Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Request method failure captured: Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc HTTP/1.1 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWloQLxHnNNSLyqIv1uUr-kKL7BMS9PuVcRRRiotWz6QYTSAM3KSU19rVpCcTtDx06Tod0KE4fGhrG7wtj42fltNjNjrtqmOah2uw0IXRdSCux0nZhTvRGDBbcJ8a7kSiBRtXcDxRJAb2hVz3gprkrUEfnYCf7h7Q6sJAW26p4tAfnys Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88e242ed84c14a5eaabf74309f00b689", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9685331306514f73a2d834a0bf5a77a3 Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 8466938a-c392-46e1-a1d1-611553fc1dbc could not be found. Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '8466938a-c392-46e1-a1d1-611553fc1dbc'} Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8466938a-c392-46e1-a1d1-611553fc1dbc could not be found. Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8466938a-c392-46e1-a1d1-611553fc1dbc could not be found. Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:04.356478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8466938a-c392-46e1-a1d1-611553fc1dbc could not be found. Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Returning 404 to user: Instance 8466938a-c392-46e1-a1d1-611553fc1dbc could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77b9b8ac-8707-4f27-b986-84bd21835b36 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc" status: 404 len: 111 microversion: 2.1 time: 0.037952 Oct 27 10:19:04.360097 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1435/2682] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:04 2022] GET /compute/v2.1/servers/8466938a-c392-46e1-a1d1-611553fc1dbc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:04.367075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:04.367691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:04.379818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:04.380430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:04.380931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:04.381686 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0cbcf5e9-da3e-4993-b769-7139e2cd0eb5 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "DELETE /compute/v2.1/images/83bc2e3d-e9e8-42a9-b0f4-8ee1ade839aa" status: 204 len: 0 microversion: 2.1 time: 1.151782 Oct 27 10:19:04.382335 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1248/2683] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:03 2022] DELETE /compute/v2.1/images/83bc2e3d-e9e8-42a9-b0f4-8ee1ade839aa => generated 0 bytes in 1155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:19:04.382674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:04.384119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:04.384783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:04.390399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ae249b2-513f-4e42-a3d2-1a89bbba3a11 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:04.434636 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ae249b2-513f-4e42-a3d2-1a89bbba3a11 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/1ad64767-929d-4bd4-a8be-c14b8bbdcbcd" status: 204 len: 0 microversion: 2.1 time: 0.048322 Oct 27 10:19:04.435255 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1249/2684] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:19:04 2022] DELETE /compute/v2.1/os-server-groups/1ad64767-929d-4bd4-a8be-c14b8bbdcbcd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:19:04.441745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22aae509-503e-40b3-a000-8b8af5567d85 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5a957670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:04.996406 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22aae509-503e-40b3-a000-8b8af5567d85 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "DELETE /compute/v2.1/images/d13f6e16-0238-47fd-bbee-19fe6d819b53" status: 204 len: 0 microversion: 2.1 time: 0.559760 Oct 27 10:19:04.997186 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1250/2685] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:04 2022] DELETE /compute/v2.1/images/d13f6e16-0238-47fd-bbee-19fe6d819b53 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:19:05.002749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:05.003552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:05.010946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:05.011684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:05.012311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:05.013305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:05.013829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:05.014321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:05.033769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:05.043860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:19:05.047726 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-664c18c6-e6d8-41fe-bcdb-c1b7192c5441 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1308 microversion: 2.1 time: 0.687218 Oct 27 10:19:05.049761 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1436/2686] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:04 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1308 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:05.063094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:05.063953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:05.078717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:05.081419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:05.081902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:05.082693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:05.084012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:05.084531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:05.161108 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-db76ddea-5b98-4a29-adcc-21c42648fee2 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 204 len: 0 microversion: 2.1 time: 0.161856 Oct 27 10:19:05.166812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1251/2687] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:19:04 2022] DELETE /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:19:05.171798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a77734a-8e09-48a9-a40e-69ec08ffa853 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] Calling method '.version_select at 0x7f6d5a97be50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:05.321066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:05.381840 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2168887-b4e2-473d-8582-13512f90c15a tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.329531 Oct 27 10:19:05.382761 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1437/2688] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:05 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:05.392963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:05.398289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:05.407437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:05.408129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:05.409230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:05.410311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:05.410774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:05.411198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:05.892989 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4a77734a-8e09-48a9-a40e-69ec08ffa853 tempest-ListImageFiltersTestJSON-854299882 tempest-ListImageFiltersTestJSON-854299882-project] 10.222.0.76 "DELETE /compute/v2.1/images/34dd97b3-c45f-4fee-b79b-065b7e8e6785" status: 204 len: 0 microversion: 2.1 time: 0.727138 Oct 27 10:19:05.894325 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1252/2689] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:05 2022] DELETE /compute/v2.1/images/34dd97b3-c45f-4fee-b79b-065b7e8e6785 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:19:05.899550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:05.900285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:05.909041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:05.913315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:05.913767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:05.914495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:05.921048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:05.921488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.227668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:06.243160 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b558c029-21e6-4356-968e-a48889573d02 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1471 microversion: 2.1 time: 0.856167 Oct 27 10:19:06.261745 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1438/2690] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:05 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1471 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:06.267778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d8da5c85-b80d-4a3b-8c5c-9a809c0922f8 req-e0d0bf0e-cf51-48c5-a788-2f1e11a4cbbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab1bd26-6fbe-4246-890f-533cf3d0a359", "tag": "55d94cc3-d256-4796-a220-b6bfaf8e263a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:06.279128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d8da5c85-b80d-4a3b-8c5c-9a809c0922f8 req-e0d0bf0e-cf51-48c5-a788-2f1e11a4cbbd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.279595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d8da5c85-b80d-4a3b-8c5c-9a809c0922f8 req-e0d0bf0e-cf51-48c5-a788-2f1e11a4cbbd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.280015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d8da5c85-b80d-4a3b-8c5c-9a809c0922f8 req-e0d0bf0e-cf51-48c5-a788-2f1e11a4cbbd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.298666 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d8da5c85-b80d-4a3b-8c5c-9a809c0922f8 req-e0d0bf0e-cf51-48c5-a788-2f1e11a4cbbd service nova] Creating event network-changed:55d94cc3-d256-4796-a220-b6bfaf8e263a for instance aab1bd26-6fbe-4246-890f-533cf3d0a359 on n-h1-854663-10 Oct 27 10:19:06.304991 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d8da5c85-b80d-4a3b-8c5c-9a809c0922f8 req-e0d0bf0e-cf51-48c5-a788-2f1e11a4cbbd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041020 Oct 27 10:19:06.306270 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1439/2691] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:06.479853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:06.501301 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86fcf3f3-367c-4392-a1df-7a2643b970e3 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1523 microversion: 2.1 time: 0.592183 Oct 27 10:19:06.502294 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1253/2692] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:05 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1523 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:06.507274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:06.508108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:06.515035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.515731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.521894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.523021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.523702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.524190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.577924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e67feedb-4182-4b0d-ae6b-f7a133b1346b tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:06.582129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e67feedb-4182-4b0d-ae6b-f7a133b1346b tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.582868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e67feedb-4182-4b0d-ae6b-f7a133b1346b tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.583580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e67feedb-4182-4b0d-ae6b-f7a133b1346b tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.584530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e67feedb-4182-4b0d-ae6b-f7a133b1346b tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.585232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e67feedb-4182-4b0d-ae6b-f7a133b1346b tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.585864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e67feedb-4182-4b0d-ae6b-f7a133b1346b tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.615127 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e67feedb-4182-4b0d-ae6b-f7a133b1346b tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.307462 Oct 27 10:19:06.618272 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1440/2693] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:06.624184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:06.625164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:06.632079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.632888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.633509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.634684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.635979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.636625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.758108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:06.790639 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3fb738c8-e561-442a-9d85-bf06b79ff8fc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1929 microversion: 2.75 time: 0.170710 Oct 27 10:19:06.791244 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1441/2694] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:06 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:06.807975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-786e03ee-fa86-450d-a88b-7711ef957fbd tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:06.811859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-786e03ee-fa86-450d-a88b-7711ef957fbd tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.812482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-786e03ee-fa86-450d-a88b-7711ef957fbd tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.813194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-786e03ee-fa86-450d-a88b-7711ef957fbd tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.814087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-786e03ee-fa86-450d-a88b-7711ef957fbd tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.814698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-786e03ee-fa86-450d-a88b-7711ef957fbd tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.815146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-786e03ee-fa86-450d-a88b-7711ef957fbd tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.866518 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-786e03ee-fa86-450d-a88b-7711ef957fbd tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.074213 Oct 27 10:19:06.867149 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1442/2695] 10.222.0.76 () {58 vars in 1170 bytes} [Thu Oct 27 10:19:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:06.880165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff9d38b6-7754-49fd-a2bb-f89429739ddf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:06.883811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff9d38b6-7754-49fd-a2bb-f89429739ddf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.884224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff9d38b6-7754-49fd-a2bb-f89429739ddf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.884676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff9d38b6-7754-49fd-a2bb-f89429739ddf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.885590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff9d38b6-7754-49fd-a2bb-f89429739ddf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.886213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff9d38b6-7754-49fd-a2bb-f89429739ddf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.886790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff9d38b6-7754-49fd-a2bb-f89429739ddf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.914359 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff9d38b6-7754-49fd-a2bb-f89429739ddf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.037499 Oct 27 10:19:06.915519 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1443/2696] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:19:06.929755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3038aad-0b39-4445-991c-4033a60fc1ce tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:06.942423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3038aad-0b39-4445-991c-4033a60fc1ce tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.943005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3038aad-0b39-4445-991c-4033a60fc1ce tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.943447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3038aad-0b39-4445-991c-4033a60fc1ce tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.944185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3038aad-0b39-4445-991c-4033a60fc1ce tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.945764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3038aad-0b39-4445-991c-4033a60fc1ce tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.946194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3038aad-0b39-4445-991c-4033a60fc1ce tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.981418 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3038aad-0b39-4445-991c-4033a60fc1ce tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?host=n-d-854663-10&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.056727 Oct 27 10:19:06.983132 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1444/2697] 10.222.0.76 () {58 vars in 1196 bytes} [Thu Oct 27 10:19:06 2022] GET /compute/v2.1/os-services?host=n-d-854663-10&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 10:19:06.997768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e034860-602a-4a1d-8a22-af7f145ba173 tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:07.003235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e034860-602a-4a1d-8a22-af7f145ba173 tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.005064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e034860-602a-4a1d-8a22-af7f145ba173 tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.008119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e034860-602a-4a1d-8a22-af7f145ba173 tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:07.010766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e034860-602a-4a1d-8a22-af7f145ba173 tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.012803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e034860-602a-4a1d-8a22-af7f145ba173 tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.013404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e034860-602a-4a1d-8a22-af7f145ba173 tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:07.092737 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e034860-602a-4a1d-8a22-af7f145ba173 tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.098281 Oct 27 10:19:07.093951 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1445/2698] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:19:07.109630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-213a7581-0214-451b-b955-d445d46420bf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:07.119950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213a7581-0214-451b-b955-d445d46420bf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.120452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213a7581-0214-451b-b955-d445d46420bf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.123120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213a7581-0214-451b-b955-d445d46420bf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:07.124327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213a7581-0214-451b-b955-d445d46420bf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.126706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213a7581-0214-451b-b955-d445d46420bf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.128421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213a7581-0214-451b-b955-d445d46420bf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:07.171340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:07.180327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d03574f-303e-4533-9fd2-68374231fd43 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1308 microversion: 2.1 time: 0.676724 Oct 27 10:19:07.191870 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-213a7581-0214-451b-b955-d445d46420bf tempest-ServicesAdminNegativeTestJSON-362940190 tempest-ServicesAdminNegativeTestJSON-362940190-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.088972 Oct 27 10:19:07.193731 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1446/2699] 10.222.0.76 () {58 vars in 1198 bytes} [Thu Oct 27 10:19:07 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:19:07.198166 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1254/2700] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:06 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1308 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:07.268650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:07.269578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:07.282129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.282754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.283269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:07.283990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.287423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.287941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:07.569653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b9289d5-0062-4588-acda-232a794c0e8b tempest-ServicesAdminNegativeTestJSON-1062989050 tempest-ServicesAdminNegativeTestJSON-1062989050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:07.574387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b9289d5-0062-4588-acda-232a794c0e8b tempest-ServicesAdminNegativeTestJSON-1062989050 tempest-ServicesAdminNegativeTestJSON-1062989050-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4396ac063de14cd4a24bfae295f69087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eab3f755638459dbb15d4ae4f3d13e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b9289d5-0062-4588-acda-232a794c0e8b tempest-ServicesAdminNegativeTestJSON-1062989050 tempest-ServicesAdminNegativeTestJSON-1062989050-project] Request method failure captured: Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsYBdZtpUEivggmXtD7xWAt-mejJPArz6ppRnPAOf9zFuxN0YZcwc9zLumWrEMj5s62m0xDSJdJ_ejH0mrRnuUVXpKmYVDUUjMkMiRTBebYEClW48gB9HwmmY561FHWPyFCZ9IRGzQ6lW98U-ZCsXlxGK2iFRvqUkPSygx9EDBXdaA Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 4eab3f755638459dbb15d4ae4f3d13e1 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1062989050 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4eab3f755638459dbb15d4ae4f3d13e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4eab3f755638459dbb15d4ae4f3d13e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4eab3f755638459dbb15d4ae4f3d13e1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4eab3f755638459dbb15d4ae4f3d13e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1062989050 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 4eab3f755638459dbb15d4ae4f3d13e1 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1062989050 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServicesAdminNegativeTestJSON-1062989050-project Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 4396ac063de14cd4a24bfae295f69087 Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1062989050-project Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: action_args: {} Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 10:19:07.579313 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:07.583147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b9289d5-0062-4588-acda-232a794c0e8b tempest-ServicesAdminNegativeTestJSON-1062989050 tempest-ServicesAdminNegativeTestJSON-1062989050-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:07.585945 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b9289d5-0062-4588-acda-232a794c0e8b tempest-ServicesAdminNegativeTestJSON-1062989050 tempest-ServicesAdminNegativeTestJSON-1062989050-project] 10.222.0.76 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.380677 Oct 27 10:19:07.591152 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1447/2701] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:07 2022] GET /compute/v2.1/os-services => generated 112 bytes in 385 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:19:07.599520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:07.601194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:07.615972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.616466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.619152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:07.619927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.620636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.621097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:07.724205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:07.737911 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7de601a-f78e-4a3f-9973-41753c28d5c8 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1471 microversion: 2.1 time: 0.473402 Oct 27 10:19:07.753600 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1255/2702] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:07 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1471 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:07.821253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:07.821870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:07.831741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.832226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.832678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:07.833429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:07.833876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:07.834297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.046696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:08.055602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00c936ce-125f-4553-81e2-99675c3e5093 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1508 microversion: 2.1 time: 0.467310 Oct 27 10:19:08.077394 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1448/2703] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:07 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1508 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:08.082779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:08.083460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:08.111445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.111926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.113094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.117870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.118501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.119076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.135441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:08.182699 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-845c01df-8927-4371-b9f6-f3384811d4cc tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1935 microversion: 2.75 time: 0.365824 Oct 27 10:19:08.183338 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1256/2704] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:07 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1935 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:08.206050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:08.207030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:08.213995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.214767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.215398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.216353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.217008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.217670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.673419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:08.685985 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3fd82ecf-f870-4e17-9a44-63248f844633 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 200 len: 1508 microversion: 2.1 time: 0.606974 Oct 27 10:19:08.690289 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1449/2705] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:08 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 1508 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:08.698471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c80b65a2-1ba8-4d4f-b3b4-3770c5ceb8f8 req-3054cbdd-34d1-42ee-9f5e-843ef842550e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3771f18-a29a-4d03-97cf-1e23ec142e87", "name": "network-vif-deleted", "tag": "1faa7e08-93b7-42ef-afb8-fe49e32820b8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:08.725351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c80b65a2-1ba8-4d4f-b3b4-3770c5ceb8f8 req-3054cbdd-34d1-42ee-9f5e-843ef842550e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.726240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c80b65a2-1ba8-4d4f-b3b4-3770c5ceb8f8 req-3054cbdd-34d1-42ee-9f5e-843ef842550e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.727588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c80b65a2-1ba8-4d4f-b3b4-3770c5ceb8f8 req-3054cbdd-34d1-42ee-9f5e-843ef842550e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.761547 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c80b65a2-1ba8-4d4f-b3b4-3770c5ceb8f8 req-3054cbdd-34d1-42ee-9f5e-843ef842550e service nova] Creating event network-vif-deleted:1faa7e08-93b7-42ef-afb8-fe49e32820b8 for instance a3771f18-a29a-4d03-97cf-1e23ec142e87 on n-h2-854663-10 Oct 27 10:19:08.780767 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c80b65a2-1ba8-4d4f-b3b4-3770c5ceb8f8 req-3054cbdd-34d1-42ee-9f5e-843ef842550e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084282 Oct 27 10:19:08.781405 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1450/2706] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:08.800204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:08.801449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:08.818614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.822001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.822748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.824704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.825753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.827602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.877782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:19:08.912109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:08.926645 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2275c59b-3afa-4a11-a482-f096c7c87325 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1308 microversion: 2.1 time: 0.724302 Oct 27 10:19:08.928414 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1257/2707] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:08 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1308 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:08.940574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:08.943517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:08.958333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.958910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.959415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.962743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.963214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.963643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:09.007218 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1b06662-ee9a-4ba4-bd96-5b45877551de tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 204 len: 0 microversion: 2.1 time: 0.221518 Oct 27 10:19:09.009680 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1451/2708] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:19:08 2022] DELETE /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:19:09.048182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:09.048905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:09.049360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:09.049823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lazy-loading 'fault' on Instance uuid a3771f18-a29a-4d03-97cf-1e23ec142e87 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:09.150454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-323440826", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "a083a069-1c5f-4798-ae6e-612bd2e50580"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:09.210840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9685331306514f73a2d834a0bf5a77a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e242ed84c14a5eaabf74309f00b689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:09.212336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] validate_networks() for [('a083a069-1c5f-4798-ae6e-612bd2e50580', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:19:09.222662 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6502c29-f8a6-47b0-b1be-331f921b7431 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 200 len: 1305 microversion: 2.1 time: 0.292510 Oct 27 10:19:09.223264 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1258/2709] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:08 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 1305 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:09.229044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:09.229918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:09.236373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:09.237134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:09.237702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:09.238583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:09.239213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:09.240041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:09.745201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:09.782109 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0285ef73-1301-40f6-990e-8ab2ccd1b4cd tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1935 microversion: 2.75 time: 0.556892 Oct 27 10:19:09.783062 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1259/2710] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:09 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1935 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:09.955378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:09.956059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:09.965597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:09.966634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:09.967428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:09.968309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:09.968894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:09.970024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:10.658359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:10.668926 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4ecd105-7b6e-4e55-99d2-247ea63da892 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1308 microversion: 2.1 time: 0.718215 Oct 27 10:19:10.670054 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1260/2711] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:09 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1308 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:10.677517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:10.678874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] [instance: a3771f18-a29a-4d03-97cf-1e23ec142e87] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:10.711446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:10.711941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:10.712372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:10.713599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:10.714384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:10.715131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:10.735364 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] HTTP exception thrown: Instance a3771f18-a29a-4d03-97cf-1e23ec142e87 could not be found. Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Request method failure captured: Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 HTTP/1.1 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWloQLxHnNNSLyqIv1uUr-kKL7BMS9PuVcRRRiotWz6QYTSAM3KSU19rVpCcTtDx06Tod0KE4fGhrG7wtj42fltNjNjrtqmOah2uw0IXRdSCux0nZhTvRGDBbcJ8a7kSiBRtXcDxRJAb2hVz3gprkrUEfnYCf7h7Q6sJAW26p4tAfnys Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88e242ed84c14a5eaabf74309f00b689", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88e242ed84c14a5eaabf74309f00b689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 88e242ed84c14a5eaabf74309f00b689 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1335994637 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9685331306514f73a2d834a0bf5a77a3 Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersOnMultiNodesTest-1335994637-project Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance a3771f18-a29a-4d03-97cf-1e23ec142e87 could not be found. Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'a3771f18-a29a-4d03-97cf-1e23ec142e87'} Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3771f18-a29a-4d03-97cf-1e23ec142e87 could not be found. Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3771f18-a29a-4d03-97cf-1e23ec142e87 could not be found. Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:10.737563 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:10.741860 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:10.741860 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:10.741860 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:10.741860 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:10.741860 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:10.741860 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3771f18-a29a-4d03-97cf-1e23ec142e87 could not be found. Oct 27 10:19:10.741860 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:10.743645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] Returning 404 to user: Instance a3771f18-a29a-4d03-97cf-1e23ec142e87 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:10.744516 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-98409826-3bf7-4749-926f-f367f7d85ba1 tempest-ServersOnMultiNodesTest-1335994637 tempest-ServersOnMultiNodesTest-1335994637-project] 10.222.0.76 "GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87" status: 404 len: 111 microversion: 2.1 time: 0.073253 Oct 27 10:19:10.745542 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1261/2712] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:10 2022] GET /compute/v2.1/servers/a3771f18-a29a-4d03-97cf-1e23ec142e87 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:10.813273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:10.814077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:10.825117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:10.829535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:10.830037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:10.830751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:10.831208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:10.833978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.019685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:11.032402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] Lazy-loading 'services' on Instance uuid ade30f2e-2aba-4430-8a68-f91f23c49b8a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:11.098532 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-065bca26-749e-4036-8455-1fc47b6ba543 tempest-ServersAdmin275Test-582860615 tempest-ServersAdmin275Test-582860615-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1920 microversion: 2.75 time: 0.289058 Oct 27 10:19:11.099743 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1262/2713] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:10 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1920 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:11.105166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-640dd129-887d-4bce-a81c-866206b2b51a req-d69c683e-740b-43e8-af94-b283c2dd1563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab1bd26-6fbe-4246-890f-533cf3d0a359", "name": "network-vif-plugged", "status": "completed", "tag": "55d94cc3-d256-4796-a220-b6bfaf8e263a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:11.137087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-640dd129-887d-4bce-a81c-866206b2b51a req-d69c683e-740b-43e8-af94-b283c2dd1563 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.141881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-640dd129-887d-4bce-a81c-866206b2b51a req-d69c683e-740b-43e8-af94-b283c2dd1563 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.144776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-640dd129-887d-4bce-a81c-866206b2b51a req-d69c683e-740b-43e8-af94-b283c2dd1563 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.171963 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-640dd129-887d-4bce-a81c-866206b2b51a req-d69c683e-740b-43e8-af94-b283c2dd1563 service nova] Creating event network-vif-plugged:55d94cc3-d256-4796-a220-b6bfaf8e263a for instance aab1bd26-6fbe-4246-890f-533cf3d0a359 on n-h1-854663-10 Oct 27 10:19:11.186585 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-640dd129-887d-4bce-a81c-866206b2b51a req-d69c683e-740b-43e8-af94-b283c2dd1563 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085309 Oct 27 10:19:11.187362 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1263/2714] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:11.196312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:11.197129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:11.207232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.208194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.209006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.214728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.215744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.217438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.303503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:19:11.448878 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-012e10e3-2b4f-4217-ac3c-b84dc3a93d79 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 204 len: 0 microversion: 2.75 time: 0.259805 Oct 27 10:19:11.449764 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1264/2715] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:19:11 2022] DELETE /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:19:11.458410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:11.459561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:11.476571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.477198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.477731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.478545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.478882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.479308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.612764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:19:11.613584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:19:11.616217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:19:11.616786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:19:11.617594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:19:11.623807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:11.645822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.648577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.649093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.650117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.650967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.653833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.693571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Getting quotas for project e24ab6322c834c3c8444cf403aca0825. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:19:11.703564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Getting quotas for user 7f2b5253b841436588fa27532e0491d8 and project e24ab6322c834c3c8444cf403aca0825. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:19:11.706541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:11.715663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:11.717238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:11.726085 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bcc7e44a-166e-47da-b68e-dba764e0de32 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1443 microversion: 2.75 time: 0.271838 Oct 27 10:19:11.729880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:19:11.730961 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1265/2716] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:11 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1443 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:11.733723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:19:11.740590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-04b517e7-507f-4ebb-bb86-f7c9d31b56b7 req-de5d44a1-1457-4cba-acb9-781e3c559d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef41d153-9311-4d5a-a975-e82b7d7c2165", "name": "network-vif-deleted", "tag": "2eb156a1-7133-48c1-89fe-956de9ca524e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:11.760428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04b517e7-507f-4ebb-bb86-f7c9d31b56b7 req-de5d44a1-1457-4cba-acb9-781e3c559d2c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.761026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04b517e7-507f-4ebb-bb86-f7c9d31b56b7 req-de5d44a1-1457-4cba-acb9-781e3c559d2c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.761534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04b517e7-507f-4ebb-bb86-f7c9d31b56b7 req-de5d44a1-1457-4cba-acb9-781e3c559d2c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.788230 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-04b517e7-507f-4ebb-bb86-f7c9d31b56b7 req-de5d44a1-1457-4cba-acb9-781e3c559d2c service nova] Creating event network-vif-deleted:2eb156a1-7133-48c1-89fe-956de9ca524e for instance ef41d153-9311-4d5a-a975-e82b7d7c2165 on n-h1-854663-10 Oct 27 10:19:11.796062 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-04b517e7-507f-4ebb-bb86-f7c9d31b56b7 req-de5d44a1-1457-4cba-acb9-781e3c559d2c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063690 Oct 27 10:19:11.798265 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1266/2717] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:11.806800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:11.809082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:11.819301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.840348 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8c0182b-2452-46e6-bb20-33d0e729cc06 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.694564 Oct 27 10:19:11.841471 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1452/2718] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:19:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:19:11.846664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.848043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.848993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:11.853700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:11.854474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:11.869626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4fd414c-5450-454d-8300-fc5a3dc4174a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:11.870774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e4fd414c-5450-454d-8300-fc5a3dc4174a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:12.175760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4fd414c-5450-454d-8300-fc5a3dc4174a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:12.190875 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4fd414c-5450-454d-8300-fc5a3dc4174a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1217 microversion: 2.1 time: 0.334352 Oct 27 10:19:12.201186 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1453/2719] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:11 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1217 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:12.455740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:12.471490 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c7b8060d-1698-4b5e-bd26-63fa065a06c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1308 microversion: 2.1 time: 0.671742 Oct 27 10:19:12.475315 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1267/2720] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:11 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1308 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:12.763521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:12.764230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:12.793475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:12.800086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:12.803798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:12.809846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:12.810904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:12.813414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:13.099896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:13.111876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:13.113503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e60d09942504fdb9ac8b8c037a0f992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85d3e042a1443fc9959ee0666c88b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:13.119992 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c8ad8a5-0a72-4380-ac68-655f6637e8b6 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 200 len: 1443 microversion: 2.75 time: 0.361451 Oct 27 10:19:13.121093 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1454/2721] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:12 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 1443 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:19:13.222821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:13.224431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:13.254290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:13.257320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:13.258989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:13.263079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:13.263585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:13.264026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:13.500270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:13.500936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:13.529801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:13.530381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:13.530839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:13.531713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:13.532180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:13.532607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:13.543527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:13.911804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:13.933881 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ea94cd1-d854-4762-8758-97aedc11021d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1269 microversion: 2.1 time: 0.718037 Oct 27 10:19:13.934513 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1268/2722] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:13 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1269 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:14.245238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82b50176-d03e-4090-9529-1883db8c3756 tempest-FlavorsV2NegativeTest-621902330 tempest-FlavorsV2NegativeTest-621902330-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:14.264416 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82b50176-d03e-4090-9529-1883db8c3756 tempest-FlavorsV2NegativeTest-621902330 tempest-FlavorsV2NegativeTest-621902330-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.328620 Oct 27 10:19:14.265051 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1269/2723] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:14.288383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:14.289040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] [instance: ade30f2e-2aba-4430-8a68-f91f23c49b8a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:14.328113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:14.331759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:14.332424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:14.333350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:14.334568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:14.336303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:14.371938 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] HTTP exception thrown: Instance ade30f2e-2aba-4430-8a68-f91f23c49b8a could not be found. Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Request method failure captured: Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a HTTP/1.1 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlrUlgVAcAED90CN5p9Eu2YzD381_84HULIee2LZyMdp2JhcTwVMHSZ2vPmNDqU4YvC9tarQfDLiBJpOrCD4x0LXsVjnKyfEXdFxH_mbLxB0Yrr8yNbRvstGWIHmhzuB6c6qUjNLV8hpPW2YY92egLZT6hbGlYf2q9CKl5ornW8bYnM Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.75 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: c85d3e042a1443fc9959ee0666c88b18 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersAdmin275Test-1821405876 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c85d3e042a1443fc9959ee0666c88b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c85d3e042a1443fc9959ee0666c88b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c85d3e042a1443fc9959ee0666c88b18", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c85d3e042a1443fc9959ee0666c88b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersAdmin275Test-1821405876 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: c85d3e042a1443fc9959ee0666c88b18 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersAdmin275Test-1821405876 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersAdmin275Test-1821405876-project Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 0e60d09942504fdb9ac8b8c037a0f992 Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersAdmin275Test-1821405876-project Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance ade30f2e-2aba-4430-8a68-f91f23c49b8a could not be found. Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'ade30f2e-2aba-4430-8a68-f91f23c49b8a'} Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade30f2e-2aba-4430-8a68-f91f23c49b8a could not be found. Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade30f2e-2aba-4430-8a68-f91f23c49b8a could not be found. Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:14.373706 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:14.378374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:14.378374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:14.378374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:14.378374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:14.378374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:14.378374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade30f2e-2aba-4430-8a68-f91f23c49b8a could not be found. Oct 27 10:19:14.378374 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:14.378374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] Returning 404 to user: Instance ade30f2e-2aba-4430-8a68-f91f23c49b8a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:14.378374 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-de362ae6-f8b5-4444-ac7a-bf90f3651f38 tempest-ServersAdmin275Test-1821405876 tempest-ServersAdmin275Test-1821405876-project] 10.222.0.76 "GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a" status: 404 len: 111 microversion: 2.75 time: 0.109143 Oct 27 10:19:14.379428 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1270/2724] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:19:14 2022] GET /compute/v2.1/servers/ade30f2e-2aba-4430-8a68-f91f23c49b8a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:19:14.959686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:14.960516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:14.977412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:14.978289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:14.979341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:14.980289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:14.980989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:14.981643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:15.267083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:15.287738 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a12296c-3159-4863-a69c-cd17ffdca13b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1275 microversion: 2.1 time: 0.323073 Oct 27 10:19:15.287738 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1271/2725] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:14 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1275 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:15.292086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:15.323073 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df6cdd16-667b-433b-ab7e-1b8750449b39 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1487 microversion: 2.1 time: 1.825670 Oct 27 10:19:15.324398 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1455/2726] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:13 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1487 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:15.348044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-577038d6-4989-44ce-bea7-266eb867ff9e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:15.348585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-577038d6-4989-44ce-bea7-266eb867ff9e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:15.356329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577038d6-4989-44ce-bea7-266eb867ff9e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:15.356846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577038d6-4989-44ce-bea7-266eb867ff9e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:15.357275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577038d6-4989-44ce-bea7-266eb867ff9e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:15.358123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577038d6-4989-44ce-bea7-266eb867ff9e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:15.358761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577038d6-4989-44ce-bea7-266eb867ff9e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:15.359392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577038d6-4989-44ce-bea7-266eb867ff9e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:15.493815 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-577038d6-4989-44ce-bea7-266eb867ff9e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359/action" status: 202 len: 0 microversion: 2.1 time: 0.150244 Oct 27 10:19:15.500199 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1272/2727] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:19:15 2022] POST /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:19:15.505683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:15.506315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:15.515055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:15.515824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:15.516419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:15.517433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:15.518091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:15.518672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:15.681541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-124f1cba-c5f8-4608-94d0-167ee155f324 tempest-FlavorsV2NegativeTest-621902330 tempest-FlavorsV2NegativeTest-621902330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1507121475", "imageRef": "f8c7620e-f5ba-41a0-bd78-faabe890eb16", "flavorRef": "452"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:15.802920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-124f1cba-c5f8-4608-94d0-167ee155f324 tempest-FlavorsV2NegativeTest-621902330 tempest-FlavorsV2NegativeTest-621902330-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:19:16.275229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:16.294231 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0803ae20-33fb-4d68-94ff-378acea370a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1492 microversion: 2.1 time: 0.791947 Oct 27 10:19:16.308687 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1456/2728] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:15 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1492 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:16.351889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:16.353603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:16.375542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:16.376172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:16.376618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:16.378220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:16.379429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:16.380043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:16.603735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:16.614830 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d7025e2-4b9b-47bd-80a7-dc961d576441 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1275 microversion: 2.1 time: 0.304512 Oct 27 10:19:16.633363 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1457/2729] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:16 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:16.853159 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-124f1cba-c5f8-4608-94d0-167ee155f324 tempest-FlavorsV2NegativeTest-621902330 tempest-FlavorsV2NegativeTest-621902330-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-124f1cba-c5f8-4608-94d0-167ee155f324 tempest-FlavorsV2NegativeTest-621902330 tempest-FlavorsV2NegativeTest-621902330-project] Request method failure captured: Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 143 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlshByROrt_YjNzQTqpK3ClQ_brdQJYCDuhFnStE4iaCN3nLAlN4CjVWiu7nqRfojx412wfhcDfmI7M7bH79W4vlShZyw42vKLzQul_G-ltASabvxJynLKz_hGK19_o2KqrRXgy7XhVH-xXeym-gzRDuKou3HaweWY-fxStmG_ZmlT4 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8a2a4c3ae7a4dddafdf9c1acd03e1c9 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-FlavorsV2NegativeTest-621902330 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8a2a4c3ae7a4dddafdf9c1acd03e1c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8a2a4c3ae7a4dddafdf9c1acd03e1c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8a2a4c3ae7a4dddafdf9c1acd03e1c9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8a2a4c3ae7a4dddafdf9c1acd03e1c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-FlavorsV2NegativeTest-621902330 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8a2a4c3ae7a4dddafdf9c1acd03e1c9 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-621902330 Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-FlavorsV2NegativeTest-621902330-project Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3d687d56add74a118e743cbd92b2880e Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-FlavorsV2NegativeTest-621902330-project Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1507121475", "imageRef": "f8c7620e-f5ba-41a0-bd78-faabe890eb16", "flavorRef": "452"}} Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: exception: Flavor's memory is too small for requested image. Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1507121475', 'imageRef': 'f8c7620e-f5ba-41a0-bd78-faabe890eb16', 'flavorRef': '452'}}} Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:19:16.855680 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-124f1cba-c5f8-4608-94d0-167ee155f324 tempest-FlavorsV2NegativeTest-621902330 tempest-FlavorsV2NegativeTest-621902330-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-124f1cba-c5f8-4608-94d0-167ee155f324 tempest-FlavorsV2NegativeTest-621902330 tempest-FlavorsV2NegativeTest-621902330-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.183203 Oct 27 10:19:16.860124 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1273/2730] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:19:15 2022] POST /compute/v2.1/servers => generated 93 bytes in 1185 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:19:17.326584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:17.327812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:17.350446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:17.350945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:17.351382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:17.352088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:17.352531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:17.352989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:17.639865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:17.641805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:17.657159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:17.670707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:17.671265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:17.672024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:17.672494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:17.691028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:18.214978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:18.224170 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-521919ba-1eb5-4de2-9539-73ca7ccf80f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 200 len: 1472 microversion: 2.1 time: 0.908226 Oct 27 10:19:18.227242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:18.236394 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-98b20bd9-5147-45ef-898e-cd82c46148cc tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1317 microversion: 2.1 time: 0.600776 Oct 27 10:19:18.239854 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1274/2731] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:17 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:18.243251 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1458/2732] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:17 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 1472 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:18.278074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec65b45b-3476-4146-8405-845bffd3841f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1383738888"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:18.280889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec65b45b-3476-4146-8405-845bffd3841f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:18.294116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec65b45b-3476-4146-8405-845bffd3841f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:18.297113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec65b45b-3476-4146-8405-845bffd3841f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:18.297864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec65b45b-3476-4146-8405-845bffd3841f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:18.298615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec65b45b-3476-4146-8405-845bffd3841f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:18.299065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec65b45b-3476-4146-8405-845bffd3841f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:18.299493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec65b45b-3476-4146-8405-845bffd3841f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:18.812777 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec65b45b-3476-4146-8405-845bffd3841f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359/action" status: 202 len: 0 microversion: 2.1 time: 0.537898 Oct 27 10:19:18.814141 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1275/2733] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:19:18 2022] POST /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:19:18.830924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5b9cd210-0c23-4a8c-b213-f7e59d3dc2be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d637f75e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:18.952066 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5b9cd210-0c23-4a8c-b213-f7e59d3dc2be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.129042 Oct 27 10:19:18.954154 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1276/2734] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:18 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:18.965839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30ac288a-ea98-491f-810b-44edb13f4d49 tempest-ListImageFiltersNegativeTestJSON-2131818475 tempest-ListImageFiltersNegativeTestJSON-2131818475-project] Calling method '.version_select at 0x7f6d5a9d95e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:18.991619 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-30ac288a-ea98-491f-810b-44edb13f4d49 tempest-ListImageFiltersNegativeTestJSON-2131818475 tempest-ListImageFiltersNegativeTestJSON-2131818475-project] HTTP exception thrown: Image not found. Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30ac288a-ea98-491f-810b-44edb13f4d49 tempest-ListImageFiltersNegativeTestJSON-2131818475 tempest-ListImageFiltersNegativeTestJSON-2131818475-project] Request method failure captured: Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/images/7465688a-ecba-4442-acd5-0cdb3a3a4db9 HTTP/1.1 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsmdQQDvZhmg3mna--jh-KmkUqIFzgeif685BNU4whHWMB7wSPlzyTee-ccWNtzFltNT-9c6Gn_aHP-eUK-wvVDwHSIrpGIJOZZzDnbJa_y_OJL7n72EX75cBs-bCSlYff14L6JvQxLe96xg4Tn-P5mClHDkrBJ-a1j3_Z-hGkg_E0 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 821308e6ba7147668204c3175cee5da9 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-2131818475 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/821308e6ba7147668204c3175cee5da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/821308e6ba7147668204c3175cee5da9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_821308e6ba7147668204c3175cee5da9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/821308e6ba7147668204c3175cee5da9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-2131818475 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 821308e6ba7147668204c3175cee5da9 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-2131818475 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ListImageFiltersNegativeTestJSON-2131818475-project Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 32e0d17b242441c8ab38527e121315f3 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-2131818475-project Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '7465688a-ecba-4442-acd5-0cdb3a3a4db9'} Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7465688a-ecba-4442-acd5-0cdb3a3a4db9 Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:19:18.994448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7465688a-ecba-4442-acd5-0cdb3a3a4db9 could not be found. Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30ac288a-ea98-491f-810b-44edb13f4d49 tempest-ListImageFiltersNegativeTestJSON-2131818475 tempest-ListImageFiltersNegativeTestJSON-2131818475-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30ac288a-ea98-491f-810b-44edb13f4d49 tempest-ListImageFiltersNegativeTestJSON-2131818475 tempest-ListImageFiltersNegativeTestJSON-2131818475-project] 10.222.0.76 "GET /compute/v2.1/images/7465688a-ecba-4442-acd5-0cdb3a3a4db9" status: 404 len: 62 microversion: 2.1 time: 0.411695 Oct 27 10:19:18.998653 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1459/2735] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:18 2022] GET /compute/v2.1/images/7465688a-ecba-4442-acd5-0cdb3a3a4db9 => generated 62 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:19:19.284437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:19.285318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:19.312089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:19.315838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:19.317433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:19.320695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:19.324178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:19.327952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:19.971315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6690108-120e-466a-9554-fbc0f8fc6d77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9d9ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:20.047160 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6690108-120e-466a-9554-fbc0f8fc6d77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.081904 Oct 27 10:19:20.047757 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1460/2736] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:19 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:20.065669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6be9cdeb-6123-4d33-a462-a043d9949b4d req-18d0b4b7-8b85-4a65-ad3c-ee5f8dc9f81e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99629d37-efb1-4b5e-b242-84d8f6fa220a", "tag": "e12eb329-1c83-48a9-841f-3e3441636969"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:20.104628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6be9cdeb-6123-4d33-a462-a043d9949b4d req-18d0b4b7-8b85-4a65-ad3c-ee5f8dc9f81e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:20.105152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6be9cdeb-6123-4d33-a462-a043d9949b4d req-18d0b4b7-8b85-4a65-ad3c-ee5f8dc9f81e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:20.107818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6be9cdeb-6123-4d33-a462-a043d9949b4d req-18d0b4b7-8b85-4a65-ad3c-ee5f8dc9f81e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:20.149496 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6be9cdeb-6123-4d33-a462-a043d9949b4d req-18d0b4b7-8b85-4a65-ad3c-ee5f8dc9f81e service nova] Creating event network-changed:e12eb329-1c83-48a9-841f-3e3441636969 for instance 99629d37-efb1-4b5e-b242-84d8f6fa220a on n-h1-854663-10 Oct 27 10:19:20.169010 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6be9cdeb-6123-4d33-a462-a043d9949b4d req-18d0b4b7-8b85-4a65-ad3c-ee5f8dc9f81e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112613 Oct 27 10:19:20.169972 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1461/2737] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:21.064225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57919e46-584d-4de8-815a-fc290077376d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9e3550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:21.114999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:21.126046 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3cab68c0-8f1e-4658-b482-91f611c700c7 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1317 microversion: 2.1 time: 1.846503 Oct 27 10:19:21.131314 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1277/2738] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:19 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1317 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:21.182652 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57919e46-584d-4de8-815a-fc290077376d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.122986 Oct 27 10:19:21.192855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1462/2739] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:21 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:22.152453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:22.153868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:22.169348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:22.201023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1105b83e-869a-4a93-b82f-e95ad7f79ccd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5aa31ca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:22.207128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:22.207421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:22.210778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:22.212129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:22.218035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:22.219101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:22.221665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:22.222350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:22.307335 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1105b83e-869a-4a93-b82f-e95ad7f79ccd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.108470 Oct 27 10:19:22.308151 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1463/2740] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:22 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:22.938585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:22.952590 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7fb83e59-7b66-4911-8803-b91a0c3ebedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1317 microversion: 2.1 time: 0.803832 Oct 27 10:19:22.963986 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1278/2741] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:22 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:23.027863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a587b7fb-dc01-4860-a29e-c3008f50eab1 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.048038 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a587b7fb-dc01-4860-a29e-c3008f50eab1 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.599934 Oct 27 10:19:23.062258 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1464/2742] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:23.065547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b3f4615b-0d9e-4a39-8cc4-22d1ec707afa tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.128642 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b3f4615b-0d9e-4a39-8cc4-22d1ec707afa tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.066945 Oct 27 10:19:23.134320 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1279/2743] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:23.151768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d6bb513-6156-44d7-bf9c-9158bb6ee3d7 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.161675 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d6bb513-6156-44d7-bf9c-9158bb6ee3d7 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013919 Oct 27 10:19:23.179160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de68fccd-13ae-4281-93bd-0f23f7cf8477 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.187943 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-de68fccd-13ae-4281-93bd-0f23f7cf8477 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013463 Oct 27 10:19:23.192114 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1465/2744] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:23.194114 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1280/2745] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:23.208458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e6cf3c4d-975f-41de-ba86-87ced0dcc1f9 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.323905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c9ec8c25-be64-408d-925e-6b64c2d1a679 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5ab489d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.355382 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e6cf3c4d-975f-41de-ba86-87ced0dcc1f9 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.152196 Oct 27 10:19:23.369413 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1466/2746] 10.222.0.76 () {58 vars in 1165 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:23.377817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3841276a-b46c-41f8-83fe-5a0220251aa2 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.407124 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3841276a-b46c-41f8-83fe-5a0220251aa2 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033241 Oct 27 10:19:23.410513 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1467/2747] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:23.429666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39b3384b-7f04-4672-83dd-7cc23ab6016d tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.468111 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c9ec8c25-be64-408d-925e-6b64c2d1a679 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.148399 Oct 27 10:19:23.484226 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1281/2748] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:23.484507 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39b3384b-7f04-4672-83dd-7cc23ab6016d tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.066270 Oct 27 10:19:23.497844 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1468/2749] 10.222.0.76 () {58 vars in 1169 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:23.503382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0355036a-cd8d-437c-8f34-b39242de0c76 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.554133 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0355036a-cd8d-437c-8f34-b39242de0c76 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.052853 Oct 27 10:19:23.570220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8018dfda-3f12-48b7-ad03-d46a3b0aec3c tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.575483 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1282/2750] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:23.581422 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8018dfda-3f12-48b7-ad03-d46a3b0aec3c tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014642 Oct 27 10:19:23.590966 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1469/2751] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:23.597962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccfc845b-1fc1-49cd-a2ab-429fddcd85e4 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.797261 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ccfc845b-1fc1-49cd-a2ab-429fddcd85e4 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.203551 Oct 27 10:19:23.801081 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1283/2752] 10.222.0.76 () {58 vars in 1167 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:23.816228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3fc4215-c17f-40c3-b3cb-5b5b9d6ecc6a tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.842099 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3fc4215-c17f-40c3-b3cb-5b5b9d6ecc6a tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030077 Oct 27 10:19:23.856273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b99c4cfc-7a19-464a-b3c0-dc6331b2f69a tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.863679 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1470/2753] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:23.924080 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b99c4cfc-7a19-464a-b3c0-dc6331b2f69a tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.072097 Oct 27 10:19:23.936091 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1284/2754] 10.222.0.76 () {58 vars in 1144 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:23.941480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1898b1ed-ab7d-48ec-bcc2-879669f9bf7c tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.953910 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1898b1ed-ab7d-48ec-bcc2-879669f9bf7c tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014226 Oct 27 10:19:23.966346 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1471/2755] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:19:23.969900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-460e365b-02be-4dc5-b66c-91fd4dd9b191 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.979957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:23.981193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:24.000262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:24.002659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:24.003995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:24.005917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:24.007451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:24.012732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:24.079342 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-460e365b-02be-4dc5-b66c-91fd4dd9b191 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.113790 Oct 27 10:19:24.085281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1285/2756] 10.222.0.76 () {58 vars in 1148 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:24.099095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6024c0b1-3258-4288-a74e-12a90920dc0e tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:24.126908 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6024c0b1-3258-4288-a74e-12a90920dc0e tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.032381 Oct 27 10:19:24.134717 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1286/2757] 10.222.0.76 () {58 vars in 1140 bytes} [Thu Oct 27 10:19:24 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:24.148092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78bc22ee-baf2-472d-b1aa-f3c7a03e6bcc tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:24.172409 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78bc22ee-baf2-472d-b1aa-f3c7a03e6bcc tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028842 Oct 27 10:19:24.173667 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1287/2758] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:24.192630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c077151-7768-4a66-8a4e-cf5942a909b6 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:24.243898 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c077151-7768-4a66-8a4e-cf5942a909b6 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.062071 Oct 27 10:19:24.244968 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1288/2759] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:19:24 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:24.266347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-545972e1-bc05-4479-bc31-428d669f8a68 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:24.353792 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-545972e1-bc05-4479-bc31-428d669f8a68 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.094135 Oct 27 10:19:24.371108 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1289/2760] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:19:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:24.392308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15dbebc7-7922-41e1-8eeb-50056bd33cb9 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:24.415701 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15dbebc7-7922-41e1-8eeb-50056bd33cb9 tempest-FlavorsV2TestJSON-2126393338 tempest-FlavorsV2TestJSON-2126393338-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029347 Oct 27 10:19:24.422639 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1290/2761] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:19:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:19:24.484958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b00d84e-addc-4d87-b38e-0c587816e8ec tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a922430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:24.617755 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b00d84e-addc-4d87-b38e-0c587816e8ec tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.137127 Oct 27 10:19:24.618387 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1291/2762] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:24 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:25.106761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:25.115723 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d710c8b-3835-4c7b-abf1-6bf9186c5a7b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1317 microversion: 2.1 time: 1.141312 Oct 27 10:19:25.125237 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1472/2763] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:23 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1317 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:25.633348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b06dcd0-255b-4b42-a6b6-ab17fa475b77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5ab48820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:25.738713 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b06dcd0-255b-4b42-a6b6-ab17fa475b77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.109678 Oct 27 10:19:25.748331 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1292/2764] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:25 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:25.878533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-64a9f252-0eef-447b-a337-abcf5e4b0d02 req-830d00da-f6c0-42aa-a619-6a6a1d20fccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab1bd26-6fbe-4246-890f-533cf3d0a359", "name": "network-vif-plugged", "status": "completed", "tag": "55d94cc3-d256-4796-a220-b6bfaf8e263a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:25.901051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64a9f252-0eef-447b-a337-abcf5e4b0d02 req-830d00da-f6c0-42aa-a619-6a6a1d20fccc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:25.902302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64a9f252-0eef-447b-a337-abcf5e4b0d02 req-830d00da-f6c0-42aa-a619-6a6a1d20fccc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:25.903975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64a9f252-0eef-447b-a337-abcf5e4b0d02 req-830d00da-f6c0-42aa-a619-6a6a1d20fccc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:25.934741 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-64a9f252-0eef-447b-a337-abcf5e4b0d02 req-830d00da-f6c0-42aa-a619-6a6a1d20fccc service nova] Creating event network-vif-plugged:55d94cc3-d256-4796-a220-b6bfaf8e263a for instance aab1bd26-6fbe-4246-890f-533cf3d0a359 on n-h1-854663-10 Oct 27 10:19:25.947096 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-64a9f252-0eef-447b-a337-abcf5e4b0d02 req-830d00da-f6c0-42aa-a619-6a6a1d20fccc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077585 Oct 27 10:19:25.952210 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1473/2765] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:26.144555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:26.145148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:26.160747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:26.161248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:26.162071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:26.162384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:26.162916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:26.178632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:26.898460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6bfb9588-e3ae-49dc-865e-45fee31edb82 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Action: 'create', calling method: .version_select at 0x7f6d5aae65e0>, body: {"keypair": {"name": "tempest-keypair-454771087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtZukVzteT/V17Ha6DMoxWCUgLOSj5ZUlI4m3gCPhhCDk9rs85Xaa1I3zSU7nMDrlEZTwQ2hwXYlUKUr0L5I9jcPdjGN91CBwn7dC3oa+5DOQjmAqeEZDleFmf0+AhgNw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:26.939345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-6bfb9588-e3ae-49dc-865e-45fee31edb82 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Getting quotas for project 349ad1084129416096a09cd524c2467d. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:19:26.954765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-6bfb9588-e3ae-49dc-865e-45fee31edb82 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Getting quotas for user 5217c06234d1413aa718cb04fe650d1f and project 349ad1084129416096a09cd524c2467d. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:19:27.012274 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6bfb9588-e3ae-49dc-865e-45fee31edb82 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.392937 Oct 27 10:19:27.013686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1474/2766] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:19:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:27.018805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1daa4fc-6233-47b3-9800-1acbb255d5fb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9fe940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:27.103322 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1daa4fc-6233-47b3-9800-1acbb255d5fb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.088202 Oct 27 10:19:27.104747 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1475/2767] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:27 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:27.285818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:27.300095 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f844ad1f-3a79-40f1-a129-feefccd6d354 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1317 microversion: 2.1 time: 1.159723 Oct 27 10:19:27.304357 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1293/2768] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:26 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1317 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:27.828563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2116909155", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:27.972264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] validate_networks() for [('fb44cd00-5720-4943-842a-282d92b4bf8f', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:19:28.122015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8a058c1-3ec9-4b99-bc0f-67b991555e7e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a92c670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:28.208616 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8a058c1-3ec9-4b99-bc0f-67b991555e7e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.090736 Oct 27 10:19:28.215705 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1294/2769] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:28 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:28.326742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:28.327514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:28.352014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:28.352521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:28.353556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:28.354299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:28.354756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:28.355188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:28.370120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:29.292287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:29.314910 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-affe16de-f7a6-4df1-9528-7de3d9a1224a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1317 microversion: 2.1 time: 0.991542 Oct 27 10:19:29.315925 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1295/2770] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:28 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1317 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:29.683865 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1fa635c5-d7df-46bd-952e-30d13eda8354 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] 10.222.0.76 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.366075 Oct 27 10:19:29.689100 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1296/2771] 10.222.0.76 () {58 vars in 1128 bytes} [Thu Oct 27 10:19:29 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 10:19:29.694588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07612494-1eab-4bcc-b39d-16c44b1266ae tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a916310>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:29.801609 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07612494-1eab-4bcc-b39d-16c44b1266ae tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.116116 Oct 27 10:19:29.802435 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1297/2772] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:29 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:29.810651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f9298fe-b0fb-4af8-b6ca-b381036cd0bb tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Calling method '.version_select at 0x7f6d5a8f8670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:29.851488 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0f9298fe-b0fb-4af8-b6ca-b381036cd0bb tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] HTTP exception thrown: Image not found. Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f9298fe-b0fb-4af8-b6ca-b381036cd0bb tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Request method failure captured: Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlswuB4JOY4seA2c5dRFv9iWE-kT39S2RGlSZ9k9Yezi3tVv_X7ToU_D6H5gdWuX1mU4U4Iiize39dxm_vA9O1LTcsZGcn_0H6UfTHW2xomV4cNWX7YnDMwLQaeRvxCGhBMi6rUeNRygWd4EV7yJ_b2WLc5T3CKJHpTH8Om6xEBdFDE Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_109cd052e9924bd4abd27f22324d5665", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1f24b1bc86644239ab5e04abb7f0b0ea Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '-1'} Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.854039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:19:29.858518 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.860693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f9298fe-b0fb-4af8-b6ca-b381036cd0bb tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:29.862024 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f9298fe-b0fb-4af8-b6ca-b381036cd0bb tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] 10.222.0.76 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.058309 Oct 27 10:19:29.862814 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1298/2773] 10.222.0.76 () {58 vars in 1134 bytes} [Thu Oct 27 10:19:29 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:19:29.880359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ad9e225-05ce-44da-b006-da737b5f1d86 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Calling method '.version_select at 0x7f6d5a969dc0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:29.941462 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-3ad9e225-05ce-44da-b006-da737b5f1d86 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] HTTP exception thrown: Image not found. Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ad9e225-05ce-44da-b006-da737b5f1d86 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Request method failure captured: Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/images/485e5d98-d4c3-4600-8182-a7cbd507dd8j HTTP/1.1 Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlswuB4JOY4seA2c5dRFv9iWE-kT39S2RGlSZ9k9Yezi3tVv_X7ToU_D6H5gdWuX1mU4U4Iiize39dxm_vA9O1LTcsZGcn_0H6UfTHW2xomV4cNWX7YnDMwLQaeRvxCGhBMi6rUeNRygWd4EV7yJ_b2WLc5T3CKJHpTH8Om6xEBdFDE Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_109cd052e9924bd4abd27f22324d5665", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1f24b1bc86644239ab5e04abb7f0b0ea Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '485e5d98-d4c3-4600-8182-a7cbd507dd8j'} Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 485e5d98-d4c3-4600-8182-a7cbd507dd8j to delete Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 485e5d98-d4c3-4600-8182-a7cbd507dd8j could not be found. Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:29.943446 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:19:29.947552 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.950611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ad9e225-05ce-44da-b006-da737b5f1d86 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:29.951774 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ad9e225-05ce-44da-b006-da737b5f1d86 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] 10.222.0.76 "DELETE /compute/v2.1/images/485e5d98-d4c3-4600-8182-a7cbd507dd8j" status: 404 len: 62 microversion: 2.1 time: 0.079893 Oct 27 10:19:29.952917 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1299/2774] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:29 2022] DELETE /compute/v2.1/images/485e5d98-d4c3-4600-8182-a7cbd507dd8j => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:19:29.963494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fa3c44e-9dec-4a9b-8c0e-bfc0a1d9a376 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Calling method '.version_select at 0x7f6d5a9160d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:29.989119 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2fa3c44e-9dec-4a9b-8c0e-bfc0a1d9a376 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] HTTP exception thrown: Image not found. Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fa3c44e-9dec-4a9b-8c0e-bfc0a1d9a376 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Request method failure captured: Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/images/3cc43763-1ee4-4217-8d19-c400941c29001 HTTP/1.1 Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlswuB4JOY4seA2c5dRFv9iWE-kT39S2RGlSZ9k9Yezi3tVv_X7ToU_D6H5gdWuX1mU4U4Iiize39dxm_vA9O1LTcsZGcn_0H6UfTHW2xomV4cNWX7YnDMwLQaeRvxCGhBMi6rUeNRygWd4EV7yJ_b2WLc5T3CKJHpTH8Om6xEBdFDE Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_109cd052e9924bd4abd27f22324d5665", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1f24b1bc86644239ab5e04abb7f0b0ea Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '3cc43763-1ee4-4217-8d19-c400941c29001'} Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3cc43763-1ee4-4217-8d19-c400941c29001 to delete Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3cc43763-1ee4-4217-8d19-c400941c29001 could not be found. Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:29.997610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.002836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fa3c44e-9dec-4a9b-8c0e-bfc0a1d9a376 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:30.004993 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fa3c44e-9dec-4a9b-8c0e-bfc0a1d9a376 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] 10.222.0.76 "DELETE /compute/v2.1/images/3cc43763-1ee4-4217-8d19-c400941c29001" status: 404 len: 62 microversion: 2.1 time: 0.044708 Oct 27 10:19:30.010164 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1300/2775] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:19:29 2022] DELETE /compute/v2.1/images/3cc43763-1ee4-4217-8d19-c400941c29001 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 10:19:30.027172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c57d892-638b-4171-9287-901302dc8d79 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Calling method '.version_select at 0x7f6d5a9118b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:30.096737 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5c57d892-638b-4171-9287-901302dc8d79 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] HTTP exception thrown: Image not found. Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c57d892-638b-4171-9287-901302dc8d79 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Request method failure captured: Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/images/tempest-invalid-123746225 HTTP/1.1 Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlswuB4JOY4seA2c5dRFv9iWE-kT39S2RGlSZ9k9Yezi3tVv_X7ToU_D6H5gdWuX1mU4U4Iiize39dxm_vA9O1LTcsZGcn_0H6UfTHW2xomV4cNWX7YnDMwLQaeRvxCGhBMi6rUeNRygWd4EV7yJ_b2WLc5T3CKJHpTH8Om6xEBdFDE Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_109cd052e9924bd4abd27f22324d5665", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1f24b1bc86644239ab5e04abb7f0b0ea Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'tempest-invalid-123746225'} Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-123746225 to delete Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-123746225 could not be found. Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.098527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:19:30.102814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.105338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c57d892-638b-4171-9287-901302dc8d79 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:30.106591 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c57d892-638b-4171-9287-901302dc8d79 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] 10.222.0.76 "DELETE /compute/v2.1/images/tempest-invalid-123746225" status: 404 len: 62 microversion: 2.1 time: 0.093215 Oct 27 10:19:30.111745 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1301/2776] 10.222.0.76 () {58 vars in 1203 bytes} [Thu Oct 27 10:19:30 2022] DELETE /compute/v2.1/images/tempest-invalid-123746225 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:19:30.129449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-389ec0d1-c383-4af4-af4d-9f5f8b043a70 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Calling method '.version_select at 0x7f6d5a97ce50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:30.171514 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-389ec0d1-c383-4af4-af4d-9f5f8b043a70 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] HTTP exception thrown: Image not found. Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-389ec0d1-c383-4af4-af4d-9f5f8b043a70 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Request method failure captured: Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/images/ae2b3039-ca42-46cf-845b-3c8c511e19d8 HTTP/1.1 Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlswuB4JOY4seA2c5dRFv9iWE-kT39S2RGlSZ9k9Yezi3tVv_X7ToU_D6H5gdWuX1mU4U4Iiize39dxm_vA9O1LTcsZGcn_0H6UfTHW2xomV4cNWX7YnDMwLQaeRvxCGhBMi6rUeNRygWd4EV7yJ_b2WLc5T3CKJHpTH8Om6xEBdFDE Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_109cd052e9924bd4abd27f22324d5665", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/109cd052e9924bd4abd27f22324d5665"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 109cd052e9924bd4abd27f22324d5665 Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717 Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1f24b1bc86644239ab5e04abb7f0b0ea Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1252314717-project Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'ae2b3039-ca42-46cf-845b-3c8c511e19d8'} Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae2b3039-ca42-46cf-845b-3c8c511e19d8 to delete Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae2b3039-ca42-46cf-845b-3c8c511e19d8 could not be found. Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:30.174065 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-389ec0d1-c383-4af4-af4d-9f5f8b043a70 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-389ec0d1-c383-4af4-af4d-9f5f8b043a70 tempest-ImagesDeleteNegativeTestJSON-1252314717 tempest-ImagesDeleteNegativeTestJSON-1252314717-project] 10.222.0.76 "DELETE /compute/v2.1/images/ae2b3039-ca42-46cf-845b-3c8c511e19d8" status: 404 len: 62 microversion: 2.1 time: 0.062525 Oct 27 10:19:30.177776 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1302/2777] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:30 2022] DELETE /compute/v2.1/images/ae2b3039-ca42-46cf-845b-3c8c511e19d8 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:19:30.340118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:30.340752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:30.349603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:30.350082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:30.350581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:30.351280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:30.351726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:30.362740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:31.107034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:19:31.107502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:19:31.107852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:19:31.108913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:19:31.109336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:19:31.133006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:31.133504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:31.133945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:31.142649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:31.153427 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c3cf1ef-fb26-4713-b099-47216fd140a0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1317 microversion: 2.1 time: 0.817178 Oct 27 10:19:31.154872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:31.160822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:31.161799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:31.167094 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1303/2778] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:30 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1317 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:31.172144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a304edc8-11ec-4c4a-9079-27380ea280e3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9119d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:31.216956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Getting quotas for project 9067a31bfee345fca080e7621aa60015. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:19:31.229992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Getting quotas for user 5fc08f1ad238424896dcefb0fa0b20c5 and project 9067a31bfee345fca080e7621aa60015. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:19:31.266609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:19:31.269466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:19:31.317305 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a304edc8-11ec-4c4a-9079-27380ea280e3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.148795 Oct 27 10:19:31.318490 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1304/2779] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:31 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:31.376941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-dc8ec73a-c26e-4c6a-8f56-89baef64950f req-13b8e63c-bd97-4c73-8290-b56baea9ecdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99629d37-efb1-4b5e-b242-84d8f6fa220a", "name": "network-vif-plugged", "status": "completed", "tag": "e12eb329-1c83-48a9-841f-3e3441636969"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:31.405014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dc8ec73a-c26e-4c6a-8f56-89baef64950f req-13b8e63c-bd97-4c73-8290-b56baea9ecdb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:31.407389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddb4f584-6c9a-4f67-8a82-9d448cbba4b3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.931543 Oct 27 10:19:31.408131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dc8ec73a-c26e-4c6a-8f56-89baef64950f req-13b8e63c-bd97-4c73-8290-b56baea9ecdb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:31.411265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dc8ec73a-c26e-4c6a-8f56-89baef64950f req-13b8e63c-bd97-4c73-8290-b56baea9ecdb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:31.421710 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1476/2780] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:19:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 3946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:19:31.432246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de13a190-426c-40a5-aa5a-4d821264a867 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:31.446504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de13a190-426c-40a5-aa5a-4d821264a867 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:31.450945 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-dc8ec73a-c26e-4c6a-8f56-89baef64950f req-13b8e63c-bd97-4c73-8290-b56baea9ecdb service nova] Creating event network-vif-plugged:e12eb329-1c83-48a9-841f-3e3441636969 for instance 99629d37-efb1-4b5e-b242-84d8f6fa220a on n-h1-854663-10 Oct 27 10:19:31.471132 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-dc8ec73a-c26e-4c6a-8f56-89baef64950f req-13b8e63c-bd97-4c73-8290-b56baea9ecdb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098543 Oct 27 10:19:31.481013 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1305/2781] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:19:31.701347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de13a190-426c-40a5-aa5a-4d821264a867 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:31.721769 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de13a190-426c-40a5-aa5a-4d821264a867 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1222 microversion: 2.1 time: 0.295925 Oct 27 10:19:31.722660 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1477/2782] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:31 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1222 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:32.052165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1919614333", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:32.188313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] validate_networks() for [('fb44cd00-5720-4943-842a-282d92b4bf8f', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:19:32.194078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:32.194843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:32.211768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:32.212443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:32.214775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:32.219444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:32.224286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:32.225737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:32.917771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:32.926712 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-872f6ffb-9a27-4d6e-855d-f3daa548b892 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1317 microversion: 2.1 time: 0.736420 Oct 27 10:19:32.931718 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1478/2783] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:32 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:32.939973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-328ebc64-b173-47a6-8754-155417c28147 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a988a60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:33.031911 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-328ebc64-b173-47a6-8754-155417c28147 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.098844 Oct 27 10:19:33.032565 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1479/2784] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:32 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:33.448731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:19:33.449884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:19:33.450604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:19:33.451218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:19:33.451855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:19:33.462216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:33.464189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:33.464643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:33.465465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:33.470361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:33.470817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:33.532771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Getting quotas for project 9067a31bfee345fca080e7621aa60015. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:19:33.542459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Getting quotas for user 5fc08f1ad238424896dcefb0fa0b20c5 and project 9067a31bfee345fca080e7621aa60015. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:19:33.587291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:19:33.590897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:19:33.686403 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be2bfa1e-1323-42a0-8fb0-85705a70c6c6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.639447 Oct 27 10:19:33.698616 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1306/2785] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:19:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:19:33.699286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6833bb58-55d7-495a-9d7a-0753a7bb8719 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:33.700018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6833bb58-55d7-495a-9d7a-0753a7bb8719 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:33.916007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6833bb58-55d7-495a-9d7a-0753a7bb8719 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:33.946876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6833bb58-55d7-495a-9d7a-0753a7bb8719 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1222 microversion: 2.1 time: 0.252397 Oct 27 10:19:33.973568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:33.978075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:33.984936 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1480/2786] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:33 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1222 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:34.001298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:34.006946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:34.016376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:34.017883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:34.018596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:34.021220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:34.053088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5da02014-b8fb-43d9-a9fb-b008ebdf752d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9ebe50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:34.141157 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5da02014-b8fb-43d9-a9fb-b008ebdf752d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.097121 Oct 27 10:19:34.143099 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1481/2787] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:34 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:34.779128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:34.789777 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4fe1c40-1b6e-41d7-952e-3090b02a2838 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1507 microversion: 2.1 time: 0.827123 Oct 27 10:19:34.790376 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1307/2788] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:33 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1507 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:34.816393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:34.821087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:34.869588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:34.872119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:34.872479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:34.874121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:34.874326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:34.881595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:34.978362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:34.978982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:35.000618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:35.001159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:35.001613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:35.002379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:35.002836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:35.003264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:35.983267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:35.994400 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-47a786ab-5e16-4eae-82af-8de1a92f3d74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1226 microversion: 2.1 time: 1.021688 Oct 27 10:19:35.998184 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1308/2789] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:34 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1226 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:36.025089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb41bdeb-d75d-4218-916b-858fb65d25e4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d637f7790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:36.172164 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb41bdeb-d75d-4218-916b-858fb65d25e4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.166271 Oct 27 10:19:36.174761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1309/2790] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:36 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:37.012697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:37.026554 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62847789-16fb-4a00-a08e-be234f456d36 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1507 microversion: 2.1 time: 2.213304 Oct 27 10:19:37.032382 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1482/2791] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:34 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1507 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:37.041411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:37.043055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:37.052146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a9cfb4a-635c-4a1a-951c-58b634f73927 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:37.060286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a9cfb4a-635c-4a1a-951c-58b634f73927 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:37.062762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:37.063252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:37.080784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a9cfb4a-635c-4a1a-951c-58b634f73927 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:37.081736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a9cfb4a-635c-4a1a-951c-58b634f73927 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:37.091235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a9cfb4a-635c-4a1a-951c-58b634f73927 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:37.092304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:37.092827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a9cfb4a-635c-4a1a-951c-58b634f73927 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:37.093526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a9cfb4a-635c-4a1a-951c-58b634f73927 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:37.098300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a9cfb4a-635c-4a1a-951c-58b634f73927 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:37.103189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:37.103673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:37.104113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:37.301029 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a9cfb4a-635c-4a1a-951c-58b634f73927 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "PUT /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1079 microversion: 2.1 time: 0.252720 Oct 27 10:19:37.316703 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1483/2792] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 10:19:37 2022] PUT /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1079 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:37.320578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dc23e3dc-d43f-4cf0-bab7-098c06e264c7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9fe700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:37.407073 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dc23e3dc-d43f-4cf0-bab7-098c06e264c7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.100181 Oct 27 10:19:37.407851 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1484/2793] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:37 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:37.426558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:37.437411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:37.438141 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0309822-bcaf-4a71-a7ac-484e9be630e9 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1280 microversion: 2.1 time: 0.414920 Oct 27 10:19:37.438842 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1310/2794] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:37 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1280 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:37.441597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:37.458451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:37.460844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:37.461671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:37.464463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:37.467325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:37.470080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:38.006773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:38.015687 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d99a4c0-de3e-46b5-bea7-add58dd14ce5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1505 microversion: 2.1 time: 0.601778 Oct 27 10:19:38.016906 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1485/2795] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:37 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:38.040388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:38.043635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:38.071373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:38.071837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:38.072285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:38.083905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:38.087071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:38.087540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:38.437066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82942e3b-add2-482f-82ba-f9219c744e23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9fed30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:38.552096 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82942e3b-add2-482f-82ba-f9219c744e23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.131487 Oct 27 10:19:38.562290 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1486/2796] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:38 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:38.597212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:38.599870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:38.612428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:38.616078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:38.630100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:38.631794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:38.634234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:38.642354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:38.677503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:38.703885 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82f2e269-9c19-4942-a645-310868a9884b tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1505 microversion: 2.1 time: 0.667534 Oct 27 10:19:38.721601 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1311/2797] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:38 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:38.749466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a45ff8ce-9f04-4d29-b26b-416b773008f5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:38.754279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a45ff8ce-9f04-4d29-b26b-416b773008f5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:38.768582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45ff8ce-9f04-4d29-b26b-416b773008f5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:38.774134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45ff8ce-9f04-4d29-b26b-416b773008f5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:38.774866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45ff8ce-9f04-4d29-b26b-416b773008f5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:38.777096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45ff8ce-9f04-4d29-b26b-416b773008f5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:38.777772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45ff8ce-9f04-4d29-b26b-416b773008f5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:38.781363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45ff8ce-9f04-4d29-b26b-416b773008f5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:39.031297 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a45ff8ce-9f04-4d29-b26b-416b773008f5 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "PUT /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1081 microversion: 2.1 time: 0.287713 Oct 27 10:19:39.035766 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1312/2798] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 10:19:38 2022] PUT /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1081 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:39.065580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:39.066388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:39.083296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:39.084115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:39.084734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:39.086049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:39.086764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:39.087424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:39.099340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:39.117869 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff875b4d-df7c-45f8-b029-4fa684ecac11 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1280 microversion: 2.1 time: 0.552684 Oct 27 10:19:39.129573 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1487/2799] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:38 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1280 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:39.412367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:39.424378 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4eb047e-70a6-4f1f-9882-210ffb6be235 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1507 microversion: 2.1 time: 0.375925 Oct 27 10:19:39.444177 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1313/2800] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:39 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:39.451137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:39.453654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:39.463642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:39.464366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:39.464982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:39.465900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:39.466498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:39.467189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:39.571776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17b2bd3b-bc9d-48c8-a0cf-12838b399851 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a87f280>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:39.692548 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17b2bd3b-bc9d-48c8-a0cf-12838b399851 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.125342 Oct 27 10:19:39.700354 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1314/2801] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:39 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:40.091818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:40.104292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a565e227-f0ba-4926-9bc5-4e767a08804c tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1507 microversion: 2.1 time: 0.658152 Oct 27 10:19:40.117413 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1488/2802] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:39 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1507 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:40.133255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:40.134643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:40.143998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:40.144712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:40.156389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:40.157094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:40.157552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:40.158310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:40.158767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:40.159194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:40.177924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:40.189944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:40.190481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:40.190931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:40.191651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:40.192107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:40.192530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:40.251231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:19:40.464650 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50ebd386-f2de-472c-984b-8e5f3fc465f0 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "DELETE /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 204 len: 0 microversion: 2.1 time: 0.338083 Oct 27 10:19:40.469909 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1315/2803] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:19:40 2022] DELETE /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:19:40.484701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1073651230", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2e225fb1-2950-40a8-a644-d64ae90ac910"}], "security_groups": [{"name": "tempest-securitygroup--1400748544"}], "key_name": "tempest-keypair-454771087", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:40.486212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:40.505229 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a87b212e-ba6b-45df-bea6-74ca56847b14 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1280 microversion: 2.1 time: 0.365261 Oct 27 10:19:40.506405 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1489/2804] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:40 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1280 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:40.518904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:40.519708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:40.535824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:40.536574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:40.549998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:40.557793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:40.558687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:40.559336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:40.622668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:19:40.726137 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.api [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Instance is already in deleting state, ignoring this request Oct 27 10:19:40.731650 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e6bd73c-78c0-40f5-bbb9-db7c2581f100 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "DELETE /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 204 len: 0 microversion: 2.1 time: 0.219735 Oct 27 10:19:40.733699 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1490/2805] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:19:40 2022] DELETE /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:19:40.746173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ec6dabc-fc70-466e-82e5-15df700cc7b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9fea60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:40.827927 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ec6dabc-fc70-466e-82e5-15df700cc7b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.092935 Oct 27 10:19:40.828516 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1491/2806] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:40 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:40.841989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:40.843061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:40.880645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:40.885886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:40.887604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:40.888600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:40.891741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:40.892377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:41.204722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:41.444583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] validate_networks() for [('2e225fb1-2950-40a8-a644-d64ae90ac910', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:19:43.157049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:43.164735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:43.167266 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a212720d-2d34-4246-aa25-e81102734f08 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1513 microversion: 2.1 time: 2.337474 Oct 27 10:19:43.168226 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1492/2807] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:40 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1513 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:43.188706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:43.189683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:43.206080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:43.210638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:43.211464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:43.213142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:43.214905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:43.217850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:43.500768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:43.573941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:43.935318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:43.984124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:44.000412 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e1dbd05-195f-4ee0-88bb-5e17165f634a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 0.822652 Oct 27 10:19:44.017545 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1493/2808] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:43 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:44.024595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-734a9edb-96bd-436a-af47-becba04941b1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9b5040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:44.098950 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-734a9edb-96bd-436a-af47-becba04941b1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.079408 Oct 27 10:19:44.102893 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1494/2809] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:44 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:44.192774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:44.194227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:44.208793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:44.215274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:44.218015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:44.221129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:44.231701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:44.232436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:44.287181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Getting quotas for project 349ad1084129416096a09cd524c2467d. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:19:44.311504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Getting quotas for user 5217c06234d1413aa718cb04fe650d1f and project 349ad1084129416096a09cd524c2467d. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:19:44.351959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:19:44.352489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:19:44.353073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:19:44.353718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:19:44.355095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:19:44.391120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:44.395187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:44.409931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:44.411541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:44.412214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:44.414268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:44.475682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Getting quotas for project 349ad1084129416096a09cd524c2467d. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:19:44.491230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Getting quotas for user 5217c06234d1413aa718cb04fe650d1f and project 349ad1084129416096a09cd524c2467d. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:19:44.528974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:19:44.541676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:19:44.723144 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72277d30-0bbe-4595-8955-3c3063f1920a tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.249107 Oct 27 10:19:44.745130 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1316/2810] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:19:40 2022] POST /compute/v2.1/servers => generated 407 bytes in 4274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:19:44.770899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82ddf1bd-dd89-481c-8205-83d2e6993c5d tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:44.771531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-82ddf1bd-dd89-481c-8205-83d2e6993c5d tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:45.060308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-82ddf1bd-dd89-481c-8205-83d2e6993c5d tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:45.086968 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82ddf1bd-dd89-481c-8205-83d2e6993c5d tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1269 microversion: 2.1 time: 0.327196 Oct 27 10:19:45.088015 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1317/2811] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:44 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1269 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:45.099664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:45.108316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:45.123327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:45.154999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:45.155558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:45.156011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:45.159945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:45.164927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:45.166838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:45.292534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:45.309325 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6468e5f4-c790-4921-9642-67fc904d9c4a tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1513 microversion: 2.1 time: 1.119078 Oct 27 10:19:45.314876 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1495/2812] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:44 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1513 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:19:45.341124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6980415c-e40c-4f16-8fb0-34a56e57ecfd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5aae65e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:45.448100 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6980415c-e40c-4f16-8fb0-34a56e57ecfd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.129076 Oct 27 10:19:45.451452 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1496/2813] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:45 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:46.116059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:46.116754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:46.130488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:46.130977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:46.131410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:46.138953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:46.139684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:46.140147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:47.811771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:47.824176 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30c828e3-d870-40d7-9d98-8a95126f59b6 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1265 microversion: 2.1 time: 1.717796 Oct 27 10:19:47.844289 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1497/2814] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:46 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1265 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:47.859092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:47.860638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:47.870848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:47.871737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:47.872384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:47.878441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:47.879252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:47.879885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:47.927709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:47.937995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f635f8da-01fc-4924-ab54-05f4239cff04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 2.847148 Oct 27 10:19:47.941998 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1318/2815] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:45 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:47.949449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a652141-c7c5-4b56-90b2-9363e9b940ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a92f4c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:48.030208 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a652141-c7c5-4b56-90b2-9363e9b940ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.086449 Oct 27 10:19:48.030847 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1319/2816] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:47 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:48.038991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-031557ff-c2d0-42fd-9b74-a75b6ca71a64 req-f849c3ac-1f21-4d0d-9051-b15263c02171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99629d37-efb1-4b5e-b242-84d8f6fa220a", "name": "network-vif-unplugged", "status": "completed", "tag": "e12eb329-1c83-48a9-841f-3e3441636969"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:48.069704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-031557ff-c2d0-42fd-9b74-a75b6ca71a64 req-f849c3ac-1f21-4d0d-9051-b15263c02171 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:48.075526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-031557ff-c2d0-42fd-9b74-a75b6ca71a64 req-f849c3ac-1f21-4d0d-9051-b15263c02171 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:48.076291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-031557ff-c2d0-42fd-9b74-a75b6ca71a64 req-f849c3ac-1f21-4d0d-9051-b15263c02171 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:48.102759 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-031557ff-c2d0-42fd-9b74-a75b6ca71a64 req-f849c3ac-1f21-4d0d-9051-b15263c02171 service nova] Creating event network-vif-unplugged:e12eb329-1c83-48a9-841f-3e3441636969 for instance 99629d37-efb1-4b5e-b242-84d8f6fa220a on n-h1-854663-10 Oct 27 10:19:48.126158 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-031557ff-c2d0-42fd-9b74-a75b6ca71a64 req-f849c3ac-1f21-4d0d-9051-b15263c02171 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087077 Oct 27 10:19:48.126834 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1320/2817] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:48.133144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-fbde5530-e2e2-43fe-ad1a-dbff599b7a0f req-4ca1b54e-9047-4ee0-b54b-eb69528f550b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac", "tag": "13893116-6587-44a1-831d-dd77042e4663"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:48.157181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fbde5530-e2e2-43fe-ad1a-dbff599b7a0f req-4ca1b54e-9047-4ee0-b54b-eb69528f550b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:48.157664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fbde5530-e2e2-43fe-ad1a-dbff599b7a0f req-4ca1b54e-9047-4ee0-b54b-eb69528f550b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:48.158092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fbde5530-e2e2-43fe-ad1a-dbff599b7a0f req-4ca1b54e-9047-4ee0-b54b-eb69528f550b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:48.175877 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-fbde5530-e2e2-43fe-ad1a-dbff599b7a0f req-4ca1b54e-9047-4ee0-b54b-eb69528f550b service nova] Creating event network-changed:13893116-6587-44a1-831d-dd77042e4663 for instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac on n-h2-854663-10 Oct 27 10:19:48.190575 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-fbde5530-e2e2-43fe-ad1a-dbff599b7a0f req-4ca1b54e-9047-4ee0-b54b-eb69528f550b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062308 Oct 27 10:19:48.191848 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1321/2818] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:48.872345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:48.873105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:48.894352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:48.894786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:48.895234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:48.897667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:48.898247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:48.898689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:49.241088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:49.244079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:49.257630 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bee1f374-81c9-4203-8fb9-124308c8de0d tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1513 microversion: 2.1 time: 1.411782 Oct 27 10:19:49.266366 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1498/2819] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:47 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1513 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:49.281324 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01254e3d-5c37-4cfe-a30a-c57e02fd68f5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1327 microversion: 2.1 time: 0.429079 Oct 27 10:19:49.281945 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1322/2820] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:48 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1327 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:49.327152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:49.327946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:49.371460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:49.373490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:49.374564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:49.377181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:49.381411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:49.385260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:49.495869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-968c9f4b-7955-46f3-85fb-c4ecfc334414 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Calling method '.version_select at 0x7f6d5a9eb8b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:49.741938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-968c9f4b-7955-46f3-85fb-c4ecfc334414 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 880d31f4-8747-4171-8bce-2cd51bbd18e8 does not exist", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:19:49.742706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.security_group_api [None req-968c9f4b-7955-46f3-85fb-c4ecfc334414 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Neutron security group 880d31f4-8747-4171-8bce-2cd51bbd18e8 not found {{(pid=120720) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:19:49.743267 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-968c9f4b-7955-46f3-85fb-c4ecfc334414 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] HTTP exception thrown: Security group 880d31f4-8747-4171-8bce-2cd51bbd18e8 does not exist Oct 27 10:19:49.743267 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-bc1f1d71-cd51-4d2a-8b32-2eb64be81ed5'] Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-968c9f4b-7955-46f3-85fb-c4ecfc334414 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Request method failure captured: Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-security-groups/880d31f4-8747-4171-8bce-2cd51bbd18e8 HTTP/1.1 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltEC5KUFZQtviNs0XxGqF7XnjTQnzyn13maQwLLw_QESXymcjFe8o_7_fwF1Q7h7V_Gf5KJkUdCJVujYKjI54Z_U1asfkcpSSi1kAfXUSSEVwP_cEnRujmEcnZowM4O4j8KMNQHGiQQcY_Z4yXd8azFdda823m_4mk8PaXctn98NmQ Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: cd68bfcefb8f4e9887c75be546d27227 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd68bfcefb8f4e9887c75be546d27227", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: cd68bfcefb8f4e9887c75be546d27227 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsNegativeTestJSON-1195487560-project Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b3e0210ba5c64aaeb1037f190c36bb81 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560-project Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group 880d31f4-8747-4171-8bce-2cd51bbd18e8 does not exist Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-bc1f1d71-cd51-4d2a-8b32-2eb64be81ed5'] Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '880d31f4-8747-4171-8bce-2cd51bbd18e8'} Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:19:49.745395 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 880d31f4-8747-4171-8bce-2cd51bbd18e8 does not exist Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc1f1d71-cd51-4d2a-8b32-2eb64be81ed5'] Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 880d31f4-8747-4171-8bce-2cd51bbd18e8 does not exist Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc1f1d71-cd51-4d2a-8b32-2eb64be81ed5'] Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 880d31f4-8747-4171-8bce-2cd51bbd18e8 does not exist Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc1f1d71-cd51-4d2a-8b32-2eb64be81ed5'] Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 880d31f4-8747-4171-8bce-2cd51bbd18e8 does not exist Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc1f1d71-cd51-4d2a-8b32-2eb64be81ed5'] Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-968c9f4b-7955-46f3-85fb-c4ecfc334414 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Returning 404 to user: Security group 880d31f4-8747-4171-8bce-2cd51bbd18e8 does not exist Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-bc1f1d71-cd51-4d2a-8b32-2eb64be81ed5'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:49.750392 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-968c9f4b-7955-46f3-85fb-c4ecfc334414 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/880d31f4-8747-4171-8bce-2cd51bbd18e8" status: 404 len: 194 microversion: 2.1 time: 0.479177 Oct 27 10:19:49.755241 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1499/2821] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:19:49 2022] DELETE /compute/v2.1/os-security-groups/880d31f4-8747-4171-8bce-2cd51bbd18e8 => generated 194 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:49.762371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6c9b4d7-7a42-4f4c-9c14-8989d55a9b0f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9fedc0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:49.880763 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6c9b4d7-7a42-4f4c-9c14-8989d55a9b0f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.127606 Oct 27 10:19:49.905152 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1500/2822] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:49 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:50.038126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-41f7b8c0-1173-47da-8622-da6290a4d2e2 req-49a9515a-d25c-417c-96df-9af2fbb5521d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99629d37-efb1-4b5e-b242-84d8f6fa220a", "name": "network-vif-deleted", "tag": "e12eb329-1c83-48a9-841f-3e3441636969"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:50.090592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-41f7b8c0-1173-47da-8622-da6290a4d2e2 req-49a9515a-d25c-417c-96df-9af2fbb5521d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:50.098950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-41f7b8c0-1173-47da-8622-da6290a4d2e2 req-49a9515a-d25c-417c-96df-9af2fbb5521d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:50.099581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-41f7b8c0-1173-47da-8622-da6290a4d2e2 req-49a9515a-d25c-417c-96df-9af2fbb5521d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:50.155494 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-41f7b8c0-1173-47da-8622-da6290a4d2e2 req-49a9515a-d25c-417c-96df-9af2fbb5521d service nova] Creating event network-vif-deleted:e12eb329-1c83-48a9-841f-3e3441636969 for instance 99629d37-efb1-4b5e-b242-84d8f6fa220a on n-h1-854663-10 Oct 27 10:19:50.182590 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-41f7b8c0-1173-47da-8622-da6290a4d2e2 req-49a9515a-d25c-417c-96df-9af2fbb5521d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275734 Oct 27 10:19:50.186978 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1501/2823] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:50.192893 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80c61f8f-c08a-47d2-bd37-1b26b4752a03 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004295 Oct 27 10:19:50.200875 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1502/2824] 10.222.0.76 () {58 vars in 1164 bytes} [Thu Oct 27 10:19:50 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 10:19:50.220706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19fe1015-c5ba-4e3a-b3ae-01f6ace69bb6 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Calling method '.version_select at 0x7f6d5a988310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:50.273361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:50.295180 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-129e894e-2227-4bf0-8b95-64523bec93e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 1.011809 Oct 27 10:19:50.297010 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1323/2825] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:49 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:50.317214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:50.327129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:50.361903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:50.364259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:50.365347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:50.366818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:50.368584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:50.370275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:50.456021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:50.457617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:50.463710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:50.464376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lazy-loading 'fault' on Instance uuid 99629d37-efb1-4b5e-b242-84d8f6fa220a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:19:50.470333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:50.625264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2b5253b841436588fa27532e0491d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24ab6322c834c3c8444cf403aca0825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:50.649758 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9adb29ef-3055-4c49-8050-c399c337cb78 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 200 len: 1307 microversion: 2.1 time: 0.348049 Oct 27 10:19:50.653274 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1324/2826] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:50 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 1307 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:50.665510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:50.670233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:50.705731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:50.707346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:50.708364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:50.714576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:50.715101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:50.717473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:50.942969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:50.956803 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e9cfef7-3599-480c-8624-e0beb8af5d3b tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1327 microversion: 2.1 time: 0.301417 Oct 27 10:19:50.959916 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1325/2827] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:50 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1327 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:50.967834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c164fabb-e3ff-49c9-86b0-9ba718937cfa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a8909d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:51.070164 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c164fabb-e3ff-49c9-86b0-9ba718937cfa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.108647 Oct 27 10:19:51.078527 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1326/2828] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:50 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:51.322199 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19fe1015-c5ba-4e3a-b3ae-01f6ace69bb6 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.112809 Oct 27 10:19:51.323322 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1503/2829] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:19:50 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:51.327751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:51.328381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:51.347053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc89973b-9029-4bd7-9161-354b68e9e9eb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Calling method '.version_select at 0x7f6d5a9bc0d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:51.366617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:51.369862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:51.371902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:51.373176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:51.374603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:51.376074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:52.151170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:52.160789 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc4e4c86-c02f-4585-a845-557f2f723d0a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 0.838458 Oct 27 10:19:52.174989 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1327/2830] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:51 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:52.348477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4054d03-9790-4533-a3be-a018b9237cc5 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Action: 'create', calling method: .version_select at 0x7f6d5a890820>, body: {"pool": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:52.697445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-bc89973b-9029-4bd7-9161-354b68e9e9eb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:19:52.699235 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-bc89973b-9029-4bd7-9161-354b68e9e9eb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 27 10:19:52.699235 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-7cb01873-bbe0-4c4a-86eb-19500e0298c1'] Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc89973b-9029-4bd7-9161-354b68e9e9eb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Request method failure captured: Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-security-groups/f900f121-339a-49a5-bd09-c01a01516f68 HTTP/1.1 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltEC5KUFZQtviNs0XxGqF7XnjTQnzyn13maQwLLw_QESXymcjFe8o_7_fwF1Q7h7V_Gf5KJkUdCJVujYKjI54Z_U1asfkcpSSi1kAfXUSSEVwP_cEnRujmEcnZowM4O4j8KMNQHGiQQcY_Z4yXd8azFdda823m_4mk8PaXctn98NmQ Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: cd68bfcefb8f4e9887c75be546d27227 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd68bfcefb8f4e9887c75be546d27227", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: cd68bfcefb8f4e9887c75be546d27227 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsNegativeTestJSON-1195487560-project Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b3e0210ba5c64aaeb1037f190c36bb81 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560-project Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: exception: Insufficient rights for removing default security group. Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-7cb01873-bbe0-4c4a-86eb-19500e0298c1'] Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'f900f121-339a-49a5-bd09-c01a01516f68'} Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:19:52.702225 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cb01873-bbe0-4c4a-86eb-19500e0298c1'] Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cb01873-bbe0-4c4a-86eb-19500e0298c1'] Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cb01873-bbe0-4c4a-86eb-19500e0298c1'] Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cb01873-bbe0-4c4a-86eb-19500e0298c1'] Oct 27 10:19:52.706025 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.713763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc89973b-9029-4bd7-9161-354b68e9e9eb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 27 10:19:52.713763 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-7cb01873-bbe0-4c4a-86eb-19500e0298c1'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:52.715057 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc89973b-9029-4bd7-9161-354b68e9e9eb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/f900f121-339a-49a5-bd09-c01a01516f68" status: 400 len: 182 microversion: 2.1 time: 1.381663 Oct 27 10:19:52.715934 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1504/2831] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:19:51 2022] DELETE /compute/v2.1/os-security-groups/f900f121-339a-49a5-bd09-c01a01516f68 => generated 182 bytes in 1383 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:19:52.738966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:52.743169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: 99629d37-efb1-4b5e-b242-84d8f6fa220a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:52.770200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:52.779118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:52.781186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:52.789949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:52.791022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:52.795104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:52.869795 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] HTTP exception thrown: Instance 99629d37-efb1-4b5e-b242-84d8f6fa220a could not be found. Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Request method failure captured: Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a HTTP/1.1 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlqE0Fv0Rl9Z2-JGnkRDN3aGDTtYJdDBlO5sqEDoQY8xo73vzpKVMyT377TzPrGe3bKKPhoq3bh-wjbdJ5oq-vi8ndcPwsxCTFT9sp5GslgGlweOFvvGuqQZzEAC20n9dSPNsD3fECo6qdeX6XhAZW1bCnjv5qkR6xqK6Q4MNf3HjfI Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e24ab6322c834c3c8444cf403aca0825", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7f2b5253b841436588fa27532e0491d8 Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 99629d37-efb1-4b5e-b242-84d8f6fa220a could not be found. Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '99629d37-efb1-4b5e-b242-84d8f6fa220a'} Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99629d37-efb1-4b5e-b242-84d8f6fa220a could not be found. Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99629d37-efb1-4b5e-b242-84d8f6fa220a could not be found. Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:52.872747 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.876494 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:52.876494 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:52.876494 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:52.876494 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:52.876494 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:52.876494 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99629d37-efb1-4b5e-b242-84d8f6fa220a could not be found. Oct 27 10:19:52.876494 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:52.894025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Returning 404 to user: Instance 99629d37-efb1-4b5e-b242-84d8f6fa220a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:52.895263 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-daaf5589-b2a7-4ed2-885f-08254d38311f tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a" status: 404 len: 111 microversion: 2.1 time: 0.178187 Oct 27 10:19:52.896057 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1505/2832] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:52 2022] GET /compute/v2.1/servers/99629d37-efb1-4b5e-b242-84d8f6fa220a => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:52.915782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:52.922495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:52.948470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:52.953633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:52.959557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:52.975522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:52.981766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:52.989286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:54.439517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:54.513582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:54.530198 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c83b8449-77ef-4b8f-bce4-ff7aba5e8fbf tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1395 microversion: 2.1 time: 1.632076 Oct 27 10:19:54.546726 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1506/2833] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:52 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1395 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:54.553077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c87022e5-2352-42cb-9787-0f5021ce0fad tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9a6af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:54.686854 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c87022e5-2352-42cb-9787-0f5021ce0fad tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1412 microversion: 2.1 time: 0.138543 Oct 27 10:19:54.688143 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1507/2834] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:54 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:54.700259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3d23c897-269d-4927-92d7-da0b986589eb req-9116dd01-b117-4c4f-800b-43bb116f479c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb55bff3-d743-41bf-a855-7405357d6f21", "tag": "d9b0f266-7b46-4532-95d3-2b1db9fbf625"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:54.745070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3d23c897-269d-4927-92d7-da0b986589eb req-9116dd01-b117-4c4f-800b-43bb116f479c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:54.745070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3d23c897-269d-4927-92d7-da0b986589eb req-9116dd01-b117-4c4f-800b-43bb116f479c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:54.745681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3d23c897-269d-4927-92d7-da0b986589eb req-9116dd01-b117-4c4f-800b-43bb116f479c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:54.766586 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3d23c897-269d-4927-92d7-da0b986589eb req-9116dd01-b117-4c4f-800b-43bb116f479c service nova] Creating event network-changed:d9b0f266-7b46-4532-95d3-2b1db9fbf625 for instance bb55bff3-d743-41bf-a855-7405357d6f21 on n-h2-854663-10 Oct 27 10:19:54.781305 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3d23c897-269d-4927-92d7-da0b986589eb req-9116dd01-b117-4c4f-800b-43bb116f479c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087661 Oct 27 10:19:54.782472 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1508/2835] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:54.795957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ae345e2-4e35-465f-88f6-f8dcbd090ceb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Calling method '.version_select at 0x7f6d5a9b5f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:54.910551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-4ae345e2-4e35-465f-88f6-f8dcbd090ceb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c849e326-d5d4-45bf-87ad-8259b337fb58 does not exist", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:19:54.911557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.security_group_api [None req-4ae345e2-4e35-465f-88f6-f8dcbd090ceb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Neutron security group c849e326-d5d4-45bf-87ad-8259b337fb58 not found {{(pid=120720) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:19:54.912529 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4ae345e2-4e35-465f-88f6-f8dcbd090ceb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] HTTP exception thrown: Security group c849e326-d5d4-45bf-87ad-8259b337fb58 does not exist Oct 27 10:19:54.912529 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-821e609f-3959-42a0-8735-1330b329be2f'] Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ae345e2-4e35-465f-88f6-f8dcbd090ceb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Request method failure captured: Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-security-groups/c849e326-d5d4-45bf-87ad-8259b337fb58 HTTP/1.1 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltEC5KUFZQtviNs0XxGqF7XnjTQnzyn13maQwLLw_QESXymcjFe8o_7_fwF1Q7h7V_Gf5KJkUdCJVujYKjI54Z_U1asfkcpSSi1kAfXUSSEVwP_cEnRujmEcnZowM4O4j8KMNQHGiQQcY_Z4yXd8azFdda823m_4mk8PaXctn98NmQ Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: cd68bfcefb8f4e9887c75be546d27227 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd68bfcefb8f4e9887c75be546d27227", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: cd68bfcefb8f4e9887c75be546d27227 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsNegativeTestJSON-1195487560-project Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b3e0210ba5c64aaeb1037f190c36bb81 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560-project Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group c849e326-d5d4-45bf-87ad-8259b337fb58 does not exist Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-821e609f-3959-42a0-8735-1330b329be2f'] Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'c849e326-d5d4-45bf-87ad-8259b337fb58'} Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:19:54.916288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c849e326-d5d4-45bf-87ad-8259b337fb58 does not exist Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-821e609f-3959-42a0-8735-1330b329be2f'] Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c849e326-d5d4-45bf-87ad-8259b337fb58 does not exist Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-821e609f-3959-42a0-8735-1330b329be2f'] Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c849e326-d5d4-45bf-87ad-8259b337fb58 does not exist Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-821e609f-3959-42a0-8735-1330b329be2f'] Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c849e326-d5d4-45bf-87ad-8259b337fb58 does not exist Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-821e609f-3959-42a0-8735-1330b329be2f'] Oct 27 10:19:54.920420 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.924956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ae345e2-4e35-465f-88f6-f8dcbd090ceb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Returning 404 to user: Security group c849e326-d5d4-45bf-87ad-8259b337fb58 does not exist Oct 27 10:19:54.924956 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-821e609f-3959-42a0-8735-1330b329be2f'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:54.926543 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ae345e2-4e35-465f-88f6-f8dcbd090ceb tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups/c849e326-d5d4-45bf-87ad-8259b337fb58" status: 404 len: 194 microversion: 2.1 time: 0.142492 Oct 27 10:19:54.933685 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1509/2836] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:19:54 2022] GET /compute/v2.1/os-security-groups/c849e326-d5d4-45bf-87ad-8259b337fb58 => generated 194 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:54.939132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:54.940108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:54.948025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:54.948923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:54.949585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:54.951312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:54.951996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:54.952715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:54.971361 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] HTTP exception thrown: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Request method failure captured: Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 HTTP/1.1 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlqE0Fv0Rl9Z2-JGnkRDN3aGDTtYJdDBlO5sqEDoQY8xo73vzpKVMyT377TzPrGe3bKKPhoq3bh-wjbdJ5oq-vi8ndcPwsxCTFT9sp5GslgGlweOFvvGuqQZzEAC20n9dSPNsD3fECo6qdeX6XhAZW1bCnjv5qkR6xqK6Q4MNf3HjfI Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e24ab6322c834c3c8444cf403aca0825", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7f2b5253b841436588fa27532e0491d8 Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ef41d153-9311-4d5a-a975-e82b7d7c2165'} Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:54.973535 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:54.978344 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:54.980186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Returning 404 to user: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:54.981368 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71883520-cb67-4fc8-9eec-3b6e7773eedf tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 404 len: 111 microversion: 2.1 time: 0.046247 Oct 27 10:19:54.982482 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1510/2837] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:19:54 2022] DELETE /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:54.987648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:54.988629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:54.996738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:54.997599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:54.998266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:54.999225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:55.000065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:55.000759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:55.072745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:55.601307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:55.631829 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ebb24ce-be5e-4a5f-a108-3f9f5c809035 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 0.647785 Oct 27 10:19:55.633735 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1511/2838] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:54 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:55.788598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-268921584", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "bc393ace-9ca8-46ee-824d-0fc414351037"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:55.898486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] validate_networks() for [('bc393ace-9ca8-46ee-824d-0fc414351037', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:19:56.306707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4054d03-9790-4533-a3be-a018b9237cc5 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.128832 Oct 27 10:19:56.308750 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1328/2839] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:19:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:56.324344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01fe0ae1-c0d3-491c-a6f3-fc7d307ec856 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Action: 'update', calling method: .version_select at 0x7f6d5a8900d0>, body: {"security_group": {"name": "tempest-sg-677441425", "description": "tempest-description-1013336618"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:56.543082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG neutronclient.v2_0.client [None req-01fe0ae1-c0d3-491c-a6f3-fc7d307ec856 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 289c88ec-841e-4748-9e96-a8dbdb3d9927 does not exist", "detail": ""}} {{(pid=120719) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:19:56.544031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.security_group_api [None req-01fe0ae1-c0d3-491c-a6f3-fc7d307ec856 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Neutron security group 289c88ec-841e-4748-9e96-a8dbdb3d9927 not found {{(pid=120719) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:19:56.544911 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-01fe0ae1-c0d3-491c-a6f3-fc7d307ec856 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] HTTP exception thrown: Security group 289c88ec-841e-4748-9e96-a8dbdb3d9927 does not exist Oct 27 10:19:56.544911 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-d557ac5f-b13c-4a8c-b896-86202f11e73f'] Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01fe0ae1-c0d3-491c-a6f3-fc7d307ec856 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Request method failure captured: Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: request: PUT /compute/v2.1/os-security-groups/289c88ec-841e-4748-9e96-a8dbdb3d9927 HTTP/1.1 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 101 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltEC5KUFZQtviNs0XxGqF7XnjTQnzyn13maQwLLw_QESXymcjFe8o_7_fwF1Q7h7V_Gf5KJkUdCJVujYKjI54Z_U1asfkcpSSi1kAfXUSSEVwP_cEnRujmEcnZowM4O4j8KMNQHGiQQcY_Z4yXd8azFdda823m_4mk8PaXctn98NmQ Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: cd68bfcefb8f4e9887c75be546d27227 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd68bfcefb8f4e9887c75be546d27227", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd68bfcefb8f4e9887c75be546d27227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: cd68bfcefb8f4e9887c75be546d27227 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupsNegativeTestJSON-1195487560-project Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: b3e0210ba5c64aaeb1037f190c36bb81 Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1195487560-project Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: {"security_group": {"name": "tempest-sg-677441425", "description": "tempest-description-1013336618"}} Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: exception: Security group 289c88ec-841e-4748-9e96-a8dbdb3d9927 does not exist Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-d557ac5f-b13c-4a8c-b896-86202f11e73f'] Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '289c88ec-841e-4748-9e96-a8dbdb3d9927', 'body': {'security_group': {'name': 'tempest-sg-677441425', 'description': 'tempest-description-1013336618'}}} Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:19:56.552755 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 289c88ec-841e-4748-9e96-a8dbdb3d9927 does not exist Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d557ac5f-b13c-4a8c-b896-86202f11e73f'] Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 289c88ec-841e-4748-9e96-a8dbdb3d9927 does not exist Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d557ac5f-b13c-4a8c-b896-86202f11e73f'] Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 289c88ec-841e-4748-9e96-a8dbdb3d9927 does not exist Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d557ac5f-b13c-4a8c-b896-86202f11e73f'] Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 289c88ec-841e-4748-9e96-a8dbdb3d9927 does not exist Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d557ac5f-b13c-4a8c-b896-86202f11e73f'] Oct 27 10:19:56.557279 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.564685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01fe0ae1-c0d3-491c-a6f3-fc7d307ec856 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] Returning 404 to user: Security group 289c88ec-841e-4748-9e96-a8dbdb3d9927 does not exist Oct 27 10:19:56.564685 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-d557ac5f-b13c-4a8c-b896-86202f11e73f'] {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:56.564685 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01fe0ae1-c0d3-491c-a6f3-fc7d307ec856 tempest-SecurityGroupsNegativeTestJSON-1195487560 tempest-SecurityGroupsNegativeTestJSON-1195487560-project] 10.222.0.76 "PUT /compute/v2.1/os-security-groups/289c88ec-841e-4748-9e96-a8dbdb3d9927" status: 404 len: 194 microversion: 2.1 time: 0.253295 Oct 27 10:19:56.564685 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1329/2840] 10.222.0.76 () {60 vars in 1290 bytes} [Thu Oct 27 10:19:56 2022] PUT /compute/v2.1/os-security-groups/289c88ec-841e-4748-9e96-a8dbdb3d9927 => generated 194 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:56.584947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:56.593633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: ef41d153-9311-4d5a-a975-e82b7d7c2165] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:56.607213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:56.608614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:56.609988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:56.624220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:56.624979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:56.625710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:56.657353 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] HTTP exception thrown: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Request method failure captured: Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 HTTP/1.1 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlqE0Fv0Rl9Z2-JGnkRDN3aGDTtYJdDBlO5sqEDoQY8xo73vzpKVMyT377TzPrGe3bKKPhoq3bh-wjbdJ5oq-vi8ndcPwsxCTFT9sp5GslgGlweOFvvGuqQZzEAC20n9dSPNsD3fECo6qdeX6XhAZW1bCnjv5qkR6xqK6Q4MNf3HjfI Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e24ab6322c834c3c8444cf403aca0825", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 7f2b5253b841436588fa27532e0491d8 Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'ef41d153-9311-4d5a-a975-e82b7d7c2165'} Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:56.660018 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.666923 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:56.666923 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:56.666923 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:56.666923 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:56.666923 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:56.666923 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. Oct 27 10:19:56.666923 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:56.673144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Returning 404 to user: Instance ef41d153-9311-4d5a-a975-e82b7d7c2165 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:56.675004 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54292959-2ac3-4cca-be3f-93b797aee957 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165" status: 404 len: 111 microversion: 2.1 time: 0.110049 Oct 27 10:19:56.677312 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1330/2841] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:56 2022] GET /compute/v2.1/servers/ef41d153-9311-4d5a-a975-e82b7d7c2165 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:56.684084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:56.685159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:56.698639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:56.700076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:56.700956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:56.702578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:56.703523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:56.704332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:56.744314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:19:56.744946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:19:56.745609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:19:56.747240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:19:56.747821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:19:56.787498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:56.788304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:56.788780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:56.795147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:56.795893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:56.796411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:56.902616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:19:56.921179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for user 6a80ce0f3a4242a9a061a311c4bb50ae and project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:19:56.952937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:19:56.964047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:19:57.051780 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-337b880b-db8a-4402-8c70-283217b29d5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392535 Oct 27 10:19:57.052935 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1512/2842] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:19:57.058375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-271eb58c-286d-4b0f-85b1-d50702f5fc26 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5aa31820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:57.232870 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-271eb58c-286d-4b0f-85b1-d50702f5fc26 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1421 microversion: 2.1 time: 0.178317 Oct 27 10:19:57.250845 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1513/2843] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:57 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1421 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:57.261498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-00967da8-422d-4884-9921-2672c76ee24b req-2570401e-4797-46aa-ae17-6348fcaf70ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319c0a04-0a7e-4ea4-863c-98b5e42dbda1", "tag": "0ad17519-23a2-4f4f-ba08-e3525af1db3f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:57.276692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:57.288766 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f30adef1-400b-4842-96da-88f474997624 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1395 microversion: 2.1 time: 0.609502 Oct 27 10:19:57.293001 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1331/2844] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:56 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1395 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:57.310943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f903aa6-29c6-4568-8848-35ac7a345356 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Calling method '.version_select at 0x7f6d5a87f0d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:57.314168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-00967da8-422d-4884-9921-2672c76ee24b req-2570401e-4797-46aa-ae17-6348fcaf70ee service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:57.321639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-00967da8-422d-4884-9921-2672c76ee24b req-2570401e-4797-46aa-ae17-6348fcaf70ee service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:57.328552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-00967da8-422d-4884-9921-2672c76ee24b req-2570401e-4797-46aa-ae17-6348fcaf70ee service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:57.361062 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-00967da8-422d-4884-9921-2672c76ee24b req-2570401e-4797-46aa-ae17-6348fcaf70ee service nova] Creating event network-changed:0ad17519-23a2-4f4f-ba08-e3525af1db3f for instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 on n-h1-854663-10 Oct 27 10:19:57.392088 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-00967da8-422d-4884-9921-2672c76ee24b req-2570401e-4797-46aa-ae17-6348fcaf70ee service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135772 Oct 27 10:19:57.395380 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1514/2845] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:57.428729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:57.429930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:57.449568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:57.450333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:57.451805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:57.454422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:57.456029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:57.456721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:58.066409 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f903aa6-29c6-4568-8848-35ac7a345356 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] 10.222.0.76 "GET /compute/v2.1/os-floating-ips/92ed4472-2f7f-41de-9bb4-bb11c28d3f46" status: 200 len: 142 microversion: 2.1 time: 0.771469 Oct 27 10:19:58.067252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1332/2846] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:19:57 2022] GET /compute/v2.1/os-floating-ips/92ed4472-2f7f-41de-9bb4-bb11c28d3f46 => generated 142 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:58.077517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:58.078637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:58.093477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:58.094171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:58.094803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:58.096488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:58.097127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:58.097470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:58.098302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:58.107801 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4487ced1-7f26-4576-af9c-9228c5f0140d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 0.703577 Oct 27 10:19:58.114285 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1515/2847] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:57 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:58.125176 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] HTTP exception thrown: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Request method failure captured: Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 HTTP/1.1 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlqE0Fv0Rl9Z2-JGnkRDN3aGDTtYJdDBlO5sqEDoQY8xo73vzpKVMyT377TzPrGe3bKKPhoq3bh-wjbdJ5oq-vi8ndcPwsxCTFT9sp5GslgGlweOFvvGuqQZzEAC20n9dSPNsD3fECo6qdeX6XhAZW1bCnjv5qkR6xqK6Q4MNf3HjfI Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e24ab6322c834c3c8444cf403aca0825", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 7f2b5253b841436588fa27532e0491d8 Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd04509dd-1faf-474a-a02d-fc408bf96fe2'} Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:58.128545 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.133325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.139233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:58.140990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:58.148516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Returning 404 to user: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:58.153680 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0498e4d-a172-4673-9262-70cb14e7bd75 tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 404 len: 111 microversion: 2.1 time: 0.085107 Oct 27 10:19:58.157513 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1333/2848] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:19:58 2022] DELETE /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:58.167966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b50bedd8-582b-4319-80b2-cf2a0ff50ab0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a87fca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:58.170485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:58.175146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:58.175800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:58.176580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:58.177086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:58.177520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:58.258921 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b50bedd8-582b-4319-80b2-cf2a0ff50ab0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 200 len: 1421 microversion: 2.1 time: 0.099902 Oct 27 10:19:58.260016 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1334/2849] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:19:58 2022] GET /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 1421 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:58.265040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ca42f0e4-79d4-4a1f-985d-00e8480f3845 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Calling method '.version_select at 0x7f6d5a8b73a0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:58.313033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:58.335394 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e1583b7-30a9-4a0d-8bc7-6ae7da1e2385 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1196 microversion: 2.1 time: 0.219849 Oct 27 10:19:58.352104 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1516/2850] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:58 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1196 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:58.364302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:58.365042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] [instance: d04509dd-1faf-474a-a02d-fc408bf96fe2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:58.376464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:58.376998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:58.379577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:58.380466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:58.381289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:58.382249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:58.408111 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] HTTP exception thrown: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Request method failure captured: Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 HTTP/1.1 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlqE0Fv0Rl9Z2-JGnkRDN3aGDTtYJdDBlO5sqEDoQY8xo73vzpKVMyT377TzPrGe3bKKPhoq3bh-wjbdJ5oq-vi8ndcPwsxCTFT9sp5GslgGlweOFvvGuqQZzEAC20n9dSPNsD3fECo6qdeX6XhAZW1bCnjv5qkR6xqK6Q4MNf3HjfI Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e24ab6322c834c3c8444cf403aca0825", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e24ab6322c834c3c8444cf403aca0825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: e24ab6322c834c3c8444cf403aca0825 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2109446825 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 7f2b5253b841436588fa27532e0491d8 Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerDiskConfigTestJSON-2109446825-project Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'd04509dd-1faf-474a-a02d-fc408bf96fe2'} Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:19:58.410161 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.414373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:19:58.414373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:19:58.414373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:19:58.414373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:19:58.414373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:19:58.414373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. Oct 27 10:19:58.414373 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:19:58.416226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] Returning 404 to user: Instance d04509dd-1faf-474a-a02d-fc408bf96fe2 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:19:58.417313 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-51513401-4f6d-4a68-860d-92e4314e17ad tempest-ServerDiskConfigTestJSON-2109446825 tempest-ServerDiskConfigTestJSON-2109446825-project] 10.222.0.76 "GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2" status: 404 len: 111 microversion: 2.1 time: 0.064080 Oct 27 10:19:58.418451 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1517/2851] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:58 2022] GET /compute/v2.1/servers/d04509dd-1faf-474a-a02d-fc408bf96fe2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:19:58.427146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1759a473-3ae1-4bb8-902a-e5695d96f49e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a9bc790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:58.874700 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ca42f0e4-79d4-4a1f-985d-00e8480f3845 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] 10.222.0.76 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.613407 Oct 27 10:19:58.876189 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1335/2852] 10.222.0.76 () {58 vars in 1149 bytes} [Thu Oct 27 10:19:58 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:58.881279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:58.881917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:58.897578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:58.898323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:58.898983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:58.899885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:58.900504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:58.901107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:59.310348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:59.326261 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-841f4dfd-f2b0-48c4-91df-c51095edba4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1395 microversion: 2.1 time: 0.447787 Oct 27 10:19:59.346280 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1336/2853] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:58 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1395 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:59.358547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e8b22c7-5e08-480d-95a6-60a1aeda8933 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Calling method '.version_select at 0x7f6d5a87f790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:59.609822 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1759a473-3ae1-4bb8-902a-e5695d96f49e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 204 len: 0 microversion: 2.1 time: 1.189794 Oct 27 10:19:59.615725 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1518/2854] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:58 2022] DELETE /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 0 bytes in 1196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:19:59.624624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:59.644032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:59.652007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:59.653170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:59.653855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:59.654745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:59.655407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:59.655990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:00.998333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:01.009867 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b05dcb0-dcc1-4d10-a5eb-e93d7dd3d72f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 1.392730 Oct 27 10:20:01.010461 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1519/2855] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:59 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:01.101089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-565410526", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "6e77c087-9c37-413a-bf33-443cd764ef30"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:01.165372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] validate_networks() for [('6e77c087-9c37-413a-bf33-443cd764ef30', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:20:03.269352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:20:03.270041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:20:03.270384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:20:03.271567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:20:03.272066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:20:03.295146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:03.301327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:03.302286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:03.303768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:03.304446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:03.305465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:03.424768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Getting quotas for project a8c3992187114a2887044b851d6c7838. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:03.441518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Getting quotas for user 3d0c785c43b24f64b5d1ec4510c78fdd and project a8c3992187114a2887044b851d6c7838. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:03.485882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:20:03.488463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:03.602950 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c800c4f8-9140-4247-84d3-f7da82d31368 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.584661 Oct 27 10:20:03.606125 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1520/2856] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:20:03.616908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:03.617525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:03.638403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:03.638912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:03.639355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:03.640359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:03.640883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:03.641516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:04.062376 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e8b22c7-5e08-480d-95a6-60a1aeda8933 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/92ed4472-2f7f-41de-9bb4-bb11c28d3f46" status: 202 len: 0 microversion: 2.1 time: 4.714768 Oct 27 10:20:04.063050 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1337/2857] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:19:59 2022] DELETE /compute/v2.1/os-floating-ips/92ed4472-2f7f-41de-9bb4-bb11c28d3f46 => generated 0 bytes in 4716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:20:04.069551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:04.070980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:04.091971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:04.092969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:04.093712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:04.094681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:04.095553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:04.096205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:04.137980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:20:04.320109 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bdda8bb4-51c1-42e3-812c-f0d73a55e4b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 204 len: 0 microversion: 2.1 time: 0.255720 Oct 27 10:20:04.321767 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1338/2858] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:20:04 2022] DELETE /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:20:04.334795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-7b427477-c742-4e54-ad0c-86a71a63801e req-956336cb-08de-4ca9-97e0-a4272e796f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab1bd26-6fbe-4246-890f-533cf3d0a359", "name": "network-vif-unplugged", "status": "completed", "tag": "55d94cc3-d256-4796-a220-b6bfaf8e263a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:04.358557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7b427477-c742-4e54-ad0c-86a71a63801e req-956336cb-08de-4ca9-97e0-a4272e796f76 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:04.363710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7b427477-c742-4e54-ad0c-86a71a63801e req-956336cb-08de-4ca9-97e0-a4272e796f76 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:04.364409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7b427477-c742-4e54-ad0c-86a71a63801e req-956336cb-08de-4ca9-97e0-a4272e796f76 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:04.397441 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-7b427477-c742-4e54-ad0c-86a71a63801e req-956336cb-08de-4ca9-97e0-a4272e796f76 service nova] Creating event network-vif-unplugged:55d94cc3-d256-4796-a220-b6bfaf8e263a for instance aab1bd26-6fbe-4246-890f-533cf3d0a359 on n-h1-854663-10 Oct 27 10:20:04.407706 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-7b427477-c742-4e54-ad0c-86a71a63801e req-956336cb-08de-4ca9-97e0-a4272e796f76 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083377 Oct 27 10:20:04.410463 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1339/2859] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:04.422979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:04.429583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:04.444547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:04.449104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:04.449708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:04.450471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:04.450938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:04.451370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:04.844281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:04.860566 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e11aaa08-ca8c-430b-b72b-0151e8e606a8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1292 microversion: 2.1 time: 1.253026 Oct 27 10:20:04.861653 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1521/2860] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:03 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1292 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:04.866386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:04.866999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:04.887533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:04.888044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:04.888491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:04.889261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:04.889708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:04.890133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:05.346587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:05.367731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:05.373154 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82e7b3b3-ea4e-48eb-b781-d756e1cf6d2f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 0.510138 Oct 27 10:20:05.383459 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1522/2861] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:04 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:05.392903 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3c795947-31f5-41b3-ab0a-633338233450 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1395 microversion: 2.1 time: 0.980931 Oct 27 10:20:05.393750 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1340/2862] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:04 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1395 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:05.407820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc74b9ea-033c-4a7d-95ff-65ac8e138787 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Action: 'create', calling method: .version_select at 0x7f6d5ab48820>, body: {"pool": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:05.421714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:05.423405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:05.437685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:05.438969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:05.439734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:05.441434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:05.442129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:05.443166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:05.686921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:05.703766 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb66cedc-a980-494b-8055-40af4e6a0b90 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1276 microversion: 2.1 time: 0.315979 Oct 27 10:20:05.721656 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1523/2863] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:05 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1276 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:05.733923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-394218972", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9817231a-6843-4f63-80f8-30528217ef12"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:05.862970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] validate_networks() for [('9817231a-6843-4f63-80f8-30528217ef12', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:20:07.501424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:20:07.503016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:20:07.504526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:20:07.506710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:20:07.507735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:20:07.574742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:07.577580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:07.581718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:07.585809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:07.586561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:07.587911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:07.733743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:07.749256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for user 8074ee4104864f7b8010104133bd2fef and project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:07.784758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:20:07.787595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:07.884548 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc5e1c9c-3b3c-46b2-8db6-7f1c4e90b06f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.160259 Oct 27 10:20:07.908048 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1524/2864] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:20:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:20:07.950721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:07.951533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:07.980188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:07.980985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:07.981599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:07.984452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:07.985509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:07.990026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:08.618685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:08.644692 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c01942e-57de-4b9d-be5d-afe0e72d0a07 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1292 microversion: 2.1 time: 0.735074 Oct 27 10:20:08.646804 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1525/2865] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:07 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1292 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:08.674630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:08.676332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:08.692139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:08.692645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:08.693286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:08.694042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:08.694715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:08.695390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:08.756388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:09.142796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:09.154677 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6b97252-d12c-490d-bd98-32c21471e501 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 0.489069 Oct 27 10:20:09.155587 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1526/2866] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:08 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:09.184359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:09.185250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:09.193889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:09.196292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:09.222158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:09.227329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:09.227866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:09.231418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:09.692211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:09.715295 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1639b295-f9df-41da-a5f2-53a2ac0b44c8 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1395 microversion: 2.1 time: 0.527229 Oct 27 10:20:09.732335 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1527/2867] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:09 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1395 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:09.737529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-af97156f-e62a-4388-ab29-490dc8510176 req-ce0f1849-6446-4461-af93-f762f21ba0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac", "name": "network-vif-plugged", "status": "completed", "tag": "13893116-6587-44a1-831d-dd77042e4663"}, {"server_uuid": "bb55bff3-d743-41bf-a855-7405357d6f21", "name": "network-vif-plugged", "status": "completed", "tag": "d9b0f266-7b46-4532-95d3-2b1db9fbf625"}, {"server_uuid": "319c0a04-0a7e-4ea4-863c-98b5e42dbda1", "name": "network-vif-plugged", "status": "completed", "tag": "0ad17519-23a2-4f4f-ba08-e3525af1db3f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:09.758605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-af97156f-e62a-4388-ab29-490dc8510176 req-ce0f1849-6446-4461-af93-f762f21ba0ea service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:09.765532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-af97156f-e62a-4388-ab29-490dc8510176 req-ce0f1849-6446-4461-af93-f762f21ba0ea service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:09.766325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-af97156f-e62a-4388-ab29-490dc8510176 req-ce0f1849-6446-4461-af93-f762f21ba0ea service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:09.797996 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-af97156f-e62a-4388-ab29-490dc8510176 req-ce0f1849-6446-4461-af93-f762f21ba0ea service nova] Creating event network-vif-plugged:13893116-6587-44a1-831d-dd77042e4663 for instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac on n-h2-854663-10 Oct 27 10:20:09.797996 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-af97156f-e62a-4388-ab29-490dc8510176 req-ce0f1849-6446-4461-af93-f762f21ba0ea service nova] Creating event network-vif-plugged:d9b0f266-7b46-4532-95d3-2b1db9fbf625 for instance bb55bff3-d743-41bf-a855-7405357d6f21 on n-h2-854663-10 Oct 27 10:20:09.800997 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-af97156f-e62a-4388-ab29-490dc8510176 req-ce0f1849-6446-4461-af93-f762f21ba0ea service nova] Creating event network-vif-plugged:0ad17519-23a2-4f4f-ba08-e3525af1db3f for instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 on n-h1-854663-10 Oct 27 10:20:09.816186 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-af97156f-e62a-4388-ab29-490dc8510176 req-ce0f1849-6446-4461-af93-f762f21ba0ea service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.082264 Oct 27 10:20:09.817836 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1528/2868] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:09.824971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:09.826438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:09.835462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:09.836456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:09.838290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:09.839548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:09.840580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:09.841303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:09.845920 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc74b9ea-033c-4a7d-95ff-65ac8e138787 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.450793 Oct 27 10:20:09.849533 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1341/2869] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:20:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:09.857598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-20aa087f-c582-43f1-91bb-5a13fd1419cb req-dfac7c7d-9588-43e4-a9eb-cbcabd578c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b74d37-2197-4675-beed-2a9a93ebc2da", "tag": "48fadaa3-acbd-4889-a75f-d05fbcd40b94"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:09.905365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-20aa087f-c582-43f1-91bb-5a13fd1419cb req-dfac7c7d-9588-43e4-a9eb-cbcabd578c92 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:09.906121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-20aa087f-c582-43f1-91bb-5a13fd1419cb req-dfac7c7d-9588-43e4-a9eb-cbcabd578c92 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:09.909168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-20aa087f-c582-43f1-91bb-5a13fd1419cb req-dfac7c7d-9588-43e4-a9eb-cbcabd578c92 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:09.929416 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-20aa087f-c582-43f1-91bb-5a13fd1419cb req-dfac7c7d-9588-43e4-a9eb-cbcabd578c92 service nova] Creating event network-changed:48fadaa3-acbd-4889-a75f-d05fbcd40b94 for instance 57b74d37-2197-4675-beed-2a9a93ebc2da on n-h1-854663-10 Oct 27 10:20:09.947808 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-20aa087f-c582-43f1-91bb-5a13fd1419cb req-dfac7c7d-9588-43e4-a9eb-cbcabd578c92 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095288 Oct 27 10:20:09.951164 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1342/2870] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:09.962481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:09.968491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:09.980311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:09.987004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:09.994874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:09.997849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:09.998488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:09.999094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:10.147863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:10.161095 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c9e86f8f-b65a-4ef3-98eb-887deee5bc8a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1259 microversion: 2.1 time: 0.206748 Oct 27 10:20:10.162489 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1343/2871] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:09 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:10.171473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-85410e14-2c04-42cc-bf01-e06b8c07a62f req-b4ae4646-6c17-43d5-9916-748c034263ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab1bd26-6fbe-4246-890f-533cf3d0a359", "name": "network-vif-deleted", "tag": "55d94cc3-d256-4796-a220-b6bfaf8e263a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:10.203096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-85410e14-2c04-42cc-bf01-e06b8c07a62f req-b4ae4646-6c17-43d5-9916-748c034263ae service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:10.204331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-85410e14-2c04-42cc-bf01-e06b8c07a62f req-b4ae4646-6c17-43d5-9916-748c034263ae service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:10.205537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-85410e14-2c04-42cc-bf01-e06b8c07a62f req-b4ae4646-6c17-43d5-9916-748c034263ae service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:10.221379 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-85410e14-2c04-42cc-bf01-e06b8c07a62f req-b4ae4646-6c17-43d5-9916-748c034263ae service nova] Creating event network-vif-deleted:55d94cc3-d256-4796-a220-b6bfaf8e263a for instance aab1bd26-6fbe-4246-890f-533cf3d0a359 on n-h1-854663-10 Oct 27 10:20:10.228827 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-85410e14-2c04-42cc-bf01-e06b8c07a62f req-b4ae4646-6c17-43d5-9916-748c034263ae service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064356 Oct 27 10:20:10.230596 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1344/2872] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:10.244160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:10.245157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:10.256250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:10.257192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:10.258488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:10.259844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:10.260872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:10.261562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:10.262765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:10.266234 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d3e907d-a560-4717-8317-d045cd48859a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1324 microversion: 2.1 time: 0.446705 Oct 27 10:20:10.271164 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1529/2873] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:09 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:10.281579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c951010-098b-4133-bb57-8ffe1b452401 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Calling method '.version_select at 0x7f6d5be40b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:10.767281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:10.775719 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-add8968d-53fb-44f6-a20b-096088cef7af tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1292 microversion: 2.1 time: 0.543077 Oct 27 10:20:10.776333 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1345/2874] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:10 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1292 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:10.781370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:10.782178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:10.788461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:10.788972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:10.789643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:10.790737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:10.791196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:10.791621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:11.708416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:11.715902 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df8c0096-5a71-4944-b6b2-37e4744b8bbe tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1322 microversion: 2.1 time: 0.938278 Oct 27 10:20:11.721093 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1346/2875] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:10 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1322 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:11.733838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:11.735770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:11.751331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:11.754099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:11.758196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:11.759267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:11.760157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:11.760828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:12.512472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:12.523774 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da1ab73d-4cfa-4f65-b479-72f93f07e9c0 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1395 microversion: 2.1 time: 0.797982 Oct 27 10:20:12.524980 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1347/2876] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:11 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1395 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:12.537573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:12.538205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:12.548096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:12.548587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:12.553348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:12.555519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:12.560159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:12.560863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:13.169220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:13.192706 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91041481-23a5-4ebe-afb0-5646a90840cd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1307 microversion: 2.1 time: 0.658951 Oct 27 10:20:13.197639 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1348/2877] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:12 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1307 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:13.209737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:13.210419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:13.221042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:13.221586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:13.222019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:13.223223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:13.223682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:13.224236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:13.430379 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c951010-098b-4133-bb57-8ffe1b452401 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/b0d666ad-bc0d-4848-9378-0fd640dadb38" status: 202 len: 0 microversion: 2.1 time: 3.156711 Oct 27 10:20:13.434060 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1530/2878] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:20:10 2022] DELETE /compute/v2.1/os-floating-ips/b0d666ad-bc0d-4848-9378-0fd640dadb38 => generated 0 bytes in 3162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:20:13.447348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:13.448251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:13.460519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:13.464089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:13.464932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:13.465506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:13.466693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:13.468559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:13.469110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:13.666181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:13.678729 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b5a0eaf-610b-47ae-8fc3-c7e1eb05c802 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1324 microversion: 2.1 time: 0.479131 Oct 27 10:20:13.679576 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1349/2879] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:13 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1324 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:13.709390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-7f255021-cd1f-4f6b-b446-51717d06d024 req-2d850092-1e1d-4361-80f8-ad583ad63494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a50fe3-e249-496a-af7a-9acffd9d7759", "tag": "f61b9b84-be36-4a94-adec-da3ae3206322"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:13.734129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7f255021-cd1f-4f6b-b446-51717d06d024 req-2d850092-1e1d-4361-80f8-ad583ad63494 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:13.737481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7f255021-cd1f-4f6b-b446-51717d06d024 req-2d850092-1e1d-4361-80f8-ad583ad63494 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:13.742189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7f255021-cd1f-4f6b-b446-51717d06d024 req-2d850092-1e1d-4361-80f8-ad583ad63494 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:13.775404 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-7f255021-cd1f-4f6b-b446-51717d06d024 req-2d850092-1e1d-4361-80f8-ad583ad63494 service nova] Creating event network-changed:f61b9b84-be36-4a94-adec-da3ae3206322 for instance 25a50fe3-e249-496a-af7a-9acffd9d7759 on n-h2-854663-10 Oct 27 10:20:13.781029 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-7f255021-cd1f-4f6b-b446-51717d06d024 req-2d850092-1e1d-4361-80f8-ad583ad63494 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086057 Oct 27 10:20:13.781222 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1350/2880] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:13.788950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:13.789572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:13.810848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:13.812064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:13.812692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:13.813706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:13.814289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:13.814931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:13.852477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:14.278365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:14.295845 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3eb7275a-94e6-4496-8b8e-9fc35784a198 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1292 microversion: 2.1 time: 0.853656 Oct 27 10:20:14.296439 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1531/2881] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:13 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1292 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:14.312367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-881dc737-f22f-4037-96f6-cd26ba3f8a5c tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Calling method '.version_select at 0x7f6d5aa31b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:14.326720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:14.367675 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-70741fe6-4864-4549-acda-55d314f0179c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1516 microversion: 2.1 time: 0.584516 Oct 27 10:20:14.394259 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1351/2882] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:13 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1516 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:14.405199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:14.407595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:14.410041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-881dc737-f22f-4037-96f6-cd26ba3f8a5c tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b0d666ad-bc0d-4848-9378-0fd640dadb38 could not be found", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:20:14.410778 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-881dc737-f22f-4037-96f6-cd26ba3f8a5c tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] HTTP exception thrown: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-881dc737-f22f-4037-96f6-cd26ba3f8a5c tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Request method failure captured: Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-floating-ips/b0d666ad-bc0d-4848-9378-0fd640dadb38 HTTP/1.1 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltHYuwKl54vxz0FlgaXNknwDMWZEkA11bjtOIjzx2Wm5nF79uUk1x53_WF5u7lgDOSs0aYH8POHE5UmR8DmcLRa2gwTfN4ZI_bOzz9M3zCok3m2c5nkYXx8FvstoUfL_tcTW5HE1FPSffpLCCxWO--RkTpr49F-RWpooOqjZ3Pg1VE Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a3a9602c695f434db66751b8dd0689b7 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsTestJSON-919971407 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3a9602c695f434db66751b8dd0689b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a3a9602c695f434db66751b8dd0689b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a3a9602c695f434db66751b8dd0689b7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3a9602c695f434db66751b8dd0689b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsTestJSON-919971407 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a3a9602c695f434db66751b8dd0689b7 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsTestJSON-919971407 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsTestJSON-919971407-project Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: e30133e8093b44db92201b50e6b043df Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsTestJSON-919971407-project Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: exception: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b0d666ad-bc0d-4848-9378-0fd640dadb38'} Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b0d666ad-bc0d-4848-9378-0fd640dadb38 could not be found Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca498100-851b-40d1-a5e0-0667fbf5002f'] Oct 27 10:20:14.412828 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38. Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-881dc737-f22f-4037-96f6-cd26ba3f8a5c tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Returning 404 to user: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:14.417010 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-881dc737-f22f-4037-96f6-cd26ba3f8a5c tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] 10.222.0.76 "GET /compute/v2.1/os-floating-ips/b0d666ad-bc0d-4848-9378-0fd640dadb38" status: 404 len: 111 microversion: 2.1 time: 0.116683 Oct 27 10:20:14.419233 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1532/2883] 10.222.0.76 () {58 vars in 1260 bytes} [Thu Oct 27 10:20:14 2022] GET /compute/v2.1/os-floating-ips/b0d666ad-bc0d-4848-9378-0fd640dadb38 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:20:14.426017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7a18a724-5da5-4894-b89f-2cd161c38f65 req-2002fc01-9bfa-40b8-ba73-19fd4e3cb8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b74d37-2197-4675-beed-2a9a93ebc2da", "name": "network-vif-plugged", "status": "completed", "tag": "48fadaa3-acbd-4889-a75f-d05fbcd40b94"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:14.427967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:14.429775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:14.433322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:14.434218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:14.434831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:14.435357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:14.451184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7a18a724-5da5-4894-b89f-2cd161c38f65 req-2002fc01-9bfa-40b8-ba73-19fd4e3cb8ce service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:14.454454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7a18a724-5da5-4894-b89f-2cd161c38f65 req-2002fc01-9bfa-40b8-ba73-19fd4e3cb8ce service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:14.454915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7a18a724-5da5-4894-b89f-2cd161c38f65 req-2002fc01-9bfa-40b8-ba73-19fd4e3cb8ce service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:14.488500 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7a18a724-5da5-4894-b89f-2cd161c38f65 req-2002fc01-9bfa-40b8-ba73-19fd4e3cb8ce service nova] Creating event network-vif-plugged:48fadaa3-acbd-4889-a75f-d05fbcd40b94 for instance 57b74d37-2197-4675-beed-2a9a93ebc2da on n-h1-854663-10 Oct 27 10:20:14.511808 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7a18a724-5da5-4894-b89f-2cd161c38f65 req-2002fc01-9bfa-40b8-ba73-19fd4e3cb8ce service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093158 Oct 27 10:20:14.512629 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1533/2884] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:14.518841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:14.519663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:14.550895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:14.552522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:14.553189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:14.554319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:14.554744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:14.555337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:15.010874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:15.021715 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f6b6089e-f2bb-49c1-95e3-8b77d4b279d2 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1576 microversion: 2.1 time: 0.625866 Oct 27 10:20:15.038552 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1352/2885] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:14 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1576 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:15.048919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:15.051650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:15.063532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:15.066888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:15.067793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:15.068749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:15.069912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:15.070514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:15.100856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lazy-loading 'flavor' on Instance uuid bb55bff3-d743-41bf-a855-7405357d6f21 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:20:15.160094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:15.178830 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67fb8c0b-2da4-4505-b310-3cd9b251b775 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1307 microversion: 2.1 time: 0.664134 Oct 27 10:20:15.179433 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1534/2886] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:14 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1307 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:15.210686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-202671cc-d832-494c-88ac-45db91560ab7 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Calling method '.version_select at 0x7f6d5aa3ca60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:15.227921 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b3a8e9a0-143d-4fad-b290-474359827244 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21/action" status: 200 len: 32 microversion: 2.1 time: 0.187530 Oct 27 10:20:15.229416 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1353/2887] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:20:15 2022] POST /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:20:15.236643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:15.237577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:15.239971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:15.249238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:15.250247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:15.250903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:15.251862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:15.252529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:15.253199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:15.693945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-202671cc-d832-494c-88ac-45db91560ab7 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b0d666ad-bc0d-4848-9378-0fd640dadb38 could not be found", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:20:15.694844 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-202671cc-d832-494c-88ac-45db91560ab7 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] HTTP exception thrown: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-202671cc-d832-494c-88ac-45db91560ab7 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Request method failure captured: Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-floating-ips/b0d666ad-bc0d-4848-9378-0fd640dadb38 HTTP/1.1 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltHYuwKl54vxz0FlgaXNknwDMWZEkA11bjtOIjzx2Wm5nF79uUk1x53_WF5u7lgDOSs0aYH8POHE5UmR8DmcLRa2gwTfN4ZI_bOzz9M3zCok3m2c5nkYXx8FvstoUfL_tcTW5HE1FPSffpLCCxWO--RkTpr49F-RWpooOqjZ3Pg1VE Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a3a9602c695f434db66751b8dd0689b7 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-FloatingIPsTestJSON-919971407 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3a9602c695f434db66751b8dd0689b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a3a9602c695f434db66751b8dd0689b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a3a9602c695f434db66751b8dd0689b7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3a9602c695f434db66751b8dd0689b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-FloatingIPsTestJSON-919971407 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a3a9602c695f434db66751b8dd0689b7 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-FloatingIPsTestJSON-919971407 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-FloatingIPsTestJSON-919971407-project Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: e30133e8093b44db92201b50e6b043df Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-FloatingIPsTestJSON-919971407-project Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: exception: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b0d666ad-bc0d-4848-9378-0fd640dadb38'} Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b0d666ad-bc0d-4848-9378-0fd640dadb38 could not be found Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c68ae472-547a-4ed4-a210-03d113018519'] Oct 27 10:20:15.697510 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38. Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 Oct 27 10:20:15.701343 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:15.706121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-202671cc-d832-494c-88ac-45db91560ab7 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] Returning 404 to user: Floating IP not found for ID b0d666ad-bc0d-4848-9378-0fd640dadb38 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:15.707103 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-202671cc-d832-494c-88ac-45db91560ab7 tempest-FloatingIPsTestJSON-919971407 tempest-FloatingIPsTestJSON-919971407-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/b0d666ad-bc0d-4848-9378-0fd640dadb38" status: 404 len: 111 microversion: 2.1 time: 0.509311 Oct 27 10:20:15.707758 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1535/2888] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:20:15 2022] DELETE /compute/v2.1/os-floating-ips/b0d666ad-bc0d-4848-9378-0fd640dadb38 => generated 111 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:20:15.715034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a01c49a3-cad9-4674-bc74-4e59cfec8f4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:15.715784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a01c49a3-cad9-4674-bc74-4e59cfec8f4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:15.731708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a01c49a3-cad9-4674-bc74-4e59cfec8f4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:15.732216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a01c49a3-cad9-4674-bc74-4e59cfec8f4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:15.733124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a01c49a3-cad9-4674-bc74-4e59cfec8f4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:15.734379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a01c49a3-cad9-4674-bc74-4e59cfec8f4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:15.734706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a01c49a3-cad9-4674-bc74-4e59cfec8f4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:15.735209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a01c49a3-cad9-4674-bc74-4e59cfec8f4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:16.051181 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a01c49a3-cad9-4674-bc74-4e59cfec8f4c tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.342094 Oct 27 10:20:16.051779 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1536/2889] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:20:15 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1/os-interface => generated 285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:16.057455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:16.058102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:16.066278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:16.066655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:16.067500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:16.067500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:16.067888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:16.068505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:16.068964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:16.081415 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3b9a63c1-798e-4f97-b2fa-ba0dc973cd11 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1324 microversion: 2.1 time: 0.850585 Oct 27 10:20:16.082007 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1354/2890] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:15 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1324 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:16.086875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:16.093535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:16.102581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:16.103588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:16.104027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:16.104763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:16.105221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:16.105643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:16.906392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:16.918085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:16.925095 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eceba3f0-7568-4873-ac66-0df8b8ac7d0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1292 microversion: 2.1 time: 0.841739 Oct 27 10:20:16.927365 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9db252e-1314-4aa8-a9f0-799f1e198b17 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.874326 Oct 27 10:20:16.928153 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1537/2891] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:16 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:16.933156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7f2b9ee4-fdde-4c9e-b24f-bb782fec1dc3 req-98168d4e-1004-43d4-a213-90af200ebb97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "199e563d-e099-4187-96ea-cc1dc2694fd2", "tag": "c17850c1-9ad6-49e6-8b2f-f5ffad635134"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:16.938271 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1355/2892] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:16 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1292 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:16.947688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:16.948918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:16.956470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f2b9ee4-fdde-4c9e-b24f-bb782fec1dc3 req-98168d4e-1004-43d4-a213-90af200ebb97 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:16.957035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f2b9ee4-fdde-4c9e-b24f-bb782fec1dc3 req-98168d4e-1004-43d4-a213-90af200ebb97 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:16.957470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f2b9ee4-fdde-4c9e-b24f-bb782fec1dc3 req-98168d4e-1004-43d4-a213-90af200ebb97 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:16.960581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:16.961802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:16.962678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:16.963654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:16.965746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:16.967361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:16.972194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7f2b9ee4-fdde-4c9e-b24f-bb782fec1dc3 req-98168d4e-1004-43d4-a213-90af200ebb97 service nova] Creating event network-changed:c17850c1-9ad6-49e6-8b2f-f5ffad635134 for instance 199e563d-e099-4187-96ea-cc1dc2694fd2 on n-h1-854663-10 Oct 27 10:20:16.998815 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7f2b9ee4-fdde-4c9e-b24f-bb782fec1dc3 req-98168d4e-1004-43d4-a213-90af200ebb97 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068038 Oct 27 10:20:17.001219 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1538/2893] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:17.106001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:17.107098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:17.116217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:17.116903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:17.117607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:17.118644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:17.119207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:17.119977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:17.650622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:17.778264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=18 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:18.002559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:18.017386 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b9f2c28d-decd-4dc9-a284-e504ea8b5f34 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1307 microversion: 2.1 time: 1.077884 Oct 27 10:20:18.017993 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1356/2894] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:16 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1307 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:18.029396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9f86bf9f-f11c-4916-98dd-19252b6bd908 req-df32de6a-0cf2-43c4-88b3-115d9a4199e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a50fe3-e249-496a-af7a-9acffd9d7759", "name": "network-vif-plugged", "status": "completed", "tag": "f61b9b84-be36-4a94-adec-da3ae3206322"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:18.052445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9f86bf9f-f11c-4916-98dd-19252b6bd908 req-df32de6a-0cf2-43c4-88b3-115d9a4199e3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:18.053239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9f86bf9f-f11c-4916-98dd-19252b6bd908 req-df32de6a-0cf2-43c4-88b3-115d9a4199e3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:18.053831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9f86bf9f-f11c-4916-98dd-19252b6bd908 req-df32de6a-0cf2-43c4-88b3-115d9a4199e3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:18.079199 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9f86bf9f-f11c-4916-98dd-19252b6bd908 req-df32de6a-0cf2-43c4-88b3-115d9a4199e3 service nova] Creating event network-vif-plugged:f61b9b84-be36-4a94-adec-da3ae3206322 for instance 25a50fe3-e249-496a-af7a-9acffd9d7759 on n-h2-854663-10 Oct 27 10:20:18.093395 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9f86bf9f-f11c-4916-98dd-19252b6bd908 req-df32de6a-0cf2-43c4-88b3-115d9a4199e3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074092 Oct 27 10:20:18.094590 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1357/2895] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:18.101909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:18.102965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:18.120613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:18.127727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:18.128415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:18.129386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:18.129999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:18.130617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:18.166000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:18.176911 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dfc0f5fd-c6a0-40a6-b45d-1fcb610002b9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1324 microversion: 2.1 time: 1.076726 Oct 27 10:20:18.181458 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1539/2896] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:17 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1324 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:20:18.192386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:18.193045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:18.217956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:18.218448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:18.224914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:18.225943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:18.226577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:18.227169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:18.751815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:18.761678 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c3c05e0-ca73-4a71-9142-5c64f91355a7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1472 microversion: 2.1 time: 0.665688 Oct 27 10:20:18.762281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1358/2897] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:18 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1472 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:18.781880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:18.782492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:18.798522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:18.798943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:18.799387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:18.800114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:18.800573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:18.801036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:19.002198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:19.032597 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b883c947-db95-49c4-8753-7639f30c6250 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.846792 Oct 27 10:20:19.035599 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1540/2898] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:18 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:19.052381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:19.053907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:19.083401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:19.083991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:19.084444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:19.085215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:19.085667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:19.086094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:19.569326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:19.578141 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-26eed725-7f91-415d-a789-cdbd8bfab008 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1576 microversion: 2.1 time: 0.814795 Oct 27 10:20:19.579440 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1359/2899] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:18 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1576 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:19.593420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-595042057", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:19.607141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:19.617914 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8bdebf1f-9e41-46b2-9939-9535d2755d8d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1307 microversion: 2.1 time: 0.579393 Oct 27 10:20:19.624226 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1541/2900] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:19 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1307 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:19.636797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a643f5c9-aed9-440f-b5c7-b566ed58dc0f req-ca20dbde-68af-4a8b-a0d1-8d8a1772d398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319c0a04-0a7e-4ea4-863c-98b5e42dbda1", "tag": "0ad17519-23a2-4f4f-ba08-e3525af1db3f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:19.684039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a643f5c9-aed9-440f-b5c7-b566ed58dc0f req-ca20dbde-68af-4a8b-a0d1-8d8a1772d398 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:19.684855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a643f5c9-aed9-440f-b5c7-b566ed58dc0f req-ca20dbde-68af-4a8b-a0d1-8d8a1772d398 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:19.687315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a643f5c9-aed9-440f-b5c7-b566ed58dc0f req-ca20dbde-68af-4a8b-a0d1-8d8a1772d398 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:19.713714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] validate_networks() for [('bc393ace-9ca8-46ee-824d-0fc414351037', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:20:19.732291 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a643f5c9-aed9-440f-b5c7-b566ed58dc0f req-ca20dbde-68af-4a8b-a0d1-8d8a1772d398 service nova] Creating event network-changed:0ad17519-23a2-4f4f-ba08-e3525af1db3f for instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 on n-h1-854663-10 Oct 27 10:20:19.744863 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a643f5c9-aed9-440f-b5c7-b566ed58dc0f req-ca20dbde-68af-4a8b-a0d1-8d8a1772d398 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118910 Oct 27 10:20:19.745753 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1542/2901] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:19.751341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:19.757459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:19.774288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:19.774826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:19.775465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:19.776189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:19.777196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:19.778224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:21.113225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:21.125501 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5468858-6c73-4f25-ba42-549e6d23e2c8 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1324 microversion: 2.1 time: 1.377925 Oct 27 10:20:21.126929 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1543/2902] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:19 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1324 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:21.145676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:21.147063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:21.165770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:21.167619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:21.168311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:21.169442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:21.170515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:21.171166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:21.743657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:21.760068 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48648e6a-a85c-437b-bbf7-5420e42eae95 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.630930 Oct 27 10:20:21.761162 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1544/2903] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:21 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:21.768959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:21.771814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:21.785446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:21.786454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:21.786902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:21.789854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:21.790471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:21.791811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:21.931091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:20:21.932148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:20:21.932806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:20:21.933364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:20:21.933926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:20:21.944572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:21.945593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:21.946383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:21.950047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:21.950746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:21.951378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:21.976382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:21.987029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for user 6a80ce0f3a4242a9a061a311c4bb50ae and project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:22.016956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:20:22.020927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 574114a0-06fb-4ba7-8afb-9c817d38f005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:22.094904 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3670839-ec03-4d56-aace-db3bcb2b3233 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514110 Oct 27 10:20:22.095762 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1360/2904] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:20:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:20:22.106998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-214724bc-8c54-4c57-b271-3b0923370137 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:22.107514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-214724bc-8c54-4c57-b271-3b0923370137 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 574114a0-06fb-4ba7-8afb-9c817d38f005] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:22.138819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-214724bc-8c54-4c57-b271-3b0923370137 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 574114a0-06fb-4ba7-8afb-9c817d38f005] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:20:22.557923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:22.566580 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6a86d8e-e22a-4545-956c-6f7168b1ee20 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1307 microversion: 2.1 time: 0.804261 Oct 27 10:20:22.571086 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1545/2905] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:21 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1307 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:22.576164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:22.589579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:22.596594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:22.597264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:22.597705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:22.598450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:22.598900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:22.599335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:22.643295 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.scheduler.client.report [None req-214724bc-8c54-4c57-b271-3b0923370137 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Deleted allocations for instance 574114a0-06fb-4ba7-8afb-9c817d38f005 Oct 27 10:20:22.673050 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-214724bc-8c54-4c57-b271-3b0923370137 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005" status: 204 len: 0 microversion: 2.1 time: 0.569766 Oct 27 10:20:22.673847 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1361/2906] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:20:22 2022] DELETE /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:20:22.682055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69737447-e757-4190-9821-cd3a185a9674 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:22.682670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-69737447-e757-4190-9821-cd3a185a9674 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 574114a0-06fb-4ba7-8afb-9c817d38f005] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:22.688305 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-69737447-e757-4190-9821-cd3a185a9674 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69737447-e757-4190-9821-cd3a185a9674 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005 HTTP/1.1 Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '574114a0-06fb-4ba7-8afb-9c817d38f005'} Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:22.689962 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:22.693885 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:22.693885 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:20:22.693885 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:20:22.693885 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:20:22.693885 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:22.693885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69737447-e757-4190-9821-cd3a185a9674 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:22.693885 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-69737447-e757-4190-9821-cd3a185a9674 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005" status: 404 len: 111 microversion: 2.1 time: 0.013200 Oct 27 10:20:22.704849 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1362/2907] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:22 2022] GET /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:20:22.790061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:22.791121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:22.804862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:22.805879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:22.808026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:22.809280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:22.810279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:22.812056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:23.506750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:23.515571 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cde1530f-585c-47d2-81b3-00b883e7a790 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1522 microversion: 2.1 time: 0.943005 Oct 27 10:20:23.517485 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1546/2908] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:22 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1522 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:23.529621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-387765286", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "bc393ace-9ca8-46ee-824d-0fc414351037"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:23.584237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:23.592604 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9da6e923-e79a-4454-a4de-e3fb6965e6ca tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.808678 Oct 27 10:20:23.609595 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1363/2909] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:22 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:20:23.615177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:23.616031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:23.632431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:23.634678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:23.635603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:23.636621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:23.637611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:23.638307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:23.952503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:23.965818 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8ef8a30d-07da-4263-8cde-51cc0fd0ed14 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1522 microversion: 2.1 time: 0.354836 Oct 27 10:20:23.966648 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1364/2910] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:23 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:23.985218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:23.986331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:24.011349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:24.016774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:24.017642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:24.018723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:24.019356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:24.019962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:24.266415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] validate_networks() for [('bc393ace-9ca8-46ee-824d-0fc414351037', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:20:24.701611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:24.713631 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f46b6325-f830-415c-a47c-f51c80c644fc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1307 microversion: 2.1 time: 0.742162 Oct 27 10:20:24.714298 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1365/2911] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:23 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1307 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:24.724726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6766422a-6e70-456e-b7cf-09c7e93f177f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1704417623", "metadata": {"": ""}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6766422a-6e70-456e-b7cf-09c7e93f177f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action HTTP/1.1 Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 107 Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1704417623", "metadata": {"": ""}}} Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '25a50fe3-e249-496a-af7a-9acffd9d7759', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1704417623', 'metadata': {'': ''}}}} Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'': ''} Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:20:24.737921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6766422a-6e70-456e-b7cf-09c7e93f177f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6766422a-6e70-456e-b7cf-09c7e93f177f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action" status: 400 len: 170 microversion: 2.1 time: 0.024194 Oct 27 10:20:24.745407 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1366/2912] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Oct 27 10:20:24 2022] POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action => generated 170 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:20:24.756214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b4749e54-57ca-4b24-8e3b-e03085aca2f6 req-fcb671a4-ec0d-481f-b02a-50c4b5c26320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199e563d-e099-4187-96ea-cc1dc2694fd2", "name": "network-vif-plugged", "status": "completed", "tag": "c17850c1-9ad6-49e6-8b2f-f5ffad635134"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:24.782783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b4749e54-57ca-4b24-8e3b-e03085aca2f6 req-fcb671a4-ec0d-481f-b02a-50c4b5c26320 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:24.783888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b4749e54-57ca-4b24-8e3b-e03085aca2f6 req-fcb671a4-ec0d-481f-b02a-50c4b5c26320 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:24.784386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b4749e54-57ca-4b24-8e3b-e03085aca2f6 req-fcb671a4-ec0d-481f-b02a-50c4b5c26320 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:24.803941 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b4749e54-57ca-4b24-8e3b-e03085aca2f6 req-fcb671a4-ec0d-481f-b02a-50c4b5c26320 service nova] Creating event network-vif-plugged:c17850c1-9ad6-49e6-8b2f-f5ffad635134 for instance 199e563d-e099-4187-96ea-cc1dc2694fd2 on n-h1-854663-10 Oct 27 10:20:24.810166 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b4749e54-57ca-4b24-8e3b-e03085aca2f6 req-fcb671a4-ec0d-481f-b02a-50c4b5c26320 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066355 Oct 27 10:20:24.811169 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1367/2913] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:25.022881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce8d3aa2-d0e7-4bf6-bfab-84b622dd6f6c tempest-ListImagesTestJSON-1528818307 tempest-ListImagesTestJSON-1528818307-project] Calling method '.version_select at 0x7f6d5a890af0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:25.091107 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce8d3aa2-d0e7-4bf6-bfab-84b622dd6f6c tempest-ListImagesTestJSON-1528818307 tempest-ListImagesTestJSON-1528818307-project] 10.222.0.76 "GET /compute/v2.1/images/e360a591-87a4-48a1-b578-afd9703b636a" status: 200 len: 784 microversion: 2.1 time: 0.278035 Oct 27 10:20:25.092005 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1368/2914] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:20:24 2022] GET /compute/v2.1/images/e360a591-87a4-48a1-b578-afd9703b636a => generated 784 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:25.102718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:25.103547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:25.114858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:25.115631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:25.116234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:25.117142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:25.117743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:25.118390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:25.602709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:25.621631 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c84829e8-b436-4f5b-b11c-23c010bc2341 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.528438 Oct 27 10:20:25.622249 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1369/2915] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:25 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:25.642305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:25.642930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:25.649739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:25.650504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:25.651518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:25.652505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:25.653132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:25.653708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:25.708739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:20:25.711532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:20:25.713083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:20:25.713630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:20:25.714162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:20:25.740050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:25.741056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:25.741852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:25.743199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:25.769232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:25.769985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:25.825873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:25.831967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for user 6a80ce0f3a4242a9a061a311c4bb50ae and project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:25.857567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:20:25.860002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:25.910025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:25.932875 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a2b28b4-66c9-43c0-8df4-183d2fa948d9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1522 microversion: 2.1 time: 0.298875 Oct 27 10:20:25.936156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1370/2916] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:25 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:25.957306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ea02b86-4aaf-4454-9e2b-9bbf696c5988 tempest-ListImagesTestJSON-1528818307 tempest-ListImagesTestJSON-1528818307-project] Calling method '.version_select at 0x7f6d5a8b7280>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:25.960413 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ce8c2eb-d1eb-4775-8aa0-bd7be17dfdf0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.441483 Oct 27 10:20:25.961483 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1547/2917] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:20:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:20:25.983957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:25.984808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:25.991799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:25.992543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:25.994564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:25.996258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:26.001530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:26.002153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:26.100573 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ea02b86-4aaf-4454-9e2b-9bbf696c5988 tempest-ListImagesTestJSON-1528818307 tempest-ListImagesTestJSON-1528818307-project] 10.222.0.76 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.162904 Oct 27 10:20:26.119208 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1371/2918] 10.222.0.76 () {58 vars in 1122 bytes} [Thu Oct 27 10:20:25 2022] GET /compute/v2.1/images => generated 445 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:26.125072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:26.125913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:26.146383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:26.146935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:26.147384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:26.148146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:26.151772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:26.152228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:26.589049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:26.597803 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cfff104d-f2b4-4fe2-9f1c-0d07cae729f7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1307 microversion: 2.1 time: 0.634800 Oct 27 10:20:26.601600 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1548/2919] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:25 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1307 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:26.610442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:26.611584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-016bfaa9-06e9-461e-891a-7e5fb2cbe461 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:26.612647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-016bfaa9-06e9-461e-891a-7e5fb2cbe461 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:26.627238 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-135ed2e3-eccf-4fc1-bd15-6a0a7eb6698f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1522 microversion: 2.1 time: 0.506418 Oct 27 10:20:26.642916 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1372/2920] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:26 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:26.655969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e693dd6-646e-43be-a89f-79f58d646751 tempest-ListImagesTestJSON-1528818307 tempest-ListImagesTestJSON-1528818307-project] Calling method '.version_select at 0x7f6d5a828430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:26.728407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-016bfaa9-06e9-461e-891a-7e5fb2cbe461 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:26.746690 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-016bfaa9-06e9-461e-891a-7e5fb2cbe461 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1220 microversion: 2.1 time: 0.142632 Oct 27 10:20:26.747495 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1549/2921] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:26 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:26.752407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:26.753566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:26.762056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:26.763113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:26.763767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:26.764827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:26.766201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:26.767179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:26.781191 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e693dd6-646e-43be-a89f-79f58d646751 tempest-ListImagesTestJSON-1528818307 tempest-ListImagesTestJSON-1528818307-project] 10.222.0.76 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.145662 Oct 27 10:20:26.782101 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1373/2922] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:20:26 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:26.810770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ef80843-2573-4946-a3e8-8ce94e24d5fd tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1776122963", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ef80843-2573-4946-a3e8-8ce94e24d5fd tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action HTTP/1.1 Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 619 Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1776122963", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '25a50fe3-e249-496a-af7a-9acffd9d7759', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1776122963', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:20:26.823988 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:20:26.826820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:26.832073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ef80843-2573-4946-a3e8-8ce94e24d5fd tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:26.832073 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ef80843-2573-4946-a3e8-8ce94e24d5fd tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action" status: 400 len: 938 microversion: 2.1 time: 0.041648 Oct 27 10:20:26.835411 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1374/2923] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Oct 27 10:20:26 2022] POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action => generated 938 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:20:26.856422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:26.863903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:26.887061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:26.889099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:26.891418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:26.892468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:26.894260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:26.895278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:26.904384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:27.158293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:27.161262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:27.172069 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df301a89-40d4-4f29-b807-4be27a77e4e1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.423224 Oct 27 10:20:27.177362 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1550/2924] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:26 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:27.305424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:27.315618 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6374571e-ac7a-40df-9d6b-ea5a2650cd81 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1522 microversion: 2.1 time: 0.476800 Oct 27 10:20:27.317207 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1375/2925] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:26 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:27.348606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:27.356865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:27.374456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:27.374972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:27.377186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:27.378582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:27.379084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:27.380811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:27.611220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-918653409", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "6685f93f-3244-4cfd-a00c-bdc7d59ec307"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:27.674654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:27.686361 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fcec9b7b-53aa-42a6-8156-30e5120343c5 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1522 microversion: 2.1 time: 0.344750 Oct 27 10:20:27.686935 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1376/2926] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:27 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:20:27.701444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:27.702118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:27.710444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:27.710924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:27.711350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:27.712326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:27.713752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:27.714496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:27.732622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] validate_networks() for [('6685f93f-3244-4cfd-a00c-bdc7d59ec307', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:20:27.966888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:27.979150 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f060785a-d501-4cd8-9fd0-a69b5aae4e96 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1486 microversion: 2.1 time: 0.286298 Oct 27 10:20:27.983120 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1377/2927] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:27 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1486 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:28.096897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1131814048", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "aebae77c-7c09-4e55-b34c-9671e2410be6"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:28.184709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] validate_networks() for [('aebae77c-7c09-4e55-b34c-9671e2410be6', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:20:28.559730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:20:28.560157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:20:28.560678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:20:28.561544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:20:28.562654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:20:28.584217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:28.585084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:28.587124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:28.588477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:28.589211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:28.589984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:28.624353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Getting quotas for project 0283c3133c5a48608dc8931bdd6c358e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:28.636160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Getting quotas for user 984b329c5a934064bd776ebbf78f4f9e and project 0283c3133c5a48608dc8931bdd6c358e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:28.660738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Going to run 3 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:20:28.664180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:28.719881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: b68520bf-600b-4e05-b466-118a72c8c30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=cf815fce-6464-4560-8e2a-5ffe7f41ee88,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:28.794257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=b68520bf-600b-4e05-b466-118a72c8c30a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:28.947225 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7612a6c-3f98-483e-8bd9-b0307a6f7c1b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.763509 Oct 27 10:20:28.948819 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1551/2928] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:20:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:20:28.958409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3041886-8194-4eb7-8654-48295597bc60 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:28.963327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:20:28.963839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:20:28.964238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:20:28.964677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:20:28.965099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3041886-8194-4eb7-8654-48295597bc60 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action HTTP/1.1 Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 285 Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '25a50fe3-e249-496a-af7a-9acffd9d7759', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:28.967627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3041886-8194-4eb7-8654-48295597bc60 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:28.971049 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3041886-8194-4eb7-8654-48295597bc60 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action" status: 400 len: 619 microversion: 2.1 time: 0.018914 Oct 27 10:20:28.976349 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1552/2929] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Oct 27 10:20:28 2022] POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:20:28.990206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:28.990720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:28.991164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:28.991900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:28.992352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:28.992480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:29.003909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:29.004303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.012642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:29.013287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:29.014143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.014974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:29.015506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:29.017667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.092130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:29.108737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for user 83da5c7956454b278e9f9d6641a01711 and project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:29.150768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:29.159314 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0df3706a-bc75-443f-9411-63f7cbd3cea0 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1278 microversion: 2.1 time: 0.181437 Oct 27 10:20:29.165832 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1553/2930] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:28 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:29.180148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5938d26e-5e54-43de-b96d-27c7d3b36e22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:29.192892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:20:29.193905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5938d26e-5e54-43de-b96d-27c7d3b36e22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:29.194410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5938d26e-5e54-43de-b96d-27c7d3b36e22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:29.194849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5938d26e-5e54-43de-b96d-27c7d3b36e22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.195628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:29.346887 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bd1edb61-55b7-4770-8e76-832a72639439 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360983 Oct 27 10:20:29.347538 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1378/2931] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:20:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:20:29.358535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:29.359153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:29.370744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:29.372936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5938d26e-5e54-43de-b96d-27c7d3b36e22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:20:29.376746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:29.385458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.386435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:29.387060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:29.387648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.448231 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5938d26e-5e54-43de-b96d-27c7d3b36e22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2/action" status: 202 len: 0 microversion: 2.1 time: 0.280375 Oct 27 10:20:29.449488 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1554/2932] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:20:29 2022] POST /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:20:29.457582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:29.463030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:29.464261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Searching by: {'deleted': False, 'project_id': '0283c3133c5a48608dc8931bdd6c358e'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:20:29.492053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:29.494198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:29.495446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.496414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:29.511191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:29.514702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.550903 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83fd9a5d-c7b0-4dd9-818f-ebced2c12cca tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.099882 Oct 27 10:20:29.554879 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1555/2933] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:20:29 2022] GET /compute/v2.1/servers => generated 1015 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:29.561514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:29.563256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:29.572249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:29.573127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:29.574340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.575402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:29.576115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:29.576847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:29.857740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:29.875113 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-643af414-b7ba-4878-b6be-2c9459e60481 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.518552 Oct 27 10:20:29.879993 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1379/2934] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:29 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:29.891546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-933491ce-e570-48b5-99ca-ae2213c69248 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:29.894257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-933491ce-e570-48b5-99ca-ae2213c69248 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:30.022760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:30.038088 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb1b3168-4afa-4575-86b4-cff6a1614ba6 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1522 microversion: 2.1 time: 0.479682 Oct 27 10:20:30.039763 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1556/2935] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:29 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:30.051149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:30.052745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:30.081252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:30.085361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:30.085887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:30.089110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:30.092043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:30.093772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:30.097054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-933491ce-e570-48b5-99ca-ae2213c69248 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:30.107358 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-933491ce-e570-48b5-99ca-ae2213c69248 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1215 microversion: 2.1 time: 0.224648 Oct 27 10:20:30.108857 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1380/2936] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:29 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:30.114937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-506994a9-297d-4739-8a63-da00bdefa5db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:30.116501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-506994a9-297d-4739-8a63-da00bdefa5db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:30.199757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-506994a9-297d-4739-8a63-da00bdefa5db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:30.224155 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-506994a9-297d-4739-8a63-da00bdefa5db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1222 microversion: 2.1 time: 0.113823 Oct 27 10:20:30.224878 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1381/2937] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:30 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:30.259244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:30.261356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:30.275490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:30.278455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:30.279638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:30.281168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:30.286004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:30.286663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:30.637005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:30.651314 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14b6ed60-ac26-40cd-8602-c9ee41d539a0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.608040 Oct 27 10:20:30.666969 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1557/2938] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:30 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:30.674607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:30.675258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:30.675891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:30.684767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:30.685249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:30.685727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:30.686434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:30.686933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:30.687372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:30.689738 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-238bdbf9-5509-4651-8ae6-c70dc6cfc0ad tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1522 microversion: 2.1 time: 0.451140 Oct 27 10:20:30.704692 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1382/2939] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:30 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:31.007129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5abdd43-fa7a-40b6-8d31-1623b225a2c3 tempest-AbsoluteLimitsTestJSON-867943680 tempest-AbsoluteLimitsTestJSON-867943680-project] Calling method '.version_select at 0x7f6d5a9224c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:31.042495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5abdd43-fa7a-40b6-8d31-1623b225a2c3 tempest-AbsoluteLimitsTestJSON-867943680 tempest-AbsoluteLimitsTestJSON-867943680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.043343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5abdd43-fa7a-40b6-8d31-1623b225a2c3 tempest-AbsoluteLimitsTestJSON-867943680 tempest-AbsoluteLimitsTestJSON-867943680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.043966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5abdd43-fa7a-40b6-8d31-1623b225a2c3 tempest-AbsoluteLimitsTestJSON-867943680 tempest-AbsoluteLimitsTestJSON-867943680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.048095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:31.049562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5abdd43-fa7a-40b6-8d31-1623b225a2c3 tempest-AbsoluteLimitsTestJSON-867943680 tempest-AbsoluteLimitsTestJSON-867943680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.050188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5abdd43-fa7a-40b6-8d31-1623b225a2c3 tempest-AbsoluteLimitsTestJSON-867943680 tempest-AbsoluteLimitsTestJSON-867943680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.050946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5abdd43-fa7a-40b6-8d31-1623b225a2c3 tempest-AbsoluteLimitsTestJSON-867943680 tempest-AbsoluteLimitsTestJSON-867943680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.056235 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-989875c6-7c41-4466-b33a-c7e6ae925dab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1320 microversion: 2.1 time: 0.386028 Oct 27 10:20:31.056915 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1558/2940] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:30 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1320 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:31.081634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53ee7222-dbdf-4142-a9d0-f5ced6a0eed1 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1062474178"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:31.086506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53ee7222-dbdf-4142-a9d0-f5ced6a0eed1 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:31.089266 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5abdd43-fa7a-40b6-8d31-1623b225a2c3 tempest-AbsoluteLimitsTestJSON-867943680 tempest-AbsoluteLimitsTestJSON-867943680-project] 10.222.0.76 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.388689 Oct 27 10:20:31.090426 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1383/2941] 10.222.0.76 () {58 vars in 1122 bytes} [Thu Oct 27 10:20:30 2022] GET /compute/v2.1/limits => generated 511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:31.094060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53ee7222-dbdf-4142-a9d0-f5ced6a0eed1 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.094558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53ee7222-dbdf-4142-a9d0-f5ced6a0eed1 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.095053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53ee7222-dbdf-4142-a9d0-f5ced6a0eed1 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.095807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53ee7222-dbdf-4142-a9d0-f5ced6a0eed1 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.096246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53ee7222-dbdf-4142-a9d0-f5ced6a0eed1 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.096933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53ee7222-dbdf-4142-a9d0-f5ced6a0eed1 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.106548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:31.107699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:31.111283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:31.121536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.123281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.123744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.124479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.130096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.130548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.530918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:31.568485 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec1a579a-0165-4349-aa60-f82c7585027c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.475603 Oct 27 10:20:31.572125 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1384/2942] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:31 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:31.600176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:31.601876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:31.612606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.613469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.614075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.615609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.616244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.616973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.625815 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53ee7222-dbdf-4142-a9d0-f5ced6a0eed1 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action" status: 202 len: 0 microversion: 2.1 time: 0.548865 Oct 27 10:20:31.636879 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1559/2943] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:20:31 2022] POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:20:31.657688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:31.658685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:31.681687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.682521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.683241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.686413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.687120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.689259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.803558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:31.831448 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cbe93302-e3c7-45cf-8946-9ff49dda8413 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1219 microversion: 2.1 time: 0.246298 Oct 27 10:20:31.839323 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1385/2944] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:31 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1219 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:31.852907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-833926585"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:31.863235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:31.893858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.896580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.897369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.899880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:31.900922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:31.904224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:31.930953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:31.949517 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e6a0f376-9731-4a8c-85d6-f700e253bbaa tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1218 microversion: 2.1 time: 0.311183 Oct 27 10:20:31.961403 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1560/2945] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:31 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1218 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:31.999698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:32.000327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:32.030407 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Cannot 'createImage' instance 25a50fe3-e249-496a-af7a-9acffd9d7759 while it is in task_state image_snapshot_pending Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action HTTP/1.1 Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 84 Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-833926585"}} Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot 'createImage' instance 25a50fe3-e249-496a-af7a-9acffd9d7759 while it is in task_state image_snapshot_pending Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '25a50fe3-e249-496a-af7a-9acffd9d7759', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-833926585'}}} Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:20:32.033624 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 25a50fe3-e249-496a-af7a-9acffd9d7759 while it is in task_state image_snapshot_pending Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 25a50fe3-e249-496a-af7a-9acffd9d7759 while it is in task_state image_snapshot_pending Oct 27 10:20:32.037942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:32.039723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:32.039723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:32.040514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:32.041790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:32.044000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:32.047426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:32.064031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 409 to user: Cannot 'createImage' instance 25a50fe3-e249-496a-af7a-9acffd9d7759 while it is in task_state image_snapshot_pending {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:32.068181 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb39ed39-fc48-434d-8279-e9524697ec77 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action" status: 409 len: 167 microversion: 2.1 time: 0.224061 Oct 27 10:20:32.069075 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1386/2946] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:20:31 2022] POST /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759/action => generated 167 bytes in 229 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:20:32.080853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4eece211-6a36-45cc-b9cc-65c0383c4382 req-9680a061-4dc4-40f9-8630-7836cb659ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdce1098-3933-4f19-bd78-fc6e60559a8e", "tag": "9ca5bddc-2e5a-42b2-8037-32aff51b9ed5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:32.096540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4eece211-6a36-45cc-b9cc-65c0383c4382 req-9680a061-4dc4-40f9-8630-7836cb659ba6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:32.097156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4eece211-6a36-45cc-b9cc-65c0383c4382 req-9680a061-4dc4-40f9-8630-7836cb659ba6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:32.097593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4eece211-6a36-45cc-b9cc-65c0383c4382 req-9680a061-4dc4-40f9-8630-7836cb659ba6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:32.117154 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4eece211-6a36-45cc-b9cc-65c0383c4382 req-9680a061-4dc4-40f9-8630-7836cb659ba6 service nova] Creating event network-changed:9ca5bddc-2e5a-42b2-8037-32aff51b9ed5 for instance cdce1098-3933-4f19-bd78-fc6e60559a8e on n-h2-854663-10 Oct 27 10:20:32.141106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4eece211-6a36-45cc-b9cc-65c0383c4382 req-9680a061-4dc4-40f9-8630-7836cb659ba6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069555 Oct 27 10:20:32.141720 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1387/2947] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:32.155752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc881d98-bf9b-4afb-97d8-e4257ec275df tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '.version_select at 0x7f6d5a84e040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:32.497641 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc881d98-bf9b-4afb-97d8-e4257ec275df tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/images/5f166386-6f60-4c11-9b03-9cb7061a8fca" status: 204 len: 0 microversion: 2.1 time: 0.354477 Oct 27 10:20:32.499256 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1388/2948] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:32 2022] DELETE /compute/v2.1/images/5f166386-6f60-4c11-9b03-9cb7061a8fca => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:20:32.513390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:32.516097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:32.574983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:32.576116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:32.577105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:32.578985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:32.582887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:32.584008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:32.764257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:32.782832 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8980d02-b1a7-4e7d-b07a-bdf0b559d4cc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.797671 Oct 27 10:20:32.784111 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1561/2949] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:31 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:32.800751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:32.804820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:32.815434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:32.815926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:32.816389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:32.817137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:32.817585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:32.818005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:33.070100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:33.082124 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-98f6395a-0e70-4e8b-9cf1-e6a08db4b4b2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1320 microversion: 2.1 time: 0.581276 Oct 27 10:20:33.083677 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1389/2950] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:32 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1320 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:33.092030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:33.093008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:33.101176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:33.102135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:33.102952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:33.104700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:33.105361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:33.106000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:33.114634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:33.124070 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1ba5c01-f931-487f-8b79-44c26027de4a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1534 microversion: 2.1 time: 0.338002 Oct 27 10:20:33.126033 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1562/2951] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:32 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1534 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:33.131456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:33.132066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:33.153779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:33.154423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:33.154975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:33.155803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:33.156484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:33.157018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:33.732538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:33.746852 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4de84c5e-9f2c-4545-bfea-92f3b1d6f368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1211 microversion: 2.1 time: 0.619087 Oct 27 10:20:33.750971 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1563/2952] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:33 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1211 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:33.760522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:33.765415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:33.776521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:33.777054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:33.777498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:33.778279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:33.778618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:33.779037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:33.950117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:33.961228 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5fa96a2-3b83-4ad6-9c3b-82b602db544e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1280 microversion: 2.1 time: 0.208848 Oct 27 10:20:33.962099 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1564/2953] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:33 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:33.983394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:33.984024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:33.992816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:33.996791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:33.998033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:33.999503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:34.003421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:34.004831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:34.005443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:34.014980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:34.023309 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d05c1617-9e35-4dce-a208-e483e2e25862 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.937195 Oct 27 10:20:34.041409 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1390/2954] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:33 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:34.110239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:34.111080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:34.120054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:34.125991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:34.126674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:34.128045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:34.129188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:34.134577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:34.516173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:34.530007 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-584d6ee1-359f-4942-ad77-0d4ddc0ef08c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.562835 Oct 27 10:20:34.531022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1565/2955] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:33 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:34.540085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:34.550571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:34.552215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:34.562690 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e617bec8-219c-4417-bd7e-179400b7d34e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1320 microversion: 2.1 time: 0.454982 Oct 27 10:20:34.566852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:34.567479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:34.568100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:34.569024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:34.569654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:34.570647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:34.586866 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1391/2956] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:34 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1320 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:20:34.771881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:34.772508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:34.779457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:34.780374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:34.781084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:34.782101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:34.782776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:34.783410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:34.824999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:34.835448 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46ddd21f-a0b1-4b99-b3e8-f319f5d11dc7 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1540 microversion: 2.1 time: 0.303071 Oct 27 10:20:34.836085 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1566/2957] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:34 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1540 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:34.890628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:34.899255 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be09676d-f970-4089-acde-ed8e6d5739d1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1273 microversion: 2.1 time: 0.131647 Oct 27 10:20:34.900459 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1392/2958] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:34 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:34.990646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:34.991291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:34.998087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:34.998566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:34.999013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:34.999709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:35.000153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:35.000789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:35.016699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:35.051422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:35.052256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:35.059456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:35.059940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:35.060529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:35.061285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:35.061800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:35.062140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:35.075852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:35.086965 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7737fca-0beb-40df-a448-a0ae1a612e05 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1280 microversion: 2.1 time: 0.101186 Oct 27 10:20:35.096886 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1567/2959] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:34 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1280 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:35.323677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:35.337049 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d8f671c-a521-49cd-aa6d-c7ae9704fd43 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.292925 Oct 27 10:20:35.337784 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1393/2960] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:35 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:35.554529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:35.555144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:35.569000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:35.570189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:35.571117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:35.572301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:35.574360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:35.575080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:35.610787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:35.612697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:35.639048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:35.639853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:35.641651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:35.643505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:35.646335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:35.648364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:36.209914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:36.218637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43ec4a33-7162-45ad-8afc-f2aa3925c743 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.667969 Oct 27 10:20:36.233092 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1568/2961] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:35 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:36.241002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:36.242114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:36.249408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:36.250186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:36.250855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:36.251755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:36.252350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:36.253007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:36.275217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:36.286255 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f82f405-209f-47ca-b19c-1a2147ee2e10 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1320 microversion: 2.1 time: 0.694524 Oct 27 10:20:36.300694 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1394/2962] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:35 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1320 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:20:36.300694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:36.300694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:36.316937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:36.317454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:36.317909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:36.318810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:36.319303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:36.320363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:36.665785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:36.709463 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1dbe35ee-d7a1-4507-bc64-240fceaca403 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1540 microversion: 2.1 time: 0.456508 Oct 27 10:20:36.714501 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1569/2963] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:36 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1540 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:36.734992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:36.735672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:36.754036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:36.756851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:36.757503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:36.769887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:36.770408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:36.770871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:36.805598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:36.824479 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a4a7879-4d40-404f-a01a-be8952da206d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1273 microversion: 2.1 time: 0.534695 Oct 27 10:20:36.826836 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1395/2964] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:36 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1273 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:36.847802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:36.850198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:36.867088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:36.867700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:36.868239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:36.870477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:36.871202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:36.874897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:37.182056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:37.191354 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1dc4b05-3c73-41d2-9a59-02c4561ca8b6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1322 microversion: 2.1 time: 0.468460 Oct 27 10:20:37.192267 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1570/2965] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:36 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:37.203679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:37.206632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:37.215355 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73b8a95a-d398-43ac-9a60-de78bb8687de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1522 microversion: 2.1 time: 0.387021 Oct 27 10:20:37.216289 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1396/2966] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:36 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:37.247104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:37.247739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:37.254400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:37.255039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:37.255977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:37.256756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:37.257421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:37.257915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:37.314749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:37.316427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:37.327250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:37.328049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:37.328798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:37.329870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:37.330482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:37.331085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:37.613449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:37.641187 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e76f9b1-a368-4ed1-80c1-05786d108280 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.396359 Oct 27 10:20:37.642246 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1571/2967] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:37 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:20:37.672441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:37.687453 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-effa1c1c-761f-451a-a0b5-653eaee5ee0c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1320 microversion: 2.1 time: 0.376145 Oct 27 10:20:37.704433 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1397/2968] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:37 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1320 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:37.740718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:37.741503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:37.751775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:37.753075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:37.753802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:37.754837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:37.755882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:37.756853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:37.855517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:37.856153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:37.865780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:37.866690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:37.867185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:37.867908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:37.868887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:37.869041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:38.266866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:38.288303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:38.297604 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3081ad6a-ceb3-4c39-891d-16d03bfccdbc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1315 microversion: 2.1 time: 0.447298 Oct 27 10:20:38.299203 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52e9a4e9-f869-4c67-a385-43978bbf47e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1522 microversion: 2.1 time: 0.562780 Oct 27 10:20:38.300065 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1572/2969] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:37 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:38.301485 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1398/2970] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:37 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:38.306193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:38.309722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:38.316965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-58614709-d557-438b-8220-7ed3a98f4cd5 req-2b33ebbc-f6c7-4fdc-b566-966fd0e2696a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdce1098-3933-4f19-bd78-fc6e60559a8e", "name": "network-vif-plugged", "status": "completed", "tag": "9ca5bddc-2e5a-42b2-8037-32aff51b9ed5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:38.334986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:38.339293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:38.340557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:38.343804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-58614709-d557-438b-8220-7ed3a98f4cd5 req-2b33ebbc-f6c7-4fdc-b566-966fd0e2696a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:38.346006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:38.348480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:38.350741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-58614709-d557-438b-8220-7ed3a98f4cd5 req-2b33ebbc-f6c7-4fdc-b566-966fd0e2696a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:38.354432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-58614709-d557-438b-8220-7ed3a98f4cd5 req-2b33ebbc-f6c7-4fdc-b566-966fd0e2696a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:38.361399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:38.382039 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-58614709-d557-438b-8220-7ed3a98f4cd5 req-2b33ebbc-f6c7-4fdc-b566-966fd0e2696a service nova] Creating event network-vif-plugged:9ca5bddc-2e5a-42b2-8037-32aff51b9ed5 for instance cdce1098-3933-4f19-bd78-fc6e60559a8e on n-h2-854663-10 Oct 27 10:20:38.395592 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-58614709-d557-438b-8220-7ed3a98f4cd5 req-2b33ebbc-f6c7-4fdc-b566-966fd0e2696a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094091 Oct 27 10:20:38.402338 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1573/2971] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:38.408200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8a3ae8c3-52fe-4454-bbd7-2fdb2f9e4e74 req-7b15e3e2-43f3-46b0-806c-17aa9817d851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf815fce-6464-4560-8e2a-5ffe7f41ee88", "tag": "1c25cb2d-aaf6-4cc4-a07c-788de23377c5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:38.427194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8a3ae8c3-52fe-4454-bbd7-2fdb2f9e4e74 req-7b15e3e2-43f3-46b0-806c-17aa9817d851 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:38.428030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8a3ae8c3-52fe-4454-bbd7-2fdb2f9e4e74 req-7b15e3e2-43f3-46b0-806c-17aa9817d851 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:38.428782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8a3ae8c3-52fe-4454-bbd7-2fdb2f9e4e74 req-7b15e3e2-43f3-46b0-806c-17aa9817d851 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:38.443220 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8a3ae8c3-52fe-4454-bbd7-2fdb2f9e4e74 req-7b15e3e2-43f3-46b0-806c-17aa9817d851 service nova] Creating event network-changed:1c25cb2d-aaf6-4cc4-a07c-788de23377c5 for instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 on n-h1-854663-10 Oct 27 10:20:38.449471 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8a3ae8c3-52fe-4454-bbd7-2fdb2f9e4e74 req-7b15e3e2-43f3-46b0-806c-17aa9817d851 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045462 Oct 27 10:20:38.450390 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1574/2972] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:38.457967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:38.458881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:38.466846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:38.467686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:38.468457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:38.469571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:38.470170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:38.470748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:38.652481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:39.083167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:39.084146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:39.116774 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e59dd12-38de-4f39-805e-6fc9a77f3939 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1502 microversion: 2.1 time: 0.663285 Oct 27 10:20:39.119072 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1575/2973] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:38 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1502 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:39.132228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:39.137605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:39.138262 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-472f7c63-33e7-4356-ad5e-34bd1c4f124c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1322 microversion: 2.1 time: 0.831482 Oct 27 10:20:39.141247 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1399/2974] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:38 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1322 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:39.150323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.152624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:39.154278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.155272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.156264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:39.157718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.158203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.158642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.176337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.177238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.178136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.180072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.180904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.181646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.218564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:20:39.387970 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-737d91b4-4b3c-41bb-92a8-d2eec65c41cb tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 204 len: 0 microversion: 2.1 time: 0.265986 Oct 27 10:20:39.390966 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1576/2975] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:20:39 2022] DELETE /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:20:39.407627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:39.413398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:39.433218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.433848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.434489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.435419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.436062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.436484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.536378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:39.684911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:39.694808 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f4f954a-8791-4a54-97cb-c924aefa3412 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.552007 Oct 27 10:20:39.695679 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1400/2976] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:39 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:39.702578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5895f4a9-94aa-4d53-b37d-ff59998753fa req-617a7cea-36d5-415b-99f2-06cfe4d462d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e5dcc4-e23c-4615-bdd2-db58762537a4", "tag": "bf9da344-b190-40e9-914a-e2a39f009d02"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:39.714221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5895f4a9-94aa-4d53-b37d-ff59998753fa req-617a7cea-36d5-415b-99f2-06cfe4d462d5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.714911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5895f4a9-94aa-4d53-b37d-ff59998753fa req-617a7cea-36d5-415b-99f2-06cfe4d462d5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.715512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5895f4a9-94aa-4d53-b37d-ff59998753fa req-617a7cea-36d5-415b-99f2-06cfe4d462d5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.731334 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5895f4a9-94aa-4d53-b37d-ff59998753fa req-617a7cea-36d5-415b-99f2-06cfe4d462d5 service nova] Creating event network-changed:bf9da344-b190-40e9-914a-e2a39f009d02 for instance 15e5dcc4-e23c-4615-bdd2-db58762537a4 on n-h1-854663-10 Oct 27 10:20:39.739947 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5895f4a9-94aa-4d53-b37d-ff59998753fa req-617a7cea-36d5-415b-99f2-06cfe4d462d5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042619 Oct 27 10:20:39.740649 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1401/2977] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:39.746696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:39.747650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:39.755467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.756152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.756846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.757847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.758464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.759050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.782498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:39.795648 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4f2c913-0d35-4acb-b300-07c41750ddd6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1320 microversion: 2.1 time: 0.402862 Oct 27 10:20:39.796639 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1577/2978] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:39 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:39.817561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:39.819393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:39.839096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.839631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.840080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:39.840855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:39.842019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:39.842463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.158016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:40.166663 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c21ea97-a40a-4d8e-90aa-90c5df5d4c0b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1315 microversion: 2.1 time: 0.352948 Oct 27 10:20:40.167994 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1578/2979] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:39 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:40.173457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:40.174650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:40.182420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.184641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.185115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.190829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.191319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.191762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.193732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:40.203076 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-27a51e3f-ee10-4c5f-b18e-b28a6e077be3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1515 microversion: 2.1 time: 0.460928 Oct 27 10:20:40.203942 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1402/2980] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:39 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1515 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:40.229062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:40.230134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:40.238825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.239705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.239993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.240753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.241219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.241632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.502694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:40.505535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:40.513695 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-636e71d0-ee28-4b63-9002-ad6526912fb3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1528 microversion: 2.1 time: 0.344423 Oct 27 10:20:40.514685 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1579/2981] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:40 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1528 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:40.518382 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a859ebdd-59e5-45e7-9850-94a81f2329db tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1322 microversion: 2.1 time: 0.292040 Oct 27 10:20:40.519302 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1403/2982] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:40 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:40.529115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b794ed6-f242-47c4-9d68-a63764e6cd56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:40.530540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f599e7f6-a01f-4e6a-8de8-f70d3c6f6387 req-e73e99bc-c464-414a-886f-77a49a76e543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a50fe3-e249-496a-af7a-9acffd9d7759", "name": "network-vif-plugged", "status": "completed", "tag": "f61b9b84-be36-4a94-adec-da3ae3206322"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:40.531782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b794ed6-f242-47c4-9d68-a63764e6cd56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: d5d972fb-8b58-4a3c-8b49-78c91a71389b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:40.551656 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-2b794ed6-f242-47c4-9d68-a63764e6cd56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] HTTP exception thrown: Instance d5d972fb-8b58-4a3c-8b49-78c91a71389b could not be found. Oct 27 10:20:40.554034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f599e7f6-a01f-4e6a-8de8-f70d3c6f6387 req-e73e99bc-c464-414a-886f-77a49a76e543 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.554716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f599e7f6-a01f-4e6a-8de8-f70d3c6f6387 req-e73e99bc-c464-414a-886f-77a49a76e543 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.555307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f599e7f6-a01f-4e6a-8de8-f70d3c6f6387 req-e73e99bc-c464-414a-886f-77a49a76e543 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b794ed6-f242-47c4-9d68-a63764e6cd56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Request method failure captured: Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/d5d972fb-8b58-4a3c-8b49-78c91a71389b/action HTTP/1.1 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 14 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsu-3_w5LGZIvZif4TTAP6HRONgNGme2C9gImyb4W0g9Upsi7Y2bHorvYIAfIK1OJaF4pOA8nmy8Y4T0BPo3Z6b72CJIADNwIlaiQrBL1QEHegWtPyuQbLI5lnUkUsZwbu1MPjFEe-CeaqflWsbqJ87tWOxBka5KpPfYl0fSmtf6VA Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9067a31bfee345fca080e7621aa60015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9067a31bfee345fca080e7621aa60015", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5fc08f1ad238424896dcefb0fa0b20c5 Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: {"rescue": {}} Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance d5d972fb-8b58-4a3c-8b49-78c91a71389b could not be found. Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'd5d972fb-8b58-4a3c-8b49-78c91a71389b', 'body': {'rescue': {}}} Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d972fb-8b58-4a3c-8b49-78c91a71389b could not be found. Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d972fb-8b58-4a3c-8b49-78c91a71389b could not be found. Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:40.560543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:40.570587 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:40.570587 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:40.570587 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:20:40.570587 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:20:40.570587 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d972fb-8b58-4a3c-8b49-78c91a71389b could not be found. Oct 27 10:20:40.570587 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:40.570587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b794ed6-f242-47c4-9d68-a63764e6cd56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Returning 404 to user: Instance d5d972fb-8b58-4a3c-8b49-78c91a71389b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:40.570587 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b794ed6-f242-47c4-9d68-a63764e6cd56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/d5d972fb-8b58-4a3c-8b49-78c91a71389b/action" status: 404 len: 111 microversion: 2.1 time: 0.047619 Oct 27 10:20:40.570587 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1580/2983] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:20:40 2022] POST /compute/v2.1/servers/d5d972fb-8b58-4a3c-8b49-78c91a71389b/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:20:40.573509 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f599e7f6-a01f-4e6a-8de8-f70d3c6f6387 req-e73e99bc-c464-414a-886f-77a49a76e543 service nova] Creating event network-vif-plugged:f61b9b84-be36-4a94-adec-da3ae3206322 for instance 25a50fe3-e249-496a-af7a-9acffd9d7759 on n-h2-854663-10 Oct 27 10:20:40.578304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ed40fb6-0f61-422c-ae72-512160a1ca80 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:40.579157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ed40fb6-0f61-422c-ae72-512160a1ca80 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:40.579626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f599e7f6-a01f-4e6a-8de8-f70d3c6f6387 req-e73e99bc-c464-414a-886f-77a49a76e543 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058367 Oct 27 10:20:40.583591 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1404/2984] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:40.589440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed40fb6-0f61-422c-ae72-512160a1ca80 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.590025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed40fb6-0f61-422c-ae72-512160a1ca80 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.590538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed40fb6-0f61-422c-ae72-512160a1ca80 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.591365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed40fb6-0f61-422c-ae72-512160a1ca80 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.591908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed40fb6-0f61-422c-ae72-512160a1ca80 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.592410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed40fb6-0f61-422c-ae72-512160a1ca80 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.687476 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ed40fb6-0f61-422c-ae72-512160a1ca80 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action" status: 202 len: 0 microversion: 2.1 time: 0.113074 Oct 27 10:20:40.688697 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1581/2985] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:20:40 2022] POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:20:40.697571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:40.699148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:40.707163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.707655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.708084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.708837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.709282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.709701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.713462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-45b2336d-b15d-4b3c-b95a-b4cb6c70ff89 req-702af050-2f1a-432f-b960-160e7440c544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68520bf-600b-4e05-b466-118a72c8c30a", "tag": "c829aa4b-4639-4ea5-ba84-7b155c16ad79"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:40.725408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-45b2336d-b15d-4b3c-b95a-b4cb6c70ff89 req-702af050-2f1a-432f-b960-160e7440c544 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.726385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-45b2336d-b15d-4b3c-b95a-b4cb6c70ff89 req-702af050-2f1a-432f-b960-160e7440c544 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.727418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-45b2336d-b15d-4b3c-b95a-b4cb6c70ff89 req-702af050-2f1a-432f-b960-160e7440c544 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.744172 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-45b2336d-b15d-4b3c-b95a-b4cb6c70ff89 req-702af050-2f1a-432f-b960-160e7440c544 service nova] Creating event network-changed:c829aa4b-4639-4ea5-ba84-7b155c16ad79 for instance b68520bf-600b-4e05-b466-118a72c8c30a on n-h2-854663-10 Oct 27 10:20:40.750610 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-45b2336d-b15d-4b3c-b95a-b4cb6c70ff89 req-702af050-2f1a-432f-b960-160e7440c544 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042691 Oct 27 10:20:40.751871 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1582/2986] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:40.757455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:40.758450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:40.766675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.767298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.767866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.768696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.769276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.769929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.900989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:40.909760 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-391776ad-ec50-4fc3-ba43-ae3b70d3c859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1520 microversion: 2.1 time: 0.216902 Oct 27 10:20:40.926604 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1405/2987] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:40 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:20:40.932079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:40.932968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:40.940207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.940916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.941520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:40.942368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:40.942963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:40.943531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:41.007639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:41.016479 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58297efd-e60c-41a2-8f81-7bbfcf466693 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.263050 Oct 27 10:20:41.028684 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1583/2988] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:40 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:41.037202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=20 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:41.076520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:41.190934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:41.193392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:41.196428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:41.202423 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-28bbea27-55af-46fa-8735-c550f69129f4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1320 microversion: 2.1 time: 0.274201 Oct 27 10:20:41.203755 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1406/2989] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:40 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1320 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:41.204808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:41.206216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:41.206886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:41.207829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:41.208586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:41.209400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:41.227442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:41.445931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:41.454733 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-91c3bfa7-082d-4e18-8f8f-9e7b09c89aa4 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1315 microversion: 2.1 time: 0.266504 Oct 27 10:20:41.455511 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1584/2990] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:41 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:41.541739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:41.541739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:41.547619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:41.548239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:41.554532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:41.555376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:41.556489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:41.557556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:41.559404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:41.560174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:41.560920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:41.561593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:41.562031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:41.562743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:41.563194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:41.563612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:42.042033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:42.059970 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-404c3e76-e9ed-4f5b-8c4a-dbdecde16048 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1322 microversion: 2.1 time: 0.516541 Oct 27 10:20:42.073430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:42.080760 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-db5c058c-f908-42b6-bf74-740cbe937850 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 200 len: 1528 microversion: 2.1 time: 0.546562 Oct 27 10:20:42.082612 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1585/2991] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:41 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:42.083369 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1407/2992] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:41 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 1528 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:42.097657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:42.098502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:42.106871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-55c8b839-5b9f-40e8-91b8-2e0f9d4996e5 req-c6809945-6726-4dbc-818f-2dbc2d59b08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b660b14-6253-4e7c-8bea-f252101ae635", "tag": "15ab1839-883f-47a4-8afe-ce70851d16d2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:42.111066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:42.111743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:42.112344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:42.113076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:42.113533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:42.113955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:42.119147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-55c8b839-5b9f-40e8-91b8-2e0f9d4996e5 req-c6809945-6726-4dbc-818f-2dbc2d59b08c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:42.119880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-55c8b839-5b9f-40e8-91b8-2e0f9d4996e5 req-c6809945-6726-4dbc-818f-2dbc2d59b08c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:42.120470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-55c8b839-5b9f-40e8-91b8-2e0f9d4996e5 req-c6809945-6726-4dbc-818f-2dbc2d59b08c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:42.133598 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-55c8b839-5b9f-40e8-91b8-2e0f9d4996e5 req-c6809945-6726-4dbc-818f-2dbc2d59b08c service nova] Creating event network-changed:15ab1839-883f-47a4-8afe-ce70851d16d2 for instance 9b660b14-6253-4e7c-8bea-f252101ae635 on n-h1-854663-10 Oct 27 10:20:42.139618 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-55c8b839-5b9f-40e8-91b8-2e0f9d4996e5 req-c6809945-6726-4dbc-818f-2dbc2d59b08c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055684 Oct 27 10:20:42.140773 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1586/2993] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:42.147315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:42.148980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:42.157487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:42.158261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:42.158849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:42.159865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:42.160473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:42.161272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.018772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:43.029999 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82b71689-e8a3-4f17-b43e-49902abd78de tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1500 microversion: 2.1 time: 0.936077 Oct 27 10:20:43.030616 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1408/2994] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:42 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1500 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:43.048061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:43.048061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:43.072296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.072856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.073306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.074025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.074570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.075300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.111736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:43.121223 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-544efcef-45fa-46d4-b40e-f682aab6050f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.978441 Oct 27 10:20:43.149047 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1587/2995] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:42 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:43.154916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:43.155774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:43.172194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.172829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.175614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.177387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.177858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.181703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.610389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:43.621960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce712702-6aef-4d16-a6b4-f0ab26ab0570 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1499 microversion: 2.1 time: 0.590064 Oct 27 10:20:43.623413 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1409/2996] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:43 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1499 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:43.630764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6db1362c-bfe5-4877-9f6f-b300e1e4922a req-8067fd7a-c645-4b68-ba05-883aee883003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a50fe3-e249-496a-af7a-9acffd9d7759", "name": "network-vif-unplugged", "status": "completed", "tag": "f61b9b84-be36-4a94-adec-da3ae3206322"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:43.644396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6db1362c-bfe5-4877-9f6f-b300e1e4922a req-8067fd7a-c645-4b68-ba05-883aee883003 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.645988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6db1362c-bfe5-4877-9f6f-b300e1e4922a req-8067fd7a-c645-4b68-ba05-883aee883003 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.647226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6db1362c-bfe5-4877-9f6f-b300e1e4922a req-8067fd7a-c645-4b68-ba05-883aee883003 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.663805 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6db1362c-bfe5-4877-9f6f-b300e1e4922a req-8067fd7a-c645-4b68-ba05-883aee883003 service nova] Creating event network-vif-unplugged:f61b9b84-be36-4a94-adec-da3ae3206322 for instance 25a50fe3-e249-496a-af7a-9acffd9d7759 on n-h2-854663-10 Oct 27 10:20:43.665305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:43.671890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6db1362c-bfe5-4877-9f6f-b300e1e4922a req-8067fd7a-c645-4b68-ba05-883aee883003 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046270 Oct 27 10:20:43.673421 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1410/2997] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:43.679859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:43.683527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:43.685554 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a70542bd-0944-43b1-bd5d-0bd7a8276a8c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1315 microversion: 2.1 time: 0.534802 Oct 27 10:20:43.695860 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1588/2998] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:43 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:43.695860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:43.695860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:43.703204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.703898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.704452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.705322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.705873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.706602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.706758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.707065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.707641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.708384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.709145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.709607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.733718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lazy-loading 'flavor' on Instance uuid f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:20:43.748066 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] HTTP exception thrown: Cannot 'rescue' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state paused Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Request method failure captured: Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action HTTP/1.1 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 14 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsu-3_w5LGZIvZif4TTAP6HRONgNGme2C9gImyb4W0g9Upsi7Y2bHorvYIAfIK1OJaF4pOA8nmy8Y4T0BPo3Z6b72CJIADNwIlaiQrBL1QEHegWtPyuQbLI5lnUkUsZwbu1MPjFEe-CeaqflWsbqJ87tWOxBka5KpPfYl0fSmtf6VA Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9067a31bfee345fca080e7621aa60015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9067a31bfee345fca080e7621aa60015", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5fc08f1ad238424896dcefb0fa0b20c5 Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: {"rescue": {}} Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot 'rescue' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state paused Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac', 'body': {'rescue': {}}} Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac in vm_state paused. Cannot rescue while the instance is in this state. Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state paused Oct 27 10:20:43.749995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state paused Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Returning 409 to user: Cannot 'rescue' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state paused {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-856b24f2-1a02-4d07-af40-30a8df2db4c2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action" status: 409 len: 144 microversion: 2.1 time: 0.076510 Oct 27 10:20:43.755441 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1411/2999] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:20:43 2022] POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action => generated 144 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:20:43.756565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:43.757206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:43.763481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.764428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.765045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.765956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.766545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.767106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.790698 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 HTTP/1.1 Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '25a50fe3-e249-496a-af7a-9acffd9d7759'} Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.792280 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-20c9cdce-dc1e-454e-a61d-f4c23ff1f10d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 404 len: 111 microversion: 2.1 time: 0.041023 Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1412/3000] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:43 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:43.804161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:43.810729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.811448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.812052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:43.812817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:43.813446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:43.813754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.087992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:44.100382 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d07b7f2-a765-45f3-b5fc-92f7f912ca4f tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1322 microversion: 2.1 time: 0.412430 Oct 27 10:20:44.101364 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1589/3001] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:43 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:44.110502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55208087-dd5d-4b46-915d-6ba2001df325 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:44.111364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55208087-dd5d-4b46-915d-6ba2001df325 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:44.119357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55208087-dd5d-4b46-915d-6ba2001df325 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.120802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55208087-dd5d-4b46-915d-6ba2001df325 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.121407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55208087-dd5d-4b46-915d-6ba2001df325 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.122498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55208087-dd5d-4b46-915d-6ba2001df325 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.123104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55208087-dd5d-4b46-915d-6ba2001df325 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.123687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55208087-dd5d-4b46-915d-6ba2001df325 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.205619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:44.220948 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55208087-dd5d-4b46-915d-6ba2001df325 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action" status: 202 len: 0 microversion: 2.1 time: 0.117457 Oct 27 10:20:44.224563 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1590/3002] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:20:44 2022] POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:20:44.227648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ec7d6af-427f-415b-92f8-b34dad3b9bba tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'create', calling method: .version_select at 0x7f6d5b4a69d0>, body: {"keypair": {"name": "tempest-keypair-235161861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnk2lVzGNAfw/T5V74iorQCp7+HyErQW6V3UrvSQkJp8I6gB+Cd3Qrn7OmisRwO5ItkrXS94D7qYEK7nOdCzZGBM1l1SGSrbdyO0QZ/XBJd6uXLfy7ZFcJvDFBqRlcwBw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:44.228197 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ffda4bb8-a90a-48c2-895b-f69e484d06d7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1499 microversion: 2.1 time: 0.430364 Oct 27 10:20:44.234957 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1413/3003] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:43 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1499 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:44.241807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:44.243092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:44.251814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.252692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.253375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.254348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.255191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.255930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.264264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1ec7d6af-427f-415b-92f8-b34dad3b9bba tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Getting quotas for project a8c3992187114a2887044b851d6c7838. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:44.280515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1ec7d6af-427f-415b-92f8-b34dad3b9bba tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Getting quotas for user 3d0c785c43b24f64b5d1ec4510c78fdd and project a8c3992187114a2887044b851d6c7838. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:44.322025 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ec7d6af-427f-415b-92f8-b34dad3b9bba tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098711 Oct 27 10:20:44.324374 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1591/3004] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:20:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:44.330899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8ae72f2c-36a1-4710-95d2-e0734698ca0d req-497dc4b8-e4e3-4632-a7ea-ee92375a51a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a50fe3-e249-496a-af7a-9acffd9d7759", "name": "network-vif-deleted", "tag": "f61b9b84-be36-4a94-adec-da3ae3206322"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:44.347881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ae72f2c-36a1-4710-95d2-e0734698ca0d req-497dc4b8-e4e3-4632-a7ea-ee92375a51a2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.348376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ae72f2c-36a1-4710-95d2-e0734698ca0d req-497dc4b8-e4e3-4632-a7ea-ee92375a51a2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.348932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ae72f2c-36a1-4710-95d2-e0734698ca0d req-497dc4b8-e4e3-4632-a7ea-ee92375a51a2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.362246 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8ae72f2c-36a1-4710-95d2-e0734698ca0d req-497dc4b8-e4e3-4632-a7ea-ee92375a51a2 service nova] Creating event network-vif-deleted:f61b9b84-be36-4a94-adec-da3ae3206322 for instance 25a50fe3-e249-496a-af7a-9acffd9d7759 on n-h2-854663-10 Oct 27 10:20:44.378020 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8ae72f2c-36a1-4710-95d2-e0734698ca0d req-497dc4b8-e4e3-4632-a7ea-ee92375a51a2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051800 Oct 27 10:20:44.379308 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1592/3005] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:44.387153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:44.388200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:44.402956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.403710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.404320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.405263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.405721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.406156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.588708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:44.602157 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38128d07-8c36-46cb-986a-769791b5d190 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.365697 Oct 27 10:20:44.617907 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1414/3006] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:44 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:44.617907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:44.617907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:44.638358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.638867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.639292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.640317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.640807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.641234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.709554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:20:44.774571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:44.818975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:44.832089 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7e40e60-eda4-4d60-a583-21ad9bc65372 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1507 microversion: 2.1 time: 0.449175 Oct 27 10:20:44.833176 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1593/3007] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:44 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:44.849137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:44.849774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:44.869113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.869712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.870182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.870974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.871437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.871987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.880323 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c665f5e4-1daa-41b5-ae6f-5f9c557cb610 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 204 len: 0 microversion: 2.1 time: 0.275659 Oct 27 10:20:44.881176 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1415/3008] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:20:44 2022] DELETE /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:20:44.892006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:44.892732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:44.912789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.913287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.913847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:44.914841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:44.914979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:44.915310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:45.337842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:45.348950 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-506bdef3-c0a2-47f2-9621-4572e7018222 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1505 microversion: 2.1 time: 0.460872 Oct 27 10:20:45.365441 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1416/3009] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:44 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:45.376901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:45.377789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:45.386339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:45.387014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:45.387622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:45.388786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:45.389419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:45.390075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:45.404748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:45.420453 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9853c450-1cb6-4180-8792-f675d614659e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1315 microversion: 2.1 time: 0.586009 Oct 27 10:20:45.424470 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1594/3010] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:44 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:45.630282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:45.631450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:45.639299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:45.645657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:45.646357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:45.647279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:45.647895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:45.648485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:45.684761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:45.695129 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-563e5f53-2ff2-468f-9304-dba4a9dee511 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1322 microversion: 2.1 time: 0.328212 Oct 27 10:20:45.698447 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1417/3011] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:45 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:45.732196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b7bae907-c555-415f-a569-98da0946211c req-eb019a5c-8d07-4c92-9e84-fdb54c2f6f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf815fce-6464-4560-8e2a-5ffe7f41ee88", "name": "network-vif-plugged", "status": "completed", "tag": "1c25cb2d-aaf6-4cc4-a07c-788de23377c5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:45.749608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7bae907-c555-415f-a569-98da0946211c req-eb019a5c-8d07-4c92-9e84-fdb54c2f6f1f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:45.750464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7bae907-c555-415f-a569-98da0946211c req-eb019a5c-8d07-4c92-9e84-fdb54c2f6f1f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:45.751155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7bae907-c555-415f-a569-98da0946211c req-eb019a5c-8d07-4c92-9e84-fdb54c2f6f1f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:45.776519 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b7bae907-c555-415f-a569-98da0946211c req-eb019a5c-8d07-4c92-9e84-fdb54c2f6f1f service nova] Creating event network-vif-plugged:1c25cb2d-aaf6-4cc4-a07c-788de23377c5 for instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 on n-h1-854663-10 Oct 27 10:20:45.832180 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b7bae907-c555-415f-a569-98da0946211c req-eb019a5c-8d07-4c92-9e84-fdb54c2f6f1f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102798 Oct 27 10:20:45.834342 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1418/3012] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:20:45.861190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:45.862567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:45.870973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:45.871978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:45.872683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:45.873647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:45.874326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:45.875013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:46.000000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:46.019873 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7eb1c2d8-b4d3-446c-a5e6-052984082e78 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.397424 Oct 27 10:20:46.021296 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1595/3013] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:45 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:20:46.218690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:46.250443 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46282c85-bab7-42ef-8f67-e534bf252058 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1507 microversion: 2.1 time: 0.392862 Oct 27 10:20:46.252558 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1419/3014] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:45 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:46.389378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:46.392244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:46.417935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:46.420117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:46.421779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:46.427631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:46.428389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:46.429158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:46.459560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:46.460942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:46.482109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:46.482876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:46.483451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:46.484460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:46.485156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:46.485807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:47.255681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:47.260929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:47.264435 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f156f207-1c57-4f08-9b1c-a757ad7dc4f9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1505 microversion: 2.1 time: 0.886891 Oct 27 10:20:47.265280 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1596/3015] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:46 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1505 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:47.280715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:47.281561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:47.286617 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5a9e2000-cf78-46f9-8fa8-2ce4aad3436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1315 microversion: 2.1 time: 0.836588 Oct 27 10:20:47.287436 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1420/3016] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:46 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:47.287969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:47.288797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:47.289375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:47.290237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:47.290862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:47.292123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:47.292253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:47.293469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:47.302899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:47.303606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:47.304183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:47.305091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:47.305684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:47.306251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:47.662871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:47.670260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:47.684413 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-64b3954f-9495-4cbd-b7f6-9c4f7e3573c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.395751 Oct 27 10:20:47.685687 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4dc8cc5c-dea0-441d-a738-4acc510a5774 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1322 microversion: 2.1 time: 0.419142 Oct 27 10:20:47.686579 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1597/3017] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:47 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:47.703877 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1421/3018] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:47 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:47.719390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:47.720544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1032461534", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:47.721497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:47.737979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:47.738854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:47.741303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:47.742275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:47.743885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:47.745216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:47.827817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] validate_networks() for [('6e77c087-9c37-413a-bf33-443cd764ef30', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:20:48.291804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:48.306021 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a85ceaa4-7e72-4cb4-9c6f-be891a1ab48d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1515 microversion: 2.1 time: 0.598186 Oct 27 10:20:48.308551 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1422/3019] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:47 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1515 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:48.609546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1f9f83a7-8464-440b-91d4-e18c0105c407 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5a969040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1214355571", "description": "tempest-description-247115899"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:48.822997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:20:48.824165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:20:48.824860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:20:48.825428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:20:48.826005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:20:48.845120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:48.847464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:48.848077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:48.850981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:48.851627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:48.854198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:48.920231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Getting quotas for project a8c3992187114a2887044b851d6c7838. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:48.937071 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1f9f83a7-8464-440b-91d4-e18c0105c407 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.626248 Oct 27 10:20:48.939285 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1423/3020] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:20:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:48.944565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-492316e9-4529-4d13-8a5d-7f9137610ef6 req-043f1fe4-4807-4909-8abc-2caf84f80efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e5dcc4-e23c-4615-bdd2-db58762537a4", "name": "network-vif-plugged", "status": "completed", "tag": "bf9da344-b190-40e9-914a-e2a39f009d02"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:48.953818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Getting quotas for user 3d0c785c43b24f64b5d1ec4510c78fdd and project a8c3992187114a2887044b851d6c7838. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:48.957464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-492316e9-4529-4d13-8a5d-7f9137610ef6 req-043f1fe4-4807-4909-8abc-2caf84f80efc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:48.958120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-492316e9-4529-4d13-8a5d-7f9137610ef6 req-043f1fe4-4807-4909-8abc-2caf84f80efc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:48.958690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-492316e9-4529-4d13-8a5d-7f9137610ef6 req-043f1fe4-4807-4909-8abc-2caf84f80efc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:48.974238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:20:48.974546 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-492316e9-4529-4d13-8a5d-7f9137610ef6 req-043f1fe4-4807-4909-8abc-2caf84f80efc service nova] Creating event network-vif-plugged:bf9da344-b190-40e9-914a-e2a39f009d02 for instance 15e5dcc4-e23c-4615-bdd2-db58762537a4 on n-h1-854663-10 Oct 27 10:20:48.976742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:48.981739 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-492316e9-4529-4d13-8a5d-7f9137610ef6 req-043f1fe4-4807-4909-8abc-2caf84f80efc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040617 Oct 27 10:20:48.988584 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1424/3021] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:48.996449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-267e9c7b-ead7-40fb-864d-0e609dc1c793 req-731d33e2-29b6-42f7-8223-b0f079a9ffd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdce1098-3933-4f19-bd78-fc6e60559a8e", "name": "network-vif-deleted", "tag": "9ca5bddc-2e5a-42b2-8037-32aff51b9ed5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:49.010615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-267e9c7b-ead7-40fb-864d-0e609dc1c793 req-731d33e2-29b6-42f7-8223-b0f079a9ffd4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.011791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-267e9c7b-ead7-40fb-864d-0e609dc1c793 req-731d33e2-29b6-42f7-8223-b0f079a9ffd4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.012604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-267e9c7b-ead7-40fb-864d-0e609dc1c793 req-731d33e2-29b6-42f7-8223-b0f079a9ffd4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.031943 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-267e9c7b-ead7-40fb-864d-0e609dc1c793 req-731d33e2-29b6-42f7-8223-b0f079a9ffd4 service nova] Creating event network-vif-deleted:9ca5bddc-2e5a-42b2-8037-32aff51b9ed5 for instance cdce1098-3933-4f19-bd78-fc6e60559a8e on n-h2-854663-10 Oct 27 10:20:49.037972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-267e9c7b-ead7-40fb-864d-0e609dc1c793 req-731d33e2-29b6-42f7-8223-b0f079a9ffd4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047137 Oct 27 10:20:49.039104 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1425/3022] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:49.048260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:49.048921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:49.063964 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-507d991c-43db-47a9-a930-69daee5edeb9 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.356465 Oct 27 10:20:49.064544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.065071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.065504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.066219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.067140 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1598/3023] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:20:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:20:49.069671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.070114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.076479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:49.078965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:49.096775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.097957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.099556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.101153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.101616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.102042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.173485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.175014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.176044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.177165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lazy-loading 'fault' on Instance uuid cdce1098-3933-4f19-bd78-fc6e60559a8e {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:20:49.366003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:49.380618 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b9e7e383-d306-4e00-a9f2-d0b54f4bc3fd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 200 len: 1310 microversion: 2.1 time: 0.338801 Oct 27 10:20:49.381485 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1426/3024] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:49 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 1310 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:49.389646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:49.391321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:49.407202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.408096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.408705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.409707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.410307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.410970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.534923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:49.543380 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6252b4c-f1e1-4dfa-96af-f7b06c732902 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1315 microversion: 2.1 time: 0.475162 Oct 27 10:20:49.547248 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1599/3025] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:49 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:49.564277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:49.565146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:49.568235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:49.574265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.575024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.575761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.576619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:49.577262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:49.577842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:49.783687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:49.800559 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f163590-4a21-4080-9cab-662bf645dc6e tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1322 microversion: 2.1 time: 0.414352 Oct 27 10:20:49.801254 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1427/3026] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:49 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:49.834062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-829831d6-1ad1-4ab3-9aa7-3efdb4d88160 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d637f7550>, body: {"security_group_rule": {"parent_group_id": "263ce342-3ac9-421d-994e-e6d87bbc910b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:50.063139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:50.075807 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a37d546e-6040-4fa9-9a4a-7dc83a89710e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.527117 Oct 27 10:20:50.076492 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1600/3027] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:49 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:50.085301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:50.086824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:50.096901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:50.097841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:50.107543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:50.108343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:50.108849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:50.109288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:50.216769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:50.236769 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e04168a-e5d2-4999-87b4-23f349223012 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1221 microversion: 2.1 time: 0.157199 Oct 27 10:20:50.270669 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-829831d6-1ad1-4ab3-9aa7-3efdb4d88160 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.451170 Oct 27 10:20:50.271495 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1428/3028] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:20:49 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:50.272698 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1601/3029] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:50 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1221 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:50.287961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f41f3173-8af6-41db-946b-f60db41e97bd tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5a94e280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1932932280", "description": "tempest-description-117759894"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:50.409112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:50.409970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:50.426272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:50.427885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:50.428326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:50.429111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:50.429612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:50.430072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:50.467534 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e HTTP/1.1 Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'cdce1098-3933-4f19-bd78-fc6e60559a8e'} Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:50.469607 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:50.473997 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:50.473997 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:50.473997 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:50.473997 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:20:50.473997 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:20:50.473997 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:20:50.473997 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:20:50.473997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:50.473997 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c3878721-df0d-404f-8fab-89eb509e5886 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 404 len: 111 microversion: 2.1 time: 0.068036 Oct 27 10:20:50.477391 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1602/3030] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:50 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:20:50.489177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d7d3493-1dc0-4291-9160-af079aa1f69e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'create', calling method: .version_select at 0x7f6d5b4a5c10>, body: {"keypair": {"name": "tempest-key-609325859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9rwWgyT06Y+w+muitFoSh1iFiecU00VTJ0/fc1+lWx7+i8wvt97A8qgM7/sC5CyOGz6PusKt5kl669wDnpYd+ZaJ/xTHoYfdwGD1RWo62LYyL930Q94h2ywZbgTa0pCw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:50.506774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8d7d3493-1dc0-4291-9160-af079aa1f69e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:50.525415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8d7d3493-1dc0-4291-9160-af079aa1f69e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for user 6a80ce0f3a4242a9a061a311c4bb50ae and project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:50.562232 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d7d3493-1dc0-4291-9160-af079aa1f69e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.076867 Oct 27 10:20:50.565777 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1603/3031] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:20:50 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:50.571900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:50.573464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:50.582006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:50.582704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:50.583358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:50.584074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:50.584693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:50.585202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:50.588505 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f41f3173-8af6-41db-946b-f60db41e97bd tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.305619 Oct 27 10:20:50.590331 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1429/3032] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:20:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:50.595564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-438e788a-ecb9-492e-a70b-d69ff0f5fca8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '.version_select at 0x7f6d5a94e8b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:50.602674 n-d-854663-10 devstack@n-api.service[120719]: WARNING oslo_db.sqlalchemy.utils [None req-438e788a-ecb9-492e-a70b-d69ff0f5fca8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 10:20:50.611327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-438e788a-ecb9-492e-a70b-d69ff0f5fca8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.019614 Oct 27 10:20:50.611985 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1430/3033] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:20:50 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:50.617193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d14428b8-b7eb-4429-91d6-a8f82e07fad0 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5ab5b3a0>, body: {"security_group_rule": {"parent_group_id": "8ddf3941-810b-4376-a543-ae69df58df6a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:50.846442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:50.849383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:50.857205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f9e4ac7-8901-4976-89d3-aa77c9a44e97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1315 microversion: 2.1 time: 0.290104 Oct 27 10:20:50.858080 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1604/3034] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:50 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:50.868769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1435780214", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "key_name": "tempest-key-609325859", "networks": [{"uuid": "bc393ace-9ca8-46ee-824d-0fc414351037"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:50.945345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] validate_networks() for [('bc393ace-9ca8-46ee-824d-0fc414351037', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:20:50.970275 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d14428b8-b7eb-4429-91d6-a8f82e07fad0 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.356610 Oct 27 10:20:50.970943 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1431/3035] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:20:50 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:50.984344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:50.985155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:50.996556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:50.997361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:50.997958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:50.999176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:51.000150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:51.000745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:51.203540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:51.216022 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0699eef7-db4b-4da2-95dd-953e42768c84 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 200 len: 1515 microversion: 2.1 time: 0.239324 Oct 27 10:20:51.216610 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1432/3036] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:50 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:51.226172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfd57ef4-6b62-4344-bc7a-ec188ebdd5ed tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5a94ee50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1711191292", "description": "tempest-description-1654699899"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:51.730455 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cfd57ef4-6b62-4344-bc7a-ec188ebdd5ed tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.512426 Oct 27 10:20:51.731116 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1433/3037] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:20:51 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:51.743673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c957a7cd-1aff-4936-b94f-7a2761ceaeb3 req-036418c8-1652-4a57-bbcc-2326e0ff8a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b660b14-6253-4e7c-8bea-f252101ae635", "name": "network-vif-plugged", "status": "completed", "tag": "15ab1839-883f-47a4-8afe-ce70851d16d2"}, {"server_uuid": "b68520bf-600b-4e05-b466-118a72c8c30a", "name": "network-vif-plugged", "status": "completed", "tag": "c829aa4b-4639-4ea5-ba84-7b155c16ad79"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:51.755157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c957a7cd-1aff-4936-b94f-7a2761ceaeb3 req-036418c8-1652-4a57-bbcc-2326e0ff8a95 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:51.755617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c957a7cd-1aff-4936-b94f-7a2761ceaeb3 req-036418c8-1652-4a57-bbcc-2326e0ff8a95 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:51.756084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c957a7cd-1aff-4936-b94f-7a2761ceaeb3 req-036418c8-1652-4a57-bbcc-2326e0ff8a95 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:51.770282 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c957a7cd-1aff-4936-b94f-7a2761ceaeb3 req-036418c8-1652-4a57-bbcc-2326e0ff8a95 service nova] Creating event network-vif-plugged:15ab1839-883f-47a4-8afe-ce70851d16d2 for instance 9b660b14-6253-4e7c-8bea-f252101ae635 on n-h1-854663-10 Oct 27 10:20:51.770788 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c957a7cd-1aff-4936-b94f-7a2761ceaeb3 req-036418c8-1652-4a57-bbcc-2326e0ff8a95 service nova] Creating event network-vif-plugged:c829aa4b-4639-4ea5-ba84-7b155c16ad79 for instance b68520bf-600b-4e05-b466-118a72c8c30a on n-h2-854663-10 Oct 27 10:20:51.780603 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c957a7cd-1aff-4936-b94f-7a2761ceaeb3 req-036418c8-1652-4a57-bbcc-2326e0ff8a95 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040377 Oct 27 10:20:51.785139 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1434/3038] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:51.797750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:20:51.801930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:20:51.802944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:20:51.804995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:20:51.805158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:51.806779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:20:51.810382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:51.818455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:51.819097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:51.819840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:51.820873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:51.821389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:51.821818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:51.833758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:51.834852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:51.835527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:51.836575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:51.837394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:51.838242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:51.847898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lazy-loading 'flavor' on Instance uuid f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:20:51.875310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:20:51.881229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for user 6a80ce0f3a4242a9a061a311c4bb50ae and project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:20:51.898945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:20:51.904655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:20:51.976847 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-522c3775-7aaa-4101-ad8b-a31152af901a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116560 Oct 27 10:20:51.978048 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1605/3039] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:20:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:20:51.988417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:51.989549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:51.993336 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aac35b6c-554a-4d58-94eb-c94ec3313b74 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action" status: 200 len: 32 microversion: 2.1 time: 0.204238 Oct 27 10:20:51.997592 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1435/3040] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:20:51 2022] POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:20:52.003787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.004570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.005201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.006180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.006783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.007423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.021641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:52.022193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: b68520bf-600b-4e05-b466-118a72c8c30a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:52.036967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:52.040443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.041106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.041563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.042289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.042748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.043174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.384502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:52.396951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:52.405364 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e4a7f6e-4c60-42aa-ba81-ccaa51998f39 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a" status: 200 len: 1322 microversion: 2.1 time: 0.400913 Oct 27 10:20:52.406036 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13883db6-cbe9-4e90-84b2-bf368c7b2979 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.426368 Oct 27 10:20:52.406629 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1606/3041] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:51 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:52.407767 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1436/3042] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:51 2022] GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:52.413865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfd96007-667e-4188-8698-3b478f37641a tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5a969700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-988372156", "description": "tempest-description-1884848191"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:52.427617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:52.428879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:52.444368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.445053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.445569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.446450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.447016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.447549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.563680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:52.573320 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d54a39b7-b2fa-42a8-b5dd-e142e9ad2788 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1283 microversion: 2.1 time: 0.165194 Oct 27 10:20:52.573879 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1607/3043] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:52 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:52.585388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:52.586213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:52.594438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.594923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.595417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.596150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.596624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.597101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.812193 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cfd96007-667e-4188-8698-3b478f37641a tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.402857 Oct 27 10:20:52.813753 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1437/3044] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:20:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:52.819312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:52.820418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:52.849569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.850373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.851698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.852604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.853272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.853958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.875674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:52.879415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:52.892475 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b700d95-a190-4878-bfde-8b63fd6e4b7b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1315 microversion: 2.1 time: 0.317470 Oct 27 10:20:52.893490 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1608/3045] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:52 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:52.899170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:52.899964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:52.907316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.908004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.908621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.910210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:52.910822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:52.912740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:52.998835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:53.016153 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb756f65-cd67-4b69-a177-f2dc5b2fce3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1232 microversion: 2.1 time: 0.197436 Oct 27 10:20:53.017672 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1438/3046] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:52 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1232 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:53.023216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b69a6619-1343-4ea2-9dc7-33e1b2c26f2d tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5a94e5e0>, body: {"security_group_rule": {"parent_group_id": "788fae09-113d-4e3f-9a45-6bbac8125dd0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c8d225af-d690-417c-90ed-3911d3b809b4"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:53.284963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:53.296003 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f5e3ef2-1dc0-4576-bfb6-8bceb2a578e4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.400671 Oct 27 10:20:53.308751 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1609/3047] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:52 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:53.430828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:53.431897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:53.441569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:53.442234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:53.442859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:53.443783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:53.444023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:53.444529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:53.735034 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b69a6619-1343-4ea2-9dc7-33e1b2c26f2d tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.714673 Oct 27 10:20:53.742312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:53.746603 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1439/3048] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:20:53 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:53.752157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:53.753092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: b68520bf-600b-4e05-b466-118a72c8c30a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:53.753564 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f62d1d8-1723-4791-bb43-5ada7af5c8fa tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.327250 Oct 27 10:20:53.754362 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1610/3049] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:53 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:20:53.759802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:53.760440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:53.767129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:53.767613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:53.768036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:53.768944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:53.769530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:53.770091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:53.777692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:53.778495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:53.779146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:53.779962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:53.780586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:53.781275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:54.360010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:54.370614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:54.371593 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a8ba21b-7535-4bf2-ae3c-e83ea3a1811e tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1325 microversion: 2.1 time: 0.614698 Oct 27 10:20:54.372581 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1611/3050] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:53 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1325 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:54.380689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f8caf7f-3419-4093-aabe-81d0c4692a67 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5aa74e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1362791192", "description": "tempest-description-743234190"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:54.381606 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b633a820-3909-4560-92bf-20d62c32fc2c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a" status: 200 len: 1514 microversion: 2.1 time: 0.633304 Oct 27 10:20:54.393061 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1440/3051] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:53 2022] GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a => generated 1514 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:54.398715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:54.399513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:54.409434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:54.410046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:54.410480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:54.411364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:54.411954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:54.412527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:54.759236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:54.768862 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-513195f0-6ac6-461b-b182-a85bcc50ecea tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1501 microversion: 2.1 time: 0.374319 Oct 27 10:20:54.782537 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1441/3052] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:54 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1501 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:54.795475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:54.796262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:54.803743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:54.804602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:54.805302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:54.806278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:54.806902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:54.807426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:54.851401 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f8caf7f-3419-4093-aabe-81d0c4692a67 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.477226 Oct 27 10:20:54.852129 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1612/3053] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:20:54 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:54.858012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:54.863234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:54.864160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Searching by: {'deleted': False, 'project_id': '349ad1084129416096a09cd524c2467d'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:20:54.870848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:54.871439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:54.871971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:54.872899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:54.873449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:54.874118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:54.905220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:20:54.952364 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15f3b755-4337-481c-a111-7d7213a78f24 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.097966 Oct 27 10:20:54.952857 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1613/3054] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:20:54 2022] GET /compute/v2.1/servers => generated 334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:54.958902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:54.959533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:54.967215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:54.967704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:54.968347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:54.969316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:54.969942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:54.970537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:54.975657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:54.994880 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f0aa8250-9049-4e15-8102-1bf36ca895e1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1286 microversion: 2.1 time: 0.210655 Oct 27 10:20:54.995753 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1442/3055] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:54 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:55.027380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:55.029623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:55.038953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.042595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.043265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.044384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.045031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.045679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.205251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:55.215740 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b95da695-b9b2-46cd-b865-32c3092c31bf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.261745 Oct 27 10:20:55.216494 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1614/3056] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:54 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:55.221526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a9141096-f1ae-4696-b588-80bba5b1a7e9 req-bb8adf1e-77af-4df3-882e-a13d2bc5fc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66526d64-5921-4273-a259-32f11a2fe5ec", "tag": "df8c6df5-ea64-4833-8236-d8e7d654a3dc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:55.232526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a9141096-f1ae-4696-b588-80bba5b1a7e9 req-bb8adf1e-77af-4df3-882e-a13d2bc5fc4e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.233436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a9141096-f1ae-4696-b588-80bba5b1a7e9 req-bb8adf1e-77af-4df3-882e-a13d2bc5fc4e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.234122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a9141096-f1ae-4696-b588-80bba5b1a7e9 req-bb8adf1e-77af-4df3-882e-a13d2bc5fc4e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.255645 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a9141096-f1ae-4696-b588-80bba5b1a7e9 req-bb8adf1e-77af-4df3-882e-a13d2bc5fc4e service nova] Creating event network-changed:df8c6df5-ea64-4833-8236-d8e7d654a3dc for instance 66526d64-5921-4273-a259-32f11a2fe5ec on n-h2-854663-10 Oct 27 10:20:55.262282 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a9141096-f1ae-4696-b588-80bba5b1a7e9 req-bb8adf1e-77af-4df3-882e-a13d2bc5fc4e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044445 Oct 27 10:20:55.263524 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1615/3057] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:55.270761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:55.273738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:55.282530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.283149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.283825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.284885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.285560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.290775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.361150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:55.375417 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5527251a-05e5-4369-a43e-79c995f249f1 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 200 len: 1515 microversion: 2.1 time: 0.368262 Oct 27 10:20:55.389384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1443/3058] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:55 2022] GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 1515 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:55.405642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:55.406478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:55.414835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.416426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.417306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.418864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.419486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.420382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.452012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:20:55.588586 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4dc8672b-d594-47d4-8bbc-00c845bb01b1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 204 len: 0 microversion: 2.1 time: 0.196580 Oct 27 10:20:55.591321 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1444/3059] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:20:55 2022] DELETE /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:20:55.598874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-062ab85e-0290-4705-861d-7c8144b62b8c tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5a84e040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-690568224", "description": "tempest-description-1227239561"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:55.684496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:55.694558 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-482a4919-9b2e-481a-b2f2-4ea8bf6069ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.429267 Oct 27 10:20:55.695185 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1616/3060] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:55 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:55.701484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:55.706683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:55.707876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Searching by: {'deleted': False, 'project_id': '349ad1084129416096a09cd524c2467d'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:20:55.714439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.714882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.715521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.716236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.716703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.717124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.748087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:20:55.793952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:55.800866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.801669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.802149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.893789 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-062ab85e-0290-4705-861d-7c8144b62b8c tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.300250 Oct 27 10:20:55.894765 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1445/3061] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:20:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:55.899863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:55.902095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:55.927711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.929134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.929791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.930705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.931372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.932133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.973855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3bb0e9c-c9a3-4f93-a954-7b8d05c2558f tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.277169 Oct 27 10:20:55.974665 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1617/3062] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:20:55 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:55.979648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:55.980377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:55.993265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.994028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.995347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:55.996594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:55.997143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:55.997570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.026908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:20:56.091845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:56.100494 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d64259fc-0b17-4bc5-8afc-b496742f2f85 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1325 microversion: 2.1 time: 0.204435 Oct 27 10:20:56.101251 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1446/3063] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:55 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1325 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:56.121628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:56.122250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:56.129277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.129788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.130257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.131020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.131511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.131990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.134558 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-73fa6a5e-5938-4037-83c2-d313ff6d6e32 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 204 len: 0 microversion: 2.1 time: 0.158519 Oct 27 10:20:56.135502 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1618/3064] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:20:55 2022] DELETE /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:20:56.142441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1f1b43e-d276-4c53-846a-1649570ee798 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5b5a7820>, body: {"security_group_rule": {"parent_group_id": "8d0ee5f7-f9dd-440e-92c7-505716f0a474", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9ddca788-5eae-4f74-8f3b-c5a610f30aa2"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:56.313703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:56.322113 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6b400f13-de63-4919-ad07-1fdfc100ac0a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1507 microversion: 2.1 time: 0.204678 Oct 27 10:20:56.323088 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1447/3065] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:56 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:56.329033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e99f4d1a-57f8-455b-8bd7-773012ef4ab5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:56.338640 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e99f4d1a-57f8-455b-8bd7-773012ef4ab5 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014383 Oct 27 10:20:56.339224 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1448/3066] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:20:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:56.344128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:56.344741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:56.351703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.352505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.353078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.353930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.354445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.354886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.539127 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1f1b43e-d276-4c53-846a-1649570ee798 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.402582 Oct 27 10:20:56.539784 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1619/3067] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:20:56 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:56.544369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c423ab51-1176-4495-b0af-e6a8e22d4c0c req-6462c583-d936-4573-b012-6b5fbce695e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ba664ff-9f3e-44a7-9921-fd60d7bb22c4", "tag": "5dca42bf-caa2-4034-97eb-d52bb510e74a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:56.544927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:56.554029 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c23f6447-ced8-4450-b1c4-ec986048ea4c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1328 microversion: 2.1 time: 0.213618 Oct 27 10:20:56.554762 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1449/3068] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:56 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:56.560296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:56.560931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:56.567229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.567658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c423ab51-1176-4495-b0af-e6a8e22d4c0c req-6462c583-d936-4573-b012-6b5fbce695e5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.568028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.568252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c423ab51-1176-4495-b0af-e6a8e22d4c0c req-6462c583-d936-4573-b012-6b5fbce695e5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.568466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.568681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c423ab51-1176-4495-b0af-e6a8e22d4c0c req-6462c583-d936-4573-b012-6b5fbce695e5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.569192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.569639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.570059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.580637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c423ab51-1176-4495-b0af-e6a8e22d4c0c req-6462c583-d936-4573-b012-6b5fbce695e5 service nova] Creating event network-changed:5dca42bf-caa2-4034-97eb-d52bb510e74a for instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 on n-h2-854663-10 Oct 27 10:20:56.585640 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c423ab51-1176-4495-b0af-e6a8e22d4c0c req-6462c583-d936-4573-b012-6b5fbce695e5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044714 Oct 27 10:20:56.586229 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1620/3069] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:56.591317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:56.592020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:56.598185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.598710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.599082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.599901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.600350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.600802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.784416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:56.791522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:56.792510 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95a2b040-698c-45f9-8822-dc1e6aec07f0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 200 len: 1521 microversion: 2.1 time: 0.236509 Oct 27 10:20:56.793226 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1450/3070] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:56 2022] GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:56.798210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88673cfb-2593-48d8-a360-64fd803467f0 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5a94ed30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:56.800331 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67c2ce3d-3885-48af-86ae-b84a65f4ae49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.212970 Oct 27 10:20:56.801015 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1621/3071] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:56 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:56.809766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:56.810645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:56.817116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.817595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.818025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:56.818746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:56.819190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:56.819606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.118379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:57.121221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:57.129454 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cbf4ccc9-4143-46d1-8b32-f6fed4797010 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.327238 Oct 27 10:20:57.158596 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1622/3072] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:56 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:57.165213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:57.165962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:57.179461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.179998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.180433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.181831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.182691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.185874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.202883 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88673cfb-2593-48d8-a360-64fd803467f0 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/9ddca788-5eae-4f74-8f3b-c5a610f30aa2" status: 202 len: 0 microversion: 2.1 time: 0.408541 Oct 27 10:20:57.207651 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1451/3073] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:20:56 2022] DELETE /compute/v2.1/os-security-groups/9ddca788-5eae-4f74-8f3b-c5a610f30aa2 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:20:57.212749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:57.213659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:57.222253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.222937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.224156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.225060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.225741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.226319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.263194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:20:57.347877 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f35335f-f33b-4834-806d-b10dda9c7437 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "DELETE /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 204 len: 0 microversion: 2.1 time: 0.138728 Oct 27 10:20:57.349012 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1452/3074] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:20:57 2022] DELETE /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:20:57.354347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d146023c-d910-4724-86aa-9804a6b84f9e tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5a84e9d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:57.466077 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d146023c-d910-4724-86aa-9804a6b84f9e tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups/8d0ee5f7-f9dd-440e-92c7-505716f0a474" status: 200 len: 247 microversion: 2.1 time: 0.115730 Oct 27 10:20:57.467616 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1453/3075] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:20:57 2022] GET /compute/v2.1/os-security-groups/8d0ee5f7-f9dd-440e-92c7-505716f0a474 => generated 247 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:57.472983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:57.473810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:57.476191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:57.481378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.481988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.482505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.483286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.483858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.484352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.487557 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3603ab99-f143-4f21-b7e7-11542bc356fc tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1325 microversion: 2.1 time: 0.327586 Oct 27 10:20:57.502070 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1623/3076] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:57 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:57.502070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:57.502070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:57.502070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.502070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.502070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.502759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.503445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.503881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.763261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:57.771479 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-905bb2cd-76de-4576-ae32-067fba23116c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1507 microversion: 2.1 time: 0.302927 Oct 27 10:20:57.772270 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1454/3077] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:57 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:57.776797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fe7cea0-b7ed-47ee-a781-28076b50ef99 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d637f7d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-821514567", "description": "tempest-description-1758515476"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:57.808646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:57.817242 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11cbe500-8193-4dbe-9719-31e2c32c43ca tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1701 microversion: 2.1 time: 0.327471 Oct 27 10:20:57.818482 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1624/3078] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:57 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1701 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:57.823390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:57.824012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:57.830289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.830769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.831505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:57.832117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:57.832828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:57.833254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.135467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:58.145436 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1cda07c-d425-4723-8301-05a0825672d2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1328 microversion: 2.1 time: 0.325584 Oct 27 10:20:58.146039 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1625/3079] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:57 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1328 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:58.152473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:58.153128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:58.159658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.160303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.160774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.161560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.161964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.162561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.163979 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fe7cea0-b7ed-47ee-a781-28076b50ef99 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.388610 Oct 27 10:20:58.165509 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1455/3080] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:20:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:58.175409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:58.176191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:58.184051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.184831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.185387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.186193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.186745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.187902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.365426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:58.374302 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0939c84c-eddf-4f1a-8a13-afa2a804aa62 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 200 len: 1521 microversion: 2.1 time: 0.226949 Oct 27 10:20:58.374904 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1626/3081] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:58 2022] GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:58.379569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:58.380178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:58.386464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.387182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.387789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.388498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.388972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.389772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.392195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:58.401173 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-27b2df9f-a1df-4a6b-bef1-f2e0a4457ce8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.233423 Oct 27 10:20:58.401932 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1456/3082] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:58 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:58.406832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3e947972-1f98-44e6-ab60-00f827170929 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5a922790>, body: {"security_group_rule": {"parent_group_id": "21c71bb5-6149-444a-add1-d0a1ef23106d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:58.562358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:58.570469 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a96b740-c74c-499d-a56b-8c200b9db534 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.194538 Oct 27 10:20:58.571048 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1627/3083] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:58 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:58.576039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:58.576697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:58.582895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.583546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.583813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.584514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.585000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.585428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.694612 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3e947972-1f98-44e6-ab60-00f827170929 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.291309 Oct 27 10:20:58.695326 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1457/3084] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:20:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:58.707342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9cd345c0-e345-498f-a301-fe2100c4b302 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Action: 'create', calling method: .version_select at 0x7f6d5a94e0d0>, body: {"security_group_rule": {"parent_group_id": "21c71bb5-6149-444a-add1-d0a1ef23106d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:20:58.780994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:58.789361 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e1ebe89-89a1-4d33-a123-d2cc43d6426c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1325 microversion: 2.1 time: 0.217325 Oct 27 10:20:58.790043 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1628/3085] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:58 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:58.798621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:58.799385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:58.806220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.806780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.807315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.808105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.808799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.809444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:58.981816 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9cd345c0-e345-498f-a301-fe2100c4b302 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.278052 Oct 27 10:20:58.982433 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1458/3086] 10.222.0.76 () {60 vars in 1195 bytes} [Thu Oct 27 10:20:58 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:20:58.987628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:58.988237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:58.995032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:58.998414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:58.998724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:58.999251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.000118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.000684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.001193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.006643 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c82aef6-39dc-4aa6-abf7-d12583628918 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1507 microversion: 2.1 time: 0.212111 Oct 27 10:20:59.007411 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1629/3087] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:58 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:59.012678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77437d17-4c9e-4b0c-9b43-a1856ab0b187 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5aeb0b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:59.100058 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77437d17-4c9e-4b0c-9b43-a1856ab0b187 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups/21c71bb5-6149-444a-add1-d0a1ef23106d" status: 200 len: 664 microversion: 2.1 time: 0.091369 Oct 27 10:20:59.100626 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1630/3088] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:20:59 2022] GET /compute/v2.1/os-security-groups/21c71bb5-6149-444a-add1-d0a1ef23106d => generated 664 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:20:59.114498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-306497a5-eb20-436b-af2a-092b9fbc3f70 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5b497280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:59.197040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:59.199814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:20:59.207346 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-718ad635-733e-4d2b-9017-a3284a911ecb tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1701 microversion: 2.1 time: 0.223868 Oct 27 10:20:59.208114 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1459/3089] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:58 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1701 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:59.214126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:59.214748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:59.221710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.222200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.222697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.223421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.223859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.224268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.369014 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-306497a5-eb20-436b-af2a-092b9fbc3f70 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-group-rules/4e18118f-84ee-4749-aafa-629eaaefef14" status: 202 len: 0 microversion: 2.1 time: 0.258415 Oct 27 10:20:59.369757 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1631/3090] 10.222.0.76 () {58 vars in 1287 bytes} [Thu Oct 27 10:20:59 2022] DELETE /compute/v2.1/os-security-group-rules/4e18118f-84ee-4749-aafa-629eaaefef14 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:20:59.379025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c5ce822-868a-4d66-860a-5523af6179d8 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5b4a6550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:59.393039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:59.401917 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e286aec-354d-4123-b9bf-d26d9c341155 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1328 microversion: 2.1 time: 0.192355 Oct 27 10:20:59.402876 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1460/3091] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:59 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1328 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:59.407470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:59.408076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:59.414823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.415576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.416202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.417110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.417967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.418345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.610995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:59.619167 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-479ffc40-8db9-4a77-af86-78fd0bcaa5f6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 200 len: 1521 microversion: 2.1 time: 0.215123 Oct 27 10:20:59.620263 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1461/3092] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:59 2022] GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:59.624971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:59.625580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:59.631528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.632222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.632688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.633387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.634001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.634437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.657071 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c5ce822-868a-4d66-860a-5523af6179d8 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/21c71bb5-6149-444a-add1-d0a1ef23106d" status: 202 len: 0 microversion: 2.1 time: 0.281799 Oct 27 10:20:59.661683 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1632/3093] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:20:59 2022] DELETE /compute/v2.1/os-security-groups/21c71bb5-6149-444a-add1-d0a1ef23106d => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:20:59.667691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:59.668331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:59.678839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.679543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.680136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.681175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.682118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.682803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.831641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:59.841222 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8660c484-9a8b-47ff-b3dd-60ce9e0cf340 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.219707 Oct 27 10:20:59.842093 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1462/3094] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:59 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:59.847136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2201186-3980-4dea-ab54-ef1c9b82b801 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5a85e940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:59.882315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG neutronclient.v2_0.client [None req-a2201186-3980-4dea-ab54-ef1c9b82b801 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ddca788-5eae-4f74-8f3b-c5a610f30aa2 does not exist", "detail": ""}} {{(pid=120719) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:20:59.882932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.security_group_api [None req-a2201186-3980-4dea-ab54-ef1c9b82b801 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Neutron security group 9ddca788-5eae-4f74-8f3b-c5a610f30aa2 not found {{(pid=120719) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:20:59.883466 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a2201186-3980-4dea-ab54-ef1c9b82b801 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] HTTP exception thrown: Security group 9ddca788-5eae-4f74-8f3b-c5a610f30aa2 does not exist Oct 27 10:20:59.883466 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-f9621a43-d5e4-41a5-ada8-a21c178c1ca7'] Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2201186-3980-4dea-ab54-ef1c9b82b801 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Request method failure captured: Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-security-groups/9ddca788-5eae-4f74-8f3b-c5a610f30aa2 HTTP/1.1 Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlt_GkovsGcccaR2ganPLL46iTUWhDYxn889zMb6sUqQ7KZcfsHE7FyRYF675ZjZR18VaHNGEBxPSPugc_AYUxkJub53UcGKim_I_qh9hPnYq6r3-tBLVxRPLEptHbPTxKYVe2U_g7Y9ZEWeRXFczb9Q_ivFEMCjOVywO_4uGEzKct8 Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: cbaeaf8a4aa049a99b0ab4fe8568904a Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1704548847 Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cbaeaf8a4aa049a99b0ab4fe8568904a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cbaeaf8a4aa049a99b0ab4fe8568904a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cbaeaf8a4aa049a99b0ab4fe8568904a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cbaeaf8a4aa049a99b0ab4fe8568904a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1704548847 Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: cbaeaf8a4aa049a99b0ab4fe8568904a Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1704548847 Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupRulesTestJSON-1704548847-project Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: b1dbb01ef6ff408699b28af2d793ac4a Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1704548847-project Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: exception: Security group 9ddca788-5eae-4f74-8f3b-c5a610f30aa2 does not exist Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-f9621a43-d5e4-41a5-ada8-a21c178c1ca7'] Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '9ddca788-5eae-4f74-8f3b-c5a610f30aa2'} Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:20:59.885842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ddca788-5eae-4f74-8f3b-c5a610f30aa2 does not exist Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9621a43-d5e4-41a5-ada8-a21c178c1ca7'] Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ddca788-5eae-4f74-8f3b-c5a610f30aa2 does not exist Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9621a43-d5e4-41a5-ada8-a21c178c1ca7'] Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ddca788-5eae-4f74-8f3b-c5a610f30aa2 does not exist Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9621a43-d5e4-41a5-ada8-a21c178c1ca7'] Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ddca788-5eae-4f74-8f3b-c5a610f30aa2 does not exist Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9621a43-d5e4-41a5-ada8-a21c178c1ca7'] Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2201186-3980-4dea-ab54-ef1c9b82b801 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Returning 404 to user: Security group 9ddca788-5eae-4f74-8f3b-c5a610f30aa2 does not exist Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-f9621a43-d5e4-41a5-ada8-a21c178c1ca7'] {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:20:59.890690 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2201186-3980-4dea-ab54-ef1c9b82b801 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/9ddca788-5eae-4f74-8f3b-c5a610f30aa2" status: 404 len: 194 microversion: 2.1 time: 0.043966 Oct 27 10:20:59.893763 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1463/3095] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:20:59 2022] DELETE /compute/v2.1/os-security-groups/9ddca788-5eae-4f74-8f3b-c5a610f30aa2 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:20:59.898568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:20:59.899198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:20:59.909136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:20:59.915842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.916609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.918021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.918813 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65874d90-902d-4181-81f3-4435e545d970 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1496 microversion: 2.1 time: 0.255524 Oct 27 10:20:59.918918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:20:59.919427 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1633/3096] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:59 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1496 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:20:59.920056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:20:59.920554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:20:59.924954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aff0ebb6-5eaa-42eb-a89c-f7a683afdddb tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5b497dc0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:00.128733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:00.142174 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d98e9e8b-cd94-4894-8662-5e1eda55985b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1325 microversion: 2.1 time: 0.248326 Oct 27 10:21:00.156978 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1464/3097] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:20:59 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:00.162324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:00.163076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:00.170131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:00.170866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:00.171396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:00.173080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:00.173080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:00.173622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:00.209161 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aff0ebb6-5eaa-42eb-a89c-f7a683afdddb tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/8d0ee5f7-f9dd-440e-92c7-505716f0a474" status: 202 len: 0 microversion: 2.1 time: 0.288086 Oct 27 10:21:00.210581 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1634/3098] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:20:59 2022] DELETE /compute/v2.1/os-security-groups/8d0ee5f7-f9dd-440e-92c7-505716f0a474 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:21:00.218263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c74fa8d-71c9-4c2e-a285-8a26888b9f15 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5b497790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:00.884076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:00.893365 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-56c4d518-ff43-402a-830e-5ce0af47ad23 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1507 microversion: 2.1 time: 0.735047 Oct 27 10:21:00.894082 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1465/3099] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:00 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1507 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:00.899221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:00.900218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:00.908920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:00.909859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:00.910590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:00.911541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:00.912113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:00.912612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:01.224033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:01.246865 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c74fa8d-71c9-4c2e-a285-8a26888b9f15 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/c8d225af-d690-417c-90ed-3911d3b809b4" status: 202 len: 0 microversion: 2.1 time: 1.032449 Oct 27 10:21:01.248427 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1635/3100] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:21:00 2022] DELETE /compute/v2.1/os-security-groups/c8d225af-d690-417c-90ed-3911d3b809b4 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:21:01.256102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:01.256953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:01.285068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:01.287994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:01.288767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:01.292813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:01.293507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:01.294990 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e117f2f-ccd2-4828-8ef4-0bb31d8d6d89 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1701 microversion: 2.1 time: 0.398192 Oct 27 10:21:01.295552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:01.298145 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1466/3101] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:00 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1701 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:01.317987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:01.319008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:01.349243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:01.349768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:01.350237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:01.350983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:01.351452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:01.351920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:01.599846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:01.609420 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa224d32-d14b-48f1-be91-d514708a0aee tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 200 len: 1479 microversion: 2.1 time: 0.307992 Oct 27 10:21:01.610066 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1467/3102] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:01 2022] GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 1479 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:01.640962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:01.642303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:01.650044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:01.652151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:01.652827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:01.655447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:01.659106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:01.659590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:01.785673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:01.796389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d4691e8-10f9-4ba7-b7b8-313149815ce4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1328 microversion: 2.1 time: 0.546519 Oct 27 10:21:01.798915 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1636/3103] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:01 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1328 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:01.805564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:01.806775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:01.814675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:01.815403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:01.816018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:01.817056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:01.817660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:01.818361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:01.997543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:02.040888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e8403cca-893c-4e74-a9a9-ace78a720e59 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.414968 Oct 27 10:21:02.069457 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1468/3104] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:01 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:02.082187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:02.082937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:02.093854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.094536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.094977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.096392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.100262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.101480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.151572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:02.161435 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81239bc0-f3e8-4b4c-a91b-72403bdb401b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 200 len: 1473 microversion: 2.1 time: 0.360513 Oct 27 10:21:02.162474 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1637/3105] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:01 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:02.177895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-598f0ea3-d5b4-452d-968e-b582f3538a4a req-3a9215e8-58bb-49f5-a1fe-eb96fb59bc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b660b14-6253-4e7c-8bea-f252101ae635", "name": "network-vif-deleted", "tag": "15ab1839-883f-47a4-8afe-ce70851d16d2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:02.192461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-598f0ea3-d5b4-452d-968e-b582f3538a4a req-3a9215e8-58bb-49f5-a1fe-eb96fb59bc70 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.193053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-598f0ea3-d5b4-452d-968e-b582f3538a4a req-3a9215e8-58bb-49f5-a1fe-eb96fb59bc70 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.193913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-598f0ea3-d5b4-452d-968e-b582f3538a4a req-3a9215e8-58bb-49f5-a1fe-eb96fb59bc70 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.214174 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-598f0ea3-d5b4-452d-968e-b582f3538a4a req-3a9215e8-58bb-49f5-a1fe-eb96fb59bc70 service nova] Creating event network-vif-deleted:15ab1839-883f-47a4-8afe-ce70851d16d2 for instance 9b660b14-6253-4e7c-8bea-f252101ae635 on n-h1-854663-10 Oct 27 10:21:02.221055 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-598f0ea3-d5b4-452d-968e-b582f3538a4a req-3a9215e8-58bb-49f5-a1fe-eb96fb59bc70 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057036 Oct 27 10:21:02.222138 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1638/3106] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:02.229107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b921bd2d-b591-455f-9cb1-b6aa5a3f1a24 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d60245820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:02.418481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:02.430596 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-56bfa554-aaaa-4a6b-b77c-54a94e278b9a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1325 microversion: 2.1 time: 0.359796 Oct 27 10:21:02.432223 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1469/3107] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:02 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:02.438492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:02.442653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:02.453517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.454246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.455093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.456901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.457754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.458571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.529938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.530529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.531032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.531500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lazy-loading 'fault' on Instance uuid 9b660b14-6253-4e7c-8bea-f252101ae635 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:21:02.660082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:02.669543 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-69b1b69e-2d96-4474-9144-eec7f39efecd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 200 len: 1305 microversion: 2.1 time: 0.235901 Oct 27 10:21:02.687941 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1470/3108] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:02 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 1305 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:02.694477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4ac742cc-6f98-419f-ab1b-cc9ceec32d21 req-691f1ecf-65b5-49cf-a80d-5aac25a00fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66526d64-5921-4273-a259-32f11a2fe5ec", "name": "network-vif-plugged", "status": "completed", "tag": "df8c6df5-ea64-4833-8236-d8e7d654a3dc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:02.711885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4ac742cc-6f98-419f-ab1b-cc9ceec32d21 req-691f1ecf-65b5-49cf-a80d-5aac25a00fa6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.712640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4ac742cc-6f98-419f-ab1b-cc9ceec32d21 req-691f1ecf-65b5-49cf-a80d-5aac25a00fa6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.713547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4ac742cc-6f98-419f-ab1b-cc9ceec32d21 req-691f1ecf-65b5-49cf-a80d-5aac25a00fa6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.728564 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4ac742cc-6f98-419f-ab1b-cc9ceec32d21 req-691f1ecf-65b5-49cf-a80d-5aac25a00fa6 service nova] Creating event network-vif-plugged:df8c6df5-ea64-4833-8236-d8e7d654a3dc for instance 66526d64-5921-4273-a259-32f11a2fe5ec on n-h2-854663-10 Oct 27 10:21:02.734035 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4ac742cc-6f98-419f-ab1b-cc9ceec32d21 req-691f1ecf-65b5-49cf-a80d-5aac25a00fa6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044461 Oct 27 10:21:02.734964 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1471/3109] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:02.740427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76ee6cfb-2828-4279-bdf9-e9294801997e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-853946419"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:02.742866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76ee6cfb-2828-4279-bdf9-e9294801997e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:02.749702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfb-2828-4279-bdf9-e9294801997e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.750195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfb-2828-4279-bdf9-e9294801997e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.750634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfb-2828-4279-bdf9-e9294801997e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.751337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfb-2828-4279-bdf9-e9294801997e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.751780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfb-2828-4279-bdf9-e9294801997e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.752386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfb-2828-4279-bdf9-e9294801997e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.831994 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b921bd2d-b591-455f-9cb1-b6aa5a3f1a24 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/788fae09-113d-4e3f-9a45-6bbac8125dd0" status: 202 len: 0 microversion: 2.1 time: 0.608233 Oct 27 10:21:02.834123 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1639/3110] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:21:02 2022] DELETE /compute/v2.1/os-security-groups/788fae09-113d-4e3f-9a45-6bbac8125dd0 => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:21:02.840628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:02.841886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:02.850825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.851845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.852701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:02.853917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:02.854849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:02.855479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.000427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5217c06234d1413aa718cb04fe650d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349ad1084129416096a09cd524c2467d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:03.012944 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68afaab7-62d2-490d-9e8f-55d783897b75 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 200 len: 1633 microversion: 2.1 time: 0.177308 Oct 27 10:21:03.014703 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1640/3111] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:02 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 1633 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:03.022059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:03.023243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:03.026072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:03.036606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.038428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.039139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.040082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.040931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.042177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.074878 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76ee6cfb-2828-4279-bdf9-e9294801997e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2/action" status: 202 len: 0 microversion: 2.1 time: 0.338408 Oct 27 10:21:03.076279 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1472/3112] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:21:02 2022] POST /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:21:03.097189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0112cfac-9bbe-4345-9312-d3c9b666d51b req-839702b2-3389-43a1-88c1-909d793a2ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319c0a04-0a7e-4ea4-863c-98b5e42dbda1", "name": "network-vif-deleted", "tag": "0ad17519-23a2-4f4f-ba08-e3525af1db3f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:03.104931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.106452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.107213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.107918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lazy-loading 'fault' on Instance uuid cf815fce-6464-4560-8e2a-5ffe7f41ee88 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:21:03.120445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0112cfac-9bbe-4345-9312-d3c9b666d51b req-839702b2-3389-43a1-88c1-909d793a2ff8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.122606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0112cfac-9bbe-4345-9312-d3c9b666d51b req-839702b2-3389-43a1-88c1-909d793a2ff8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.123306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0112cfac-9bbe-4345-9312-d3c9b666d51b req-839702b2-3389-43a1-88c1-909d793a2ff8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.139723 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0112cfac-9bbe-4345-9312-d3c9b666d51b req-839702b2-3389-43a1-88c1-909d793a2ff8 service nova] Creating event network-vif-deleted:0ad17519-23a2-4f4f-ba08-e3525af1db3f for instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 on n-h1-854663-10 Oct 27 10:21:03.146714 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0112cfac-9bbe-4345-9312-d3c9b666d51b req-839702b2-3389-43a1-88c1-909d793a2ff8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068076 Oct 27 10:21:03.147505 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1473/3113] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:03.154375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:03.155131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:03.164205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.164826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.165455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.166382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.167215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.167916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.187144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:03.200307 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d311f3ae-623a-4c2c-a13c-8d529ee731f8 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 200 len: 1312 microversion: 2.1 time: 0.184281 Oct 27 10:21:03.207848 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1641/3114] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:03 2022] GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:03.218933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-314dd676-ab41-4253-97fe-810696d4d37b tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5aa74550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:03.424149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:03.439013 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f407d3d-bc62-45f7-9fdc-dc5f5627dabb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1328 microversion: 2.1 time: 0.289629 Oct 27 10:21:03.440183 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1474/3115] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:03 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1328 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:03.449805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:03.450640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:03.464654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.465695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.466294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.467502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.468008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.468491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.505130 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-314dd676-ab41-4253-97fe-810696d4d37b tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/8ddf3941-810b-4376-a543-ae69df58df6a" status: 202 len: 0 microversion: 2.1 time: 0.293542 Oct 27 10:21:03.507317 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1642/3116] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:21:03 2022] DELETE /compute/v2.1/os-security-groups/8ddf3941-810b-4376-a543-ae69df58df6a => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:21:03.511508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d39b229e-65ec-4d1d-8fa1-330e7f8eddc4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b5d40d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:03.566915 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d39b229e-65ec-4d1d-8fa1-330e7f8eddc4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.059557 Oct 27 10:21:03.568004 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1643/3117] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:03 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:03.573083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:03.574038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:03.583319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.583872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.584521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.585685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.586367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.586848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.622638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:03.632406 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-836aae1e-7061-4751-a95c-9d48088eff49 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.190859 Oct 27 10:21:03.633038 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1475/3118] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:03 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:03.648713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b245fdb0-5cfa-48bf-b469-901b5c268e04 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] Calling method '.version_select at 0x7f6d5a84ee50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:03.778473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:03.792440 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ab0b0c2-0594-4aa1-97a5-1d76c653f933 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1325 microversion: 2.1 time: 0.222961 Oct 27 10:21:03.793264 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1644/3119] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:03 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1325 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:03.800554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:03.806147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:03.821869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.822626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.823321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.824396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:03.825699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:03.826297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:03.844462 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 HTTP/1.1 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '9b660b14-6253-4e7c-8bea-f252101ae635'} Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:03.847066 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:03.852100 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:03.852100 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:03.852100 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:03.852100 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:03.852100 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:03.852100 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:21:03.852100 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:03.852100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:03.852100 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18cf6b14-5c57-44f6-aba7-9e9f88e69368 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 404 len: 111 microversion: 2.1 time: 0.054064 Oct 27 10:21:03.860977 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1645/3120] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:03 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:04.015569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1081178577", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "aebae77c-7c09-4e55-b34c-9671e2410be6"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:04.067738 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b245fdb0-5cfa-48bf-b469-901b5c268e04 tempest-SecurityGroupRulesTestJSON-1704548847 tempest-SecurityGroupRulesTestJSON-1704548847-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/263ce342-3ac9-421d-994e-e6d87bbc910b" status: 202 len: 0 microversion: 2.1 time: 0.424226 Oct 27 10:21:04.069247 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1476/3121] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:21:03 2022] DELETE /compute/v2.1/os-security-groups/263ce342-3ac9-421d-994e-e6d87bbc910b => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:21:04.092381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:04.095781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] [instance: 319c0a04-0a7e-4ea4-863c-98b5e42dbda1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:04.120972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.123236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.123769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.124601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.125104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.132977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.150004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] validate_networks() for [('aebae77c-7c09-4e55-b34c-9671e2410be6', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:21:04.162128 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] HTTP exception thrown: Instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 could not be found. Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Request method failure captured: Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 HTTP/1.1 Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsubqvb7EVjF1OjIX_cfl-ObRKtMlSyV1BQOApIWhHQ1Zo9YZuJ__NVjaifcfKszp8FPGOT9v0GrG7JffpSxD45ijcWkqg5glAG9EUEXp8tA44SJVo21nvVFT9zixF9JGYnKgu-tNq-WycGHyzXFQeaQiux3dzql-uet1hpqsliQz8 Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 349ad1084129416096a09cd524c2467d Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-574468859 Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/349ad1084129416096a09cd524c2467d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/349ad1084129416096a09cd524c2467d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_349ad1084129416096a09cd524c2467d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/349ad1084129416096a09cd524c2467d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-574468859 Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 349ad1084129416096a09cd524c2467d Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-574468859 Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-574468859-project Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5217c06234d1413aa718cb04fe650d1f Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-574468859-project Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 could not be found. Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '319c0a04-0a7e-4ea4-863c-98b5e42dbda1'} Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 could not be found. Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 could not be found. Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.164338 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:04.168965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:04.168965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:04.168965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:04.168965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:04.168965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 could not be found. Oct 27 10:21:04.168965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.168965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Returning 404 to user: Instance 319c0a04-0a7e-4ea4-863c-98b5e42dbda1 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:04.168965 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38398215-2ca2-4a99-b5d6-f9d9c1a8f4e3 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1" status: 404 len: 111 microversion: 2.1 time: 0.095621 Oct 27 10:21:04.168965 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1477/3122] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:04 2022] GET /compute/v2.1/servers/319c0a04-0a7e-4ea4-863c-98b5e42dbda1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:04.176236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e9493ef1-f06a-4831-8095-349b869157b7 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] Calling method '.version_select at 0x7f6d5a84e0d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:04.233164 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e9493ef1-f06a-4831-8095-349b869157b7 tempest-ServersTestJSON-574468859 tempest-ServersTestJSON-574468859-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454771087" status: 202 len: 0 microversion: 2.1 time: 0.061392 Oct 27 10:21:04.237184 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1478/3123] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:21:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454771087 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:21:04.242525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:04.243153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:04.259882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.260633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.261202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.262111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.262564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.262992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.277715 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] HTTP exception thrown: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Request method failure captured: Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 HTTP/1.1 Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltqK-aBtvYDjSlO9UB1H_uGfRUagpne7w_ESaFetJZcGmHPuIElE4jvVD9pt7ElCW3r_QNgZfLH-V8mwVAFd8n0Zrf33lgxzaQU22RJ9FZR_s0XyxqdD0FmZhGuHpVFNliL5JK73b-56gqbXD9GjLE0_S2Q11Uoo9756Er70AlAK6s Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0283c3133c5a48608dc8931bdd6c358e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 984b329c5a934064bd776ebbf78f4f9e Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'cf815fce-6464-4560-8e2a-5ffe7f41ee88'} Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.279293 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Returning 404 to user: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:04.286339 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-535fcee3-f17a-4131-bfa2-8453ac9039de tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 404 len: 111 microversion: 2.1 time: 0.042481 Oct 27 10:21:04.291742 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1479/3124] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:04 2022] GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:04.296982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1487ea74-2246-4141-97d5-ddaf7cb59126 req-d0323533-b2ed-48b1-a312-3694b5186d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf815fce-6464-4560-8e2a-5ffe7f41ee88", "name": "network-vif-deleted", "tag": "1c25cb2d-aaf6-4cc4-a07c-788de23377c5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:04.308466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1487ea74-2246-4141-97d5-ddaf7cb59126 req-d0323533-b2ed-48b1-a312-3694b5186d55 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.309230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1487ea74-2246-4141-97d5-ddaf7cb59126 req-d0323533-b2ed-48b1-a312-3694b5186d55 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.309813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1487ea74-2246-4141-97d5-ddaf7cb59126 req-d0323533-b2ed-48b1-a312-3694b5186d55 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.325507 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1487ea74-2246-4141-97d5-ddaf7cb59126 req-d0323533-b2ed-48b1-a312-3694b5186d55 service nova] Creating event network-vif-deleted:1c25cb2d-aaf6-4cc4-a07c-788de23377c5 for instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 on n-h1-854663-10 Oct 27 10:21:04.331447 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1487ea74-2246-4141-97d5-ddaf7cb59126 req-d0323533-b2ed-48b1-a312-3694b5186d55 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038146 Oct 27 10:21:04.332643 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1480/3125] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:04.340426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:04.346003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:04.347173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '0283c3133c5a48608dc8931bdd6c358e'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:21:04.353996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.355023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.355681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.356616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.357274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.357884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.441689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:04.459824 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5b631e7-bf9c-4957-be98-661ab322c49a tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.125295 Oct 27 10:21:04.470057 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1481/3126] 10.222.0.76 () {58 vars in 1230 bytes} [Thu Oct 27 10:21:04 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:21:04.476225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:04.477001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:04.483812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.484567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.485179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.486041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.486647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.487249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.757159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:04.766369 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0dc4094-a1df-469e-bad0-5e85afdd36fe tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1328 microversion: 2.1 time: 0.295054 Oct 27 10:21:04.766943 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1482/3127] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:04 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:04.771821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2012fbc-5d97-46d1-8fd0-922fdec03d56 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2012fbc-5d97-46d1-8fd0-922fdec03d56 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Request method failure captured: Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltqK-aBtvYDjSlO9UB1H_uGfRUagpne7w_ESaFetJZcGmHPuIElE4jvVD9pt7ElCW3r_QNgZfLH-V8mwVAFd8n0Zrf33lgxzaQU22RJ9FZR_s0XyxqdD0FmZhGuHpVFNliL5JK73b-56gqbXD9GjLE0_S2Q11Uoo9756Er70AlAK6s Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0283c3133c5a48608dc8931bdd6c358e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 984b329c5a934064bd776ebbf78f4f9e Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: action_args: {} Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 10:21:04.776032 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 10:21:04.781802 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:04.783875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2012fbc-5d97-46d1-8fd0-922fdec03d56 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:04.784900 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b2012fbc-5d97-46d1-8fd0-922fdec03d56 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016707 Oct 27 10:21:04.785616 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1483/3128] 10.222.0.76 () {58 vars in 1182 bytes} [Thu Oct 27 10:21:04 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:21:04.794568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7d9207e-71a9-46c9-b3d8-9aefb2600562 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5ac1db80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:04.850790 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7d9207e-71a9-46c9-b3d8-9aefb2600562 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.059897 Oct 27 10:21:04.852090 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1484/3129] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:04 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:04.861219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:04.861857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:04.868990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.869742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.870616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.871840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.872329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.872793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.891255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:21:04.892529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:21:04.893235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:21:04.893851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:21:04.894570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:21:04.918273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.919300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.919937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.920883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:04.921700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:04.922810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:04.960749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:21:04.968500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for user 83da5c7956454b278e9f9d6641a01711 and project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:21:04.985481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:21:04.987809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:21:05.051234 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b66ac1f-a212-4730-87cc-cee3ed62ed01 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042069 Oct 27 10:21:05.052385 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1646/3130] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:21:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:21:05.059155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4e62c074-ce3e-4070-b173-bd69ea35314a req-bb0f895d-1d48-4539-b0d5-69d6a57a3945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba664ff-9f3e-44a7-9921-fd60d7bb22c4", "name": "network-vif-plugged", "status": "completed", "tag": "5dca42bf-caa2-4034-97eb-d52bb510e74a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:05.062572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:05.074683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4e62c074-ce3e-4070-b173-bd69ea35314a req-bb0f895d-1d48-4539-b0d5-69d6a57a3945 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.075547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4e62c074-ce3e-4070-b173-bd69ea35314a req-bb0f895d-1d48-4539-b0d5-69d6a57a3945 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.076593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4e62c074-ce3e-4070-b173-bd69ea35314a req-bb0f895d-1d48-4539-b0d5-69d6a57a3945 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.078777 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e61a2cc6-8edb-476d-aeb3-61dc098d213d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.225283 Oct 27 10:21:05.079300 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1485/3131] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:04 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:05.097596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.110167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:05.114515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Searching by: {'deleted': False, 'project_id': '0283c3133c5a48608dc8931bdd6c358e'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:21:05.122825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.123427 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4e62c074-ce3e-4070-b173-bd69ea35314a req-bb0f895d-1d48-4539-b0d5-69d6a57a3945 service nova] Creating event network-vif-plugged:5dca42bf-caa2-4034-97eb-d52bb510e74a for instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 on n-h2-854663-10 Oct 27 10:21:05.124086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.125030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.126104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.126884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.127454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.130784 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4e62c074-ce3e-4070-b173-bd69ea35314a req-bb0f895d-1d48-4539-b0d5-69d6a57a3945 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076373 Oct 27 10:21:05.132172 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1647/3132] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:05.139189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.139906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:05.147366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.148085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.150426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.151953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.152604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.153260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.196365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:21:05.237185 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4910540d-4eff-4017-9f18-d1410e198867 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.153239 Oct 27 10:21:05.238249 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1486/3133] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers => generated 681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:05.243443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b3250825-bf22-40a5-b007-28b0f5321785 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.244088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b3250825-bf22-40a5-b007-28b0f5321785 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:05.343836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b3250825-bf22-40a5-b007-28b0f5321785 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:05.356920 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b3250825-bf22-40a5-b007-28b0f5321785 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1215 microversion: 2.1 time: 0.117002 Oct 27 10:21:05.368944 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1487/3134] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:05.368944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.380897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:05.381563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.compute.servers [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Removing options 'limit' from query {{(pid=120719) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 10:21:05.382808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Searching by: {'deleted': False, 'project_id': '0283c3133c5a48608dc8931bdd6c358e'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:21:05.389963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.390682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.391475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.393527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.394159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.394777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.424508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:05.428952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:21:05.436028 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e27964d-ab22-4a89-8ad6-d40b679198ed tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1523 microversion: 2.1 time: 0.302400 Oct 27 10:21:05.450659 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1648/3135] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:05.472898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.474954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:05.477967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-473ef616-b82d-47f5-a88c-7b90ca19b9e6 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.119408 Oct 27 10:21:05.478553 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1488/3136] 10.222.0.76 () {58 vars in 1144 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:05.484550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.485217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.485874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.486668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.487197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.487692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.494159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e91a33fb-2121-42d5-9df0-7c390a5d0565 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e91a33fb-2121-42d5-9df0-7c390a5d0565 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Request method failure captured: Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltqK-aBtvYDjSlO9UB1H_uGfRUagpne7w_ESaFetJZcGmHPuIElE4jvVD9pt7ElCW3r_QNgZfLH-V8mwVAFd8n0Zrf33lgxzaQU22RJ9FZR_s0XyxqdD0FmZhGuHpVFNliL5JK73b-56gqbXD9GjLE0_S2Q11Uoo9756Er70AlAK6s Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0283c3133c5a48608dc8931bdd6c358e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 984b329c5a934064bd776ebbf78f4f9e Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: action_args: {} Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '-1' Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 10:21:05.501969 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e91a33fb-2121-42d5-9df0-7c390a5d0565 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e91a33fb-2121-42d5-9df0-7c390a5d0565 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.014827 Oct 27 10:21:05.507854 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1489/3137] 10.222.0.76 () {58 vars in 1142 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:21:05.514604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f8e3da0d-6062-4667-978b-49982f180920 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f8e3da0d-6062-4667-978b-49982f180920 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Request method failure captured: Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltqK-aBtvYDjSlO9UB1H_uGfRUagpne7w_ESaFetJZcGmHPuIElE4jvVD9pt7ElCW3r_QNgZfLH-V8mwVAFd8n0Zrf33lgxzaQU22RJ9FZR_s0XyxqdD0FmZhGuHpVFNliL5JK73b-56gqbXD9GjLE0_S2Q11Uoo9756Er70AlAK6s Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0283c3133c5a48608dc8931bdd6c358e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 984b329c5a934064bd776ebbf78f4f9e Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: action_args: {} Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'testing' Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 10:21:05.526651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f8e3da0d-6062-4667-978b-49982f180920 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f8e3da0d-6062-4667-978b-49982f180920 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.018480 Oct 27 10:21:05.531645 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1490/3138] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:21:05.539418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7cda11b3-c06f-4c40-b432-0d5000c38d06 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.545161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7cda11b3-c06f-4c40-b432-0d5000c38d06 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:05.545841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7cda11b3-c06f-4c40-b432-0d5000c38d06 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '0283c3133c5a48608dc8931bdd6c358e'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:21:05.550780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:05.553715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.compute.servers [None req-7cda11b3-c06f-4c40-b432-0d5000c38d06 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Flavor 'non_existing_flavor' could not be found {{(pid=120719) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 27 10:21:05.554991 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7cda11b3-c06f-4c40-b432-0d5000c38d06 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.020366 Oct 27 10:21:05.556132 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1491/3139] 10.222.0.76 () {58 vars in 1178 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:21:05.569932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.575860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:05.576860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '0283c3133c5a48608dc8931bdd6c358e'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:21:05.586368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.586982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.587644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.589480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.591267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.591980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.705224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65edf281-2628-492a-94d4-e9232febf046 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.140216 Oct 27 10:21:05.706403 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1492/3140] 10.222.0.76 () {58 vars in 1174 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:21:05.719940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.725388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:05.726061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '0283c3133c5a48608dc8931bdd6c358e'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:21:05.731968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.732709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.733289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.734178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.734782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.735368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.745668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:05.748472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:05.757799 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b18c8d9-7ed2-4914-911e-c2859e1b6e0b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1523 microversion: 2.1 time: 0.295910 Oct 27 10:21:05.770414 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1649/3141] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:05.800821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74679a13-b45d-4cbf-9cdb-8e6e490a86a3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1016229464"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:05.803967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74679a13-b45d-4cbf-9cdb-8e6e490a86a3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:05.825494 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dda7f62f-d0fe-4170-9159-80f42dbc1e48 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.109267 Oct 27 10:21:05.834224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74679a13-b45d-4cbf-9cdb-8e6e490a86a3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.834830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74679a13-b45d-4cbf-9cdb-8e6e490a86a3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.835281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74679a13-b45d-4cbf-9cdb-8e6e490a86a3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.836011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74679a13-b45d-4cbf-9cdb-8e6e490a86a3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.838761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1493/3142] 10.222.0.76 () {58 vars in 1184 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 10:21:05.839722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74679a13-b45d-4cbf-9cdb-8e6e490a86a3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.841372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74679a13-b45d-4cbf-9cdb-8e6e490a86a3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.847388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:05.848196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:05.863307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.864052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.864718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:05.865586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:05.866189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:05.866783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:06.205971 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74679a13-b45d-4cbf-9cdb-8e6e490a86a3 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.425544 Oct 27 10:21:06.207718 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1650/3143] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:21:05 2022] POST /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 27 10:21:06.218396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:06.225362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:06.227194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Searching by: {'deleted': False, 'project_id': '0283c3133c5a48608dc8931bdd6c358e'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:21:06.234946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:06.236155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:06.237001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:06.238084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:06.239256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:06.240793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:06.304324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:21:06.341167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:06.353775 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-251437f7-6be6-4024-969f-265aa0693b5e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1328 microversion: 2.1 time: 0.509835 Oct 27 10:21:06.369298 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1494/3144] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:05 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1328 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:06.380927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff2bb75c-6634-4c67-97d0-47c8f7f53bd4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b2eb550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:06.401332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:06.429475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:06.439006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:06.439485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:06.456869 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff2bb75c-6634-4c67-97d0-47c8f7f53bd4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.084373 Oct 27 10:21:06.458025 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1495/3145] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:06 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:06.463283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:06.464164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:06.471565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:06.472696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:06.473583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:06.474705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:06.475434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:06.476384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:06.764084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:06.778244 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-08fdc090-e131-4fa5-becc-7ca9f7f2498f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.318830 Oct 27 10:21:06.778996 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1496/3146] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:06 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:06.792231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b65cff1d-33fd-4941-baaf-60c246a3e242 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '.version_select at 0x7f6d5a911280>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:06.834230 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2375f69-ef6e-43af-8b0f-fa49852fa92b tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.625052 Oct 27 10:21:06.835500 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1651/3147] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:21:06 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:06.849522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:06.850898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:06.860880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:06.861761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:06.862421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:06.864392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:06.871567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:06.872298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:07.132175 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b65cff1d-33fd-4941-baaf-60c246a3e242 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/images/4c592a3c-8fc2-44f9-9fb7-293868e9d9d5" status: 204 len: 0 microversion: 2.1 time: 0.349387 Oct 27 10:21:07.133208 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1497/3148] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:06 2022] DELETE /compute/v2.1/images/4c592a3c-8fc2-44f9-9fb7-293868e9d9d5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:21:07.147100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-985ce4c0-ee66-47a9-abdb-b13b69cc38c9 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:07.161745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-985ce4c0-ee66-47a9-abdb-b13b69cc38c9 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:07.166641 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-985ce4c0-ee66-47a9-abdb-b13b69cc38c9 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.030697 Oct 27 10:21:07.169598 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1498/3149] 10.222.0.76 () {58 vars in 1178 bytes} [Thu Oct 27 10:21:07 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:21:07.183733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c5fd34e4-fec1-491a-aaed-6d1c5d699e16 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '.version_select at 0x7f6d6373e940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:07.243815 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c5fd34e4-fec1-491a-aaed-6d1c5d699e16 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Image not found. Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c5fd34e4-fec1-491a-aaed-6d1c5d699e16 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/images/4c592a3c-8fc2-44f9-9fb7-293868e9d9d5 HTTP/1.1 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '4c592a3c-8fc2-44f9-9fb7-293868e9d9d5'} Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4c592a3c-8fc2-44f9-9fb7-293868e9d9d5 Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:21:07.246245 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4c592a3c-8fc2-44f9-9fb7-293868e9d9d5 could not be found. Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:21:07.251171 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:07.256193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c5fd34e4-fec1-491a-aaed-6d1c5d699e16 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:07.257262 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c5fd34e4-fec1-491a-aaed-6d1c5d699e16 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/images/4c592a3c-8fc2-44f9-9fb7-293868e9d9d5" status: 404 len: 62 microversion: 2.1 time: 0.086163 Oct 27 10:21:07.258407 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1499/3150] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:07 2022] GET /compute/v2.1/images/4c592a3c-8fc2-44f9-9fb7-293868e9d9d5 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:21:07.273816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:07.284991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:07.289407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Searching by: {'deleted': False, 'project_id': '0283c3133c5a48608dc8931bdd6c358e'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:21:07.309293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:07.310540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:07.314345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:07.315691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:07.316409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:07.319349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:07.386890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:21:07.446620 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4aa51c1-6081-44f7-99ed-b849139666e0 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.185838 Oct 27 10:21:07.450745 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1500/3151] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:21:07 2022] GET /compute/v2.1/servers => generated 681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:07.473215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:07.474227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:07.490439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:07.491746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:07.494043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:07.495349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:07.497752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:07.498439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:07.880488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:07.889818 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9b694516-9a4e-4979-ba74-6598fd2ef90d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1275 microversion: 2.1 time: 1.052892 Oct 27 10:21:07.898130 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1652/3152] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:06 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1275 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:07.917727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:07.918736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:07.929247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:07.932164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:07.937511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:07.938686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:07.945035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:07.947056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.118495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:08.130902 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7d7858b-05d4-4834-a7c0-7eed0875cee2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1535 microversion: 2.1 time: 0.668877 Oct 27 10:21:08.136897 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1501/3153] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:07 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1535 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:08.151520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:08.151987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:08.164948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.165453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.165915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.166980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.167441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.167873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.205281 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] HTTP exception thrown: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Request method failure captured: Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 HTTP/1.1 Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltqK-aBtvYDjSlO9UB1H_uGfRUagpne7w_ESaFetJZcGmHPuIElE4jvVD9pt7ElCW3r_QNgZfLH-V8mwVAFd8n0Zrf33lgxzaQU22RJ9FZR_s0XyxqdD0FmZhGuHpVFNliL5JK73b-56gqbXD9GjLE0_S2Q11Uoo9756Er70AlAK6s Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0283c3133c5a48608dc8931bdd6c358e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 984b329c5a934064bd776ebbf78f4f9e Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'cf815fce-6464-4560-8e2a-5ffe7f41ee88'} Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:08.206910 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Returning 404 to user: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:08.214365 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bd9da3c9-e2ba-4a52-8168-2f0a01579ab3 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 404 len: 111 microversion: 2.1 time: 0.070426 Oct 27 10:21:08.222061 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1502/3154] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:21:08 2022] DELETE /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:08.237772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eec3f60e-b5cf-4c75-9617-d0b292317b22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d6373eaf0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:08.336300 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eec3f60e-b5cf-4c75-9617-d0b292317b22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.112683 Oct 27 10:21:08.340809 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1503/3155] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:08 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:08.353190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:08.354784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:08.362707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.363353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.364496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.365460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.366106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.366684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.494714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:08.504960 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df9b8c1b-3a3f-4372-b72c-14e0ca1f2e97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1508 microversion: 2.1 time: 0.604725 Oct 27 10:21:08.506459 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1653/3156] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:07 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1508 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:08.512544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:08.513427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: b68520bf-600b-4e05-b466-118a72c8c30a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:08.521274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.522124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.522786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.523723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.524460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.525137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.570829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: b68520bf-600b-4e05-b466-118a72c8c30a] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:21:08.800975 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fab1f40f-480a-4722-8dcc-ec3d40512f7c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a" status: 204 len: 0 microversion: 2.1 time: 0.290826 Oct 27 10:21:08.802719 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1654/3157] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:21:08 2022] DELETE /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:21:08.810342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:08.811540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:08.818604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.819648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.820622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.821652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.822414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.823506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.881506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:08.900192 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8881dc5b-782f-44bf-a137-97ba225ee3ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1501 microversion: 2.1 time: 0.555549 Oct 27 10:21:08.903885 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1504/3158] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:08 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1501 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:08.934102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:08.935849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:08.953534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.954393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.956832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:08.957891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:08.958472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:08.959178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.005357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:21:09.213146 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d6165c8-fa28-44ab-9697-7b73e9c29b67 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "DELETE /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 204 len: 0 microversion: 2.1 time: 0.306593 Oct 27 10:21:09.214735 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1505/3159] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:21:08 2022] DELETE /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:21:09.220619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:09.223715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:09.234028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.234930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.235654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.236729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.237439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.238195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.370251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:09.385607 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39b15019-fb4d-4a88-85b7-f84558e763d6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1508 microversion: 2.1 time: 0.577308 Oct 27 10:21:09.386348 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1655/3160] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:08 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1508 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:09.400626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81470f95-814a-4d47-bf72-b21f839c4ef3"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:09.407174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:09.418608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:09.424038 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ffb22312-a1e8-45c4-bd9c-0b4526f84010 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1273 microversion: 2.1 time: 0.204439 Oct 27 10:21:09.424945 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1506/3161] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:09 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:09.444384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.449029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:09.449258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.449811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:09.450670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.453930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.455835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.456490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.459662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.460161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.460602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.461366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.461822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.462244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.498209 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] HTTP exception thrown: Cannot 'attach_volume' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state rescued Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Request method failure captured: Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/os-volume_attachments HTTP/1.1 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 74 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsu-3_w5LGZIvZif4TTAP6HRONgNGme2C9gImyb4W0g9Upsi7Y2bHorvYIAfIK1OJaF4pOA8nmy8Y4T0BPo3Z6b72CJIADNwIlaiQrBL1QEHegWtPyuQbLI5lnUkUsZwbu1MPjFEe-CeaqflWsbqJ87tWOxBka5KpPfYl0fSmtf6VA Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9067a31bfee345fca080e7621aa60015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9067a31bfee345fca080e7621aa60015", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5fc08f1ad238424896dcefb0fa0b20c5 Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: {"volumeAttachment": {"volumeId": "81470f95-814a-4d47-bf72-b21f839c4ef3"}} Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: exception: Cannot 'attach_volume' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state rescued Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': 'f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac', 'body': {'volumeAttachment': {'volumeId': '81470f95-814a-4d47-bf72-b21f839c4ef3'}}} Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 27 10:21:09.500258 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state rescued Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state rescued Oct 27 10:21:09.504950 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.507906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Returning 409 to user: Cannot 'attach_volume' instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac while it is in vm_state rescued {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:09.509050 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd69d460-a693-4113-86bd-fb329775f3ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.121660 Oct 27 10:21:09.509831 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1656/3162] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:21:09 2022] POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/os-volume_attachments => generated 152 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:21:09.517010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:09.517880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: cf815fce-6464-4560-8e2a-5ffe7f41ee88] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:09.528145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.528887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.529486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.530342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.530949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.531514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.553637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] HTTP exception thrown: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Request method failure captured: Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 HTTP/1.1 Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltqK-aBtvYDjSlO9UB1H_uGfRUagpne7w_ESaFetJZcGmHPuIElE4jvVD9pt7ElCW3r_QNgZfLH-V8mwVAFd8n0Zrf33lgxzaQU22RJ9FZR_s0XyxqdD0FmZhGuHpVFNliL5JK73b-56gqbXD9GjLE0_S2Q11Uoo9756Er70AlAK6s Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0283c3133c5a48608dc8931bdd6c358e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 984b329c5a934064bd776ebbf78f4f9e Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'cf815fce-6464-4560-8e2a-5ffe7f41ee88'} Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.555206 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:09.560610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.560610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:09.560610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:09.560610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:09.560610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:09.560610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:09.560610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. Oct 27 10:21:09.560610 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:09.562802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Returning 404 to user: Instance cf815fce-6464-4560-8e2a-5ffe7f41ee88 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:09.563845 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19a8deb2-aad8-4467-8a4a-2f1fb6221699 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88" status: 404 len: 111 microversion: 2.1 time: 0.052898 Oct 27 10:21:09.567677 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1657/3163] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:09 2022] GET /compute/v2.1/servers/cf815fce-6464-4560-8e2a-5ffe7f41ee88 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:09.573574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02ca1d03-9c3b-4230-9067-d904facc31bf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d637cf280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:09.654059 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02ca1d03-9c3b-4230-9067-d904facc31bf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.084973 Oct 27 10:21:09.655779 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1658/3164] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:09 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:09.668136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:09.671307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:09.679589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.680327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.681041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.681991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.682930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.683387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.720235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:21:09.897863 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d555877-7478-429d-818b-9ecd1bb4b562 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 204 len: 0 microversion: 2.1 time: 0.237346 Oct 27 10:21:09.903515 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1659/3165] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:21:09 2022] DELETE /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:21:09.915376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66eeed2e-5555-463f-baae-e66d67ff5638 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:09.916237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66eeed2e-5555-463f-baae-e66d67ff5638 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:09.936295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66eeed2e-5555-463f-baae-e66d67ff5638 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.942874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66eeed2e-5555-463f-baae-e66d67ff5638 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.949291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66eeed2e-5555-463f-baae-e66d67ff5638 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:09.951017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66eeed2e-5555-463f-baae-e66d67ff5638 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:09.951683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66eeed2e-5555-463f-baae-e66d67ff5638 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:09.952440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66eeed2e-5555-463f-baae-e66d67ff5638 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:10.164400 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66eeed2e-5555-463f-baae-e66d67ff5638 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action" status: 202 len: 0 microversion: 2.1 time: 0.257074 Oct 27 10:21:10.166135 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1660/3166] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:21:09 2022] POST /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:21:10.176097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:10.177522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: b68520bf-600b-4e05-b466-118a72c8c30a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:10.189227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:10.190154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:10.190809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:10.191926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:10.192605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:10.193364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:10.814457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:10.830308 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea72f7e6-6b12-4652-befd-d3e0e9e5ac8c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1541 microversion: 2.1 time: 1.402874 Oct 27 10:21:10.831036 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1507/3167] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:09 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1541 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:10.841244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:10.841951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:10.867823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:10.873001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:10.874250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:10.875138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:10.876061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:10.876806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:11.184619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:11.200295 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1877156e-9a34-4ce2-b882-36347828ee4c tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a" status: 200 len: 1520 microversion: 2.1 time: 1.030589 Oct 27 10:21:11.201893 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1661/3168] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:10 2022] GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a => generated 1520 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:11.217631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:11.218402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:11.236594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:11.237430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:11.237538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:11.238257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:11.238711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:11.239453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:11.296937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:12.320789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:12.324773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:12.331969 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d54cab8-ab53-494c-8b5e-93fbd5e0b874 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1514 microversion: 2.1 time: 1.499584 Oct 27 10:21:12.338094 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1508/3169] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:10 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1514 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:12.347076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:12.368539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:12.420341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:12.420871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:12.421317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:12.422045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:12.422508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:12.449309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:12.883921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:12.900209 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6fa0f41c-567d-4b93-b825-d292714efcd4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1509 microversion: 2.1 time: 1.696030 Oct 27 10:21:12.932148 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1662/3170] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:11 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1509 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:12.943244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eef8cc2d-73c4-48a5-8abf-c71ea0e92efc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b753700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:13.043010 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eef8cc2d-73c4-48a5-8abf-c71ea0e92efc tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.108711 Oct 27 10:21:13.055868 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1663/3171] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:12 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:13.085689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4dc77e34-a288-46bd-9d95-c2726d2f70c6 req-403efdce-0143-46c6-9677-78e80b9bf6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199e563d-e099-4187-96ea-cc1dc2694fd2", "name": "network-vif-plugged", "status": "completed", "tag": "c17850c1-9ad6-49e6-8b2f-f5ffad635134"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:13.132932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4dc77e34-a288-46bd-9d95-c2726d2f70c6 req-403efdce-0143-46c6-9677-78e80b9bf6ec service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:13.135725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4dc77e34-a288-46bd-9d95-c2726d2f70c6 req-403efdce-0143-46c6-9677-78e80b9bf6ec service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:13.140388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4dc77e34-a288-46bd-9d95-c2726d2f70c6 req-403efdce-0143-46c6-9677-78e80b9bf6ec service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:13.200709 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4dc77e34-a288-46bd-9d95-c2726d2f70c6 req-403efdce-0143-46c6-9677-78e80b9bf6ec service nova] Creating event network-vif-plugged:c17850c1-9ad6-49e6-8b2f-f5ffad635134 for instance 199e563d-e099-4187-96ea-cc1dc2694fd2 on n-h1-854663-10 Oct 27 10:21:13.216406 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4dc77e34-a288-46bd-9d95-c2726d2f70c6 req-403efdce-0143-46c6-9677-78e80b9bf6ec service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158841 Oct 27 10:21:13.219565 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1664/3172] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:13.232392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-66380783-2530-4c0f-b8a9-b129ec2d61b5 req-43dad2be-2e80-4932-aa0b-b1568acf5770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e5dcc4-e23c-4615-bdd2-db58762537a4", "name": "network-vif-deleted", "tag": "bf9da344-b190-40e9-914a-e2a39f009d02"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:13.274936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-66380783-2530-4c0f-b8a9-b129ec2d61b5 req-43dad2be-2e80-4932-aa0b-b1568acf5770 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:13.276254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-66380783-2530-4c0f-b8a9-b129ec2d61b5 req-43dad2be-2e80-4932-aa0b-b1568acf5770 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:13.279653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-66380783-2530-4c0f-b8a9-b129ec2d61b5 req-43dad2be-2e80-4932-aa0b-b1568acf5770 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:13.303585 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-66380783-2530-4c0f-b8a9-b129ec2d61b5 req-43dad2be-2e80-4932-aa0b-b1568acf5770 service nova] Creating event network-vif-deleted:bf9da344-b190-40e9-914a-e2a39f009d02 for instance 15e5dcc4-e23c-4615-bdd2-db58762537a4 on n-h1-854663-10 Oct 27 10:21:13.316190 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-66380783-2530-4c0f-b8a9-b129ec2d61b5 req-43dad2be-2e80-4932-aa0b-b1568acf5770 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094940 Oct 27 10:21:13.328676 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1665/3173] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:13.349100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:13.354034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:13.384244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:13.385288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:13.388419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:13.391386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:13.392314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:13.405636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:14.244607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:14.253761 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e456421e-8150-4c44-8378-dd934fe7f408 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1315 microversion: 2.1 time: 1.912195 Oct 27 10:21:14.259413 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1509/3174] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:12 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1315 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:14.279865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:14.282525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: b68520bf-600b-4e05-b466-118a72c8c30a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:14.310480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:14.314031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:14.317050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:14.319606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:14.322380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:14.325199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:14.460369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:14.460910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:14.461360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:14.461809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lazy-loading 'fault' on Instance uuid b68520bf-600b-4e05-b466-118a72c8c30a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:21:14.651219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984b329c5a934064bd776ebbf78f4f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0283c3133c5a48608dc8931bdd6c358e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:14.660817 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52116623-c167-48aa-a47d-eab1e7f17547 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a" status: 200 len: 1312 microversion: 2.1 time: 0.399786 Oct 27 10:21:14.667164 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1510/3175] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:14 2022] GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a => generated 1312 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:14.677826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:14.678458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:14.718069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:14.718876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:14.720415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:14.721210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:14.732411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:14.733160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:14.780183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:14.787757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:14.788496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:14.789160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lazy-loading 'fault' on Instance uuid 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:21:15.052681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:15.053532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:15.069725 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac9c6357-5cd8-475e-a2b7-d6622432df7b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1523 microversion: 2.1 time: 1.739154 Oct 27 10:21:15.089011 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-687982d8-37ce-4dee-a847-c86cc6ddc38a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 200 len: 1318 microversion: 2.1 time: 0.409853 Oct 27 10:21:15.091391 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1666/3176] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:13 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1523 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:15.094521 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1511/3177] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:14 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:15.098230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:15.100008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:15.108545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c85b0e87-30da-4dce-a684-b79a00174887 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a85e0d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:15.114168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:15.115366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:15.116155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:15.117737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:15.118635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:15.119526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:15.221788 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c85b0e87-30da-4dce-a684-b79a00174887 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.126387 Oct 27 10:21:15.222473 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1512/3178] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:15 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:15.227018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:15.227519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:15.248140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:15.248849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:15.249095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:15.250095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:15.250618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:15.251122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:15.288753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:21:15.355323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:15.399694 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9187918c-c343-4870-81c4-008711e8a199 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 204 len: 0 microversion: 2.1 time: 0.174802 Oct 27 10:21:15.400649 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1513/3179] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:21:15 2022] DELETE /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:21:15.408816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:15.410305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:15.419264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:15.420070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:15.420955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:15.422126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:15.423875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:15.424573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:15.800353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:15.812525 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a761c86-e409-4005-832a-097fa8f597d6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1509 microversion: 2.1 time: 0.719543 Oct 27 10:21:15.814859 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1667/3180] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:15 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1509 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:15.820635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-23de9e82-8ddc-46a5-abfc-0e53e1a9d53f req-047b19ec-30e1-43ad-8570-f9dfd0375f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68520bf-600b-4e05-b466-118a72c8c30a", "name": "network-vif-deleted", "tag": "c829aa4b-4639-4ea5-ba84-7b155c16ad79"}, {"server_uuid": "1ba664ff-9f3e-44a7-9921-fd60d7bb22c4", "name": "network-vif-deleted", "tag": "5dca42bf-caa2-4034-97eb-d52bb510e74a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:15.834527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-23de9e82-8ddc-46a5-abfc-0e53e1a9d53f req-047b19ec-30e1-43ad-8570-f9dfd0375f01 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:15.835234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-23de9e82-8ddc-46a5-abfc-0e53e1a9d53f req-047b19ec-30e1-43ad-8570-f9dfd0375f01 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:15.836259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-23de9e82-8ddc-46a5-abfc-0e53e1a9d53f req-047b19ec-30e1-43ad-8570-f9dfd0375f01 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:15.860431 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-23de9e82-8ddc-46a5-abfc-0e53e1a9d53f req-047b19ec-30e1-43ad-8570-f9dfd0375f01 service nova] Creating event network-vif-deleted:c829aa4b-4639-4ea5-ba84-7b155c16ad79 for instance b68520bf-600b-4e05-b466-118a72c8c30a on n-h2-854663-10 Oct 27 10:21:15.861200 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-23de9e82-8ddc-46a5-abfc-0e53e1a9d53f req-047b19ec-30e1-43ad-8570-f9dfd0375f01 service nova] Creating event network-vif-deleted:5dca42bf-caa2-4034-97eb-d52bb510e74a for instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 on n-h2-854663-10 Oct 27 10:21:15.869370 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-23de9e82-8ddc-46a5-abfc-0e53e1a9d53f req-047b19ec-30e1-43ad-8570-f9dfd0375f01 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052916 Oct 27 10:21:15.871046 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1668/3181] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:15.878604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:15.879211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:15.886464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:15.886977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:15.887526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:15.888640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:15.889290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:15.889924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:15.994693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:16.002964 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-26b9874d-8e45-4396-b068-1ae53b1df932 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1315 microversion: 2.1 time: 0.600718 Oct 27 10:21:16.003782 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1514/3182] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:15 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:16.008493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-848c6c02-74bb-4dd5-afa4-ae74b9b6498a req-97b68aee-d430-4e64-8186-f93bc8595a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66526d64-5921-4273-a259-32f11a2fe5ec", "name": "network-vif-plugged", "status": "completed", "tag": "df8c6df5-ea64-4833-8236-d8e7d654a3dc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:16.019511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-848c6c02-74bb-4dd5-afa4-ae74b9b6498a req-97b68aee-d430-4e64-8186-f93bc8595a5d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.020293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-848c6c02-74bb-4dd5-afa4-ae74b9b6498a req-97b68aee-d430-4e64-8186-f93bc8595a5d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.020915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-848c6c02-74bb-4dd5-afa4-ae74b9b6498a req-97b68aee-d430-4e64-8186-f93bc8595a5d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:16.034392 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-848c6c02-74bb-4dd5-afa4-ae74b9b6498a req-97b68aee-d430-4e64-8186-f93bc8595a5d service nova] Creating event network-vif-plugged:df8c6df5-ea64-4833-8236-d8e7d654a3dc for instance 66526d64-5921-4273-a259-32f11a2fe5ec on n-h2-854663-10 Oct 27 10:21:16.039836 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-848c6c02-74bb-4dd5-afa4-ae74b9b6498a req-97b68aee-d430-4e64-8186-f93bc8595a5d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Oct 27 10:21:16.040758 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1515/3183] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:16.046263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:16.047164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: b68520bf-600b-4e05-b466-118a72c8c30a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:16.054240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.055011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.055597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:16.056461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.057144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.057749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:16.075098 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] HTTP exception thrown: Instance b68520bf-600b-4e05-b466-118a72c8c30a could not be found. Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Request method failure captured: Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a HTTP/1.1 Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltqK-aBtvYDjSlO9UB1H_uGfRUagpne7w_ESaFetJZcGmHPuIElE4jvVD9pt7ElCW3r_QNgZfLH-V8mwVAFd8n0Zrf33lgxzaQU22RJ9FZR_s0XyxqdD0FmZhGuHpVFNliL5JK73b-56gqbXD9GjLE0_S2Q11Uoo9756Er70AlAK6s Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0283c3133c5a48608dc8931bdd6c358e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 984b329c5a934064bd776ebbf78f4f9e Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance b68520bf-600b-4e05-b466-118a72c8c30a could not be found. Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'b68520bf-600b-4e05-b466-118a72c8c30a'} Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68520bf-600b-4e05-b466-118a72c8c30a could not be found. Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68520bf-600b-4e05-b466-118a72c8c30a could not be found. Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.078050 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68520bf-600b-4e05-b466-118a72c8c30a could not be found. Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Returning 404 to user: Instance b68520bf-600b-4e05-b466-118a72c8c30a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:16.082611 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4d67eb1-cac3-4c00-a6ad-c60ead599f02 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a" status: 404 len: 111 microversion: 2.1 time: 0.040231 Oct 27 10:21:16.085906 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1516/3184] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:16 2022] GET /compute/v2.1/servers/b68520bf-600b-4e05-b466-118a72c8c30a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:16.091104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:16.091931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] [instance: 15e5dcc4-e23c-4615-bdd2-db58762537a4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:16.099685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.100525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.101212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:16.102126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.102732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.103300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:16.124849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] HTTP exception thrown: Instance 15e5dcc4-e23c-4615-bdd2-db58762537a4 could not be found. Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Request method failure captured: Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 HTTP/1.1 Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltqK-aBtvYDjSlO9UB1H_uGfRUagpne7w_ESaFetJZcGmHPuIElE4jvVD9pt7ElCW3r_QNgZfLH-V8mwVAFd8n0Zrf33lgxzaQU22RJ9FZR_s0XyxqdD0FmZhGuHpVFNliL5JK73b-56gqbXD9GjLE0_S2Q11Uoo9756Er70AlAK6s Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0283c3133c5a48608dc8931bdd6c358e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0283c3133c5a48608dc8931bdd6c358e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0283c3133c5a48608dc8931bdd6c358e Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-925122450 Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 984b329c5a934064bd776ebbf78f4f9e Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ListServersNegativeTestJSON-925122450-project Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 15e5dcc4-e23c-4615-bdd2-db58762537a4 could not be found. Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '15e5dcc4-e23c-4615-bdd2-db58762537a4'} Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e5dcc4-e23c-4615-bdd2-db58762537a4 could not be found. Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e5dcc4-e23c-4615-bdd2-db58762537a4 could not be found. Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.126842 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:16.132601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.132601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:16.132601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:16.132601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:16.132601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:16.132601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:16.132601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e5dcc4-e23c-4615-bdd2-db58762537a4 could not be found. Oct 27 10:21:16.132601 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.137007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] Returning 404 to user: Instance 15e5dcc4-e23c-4615-bdd2-db58762537a4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:16.137007 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3106707-108d-43f5-b860-6732f391bf20 tempest-ListServersNegativeTestJSON-925122450 tempest-ListServersNegativeTestJSON-925122450-project] 10.222.0.76 "GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4" status: 404 len: 111 microversion: 2.1 time: 0.049412 Oct 27 10:21:16.143018 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1517/3185] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:16 2022] GET /compute/v2.1/servers/15e5dcc4-e23c-4615-bdd2-db58762537a4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:16.152399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:16.153419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:16.162886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.164070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.165461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:16.166380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.167097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.167873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:16.189179 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 HTTP/1.1 Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '1ba664ff-9f3e-44a7-9921-fd60d7bb22c4'} Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:16.191047 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.196851 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:16.196851 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:16.196851 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:16.196851 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:16.196851 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:16.196851 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:21:16.196851 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:16.200487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:16.202217 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e3e9eed3-b838-4379-abef-466f0c5f4035 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 404 len: 111 microversion: 2.1 time: 0.055106 Oct 27 10:21:16.204829 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1518/3186] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:16 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:16.221046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76e5424f-cbd9-4829-a781-eea755363cc8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '.version_select at 0x7f6d6373e1f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:16.250377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:16.272790 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76e5424f-cbd9-4829-a781-eea755363cc8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-key-609325859" status: 202 len: 0 microversion: 2.1 time: 0.062001 Oct 27 10:21:16.279685 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1519/3187] 10.222.0.76 () {58 vars in 1206 bytes} [Thu Oct 27 10:21:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-609325859 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:21:16.347886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bb985ed8-adae-4220-a00f-ff299ebf7708 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5ac1dd30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:16.402526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=30 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:16.439684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:16.474152 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bb985ed8-adae-4220-a00f-ff299ebf7708 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.193026 Oct 27 10:21:16.477591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2498bcac-e048-4c6e-8a3e-912fc30b331a tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1529 microversion: 2.1 time: 0.605090 Oct 27 10:21:16.478088 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1520/3188] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:16 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:16.482620 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1669/3189] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:15 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1529 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:16.496799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4eda85da-9d35-444a-ac4d-ba31c7ba4c54 req-b81a3109-e961-4f62-a7ec-02d08aa82b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c1dd7f-094e-451b-bbd1-0aceb7873a96", "tag": "9397bff6-e10d-4ce0-b94a-3f64f4b9f8d2"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:16.533466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4eda85da-9d35-444a-ac4d-ba31c7ba4c54 req-b81a3109-e961-4f62-a7ec-02d08aa82b04 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.534032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4eda85da-9d35-444a-ac4d-ba31c7ba4c54 req-b81a3109-e961-4f62-a7ec-02d08aa82b04 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.537080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4eda85da-9d35-444a-ac4d-ba31c7ba4c54 req-b81a3109-e961-4f62-a7ec-02d08aa82b04 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:16.562567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1436285130", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "bc393ace-9ca8-46ee-824d-0fc414351037"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:16.572677 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4eda85da-9d35-444a-ac4d-ba31c7ba4c54 req-b81a3109-e961-4f62-a7ec-02d08aa82b04 service nova] Creating event network-changed:9397bff6-e10d-4ce0-b94a-3f64f4b9f8d2 for instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 on n-h1-854663-10 Oct 27 10:21:16.584615 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4eda85da-9d35-444a-ac4d-ba31c7ba4c54 req-b81a3109-e961-4f62-a7ec-02d08aa82b04 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105503 Oct 27 10:21:16.588938 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1521/3190] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:16.681664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] validate_networks() for [('bc393ace-9ca8-46ee-824d-0fc414351037', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:21:16.840585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:16.841631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:16.860730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.863107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.863573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:16.864314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:16.865198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:16.867230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:17.350629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:18.137368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:18.147087 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a4dbc9d0-d543-4cd9-bed2-f397e7f5f2e6 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1509 microversion: 2.1 time: 1.312314 Oct 27 10:21:18.151201 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1522/3191] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:16 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1509 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:18.165185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:18.166230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:18.186918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:18.188026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:18.188692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:18.189652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:18.190307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:18.190951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:18.781735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:21:18.782250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:21:18.782614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:21:18.790164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:21:18.790938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:21:18.806076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:18.809091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:18.809749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:18.815080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:18.815847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:18.817894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:18.865598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:18.869127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:21:18.884017 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d131cb35-a14d-4882-8749-ea1dfc61ff08 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1315 microversion: 2.1 time: 0.731346 Oct 27 10:21:18.885160 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1523/3192] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:18 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:18.896518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-33c72464-0f4d-4b78-9121-e39b447e2286 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b2c7ee0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:18.912405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for user 6a80ce0f3a4242a9a061a311c4bb50ae and project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:21:18.931656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:21:18.935142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:21:19.008441 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6786456e-002d-434c-99b8-b6c1b4d52f12 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.451580 Oct 27 10:21:19.010304 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1670/3193] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:21:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:21:19.015385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:19.016469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:19.024144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:19.030931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:19.031749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:19.032764 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-33c72464-0f4d-4b78-9121-e39b447e2286 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.144896 Oct 27 10:21:19.033166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:19.033799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:19.034443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:19.036460 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1524/3194] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:18 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:19.054578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5dfd02ff-40d3-44e2-9045-e51f3556a0f3 req-efe4fc58-8542-4ded-a5fa-bbcebc1848b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66526d64-5921-4273-a259-32f11a2fe5ec", "name": "network-vif-unplugged", "status": "completed", "tag": "df8c6df5-ea64-4833-8236-d8e7d654a3dc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:19.085592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5dfd02ff-40d3-44e2-9045-e51f3556a0f3 req-efe4fc58-8542-4ded-a5fa-bbcebc1848b2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:19.086371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5dfd02ff-40d3-44e2-9045-e51f3556a0f3 req-efe4fc58-8542-4ded-a5fa-bbcebc1848b2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:19.087027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5dfd02ff-40d3-44e2-9045-e51f3556a0f3 req-efe4fc58-8542-4ded-a5fa-bbcebc1848b2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:19.109824 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5dfd02ff-40d3-44e2-9045-e51f3556a0f3 req-efe4fc58-8542-4ded-a5fa-bbcebc1848b2 service nova] Creating event network-vif-unplugged:df8c6df5-ea64-4833-8236-d8e7d654a3dc for instance 66526d64-5921-4273-a259-32f11a2fe5ec on n-h2-854663-10 Oct 27 10:21:19.133957 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5dfd02ff-40d3-44e2-9045-e51f3556a0f3 req-efe4fc58-8542-4ded-a5fa-bbcebc1848b2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094865 Oct 27 10:21:19.135232 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1525/3195] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:19.142857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d5be9b4a-44a3-4641-a568-7183da49a9ab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:19.144057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d5be9b4a-44a3-4641-a568-7183da49a9ab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:19.246038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5be9b4a-44a3-4641-a568-7183da49a9ab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:19.254639 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d5be9b4a-44a3-4641-a568-7183da49a9ab tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1209 microversion: 2.1 time: 0.117355 Oct 27 10:21:19.256524 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1526/3196] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:19 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:19.262467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:19.274999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:19.287582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:19.288527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:19.289267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:19.290553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:19.291250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:19.292239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:19.366773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:19.378459 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65220b2c-bf00-4403-8075-ccd976b6bd41 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1529 microversion: 2.1 time: 0.366813 Oct 27 10:21:19.387417 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1671/3197] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:19 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1529 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:19.738655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:19.752641 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c3c479df-f90d-4466-8c0c-dc627834533c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1515 microversion: 2.1 time: 0.494358 Oct 27 10:21:19.765947 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1527/3198] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:19 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1515 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:19.912736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:19.914077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:19.926070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:19.927806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:19.929413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:19.931006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:19.933998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:19.934555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:20.060842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ce060e8-e099-401a-b1e4-d70a259555cb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5ad67310>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:20.190951 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ce060e8-e099-401a-b1e4-d70a259555cb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.145096 Oct 27 10:21:20.193761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1528/3199] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:20 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:20.281496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:20.282122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:20.301522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:20.303162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:20.304140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:20.309084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:20.312115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:20.312990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:20.630258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:20.647254 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a717ac60-d56e-41ac-9bf5-bc4f2a4a0652 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1213 microversion: 2.1 time: 0.371477 Oct 27 10:21:20.664508 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1529/3200] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:20 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1213 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:21:20.665281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:20.682983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:20.697119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:20.697736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:20.698922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:20.699787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:20.701208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:20.703607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:20.856071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:20.868067 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77251126-670c-4bb1-892c-bc8052a3538d tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1487 microversion: 2.1 time: 0.211419 Oct 27 10:21:20.887431 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1530/3201] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:20 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1487 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:20.891240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:20.899794 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1336edae-638b-4781-8c1a-979da3fed1f2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1315 microversion: 2.1 time: 0.991873 Oct 27 10:21:20.901113 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1672/3202] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:19 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1315 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:21.213613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e2ab8db-0e32-4a82-9667-ac9c2858dc99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b4009d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:21.352575 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e2ab8db-0e32-4a82-9667-ac9c2858dc99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.147896 Oct 27 10:21:21.353451 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1531/3203] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:21 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:21.378428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b0da4137-fe10-420b-bf30-824d526ba53b req-f4210cf4-dfb8-4fe0-aa10-119c1ce8b5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66526d64-5921-4273-a259-32f11a2fe5ec", "name": "network-vif-deleted", "tag": "df8c6df5-ea64-4833-8236-d8e7d654a3dc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:21.396073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:21.425531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b0da4137-fe10-420b-bf30-824d526ba53b req-f4210cf4-dfb8-4fe0-aa10-119c1ce8b5a4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.428365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b0da4137-fe10-420b-bf30-824d526ba53b req-f4210cf4-dfb8-4fe0-aa10-119c1ce8b5a4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.428872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b0da4137-fe10-420b-bf30-824d526ba53b req-f4210cf4-dfb8-4fe0-aa10-119c1ce8b5a4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.463492 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b0da4137-fe10-420b-bf30-824d526ba53b req-f4210cf4-dfb8-4fe0-aa10-119c1ce8b5a4 service nova] Creating event network-vif-deleted:df8c6df5-ea64-4833-8236-d8e7d654a3dc for instance 66526d64-5921-4273-a259-32f11a2fe5ec on n-h2-854663-10 Oct 27 10:21:21.497490 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b0da4137-fe10-420b-bf30-824d526ba53b req-f4210cf4-dfb8-4fe0-aa10-119c1ce8b5a4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098713 Oct 27 10:21:21.503749 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1673/3204] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:21.679108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:21.679814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:21.691273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.692088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.692779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.693744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.694355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.694931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.802203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:21.813434 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef6c9d92-3643-455a-a666-23b3aacc9e87 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1279 microversion: 2.1 time: 0.141159 Oct 27 10:21:21.825618 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1532/3205] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:21 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:21.902763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:21.904905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:21.936297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:21.939186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:21.939641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.945347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.955008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.956827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.958270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.960359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.979839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.980861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.982969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.983862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.984575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.989520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:22.052111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:22.055011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:22.055657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:22.056245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lazy-loading 'fault' on Instance uuid 66526d64-5921-4273-a259-32f11a2fe5ec {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:21:22.172442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:22.181198 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c708ea74-d91d-455a-ae57-1bcec750e240 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 200 len: 1315 microversion: 2.1 time: 0.288922 Oct 27 10:21:22.188735 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1674/3206] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:21 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:22.264564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:22.273780 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3589bbb6-8690-48ce-bbd3-8f253e8339b2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1315 microversion: 2.1 time: 0.347533 Oct 27 10:21:22.284988 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1533/3207] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:21 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:22.370517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a56416e-047c-423f-b7af-258b16d6d67e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5baf33a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:22.472566 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a56416e-047c-423f-b7af-258b16d6d67e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.104641 Oct 27 10:21:22.474468 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1675/3208] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:22 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:22.743716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-61126545-0da3-4996-bb63-e37068317f65 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'create', calling method: .version_select at 0x7f6d5b2a5af0>, body: {"keypair": {"name": "tempest-keypair-734995899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDanML/xlDldsCSdmguSkbLdglKiBAmumrOgtpn4bVIGgwQU6YlN6vNp+4JXRJ0tbchcAVGc2NfY5yy2hcIaNYUorItVCwLQ0FEYRybnqoAl+nkCycEVeo1T0umrWfDaw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:22.769170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-61126545-0da3-4996-bb63-e37068317f65 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Getting quotas for project 9067a31bfee345fca080e7621aa60015. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:21:22.777876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-61126545-0da3-4996-bb63-e37068317f65 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Getting quotas for user 5fc08f1ad238424896dcefb0fa0b20c5 and project 9067a31bfee345fca080e7621aa60015. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:21:22.842091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:22.842814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:22.848970 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-61126545-0da3-4996-bb63-e37068317f65 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110347 Oct 27 10:21:22.855951 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1534/3209] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:21:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:22.881775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:22.883339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:22.884532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:22.889784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:22.890695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:22.891298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:23.097194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:23.132110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd7b05f2-7986-4c98-8beb-8ba3b03fd38b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1267 microversion: 2.1 time: 0.292074 Oct 27 10:21:23.139338 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1676/3210] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:22 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:23.210616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:23.211213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:23.222421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:23.222908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:23.223342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:23.228077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:23.228561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:23.230378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:23.242796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:23.306445 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:23.308057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:23.308928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec HTTP/1.1 Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '66526d64-5921-4273-a259-32f11a2fe5ec'} Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:23.319942 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:23.324951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:23.324951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:23.324951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:23.324951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:23.324951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:23.324951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:23.324951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:23.324951 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:21:23.324951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:23.326387 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73af59cf-dbb8-4f14-b37d-4bb763839b37 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 404 len: 111 microversion: 2.1 time: 0.121154 Oct 27 10:21:23.327040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:23.328280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:23.332253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:23.333227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:23.333822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:23.334383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:23.338388 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1535/3211] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:23 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:23.473562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-365853175", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:23.491063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:23.588861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] validate_networks() for [('6e77c087-9c37-413a-bf33-443cd764ef30', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:21:23.987552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:24.002696 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-174afcf9-5655-445c-a036-7b565ba42847 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1315 microversion: 2.1 time: 0.704488 Oct 27 10:21:24.006922 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1677/3212] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:23 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:24.022044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9718ff5-5508-4dab-8a33-268ba6edd7a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5babae50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:24.102883 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9718ff5-5508-4dab-8a33-268ba6edd7a3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.094588 Oct 27 10:21:24.103476 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1678/3213] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:24 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:24.170683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:24.171465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:24.183849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:24.184586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:24.185192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:24.186238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:24.186862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:24.187437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:24.690128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:24.733572 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb7c368f-e9d7-4a09-a51e-8e38e1411930 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1309 microversion: 2.1 time: 0.567267 Oct 27 10:21:24.736493 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1679/3214] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:24 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1309 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:25.035542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:25.037614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:25.049627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:25.050450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:25.053687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:25.054779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:21:25.055358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:21:25.055673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:21:25.056081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:21:25.056490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:21:25.057074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:25.064280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:25.065028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:25.085139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:25.085940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:25.086578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:25.087503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:25.089881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:25.092982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:25.154237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Getting quotas for project a8c3992187114a2887044b851d6c7838. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:21:25.173787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Getting quotas for user 3d0c785c43b24f64b5d1ec4510c78fdd and project a8c3992187114a2887044b851d6c7838. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:21:25.217981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:21:25.222065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:21:25.374223 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e242ff91-114a-462c-95c5-6fd146d6f332 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.900843 Oct 27 10:21:25.389514 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1536/3215] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:21:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:21:25.398390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35636643-6ac3-4434-8ca0-d9e3abc76c09 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b5044c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:25.491306 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35636643-6ac3-4434-8ca0-d9e3abc76c09 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.100429 Oct 27 10:21:25.492627 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1537/3216] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:25 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:25.499229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-753a2a18-81ec-46cb-ac22-98144abe0ad4 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:25.500430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-753a2a18-81ec-46cb-ac22-98144abe0ad4 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:26.355516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-753a2a18-81ec-46cb-ac22-98144abe0ad4 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:26.372863 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-753a2a18-81ec-46cb-ac22-98144abe0ad4 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1224 microversion: 2.1 time: 0.877494 Oct 27 10:21:26.392358 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1538/3217] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:25 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1224 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:26.412014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:26.413025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:26.420973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:26.423150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:26.424562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:26.425491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:26.426100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:26.426780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:27.009130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:27.023807 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8e5a8be5-8de9-4571-90b8-a6fcad01e37c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1315 microversion: 2.1 time: 1.994756 Oct 27 10:21:27.026515 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1680/3218] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:25 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1315 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:21:27.054945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-fef20953-fdb9-4363-bfaa-3583be1cd948 req-39ecc476-e503-4555-b00e-e14beefd1331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c1dd7f-094e-451b-bbd1-0aceb7873a96", "name": "network-vif-plugged", "status": "completed", "tag": "9397bff6-e10d-4ce0-b94a-3f64f4b9f8d2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:27.088352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fef20953-fdb9-4363-bfaa-3583be1cd948 req-39ecc476-e503-4555-b00e-e14beefd1331 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:27.091615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fef20953-fdb9-4363-bfaa-3583be1cd948 req-39ecc476-e503-4555-b00e-e14beefd1331 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:27.092163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fef20953-fdb9-4363-bfaa-3583be1cd948 req-39ecc476-e503-4555-b00e-e14beefd1331 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:27.124352 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-fef20953-fdb9-4363-bfaa-3583be1cd948 req-39ecc476-e503-4555-b00e-e14beefd1331 service nova] Creating event network-vif-plugged:9397bff6-e10d-4ce0-b94a-3f64f4b9f8d2 for instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 on n-h1-854663-10 Oct 27 10:21:27.153567 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-fef20953-fdb9-4363-bfaa-3583be1cd948 req-39ecc476-e503-4555-b00e-e14beefd1331 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123308 Oct 27 10:21:27.163968 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1681/3219] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:27.180411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddcb13b5-c233-4838-9192-e2394ddc76cf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5aa74430>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:27.208764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:27.222698 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4eacd8d0-32a4-49b5-bb98-4747741c3dfc tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1309 microversion: 2.1 time: 0.823288 Oct 27 10:21:27.224059 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1539/3220] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:26 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1309 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:27.308599 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddcb13b5-c233-4838-9192-e2394ddc76cf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.141662 Oct 27 10:21:27.309908 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1682/3221] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:27 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:27.406463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:27.407516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:27.434184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:27.441044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:27.441599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:27.450128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:27.450977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:27.454114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:27.727675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:27.739200 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae6ccd22-5b60-4729-ac2a-af8a9c85074b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1294 microversion: 2.1 time: 0.339641 Oct 27 10:21:27.740171 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1540/3222] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:27 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1294 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:28.068303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:28.069212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:28.099509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:28.105604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:28.106276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:28.108407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:28.108938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:28.109390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:28.247305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:28.247927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:28.269870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:28.272061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:28.272770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:28.280994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:28.281673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:28.283720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:28.834018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:28.845402 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8e97aa4-79e9-4cae-8a0c-a57e42f6cca1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1309 microversion: 2.1 time: 0.602600 Oct 27 10:21:28.846631 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1541/3223] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:28 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1309 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:28.847566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:28.853341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2100619062", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb44cd00-5720-4943-842a-282d92b4bf8f"}], "security_groups": [{"name": "tempest-securitygroup--688231043"}], "key_name": "tempest-keypair-734995899", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:28.925170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:29.096544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:29.117407 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c1e9ff5-8eab-40b8-9e1e-f3887ec4839b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1315 microversion: 2.1 time: 1.064535 Oct 27 10:21:29.123324 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1683/3224] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:28 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:29.139540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5c8445f-6018-4560-8f4c-cb55e4424a81 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b6faca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:29.220586 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5c8445f-6018-4560-8f4c-cb55e4424a81 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.095793 Oct 27 10:21:29.221812 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1684/3225] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:29 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:29.236123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:29.237136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:29.252064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:29.252842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:29.253548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:29.254900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:29.255633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:29.256343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:29.302475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] validate_networks() for [('fb44cd00-5720-4943-842a-282d92b4bf8f', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:21:29.497596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:29.508706 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f09c53fa-637b-4240-97b0-ba1f9592e337 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1282 microversion: 2.1 time: 0.282568 Oct 27 10:21:29.509557 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1685/3226] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:29 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1282 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:29.533510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-15ffef8e-fd1b-4417-b82b-9430c3d484ed req-82925284-70ce-4e31-ae17-dc118ef7832e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d223963b-e688-4013-8a89-71b392277a1a", "tag": "972c5745-1993-4b85-b35d-b7db394b9669"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:29.572837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-15ffef8e-fd1b-4417-b82b-9430c3d484ed req-82925284-70ce-4e31-ae17-dc118ef7832e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:29.573393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-15ffef8e-fd1b-4417-b82b-9430c3d484ed req-82925284-70ce-4e31-ae17-dc118ef7832e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:29.574094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-15ffef8e-fd1b-4417-b82b-9430c3d484ed req-82925284-70ce-4e31-ae17-dc118ef7832e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:29.606485 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-15ffef8e-fd1b-4417-b82b-9430c3d484ed req-82925284-70ce-4e31-ae17-dc118ef7832e service nova] Creating event network-changed:972c5745-1993-4b85-b35d-b7db394b9669 for instance d223963b-e688-4013-8a89-71b392277a1a on n-h1-854663-10 Oct 27 10:21:29.614714 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-15ffef8e-fd1b-4417-b82b-9430c3d484ed req-82925284-70ce-4e31-ae17-dc118ef7832e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102706 Oct 27 10:21:29.615719 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1686/3227] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:29.881655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:29.883570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:29.907562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:29.908087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:29.915095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:29.934011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:29.935261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:29.940417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:31.062347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:31.073225 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a5600a4-2bed-4f36-9f1f-38fde205c5b8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1309 microversion: 2.1 time: 1.201514 Oct 27 10:21:31.073855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1687/3228] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:29 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1309 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:31.078589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:31.079197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:31.103026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:31.109769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:31.110520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:31.111481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:31.112126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:31.112825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:31.126826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:31.178595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:21:31.182822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:21:31.183498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:21:31.187982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:21:31.189535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:21:31.219904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:31.223279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:31.224428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:31.225485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:31.227243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:31.227892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:31.299672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Getting quotas for project 9067a31bfee345fca080e7621aa60015. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:21:31.314528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Getting quotas for user 5fc08f1ad238424896dcefb0fa0b20c5 and project 9067a31bfee345fca080e7621aa60015. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:21:31.350743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:21:31.353080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:21:31.464757 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a80fc734-db65-4597-a98a-e820007df8dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.616608 Oct 27 10:21:31.466720 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1542/3229] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:21:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 2619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:21:31.479130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ef1ff08-32fd-442f-ac8b-8f4a2f6b55d5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b43e670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:31.586577 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ef1ff08-32fd-442f-ac8b-8f4a2f6b55d5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.118670 Oct 27 10:21:31.587528 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1543/3230] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:31 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:31.593136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:31.593965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:31.600650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:31.601397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:31.602180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:31.603328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:31.604356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:31.605046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:31.940193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:31.953792 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1a42860a-cd34-4eaf-b6b7-e06878fd3335 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1502 microversion: 2.1 time: 0.878831 Oct 27 10:21:31.954389 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1688/3231] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:31 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1502 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:31.965470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d093b86f-b37e-4ce9-a6ed-001434453a9c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:31.966223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d093b86f-b37e-4ce9-a6ed-001434453a9c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:32.348836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d093b86f-b37e-4ce9-a6ed-001434453a9c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:32.369511 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d093b86f-b37e-4ce9-a6ed-001434453a9c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1245 microversion: 2.1 time: 0.413791 Oct 27 10:21:32.388767 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1689/3232] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:31 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1245 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:32.402701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:32.410866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:32.436584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:32.437410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:32.438124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:32.439085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:32.441029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:32.441657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:32.651812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:32.660292 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4c2ab31-76e4-4422-a104-773bd5fe0d29 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1324 microversion: 2.1 time: 1.071136 Oct 27 10:21:32.671646 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1544/3233] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:31 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1324 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:32.679522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d72b3e7b-3018-4da4-838d-8d66641a4f36 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5ac0ff70>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:32.817477 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d72b3e7b-3018-4da4-838d-8d66641a4f36 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1411 microversion: 2.1 time: 0.144724 Oct 27 10:21:32.826677 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1545/3234] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:32 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:33.292492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:33.319878 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8dc9993b-3025-44de-b7bd-5ca7bff6f17c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1309 microversion: 2.1 time: 0.926448 Oct 27 10:21:33.321051 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1690/3235] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:32 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1309 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:33.396762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:33.397755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:33.432769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:33.440566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:33.441402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:33.446447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:33.448425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:33.450893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:33.698933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:33.700560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:33.759006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:33.760037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:33.760892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:33.761812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:33.762864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:33.763468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:33.882382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:33.900468 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8abd1889-84da-4c0f-a72e-a0b00ec902ae tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1297 microversion: 2.1 time: 0.506701 Oct 27 10:21:33.925013 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1546/3236] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:33 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1297 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:33.946055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-407e3189-5dc4-4061-82a7-abeacefa5072 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b43e430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:34.026313 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-407e3189-5dc4-4061-82a7-abeacefa5072 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1420 microversion: 2.1 time: 0.098244 Oct 27 10:21:34.028019 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1547/3237] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:33 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:34.047000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f8032ce0-fc71-466c-b085-fbbda9040137 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d63778700>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:34.144723 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f8032ce0-fc71-466c-b085-fbbda9040137 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 200 len: 1420 microversion: 2.1 time: 0.101809 Oct 27 10:21:34.161358 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1548/3238] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:21:34 2022] GET /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:34.167956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-001639db-ea80-4918-9345-30b5a9a517c6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5ac1dd30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:34.606572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:34.617858 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a2b3296-40b5-4f51-a2a7-a6b983705195 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1324 microversion: 2.1 time: 0.924148 Oct 27 10:21:34.628761 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1691/3239] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:33 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1324 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:34.634029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:34.634756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:34.648805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:34.649407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:34.649921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:34.653001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:34.653813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:34.654474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:35.555895 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-001639db-ea80-4918-9345-30b5a9a517c6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 204 len: 0 microversion: 2.1 time: 1.392704 Oct 27 10:21:35.557574 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1549/3240] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:34 2022] DELETE /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 0 bytes in 1395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:21:35.565294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:35.565912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:35.584383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:35.584907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:35.585351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:35.586063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:35.586520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:35.586948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:35.699614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:35.708003 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32f10bfd-c8c9-4bb1-9a96-f55551f37577 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1309 microversion: 2.1 time: 1.087055 Oct 27 10:21:35.708632 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1692/3241] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:34 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1309 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:35.726882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4ac329a-5588-4f40-a181-48bd122df120 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b60f008-0138-4b9e-a3ec-f778e6a11473"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:35.739729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4ac329a-5588-4f40-a181-48bd122df120 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:35.768243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ac329a-5588-4f40-a181-48bd122df120 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:35.770915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ac329a-5588-4f40-a181-48bd122df120 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:35.772054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ac329a-5588-4f40-a181-48bd122df120 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:35.776519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ac329a-5588-4f40-a181-48bd122df120 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:35.777280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ac329a-5588-4f40-a181-48bd122df120 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:35.787803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ac329a-5588-4f40-a181-48bd122df120 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:35.852053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:35.864509 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6e6ff93-5d69-46d2-bbb9-eb4a81b4961e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1303 microversion: 2.1 time: 0.302900 Oct 27 10:21:35.881297 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1550/3242] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:35 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1303 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:35.891808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:35.895741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:35.908632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:35.910735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:35.912455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:35.913537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:35.914391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:35.917896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:35.986532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:21:36.211796 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b9abadb-b0af-4f91-8966-04c5d9d83ec2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 204 len: 0 microversion: 2.1 time: 0.325094 Oct 27 10:21:36.212463 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1551/3243] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:21:35 2022] DELETE /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:21:36.239313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:36.243473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:36.261136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:36.264896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:36.271028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:36.273671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:36.279697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:36.280751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:36.346156 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4ac329a-5588-4f40-a181-48bd122df120 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.634559 Oct 27 10:21:36.353652 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1693/3244] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:21:35 2022] POST /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:36.369711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5c7a38a5-31b6-4c3c-866b-2b79e3a77883 req-0c96220f-e02d-4fb3-a2f8-08efc13dd0bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f302063-d3bf-42f7-bca0-250439687c97", "tag": "dabf0782-b3f5-4cd6-84d2-bf55ca9aa27e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:36.404402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5c7a38a5-31b6-4c3c-866b-2b79e3a77883 req-0c96220f-e02d-4fb3-a2f8-08efc13dd0bf service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:36.407304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5c7a38a5-31b6-4c3c-866b-2b79e3a77883 req-0c96220f-e02d-4fb3-a2f8-08efc13dd0bf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:36.408859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5c7a38a5-31b6-4c3c-866b-2b79e3a77883 req-0c96220f-e02d-4fb3-a2f8-08efc13dd0bf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:36.450001 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5c7a38a5-31b6-4c3c-866b-2b79e3a77883 req-0c96220f-e02d-4fb3-a2f8-08efc13dd0bf service nova] Creating event network-changed:dabf0782-b3f5-4cd6-84d2-bf55ca9aa27e for instance 9f302063-d3bf-42f7-bca0-250439687c97 on n-h2-854663-10 Oct 27 10:21:36.477345 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5c7a38a5-31b6-4c3c-866b-2b79e3a77883 req-0c96220f-e02d-4fb3-a2f8-08efc13dd0bf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120406 Oct 27 10:21:36.481345 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1694/3245] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:36.575228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-318075750", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9817231a-6843-4f63-80f8-30528217ef12"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:36.665125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] validate_networks() for [('9817231a-6843-4f63-80f8-30528217ef12', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:21:37.163116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:37.174524 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ace6e7a5-92e6-4cd7-b9a5-f266a762fa66 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1324 microversion: 2.1 time: 0.954715 Oct 27 10:21:37.177271 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1552/3246] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:36 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1324 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:37.185753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:37.186372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:37.204996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:37.205477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:37.206369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:37.207083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:37.207520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:37.209293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:37.752048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:37.768724 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae13b052-8ce0-40bb-beb6-58358b58316d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1309 microversion: 2.1 time: 0.587754 Oct 27 10:21:37.769657 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1553/3247] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:37 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1309 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:37.792116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:37.792906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:37.800504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:37.801346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:37.801790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:37.802562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:37.803121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:37.804237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:38.820679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:38.822193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:21:38.822616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:21:38.823093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:21:38.823539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:21:38.824014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:21:38.832532 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35f8eddb-ea5a-472d-aa1a-e9c34c7e8c7f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1370 microversion: 2.1 time: 1.047579 Oct 27 10:21:38.833365 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1554/3248] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:37 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1370 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:38.840165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-32345ba2-a03f-4c89-810b-ec317b551505 req-dc275a68-68c8-437c-9a1c-84266f49cbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199e563d-e099-4187-96ea-cc1dc2694fd2", "name": "network-vif-unplugged", "status": "completed", "tag": "c17850c1-9ad6-49e6-8b2f-f5ffad635134"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:38.845420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:38.846065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:38.848086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:38.852219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:38.852770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:38.853234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:38.855142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-32345ba2-a03f-4c89-810b-ec317b551505 req-dc275a68-68c8-437c-9a1c-84266f49cbb8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:38.855620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-32345ba2-a03f-4c89-810b-ec317b551505 req-dc275a68-68c8-437c-9a1c-84266f49cbb8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:38.856054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-32345ba2-a03f-4c89-810b-ec317b551505 req-dc275a68-68c8-437c-9a1c-84266f49cbb8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:38.875718 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-32345ba2-a03f-4c89-810b-ec317b551505 req-dc275a68-68c8-437c-9a1c-84266f49cbb8 service nova] Creating event network-vif-unplugged:c17850c1-9ad6-49e6-8b2f-f5ffad635134 for instance 199e563d-e099-4187-96ea-cc1dc2694fd2 on n-h1-854663-10 Oct 27 10:21:38.882993 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-32345ba2-a03f-4c89-810b-ec317b551505 req-dc275a68-68c8-437c-9a1c-84266f49cbb8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046955 Oct 27 10:21:38.884128 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1555/3249] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:38.899004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:38.900034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:38.908633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:21:38.910473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:38.910964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:38.911399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:38.912110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:38.912554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:38.913006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:38.922467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for user 8074ee4104864f7b8010104133bd2fef and project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:21:38.964123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:21:38.966750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:21:39.077355 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-252ac434-8d8d-4056-8c71-576162da876b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.508703 Oct 27 10:21:39.078680 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1695/3250] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:21:39.089664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:39.094705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:39.107409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:39.113910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:39.114620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:39.115575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:39.116249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:39.117042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:39.598253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:39.609120 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d2ba86b-6178-46d4-b134-971af4511257 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1324 microversion: 2.1 time: 0.717712 Oct 27 10:21:39.620800 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1556/3251] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:38 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1324 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:39.620800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58ab5b0e-1e66-4a17-923e-e566a4763823 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:39.629620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58ab5b0e-1e66-4a17-923e-e566a4763823 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:40.162416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58ab5b0e-1e66-4a17-923e-e566a4763823 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:40.174787 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58ab5b0e-1e66-4a17-923e-e566a4763823 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1207 microversion: 2.1 time: 0.561884 Oct 27 10:21:40.175782 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1557/3252] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:39 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1207 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:40.188773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:40.189643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:40.204935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:40.205427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:40.205862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:40.206562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:40.222508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:40.222960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:40.758932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:40.767662 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb3292e5-5dff-4887-bfdd-92364490b488 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1309 microversion: 2.1 time: 1.687537 Oct 27 10:21:40.768265 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1696/3253] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:39 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1309 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:40.788259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:40.788834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:40.802680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:40.803185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:40.803966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:40.804924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:40.814775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:40.815258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:41.259876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:41.289551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:41.298532 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fbee70e2-ba36-4901-b8c3-9668a5c5bba2 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1370 microversion: 2.1 time: 1.121203 Oct 27 10:21:41.321578 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1558/3254] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:40 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1370 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:41.332460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-17a4a936-8e09-4d39-be3f-94b0b2e5889b req-07848eae-3706-45d0-9bc3-113686715c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d223963b-e688-4013-8a89-71b392277a1a", "name": "network-vif-plugged", "status": "completed", "tag": "972c5745-1993-4b85-b35d-b7db394b9669"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:41.371225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-17a4a936-8e09-4d39-be3f-94b0b2e5889b req-07848eae-3706-45d0-9bc3-113686715c47 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:41.372037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-17a4a936-8e09-4d39-be3f-94b0b2e5889b req-07848eae-3706-45d0-9bc3-113686715c47 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:41.372757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-17a4a936-8e09-4d39-be3f-94b0b2e5889b req-07848eae-3706-45d0-9bc3-113686715c47 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:41.397098 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-17a4a936-8e09-4d39-be3f-94b0b2e5889b req-07848eae-3706-45d0-9bc3-113686715c47 service nova] Creating event network-vif-plugged:972c5745-1993-4b85-b35d-b7db394b9669 for instance d223963b-e688-4013-8a89-71b392277a1a on n-h1-854663-10 Oct 27 10:21:41.403669 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-17a4a936-8e09-4d39-be3f-94b0b2e5889b req-07848eae-3706-45d0-9bc3-113686715c47 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080664 Oct 27 10:21:41.404997 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1559/3255] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:41.427809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:41.429832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:41.454878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:41.458472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:41.471617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:41.474918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:41.479484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:41.492303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:42.219257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:42.249292 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d4d355ec-d43c-4832-a373-74bf4cec8374 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1267 microversion: 2.1 time: 0.826955 Oct 27 10:21:42.251296 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1560/3256] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:41 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1267 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:42.277113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:42.281354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:42.315557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:42.323063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:42.328534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:42.329885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:42.331502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:42.332984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:42.381655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:42.700004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:42.714377 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af74c23c-58ba-424d-b3be-589cb58e3977 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1324 microversion: 2.1 time: 1.943733 Oct 27 10:21:42.714867 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1697/3257] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:40 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1324 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:42.736767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:42.737400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:42.754779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:42.755519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:42.756149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:42.769219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:42.769959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:42.771040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:43.461554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:43.479954 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-506d6105-dacb-4a95-ac4e-74e5b03b4739 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1309 microversion: 2.1 time: 1.217996 Oct 27 10:21:43.496930 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1561/3258] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:42 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1309 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:43.496930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6edecf6d-987b-4acd-95df-3f30b82fc995 req-1a41502c-8797-434e-a58e-8d06d8d2328e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199e563d-e099-4187-96ea-cc1dc2694fd2", "name": "network-vif-deleted", "tag": "c17850c1-9ad6-49e6-8b2f-f5ffad635134"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:43.502582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6edecf6d-987b-4acd-95df-3f30b82fc995 req-1a41502c-8797-434e-a58e-8d06d8d2328e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:43.504007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6edecf6d-987b-4acd-95df-3f30b82fc995 req-1a41502c-8797-434e-a58e-8d06d8d2328e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:43.504538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6edecf6d-987b-4acd-95df-3f30b82fc995 req-1a41502c-8797-434e-a58e-8d06d8d2328e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:43.564405 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6edecf6d-987b-4acd-95df-3f30b82fc995 req-1a41502c-8797-434e-a58e-8d06d8d2328e service nova] Creating event network-vif-deleted:c17850c1-9ad6-49e6-8b2f-f5ffad635134 for instance 199e563d-e099-4187-96ea-cc1dc2694fd2 on n-h1-854663-10 Oct 27 10:21:43.589268 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6edecf6d-987b-4acd-95df-3f30b82fc995 req-1a41502c-8797-434e-a58e-8d06d8d2328e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105474 Oct 27 10:21:43.590567 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1562/3259] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:43.601335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:43.610318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:43.627519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:43.633727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:43.637686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:43.638764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:43.639594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:43.640107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:44.006812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:44.015792 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42b0a1b2-471f-4ce9-8597-050064ddf958 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1370 microversion: 2.1 time: 1.299792 Oct 27 10:21:44.016445 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1698/3260] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:42 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1370 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:44.025712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:44.039053 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5b52fba-e7ef-475a-b1f1-2d5cc2496399 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1265 microversion: 2.1 time: 0.447052 Oct 27 10:21:44.041522 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1563/3261] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:43 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1265 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:44.049918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:44.055071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:44.071871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:44.072379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:44.072861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:44.073709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:44.074454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:44.074899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:44.374504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9c10ad7d-bd3a-4a83-9cb2-d1ad82b8bd11 req-3cbf1125-6ea8-459f-a895-f237fbfa01ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54c5675-6a87-4213-a858-dd71fc93e9c7", "tag": "71360be2-953d-4a1c-9c77-3a1b49634b01"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:44.411659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9c10ad7d-bd3a-4a83-9cb2-d1ad82b8bd11 req-3cbf1125-6ea8-459f-a895-f237fbfa01ef service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:44.412603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9c10ad7d-bd3a-4a83-9cb2-d1ad82b8bd11 req-3cbf1125-6ea8-459f-a895-f237fbfa01ef service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:44.417674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9c10ad7d-bd3a-4a83-9cb2-d1ad82b8bd11 req-3cbf1125-6ea8-459f-a895-f237fbfa01ef service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:44.456773 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9c10ad7d-bd3a-4a83-9cb2-d1ad82b8bd11 req-3cbf1125-6ea8-459f-a895-f237fbfa01ef service nova] Creating event network-changed:71360be2-953d-4a1c-9c77-3a1b49634b01 for instance b54c5675-6a87-4213-a858-dd71fc93e9c7 on n-h2-854663-10 Oct 27 10:21:44.479310 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9c10ad7d-bd3a-4a83-9cb2-d1ad82b8bd11 req-3cbf1125-6ea8-459f-a895-f237fbfa01ef service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108116 Oct 27 10:21:44.481975 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1564/3262] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:44.510459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:44.511774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:44.529716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:44.540193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:44.541376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:44.542343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:44.542917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:44.543753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:45.119705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:45.131353 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e2f8220-03fa-49ac-bf91-c30a90fec7e2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1324 microversion: 2.1 time: 1.099770 Oct 27 10:21:45.150900 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1699/3263] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:44 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1324 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:45.171488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:45.173269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:45.190313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:45.191670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:45.192396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:45.193088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:45.194292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:45.195776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:45.196410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:45.211525 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43cb2bf3-b146-4ba9-bdff-e0e47297e383 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1489 microversion: 2.1 time: 0.705338 Oct 27 10:21:45.212257 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1565/3264] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:44 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1489 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:21:45.217929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:45.218639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:45.238405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:45.239554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:45.240075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:45.240895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:45.241578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:45.242263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:45.545252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:45.558271 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73a7d7cf-d671-4ded-9f21-657592c10f6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1265 microversion: 2.1 time: 0.344383 Oct 27 10:21:45.562595 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1566/3265] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:45 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:45.569251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1436285130", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "bc393ace-9ca8-46ee-824d-0fc414351037"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:45.697680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] validate_networks() for [('bc393ace-9ca8-46ee-824d-0fc414351037', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:21:46.023701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:46.036083 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66f45175-29a0-4330-a952-13aaa2172ea8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1370 microversion: 2.1 time: 0.883531 Oct 27 10:21:46.036797 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1700/3266] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:45 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1370 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:46.056096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d4a82eca-94be-4883-a143-3bf399e5e15d req-e9b3d35b-5bef-4d85-a488-ac1f641eab00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f302063-d3bf-42f7-bca0-250439687c97", "name": "network-vif-plugged", "status": "completed", "tag": "dabf0782-b3f5-4cd6-84d2-bf55ca9aa27e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:46.082156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d4a82eca-94be-4883-a143-3bf399e5e15d req-e9b3d35b-5bef-4d85-a488-ac1f641eab00 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:46.082595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d4a82eca-94be-4883-a143-3bf399e5e15d req-e9b3d35b-5bef-4d85-a488-ac1f641eab00 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:46.083035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d4a82eca-94be-4883-a143-3bf399e5e15d req-e9b3d35b-5bef-4d85-a488-ac1f641eab00 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:46.110165 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d4a82eca-94be-4883-a143-3bf399e5e15d req-e9b3d35b-5bef-4d85-a488-ac1f641eab00 service nova] Creating event network-vif-plugged:dabf0782-b3f5-4cd6-84d2-bf55ca9aa27e for instance 9f302063-d3bf-42f7-bca0-250439687c97 on n-h2-854663-10 Oct 27 10:21:46.121765 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d4a82eca-94be-4883-a143-3bf399e5e15d req-e9b3d35b-5bef-4d85-a488-ac1f641eab00 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082499 Oct 27 10:21:46.123924 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1701/3267] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:46.166249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:46.167431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:46.180126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:46.189343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:46.190135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:46.191094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:46.191748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:46.197158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:47.368142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:47.378939 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-abaf7cc6-04de-49f0-a842-641fef8e880f tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1324 microversion: 2.1 time: 1.218894 Oct 27 10:21:47.382836 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1702/3268] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:46 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1324 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:21:47.395940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:47.399878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:47.417712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:47.418425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:47.419013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:47.419959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:47.422741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:47.423451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:47.645203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:21:47.645677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:21:47.646077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:21:47.646522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:21:47.647469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:21:47.686518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=23 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:47.691498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:47.698018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:47.703145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:47.705131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:47.705654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:47.706777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:47.812322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:21:47.829383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for user 6a80ce0f3a4242a9a061a311c4bb50ae and project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:21:47.906108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:47.913025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:21:47.918231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:21:48.025354 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc1f44f2-429e-4545-ada9-185275cfddac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.461139 Oct 27 10:21:48.026121 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1567/3269] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:21:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:21:48.038034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:48.038684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:48.058240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:48.059731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:48.061253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:48.065942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:48.067788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:48.070060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:48.880643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:48.944623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:49.110296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:49.110754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:49.119359 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b07ea164-30d8-4bf8-8234-65c77a3d9a33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1370 microversion: 2.1 time: 1.085525 Oct 27 10:21:49.119605 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ecb1e29-965d-40a7-888a-8d72a5e7857a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1307 microversion: 2.1 time: 1.729936 Oct 27 10:21:49.121153 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1703/3270] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:47 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1307 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:49.123969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1568/3271] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:48 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1370 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:49.129060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:49.129609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:49.130420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:49.139034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:49.153452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:49.153958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:49.154396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:49.155117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:49.155572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:49.156002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:49.175051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:49.176279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:49.177335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:49.178329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:49.179404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:49.180090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:49.411980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:49.420878 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e564b519-e084-4bba-99d1-7de1f0791988 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1213 microversion: 2.1 time: 0.298230 Oct 27 10:21:49.424806 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1704/3272] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:49 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1213 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:50.146540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:50.147209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:50.161366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:50.161803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:50.169350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:50.177347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:50.177850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:50.180172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:50.497903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:50.517465 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93be1577-b072-4584-8689-4c598e816c88 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1521 microversion: 2.1 time: 1.392241 Oct 27 10:21:50.518183 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1569/3273] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:49 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1521 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:50.536751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:50.537386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:50.553806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:50.556044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:50.560881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:50.561831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:50.562466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:50.563095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:50.982796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:51.007260 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a213c0ff-13c0-4b29-bc97-3a5ce6f5d6f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1307 microversion: 2.1 time: 0.864575 Oct 27 10:21:51.020197 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1705/3274] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:50 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1307 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:21:51.040158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:51.041357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:51.066569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:51.070651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:51.071139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:51.080707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:51.080931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:51.083322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:51.190032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:51.218148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:51.231627 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-301cf6af-514c-44b1-90d2-621cd23ff198 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1370 microversion: 2.1 time: 0.710398 Oct 27 10:21:51.238955 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1570/3275] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:50 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1370 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:51.262253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:51.262773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:51.283458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:51.283914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:51.284356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:51.297752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:51.298262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:51.303646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:51.381186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:21:51.442931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:51.467875 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6ef4532-b7fc-4b33-a317-24526b79a626 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1267 microversion: 2.1 time: 0.441931 Oct 27 10:21:51.469092 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1706/3276] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:51 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1267 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:51.610278 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c910ce4-cb05-4928-88b2-909a68007ce2 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 204 len: 0 microversion: 2.1 time: 0.368672 Oct 27 10:21:51.625680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:51.627960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:51.637460 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1571/3277] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:21:51 2022] DELETE /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:21:51.681703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:51.684904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:51.688979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:51.693631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:51.694980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:51.697759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:52.045380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:52.055387 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-486f1648-0576-40e2-81de-68af57c5e7da tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1527 microversion: 2.1 time: 0.437555 Oct 27 10:21:52.056737 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1707/3278] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:51 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1527 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:52.066042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:52.073303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:52.100512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:52.103058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:52.105752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:52.107053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:52.113147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:52.113919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:52.267745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:52.268377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:52.277587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:52.282023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:52.284489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:52.285350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:52.286253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:52.287015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:52.287864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:53.493754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:53.512245 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd50aa26-56c8-4731-9fee-08fc8cdc6141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1307 microversion: 2.1 time: 1.462863 Oct 27 10:21:53.513264 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1572/3279] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:52 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1307 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:53.738023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:53.764790 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21e1d869-8ae8-43ee-8553-bb37c6119d3a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1370 microversion: 2.1 time: 1.508443 Oct 27 10:21:53.776107 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1708/3280] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:52 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1370 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:21:53.798924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:53.803908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:53.838495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:53.841554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:53.842283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-741398752", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "b921834f-df7d-4794-b14d-8894d9a0442b"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:53.844190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:53.846641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:53.848682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:53.849295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:54.025825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] validate_networks() for [('b921834f-df7d-4794-b14d-8894d9a0442b', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:21:54.815924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:54.833444 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca39f07d-88a1-430c-8fd2-eb5ca54ee01c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1309 microversion: 2.1 time: 1.055732 Oct 27 10:21:54.835499 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1709/3281] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:53 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1309 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:54.847251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:54.847880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:54.874886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:54.881610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:54.882088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:54.883237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:54.883715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:54.885644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:55.962043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d0c785c43b24f64b5d1ec4510c78fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3992187114a2887044b851d6c7838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:55.974940 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a260fca2-313e-4f14-9310-31b84df62d30 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 200 len: 1527 microversion: 2.1 time: 1.138331 Oct 27 10:21:55.979296 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1710/3282] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:54 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 1527 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:55.988733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2fc84695-9a4a-4402-9a11-c5d25fb09e8f req-5dc1c563-0ab7-41cd-b618-2eeab1163279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74d2938-9f25-40b2-abee-11f4d42e46fd", "tag": "eea30e87-7401-4aec-9292-4c76c45f04bd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:56.016912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2fc84695-9a4a-4402-9a11-c5d25fb09e8f req-5dc1c563-0ab7-41cd-b618-2eeab1163279 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.029525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2fc84695-9a4a-4402-9a11-c5d25fb09e8f req-5dc1c563-0ab7-41cd-b618-2eeab1163279 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.030353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2fc84695-9a4a-4402-9a11-c5d25fb09e8f req-5dc1c563-0ab7-41cd-b618-2eeab1163279 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.044838 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2fc84695-9a4a-4402-9a11-c5d25fb09e8f req-5dc1c563-0ab7-41cd-b618-2eeab1163279 service nova] Creating event network-changed:eea30e87-7401-4aec-9292-4c76c45f04bd for instance c74d2938-9f25-40b2-abee-11f4d42e46fd on n-h1-854663-10 Oct 27 10:21:56.062742 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2fc84695-9a4a-4402-9a11-c5d25fb09e8f req-5dc1c563-0ab7-41cd-b618-2eeab1163279 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081775 Oct 27 10:21:56.063811 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1711/3283] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:56.073439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:56.079387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:56.098102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.099156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.099827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.106517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.107384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.108042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.236603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:21:56.237298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:21:56.238887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:21:56.239321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:21:56.239769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:21:56.279621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.280743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.281289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.282144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.284050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.284622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.353013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Getting quotas for project 3440243e4e364d1ba0ce7b951967c240. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:21:56.368851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Getting quotas for user 9d92cb5870244c56be85ea3914938628 and project 3440243e4e364d1ba0ce7b951967c240. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:21:56.424443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:21:56.436245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:21:56.500086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:56.514062 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68b47dab-5bea-4283-88a6-1a9eac6ed846 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1307 microversion: 2.1 time: 0.448772 Oct 27 10:21:56.514937 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1712/3284] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:56 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1307 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:56.519879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8f4f94be-8025-4cb7-a07f-29e47e1e575f req-3b44c3ed-4689-45eb-934a-e6760531eeff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54c5675-6a87-4213-a858-dd71fc93e9c7", "name": "network-vif-plugged", "status": "completed", "tag": "71360be2-953d-4a1c-9c77-3a1b49634b01"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:56.558338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8f4f94be-8025-4cb7-a07f-29e47e1e575f req-3b44c3ed-4689-45eb-934a-e6760531eeff service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.561261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8f4f94be-8025-4cb7-a07f-29e47e1e575f req-3b44c3ed-4689-45eb-934a-e6760531eeff service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.561993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8f4f94be-8025-4cb7-a07f-29e47e1e575f req-3b44c3ed-4689-45eb-934a-e6760531eeff service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.586901 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8f4f94be-8025-4cb7-a07f-29e47e1e575f req-3b44c3ed-4689-45eb-934a-e6760531eeff service nova] Creating event network-vif-plugged:71360be2-953d-4a1c-9c77-3a1b49634b01 for instance b54c5675-6a87-4213-a858-dd71fc93e9c7 on n-h2-854663-10 Oct 27 10:21:56.599596 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8f4f94be-8025-4cb7-a07f-29e47e1e575f req-3b44c3ed-4689-45eb-934a-e6760531eeff service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083154 Oct 27 10:21:56.602983 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1713/3285] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:56.617697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:56.621485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:56.637310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.640837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.641704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.643544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.646646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.649454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.659041 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.131126 Oct 27 10:21:56.662248 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1573/3286] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:21:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:21:56.670187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:56.677673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:56.736122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.738590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.746467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.766148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:56.767087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:56.767844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:56.855695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:21:57.203287 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1f51341e-2c2b-4d28-a610-7daae8ab749a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 204 len: 0 microversion: 2.1 time: 0.538933 Oct 27 10:21:57.206546 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1574/3287] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:21:56 2022] DELETE /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:21:57.220577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-686953b9-6c8c-415d-9d50-6f3f95b23225 req-6b3f1e4f-25e6-49aa-911a-10a768261557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c36f35-e7e7-4be9-9d2a-a5c584b6487b", "tag": "c46376ab-d0ed-477c-bc54-023268393e9a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:57.257242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-686953b9-6c8c-415d-9d50-6f3f95b23225 req-6b3f1e4f-25e6-49aa-911a-10a768261557 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:57.260260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-686953b9-6c8c-415d-9d50-6f3f95b23225 req-6b3f1e4f-25e6-49aa-911a-10a768261557 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:57.262865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-686953b9-6c8c-415d-9d50-6f3f95b23225 req-6b3f1e4f-25e6-49aa-911a-10a768261557 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:57.305977 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-686953b9-6c8c-415d-9d50-6f3f95b23225 req-6b3f1e4f-25e6-49aa-911a-10a768261557 service nova] Creating event network-changed:c46376ab-d0ed-477c-bc54-023268393e9a for instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b on n-h1-854663-10 Oct 27 10:21:57.323962 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-686953b9-6c8c-415d-9d50-6f3f95b23225 req-6b3f1e4f-25e6-49aa-911a-10a768261557 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114276 Oct 27 10:21:57.326349 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1575/3288] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:57.346159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:57.352519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:57.380078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:57.391030 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a200370e-68e7-4577-9a08-9f27cfcda859 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1370 microversion: 2.1 time: 0.786359 Oct 27 10:21:57.395996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:57.403019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:57.403469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:57.406233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:57.406697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:57.407813 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1714/3289] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:56 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1370 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:57.409466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:57.426959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0cdd2694-5980-4c68-b584-c1721e633d00 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:57.433426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0cdd2694-5980-4c68-b584-c1721e633d00 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:57.710950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cdd2694-5980-4c68-b584-c1721e633d00 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:57.726101 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0cdd2694-5980-4c68-b584-c1721e633d00 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1216 microversion: 2.1 time: 0.312864 Oct 27 10:21:57.751943 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1715/3290] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:57 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1216 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:57.769543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:57.772288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 9f302063-d3bf-42f7-bca0-250439687c97] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:57.790352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:57.790928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:57.791436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:57.792293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:57.793023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:57.793688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:57.811853 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Instance 9f302063-d3bf-42f7-bca0-250439687c97 could not be found. Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 HTTP/1.1 Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 9f302063-d3bf-42f7-bca0-250439687c97 could not be found. Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '9f302063-d3bf-42f7-bca0-250439687c97'} Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f302063-d3bf-42f7-bca0-250439687c97 could not be found. Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f302063-d3bf-42f7-bca0-250439687c97 could not be found. Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:57.814701 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:57.819627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:57.819627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:57.819627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:57.819627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:57.819627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:57.819627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:57.819627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f302063-d3bf-42f7-bca0-250439687c97 could not be found. Oct 27 10:21:57.819627 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:57.826441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Instance 9f302063-d3bf-42f7-bca0-250439687c97 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:57.827769 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb1e10b0-e6b8-4ee8-93a5-8bedc40dda65 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97" status: 404 len: 111 microversion: 2.1 time: 0.074051 Oct 27 10:21:57.828931 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1716/3291] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:57 2022] GET /compute/v2.1/servers/9f302063-d3bf-42f7-bca0-250439687c97 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:57.835874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:57.836937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:57.847228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:57.848247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:57.848923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:57.849810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:57.850463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:57.850983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:57.859452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:57.870385 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f5a045d-5150-4154-aacd-cf93a5ccc93f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1309 microversion: 2.1 time: 0.542730 Oct 27 10:21:57.885575 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1576/3292] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:57 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:57.956571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07771723-76c7-45e1-a17a-df1464525fee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'create', calling method: .version_select at 0x7f6d5b4173a0>, body: {"keypair": {"name": "tempest-keypair-4719984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLz5MvmVlmYj05e2WzCWIa7wEqfpz9WzOLI0Sc+cBknDD7HLhNHw4TTsbNl+SA2nI7k9ORX5ha8VcQQTGJLLiSVF+szfe9zaNkmT9eSKuZ4d9Nmt/NZfsEyoyt/pkKt9PA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:57.984364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-07771723-76c7-45e1-a17a-df1464525fee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:21:57.994073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-07771723-76c7-45e1-a17a-df1464525fee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for user 1ebcbfbb11e84fe5bbfebd8a9ebea128 and project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:21:58.032264 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07771723-76c7-45e1-a17a-df1464525fee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.155881 Oct 27 10:21:58.033289 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1577/3293] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:21:57 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:58.042630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:58.043500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:58.060906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.062310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.065375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.085802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.088389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.089545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.205591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:58.218454 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9023ff5-442a-4735-a440-17c67ca441ee tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1554 microversion: 2.1 time: 0.388114 Oct 27 10:21:58.221254 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1717/3294] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:57 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1554 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:58.236112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a511c9f9-8347-4630-af66-337736bca08b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '.version_select at 0x7f6d638b73a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:58.294492 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a511c9f9-8347-4630-af66-337736bca08b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Image not found. Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a511c9f9-8347-4630-af66-337736bca08b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/images/4c592a3c-8fc2-44f9-9fb7-293868e9d9d5 HTTP/1.1 Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '4c592a3c-8fc2-44f9-9fb7-293868e9d9d5'} Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4c592a3c-8fc2-44f9-9fb7-293868e9d9d5 to delete Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4c592a3c-8fc2-44f9-9fb7-293868e9d9d5 could not be found. Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:58.296975 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a511c9f9-8347-4630-af66-337736bca08b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a511c9f9-8347-4630-af66-337736bca08b tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/images/4c592a3c-8fc2-44f9-9fb7-293868e9d9d5" status: 404 len: 62 microversion: 2.1 time: 0.072406 Oct 27 10:21:58.304299 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1718/3295] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:58 2022] DELETE /compute/v2.1/images/4c592a3c-8fc2-44f9-9fb7-293868e9d9d5 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:21:58.308561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1593e18f-b488-4432-9699-d12595c59ffc req-55ffbdb9-44b4-47e8-afc0-b82d264da358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f302063-d3bf-42f7-bca0-250439687c97", "name": "network-vif-deleted", "tag": "dabf0782-b3f5-4cd6-84d2-bf55ca9aa27e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:58.338642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1593e18f-b488-4432-9699-d12595c59ffc req-55ffbdb9-44b4-47e8-afc0-b82d264da358 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.339894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1593e18f-b488-4432-9699-d12595c59ffc req-55ffbdb9-44b4-47e8-afc0-b82d264da358 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.340343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1593e18f-b488-4432-9699-d12595c59ffc req-55ffbdb9-44b4-47e8-afc0-b82d264da358 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.375381 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1593e18f-b488-4432-9699-d12595c59ffc req-55ffbdb9-44b4-47e8-afc0-b82d264da358 service nova] Creating event network-vif-deleted:dabf0782-b3f5-4cd6-84d2-bf55ca9aa27e for instance 9f302063-d3bf-42f7-bca0-250439687c97 on n-h2-854663-10 Oct 27 10:21:58.388307 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1593e18f-b488-4432-9699-d12595c59ffc req-55ffbdb9-44b4-47e8-afc0-b82d264da358 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087415 Oct 27 10:21:58.390617 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1719/3296] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:21:58.406121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:58.407263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:58.432913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.434386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.435090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.436228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.437229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.438036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.468575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:58.471149 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.480139 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0720ed6b-62c3-4145-843a-7d85659a4777 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1307 microversion: 2.1 time: 0.444476 Oct 27 10:21:58.481761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1578/3297] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:58 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1307 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:58.497089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec HTTP/1.1 Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '66526d64-5921-4273-a259-32f11a2fe5ec'} Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:58.501660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.506057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.507819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:58.510679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:58.517905 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33e97812-4570-4e99-b669-0ebf26563489 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 404 len: 111 microversion: 2.1 time: 0.125638 Oct 27 10:21:58.519334 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1720/3298] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:21:58 2022] DELETE /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:58.525762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.526269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.526761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.527472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.527926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.528358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.529038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:58.530661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 66526d64-5921-4273-a259-32f11a2fe5ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:58.540584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:58.546447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.550010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.553499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.554622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.556980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.566883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.613969 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec HTTP/1.1 Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '66526d64-5921-4273-a259-32f11a2fe5ec'} Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.621715 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Instance 66526d64-5921-4273-a259-32f11a2fe5ec could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:21:58.625586 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-762200b9-c126-41c3-af80-18f7d9a3842c tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec" status: 404 len: 111 microversion: 2.1 time: 0.100531 Oct 27 10:21:58.626774 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1721/3299] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:58 2022] GET /compute/v2.1/servers/66526d64-5921-4273-a259-32f11a2fe5ec => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:21:58.638996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9682272-1c0e-44c6-ac15-e0ad9ef1b221 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '.version_select at 0x7f6d639a1af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:58.685305 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9682272-1c0e-44c6-ac15-e0ad9ef1b221 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235161861" status: 202 len: 0 microversion: 2.1 time: 0.053738 Oct 27 10:21:58.688785 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1722/3300] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:21:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235161861 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:21:58.760509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:58.761691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:58.778413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.779194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.781300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.782286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:58.784416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:58.786437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:58.955257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:58.975712 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a85be012-804d-40db-bb6d-5f57a2560c52 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1370 microversion: 2.1 time: 0.482786 Oct 27 10:21:58.975712 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1579/3301] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:58 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1370 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:58.976971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:58.998333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:59.034060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:59.035388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:59.036698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:59.037578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:59.038835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:59.039980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:59.113076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:59.132568 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce9a1a59-484c-4599-b325-601a825c15b3 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1268 microversion: 2.1 time: 0.378110 Oct 27 10:21:59.144729 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1723/3302] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:58 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1268 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:59.248024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:59.248649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:59.301474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:59.302017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:59.302471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:59.303207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:59.307753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:59.308105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:59.990803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:00.005089 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bbc4a981-a406-497f-be17-12c0aef442ec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1309 microversion: 2.1 time: 1.034165 Oct 27 10:22:00.012201 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1580/3303] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:58 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1309 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:00.017935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:00.022662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:00.037426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:00.038194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:00.044725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:00.048461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:00.050026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:00.051831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:00.270758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:00.288018 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-248b89be-b363-421b-8837-03e53783af82 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1554 microversion: 2.1 time: 1.044007 Oct 27 10:22:00.295616 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1724/3304] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:59 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1554 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:00.313514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:00.314140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:00.336087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:00.337046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:00.337685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:00.338731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:00.339427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:00.340282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:01.350128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:01.371621 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e9ae1e65-8eb6-4ddd-957a-08444a09c819 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1307 microversion: 2.1 time: 1.356418 Oct 27 10:22:01.375354 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1581/3305] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:00 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1307 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:01.389208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:01.392020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:01.401501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:01.403297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:01.406948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:01.408155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:01.410399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:01.413097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:01.453796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:01.468269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-023b4e6b-b755-43a4-b034-d21aafedd5c3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1564 microversion: 2.1 time: 1.167325 Oct 27 10:22:01.471463 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1725/3306] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:00 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1564 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:01.476967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:01.484066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:01.496629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:01.499919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:01.500772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:01.501665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:01.503678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:01.506179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:01.834570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:01.858938 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35a731dc-fdda-4438-9c46-888f741fb2a5 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1274 microversion: 2.1 time: 0.481018 Oct 27 10:22:01.862321 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1582/3307] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:01 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1274 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:01.871205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:01.872372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:01.891400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:01.899157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:01.900591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:01.904014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:01.904836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:01.907621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:01.961006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:01.978428 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4524cc7-96fa-4fa1-85fb-256fcfc268e4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1309 microversion: 2.1 time: 0.504347 Oct 27 10:22:01.980576 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1726/3308] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:01 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1309 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:02.005683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f02aeb4-b656-458d-b57b-4baea2a18032 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '.version_select at 0x7f6d5b635160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:02.058559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6f02aeb4-b656-458d-b57b-4baea2a18032 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Image not found. Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f02aeb4-b656-458d-b57b-4baea2a18032 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/images/5f166386-6f60-4c11-9b03-9cb7061a8fca HTTP/1.1 Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '5f166386-6f60-4c11-9b03-9cb7061a8fca'} Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5f166386-6f60-4c11-9b03-9cb7061a8fca to delete Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5f166386-6f60-4c11-9b03-9cb7061a8fca could not be found. Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:02.060357 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f02aeb4-b656-458d-b57b-4baea2a18032 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:02.065124 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f02aeb4-b656-458d-b57b-4baea2a18032 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/images/5f166386-6f60-4c11-9b03-9cb7061a8fca" status: 404 len: 62 microversion: 2.1 time: 0.080165 Oct 27 10:22:02.066784 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1727/3309] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:01 2022] DELETE /compute/v2.1/images/5f166386-6f60-4c11-9b03-9cb7061a8fca => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:22:02.074908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c70b621-84cb-41bb-b566-7e6c7d69fc06 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:02.075436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c70b621-84cb-41bb-b566-7e6c7d69fc06 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:02.096265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c70b621-84cb-41bb-b566-7e6c7d69fc06 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.096805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c70b621-84cb-41bb-b566-7e6c7d69fc06 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.097244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c70b621-84cb-41bb-b566-7e6c7d69fc06 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.097947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c70b621-84cb-41bb-b566-7e6c7d69fc06 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.098400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c70b621-84cb-41bb-b566-7e6c7d69fc06 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.098822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c70b621-84cb-41bb-b566-7e6c7d69fc06 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.192350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:02.207102 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13f60776-2126-4b5a-a1ac-7b80b3f955e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1346 microversion: 2.1 time: 0.343297 Oct 27 10:22:02.207949 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1583/3310] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:01 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1346 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:02.217393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6585e962-e147-4143-981c-c0e81d6320a1 req-782cd643-fc12-4856-9dce-2eb7bae6a97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c1dd7f-094e-451b-bbd1-0aceb7873a96", "name": "network-vif-deleted", "tag": "9397bff6-e10d-4ce0-b94a-3f64f4b9f8d2"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:02.250381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6585e962-e147-4143-981c-c0e81d6320a1 req-782cd643-fc12-4856-9dce-2eb7bae6a97d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.251139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6585e962-e147-4143-981c-c0e81d6320a1 req-782cd643-fc12-4856-9dce-2eb7bae6a97d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.254018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6585e962-e147-4143-981c-c0e81d6320a1 req-782cd643-fc12-4856-9dce-2eb7bae6a97d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.277614 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6585e962-e147-4143-981c-c0e81d6320a1 req-782cd643-fc12-4856-9dce-2eb7bae6a97d service nova] Creating event network-vif-deleted:9397bff6-e10d-4ce0-b94a-3f64f4b9f8d2 for instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 on n-h1-854663-10 Oct 27 10:22:02.289651 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c70b621-84cb-41bb-b566-7e6c7d69fc06 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222924 Oct 27 10:22:02.291134 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1728/3311] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:22:02 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:02.297078 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6585e962-e147-4143-981c-c0e81d6320a1 req-782cd643-fc12-4856-9dce-2eb7bae6a97d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084078 Oct 27 10:22:02.299226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:02.300129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:02.303998 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1584/3312] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:02.316830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.317831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.318515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.319434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.320097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.320233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-18ccff34-565d-4019-a5e1-a0cff388de48 req-3b2a42e5-816b-497a-86a1-590f5bebcc9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74d2938-9f25-40b2-abee-11f4d42e46fd", "name": "network-vif-plugged", "status": "completed", "tag": "eea30e87-7401-4aec-9292-4c76c45f04bd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:02.320936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.347491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-18ccff34-565d-4019-a5e1-a0cff388de48 req-3b2a42e5-816b-497a-86a1-590f5bebcc9f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.347945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-18ccff34-565d-4019-a5e1-a0cff388de48 req-3b2a42e5-816b-497a-86a1-590f5bebcc9f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.348566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-18ccff34-565d-4019-a5e1-a0cff388de48 req-3b2a42e5-816b-497a-86a1-590f5bebcc9f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.354276 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 HTTP/1.1 Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '25a50fe3-e249-496a-af7a-9acffd9d7759'} Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:02.359540 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.364464 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.366045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:02.368091 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3c8dd22-f9cb-4471-9e3f-60c060bb8a01 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "DELETE /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 404 len: 111 microversion: 2.1 time: 0.075845 Oct 27 10:22:02.372973 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1729/3313] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:22:02 2022] DELETE /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:22:02.382076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:02.385194 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-18ccff34-565d-4019-a5e1-a0cff388de48 req-3b2a42e5-816b-497a-86a1-590f5bebcc9f service nova] Creating event network-vif-plugged:eea30e87-7401-4aec-9292-4c76c45f04bd for instance c74d2938-9f25-40b2-abee-11f4d42e46fd on n-h1-854663-10 Oct 27 10:22:02.390843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] [instance: 25a50fe3-e249-496a-af7a-9acffd9d7759] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:02.410801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.411239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.411693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.412413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.412560 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-18ccff34-565d-4019-a5e1-a0cff388de48 req-3b2a42e5-816b-497a-86a1-590f5bebcc9f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104725 Oct 27 10:22:02.413344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.413585 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1585/3314] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:02.414208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.433989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:02.434715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:02.456557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.457297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.457932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.458833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.460170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.460833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.478643 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] HTTP exception thrown: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Request method failure captured: Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 HTTP/1.1 Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltPb1rkGNMTeiET5UfRCoTz8wY9b_4aktMRxXlCWTV9iyCN4uTuk022xGU6qSWbpYl7vumwHk2hX0XavxiQQrcyDMPvrUMYx2UwMF2aUznwMs7-UGWoULSsWUb75IfqXU0650YqlrOL0irqytx7J2O821oAvvPc1uocMWH2Do_Twjc Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a8c3992187114a2887044b851d6c7838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a8c3992187114a2887044b851d6c7838", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a8c3992187114a2887044b851d6c7838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a8c3992187114a2887044b851d6c7838 Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-230128957 Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 3d0c785c43b24f64b5d1ec4510c78fdd Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-230128957-project Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '25a50fe3-e249-496a-af7a-9acffd9d7759'} Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.491328 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:02.495119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.495119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:02.495119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:02.495119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:02.495119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:02.495119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:02.495119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. Oct 27 10:22:02.495119 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:02.495119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] Returning 404 to user: Instance 25a50fe3-e249-496a-af7a-9acffd9d7759 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:02.496403 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4ddaee9-08e9-4d2f-9c44-f69913c30339 tempest-ImagesOneServerNegativeTestJSON-230128957 tempest-ImagesOneServerNegativeTestJSON-230128957-project] 10.222.0.76 "GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759" status: 404 len: 111 microversion: 2.1 time: 0.116117 Oct 27 10:22:02.497241 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1730/3315] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:02 2022] GET /compute/v2.1/servers/25a50fe3-e249-496a-af7a-9acffd9d7759 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:22:02.888773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:02.889431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:02.899986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.900485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.902643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:02.903408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:02.903878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:02.904310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:03.521681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:03.537777 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab62bea0-2b4d-4eae-b2be-260a7dc40efe tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1274 microversion: 2.1 time: 0.655769 Oct 27 10:22:03.538393 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1731/3316] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:02 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1274 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:03.543939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:03.544557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:03.571503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:03.572003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:03.572461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:03.573230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:03.573815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:03.574258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:03.631979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:03.642888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d157031e-7ffe-4562-8021-545b18a319f4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1307 microversion: 2.1 time: 1.228102 Oct 27 10:22:03.643495 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1586/3317] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:02 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1307 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:03.661920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:03.672217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:03.687098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:03.687870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:03.691234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:03.692269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:03.692934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:03.697092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:03.858005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:03.879714 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-beb8b4e9-e731-479c-aabe-fdb362a0d707 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1346 microversion: 2.1 time: 0.221676 Oct 27 10:22:03.892090 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1587/3318] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:03 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1346 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:04.023268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:04.026354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:04.055388 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09273910-ffa1-47d9-90dd-c5e4129a5b35 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1309 microversion: 2.1 time: 0.515835 Oct 27 10:22:04.056190 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1732/3319] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:03 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1309 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:04.562566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:04.563804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:04.587515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:04.588251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:04.588910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:04.589960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:04.593910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:04.594596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:04.670151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:04.671625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:04.689954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:04.694387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:04.700583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:04.703812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:04.704322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:04.704869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:05.253209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:05.267793 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-677aa868-f60c-41f0-a12c-4368e1ce216d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.710354 Oct 27 10:22:05.268807 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1588/3320] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:04 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:05.278023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f27dcdc9-b401-4f18-9860-9071cdeffd89 req-48a419d3-2d6d-4aa2-9ce6-a5e8bea50ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54c5675-6a87-4213-a858-dd71fc93e9c7", "tag": "71360be2-953d-4a1c-9c77-3a1b49634b01"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:05.303042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f27dcdc9-b401-4f18-9860-9071cdeffd89 req-48a419d3-2d6d-4aa2-9ce6-a5e8bea50ecc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:05.303841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f27dcdc9-b401-4f18-9860-9071cdeffd89 req-48a419d3-2d6d-4aa2-9ce6-a5e8bea50ecc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:05.305218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f27dcdc9-b401-4f18-9860-9071cdeffd89 req-48a419d3-2d6d-4aa2-9ce6-a5e8bea50ecc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:05.347158 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f27dcdc9-b401-4f18-9860-9071cdeffd89 req-48a419d3-2d6d-4aa2-9ce6-a5e8bea50ecc service nova] Creating event network-changed:71360be2-953d-4a1c-9c77-3a1b49634b01 for instance b54c5675-6a87-4213-a858-dd71fc93e9c7 on n-h2-854663-10 Oct 27 10:22:05.368964 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f27dcdc9-b401-4f18-9860-9071cdeffd89 req-48a419d3-2d6d-4aa2-9ce6-a5e8bea50ecc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097548 Oct 27 10:22:05.370585 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1589/3321] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:05.378895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:05.380478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:05.392034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:05.392871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:05.393499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:05.403537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:05.404399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:05.405129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:05.625607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:05.639562 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee5ef197-34d8-4462-86b1-458573d0ad3d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1346 microversion: 2.1 time: 0.263335 Oct 27 10:22:05.640222 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1590/3322] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:05 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1346 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:05.669761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:05.676948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:05.677918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:05.684291 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7053b3cb-5679-4443-a67c-5196ee9501be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1307 microversion: 2.1 time: 1.018156 Oct 27 10:22:05.701716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:05.702221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:05.702664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:05.703387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:05.704314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:05.707384 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1733/3323] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:04 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1307 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:05.708694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:05.795831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0d1cffdb-604d-4d24-bce7-9b9697169079 req-1ef1bd5a-59cb-4cac-bcd7-f74924ded0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c36f35-e7e7-4be9-9d2a-a5c584b6487b", "name": "network-vif-plugged", "status": "completed", "tag": "c46376ab-d0ed-477c-bc54-023268393e9a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:05.813654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0d1cffdb-604d-4d24-bce7-9b9697169079 req-1ef1bd5a-59cb-4cac-bcd7-f74924ded0ee service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:05.820344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0d1cffdb-604d-4d24-bce7-9b9697169079 req-1ef1bd5a-59cb-4cac-bcd7-f74924ded0ee service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:05.821125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0d1cffdb-604d-4d24-bce7-9b9697169079 req-1ef1bd5a-59cb-4cac-bcd7-f74924ded0ee service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:05.852513 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0d1cffdb-604d-4d24-bce7-9b9697169079 req-1ef1bd5a-59cb-4cac-bcd7-f74924ded0ee service nova] Creating event network-vif-plugged:c46376ab-d0ed-477c-bc54-023268393e9a for instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b on n-h1-854663-10 Oct 27 10:22:05.865655 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0d1cffdb-604d-4d24-bce7-9b9697169079 req-1ef1bd5a-59cb-4cac-bcd7-f74924ded0ee service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074138 Oct 27 10:22:05.866586 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1734/3324] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:22:06.296532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:06.308158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:06.311038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:06.329715 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf12b66f-e0c5-4a4f-b8ac-ce9e41c49bb8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1309 microversion: 2.1 time: 0.664917 Oct 27 10:22:06.336156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:06.336800 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1591/3325] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:05 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1309 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:06.343862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:06.344319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:06.345265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:06.345727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:06.346159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:06.678206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:06.679167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:06.688766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:06.701500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:06.703996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:06.705184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:06.706162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:06.708613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:06.709344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:06.906394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:06.909160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:06.920285 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5346706c-d3a6-4828-81f6-f2d1dc205c90 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.624096 Oct 27 10:22:06.921833 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1735/3326] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:06 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:06.936213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ccdacade-9981-4da3-9ac5-e89f78a3d98d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1346 microversion: 2.1 time: 0.268470 Oct 27 10:22:06.936849 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1592/3327] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:06 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1346 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:06.937500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:06.938343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:06.949643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:06.950562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:06.951190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:06.952095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:06.957239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:06.958229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:07.215609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:07.226210 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ef774a3-2a95-4334-a12b-19e8a9ee8c21 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1486 microversion: 2.1 time: 0.303057 Oct 27 10:22:07.227817 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1736/3328] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:06 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1486 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:07.254145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:07.255180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:07.266400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:07.267671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:07.267671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:07.268122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:07.273183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:07.273801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:07.317978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lazy-loading 'flavor' on Instance uuid c74d2938-9f25-40b2-abee-11f4d42e46fd {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:22:07.360603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:07.361235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:07.380902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:07.381379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:07.381998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:07.382904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:07.383787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:07.384225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:07.414525 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bbf2ad71-6cb5-4bff-9f53-7d471c24fe77 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd/action" status: 202 len: 0 microversion: 2.1 time: 0.165931 Oct 27 10:22:07.417535 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1593/3329] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:22:07 2022] POST /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:22:07.432189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:07.433353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:07.444390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:07.444960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:07.445397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:07.446324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:07.446932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:07.447516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:07.708432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:07.719340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:07.722342 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0dc72ee8-d5af-4540-95e9-b7787e07c13e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1309 microversion: 2.1 time: 0.366005 Oct 27 10:22:07.723519 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1737/3330] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:07 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:07.742193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-877046451", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9405a813-2b98-46c3-9126-2e0aba2c6166"}], "security_groups": [{"name": "tempest-securitygroup--1631313668"}], "key_name": "tempest-keypair-4719984", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:07.778575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:07.787024 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d5c1dd88-74d7-4ad2-b4f7-cc796fa29a1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1494 microversion: 2.1 time: 0.365176 Oct 27 10:22:07.787612 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1594/3331] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:07 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1494 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:07.950257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:07.951180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:07.951981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] validate_networks() for [('9405a813-2b98-46c3-9126-2e0aba2c6166', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:22:07.980002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:07.980946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:07.981659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:07.982653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:07.989731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:07.990545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:08.025237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=15 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:08.308601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:08.327544 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-665486b6-82ca-4992-b9ec-96176f1b8d44 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.383589 Oct 27 10:22:08.333518 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1595/3332] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:07 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:08.338645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:08.339319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:08.352806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:08.353693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:08.354404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:08.355654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:08.356681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:08.357259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:08.382384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:08.446012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:08.457133 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4f1a2094-a593-43f7-ac7e-4d8df8174c5e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1346 microversion: 2.1 time: 0.122323 Oct 27 10:22:08.459108 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1596/3333] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:08 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:08.691660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:22:08.692697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:22:08.693461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:22:08.694428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:22:08.695221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:22:08.706771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:08.707535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:08.708126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:08.709480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:08.710121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:08.710951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:08.733221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:22:08.742474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for user 1ebcbfbb11e84fe5bbfebd8a9ebea128 and project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:22:08.747744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:08.748584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:08.755463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:08.756942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:22:08.757956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:08.758617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:08.759220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:08.759665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:22:08.760526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:08.761335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:08.762243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:08.833426 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55dd529b-e607-4e48-a833-38f6201dc671 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.107931 Oct 27 10:22:08.836415 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1738/3334] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:22:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:22:08.847562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:08.849005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:08.878566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:08.879067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:08.879508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:08.884237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:08.886580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:08.886580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:09.009861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:09.018121 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-854a72d7-eaa9-4d45-bee4-14c64c68a268 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1489 microversion: 2.1 time: 0.274983 Oct 27 10:22:09.035351 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1597/3335] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:08 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1489 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:09.049602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5db7ad17-620a-4771-8379-c1443e860a2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:09.051104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5db7ad17-620a-4771-8379-c1443e860a2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:09.201730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5db7ad17-620a-4771-8379-c1443e860a2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:09.215249 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5db7ad17-620a-4771-8379-c1443e860a2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1235 microversion: 2.1 time: 0.177016 Oct 27 10:22:09.217914 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1598/3336] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:09 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1235 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:09.240227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:09.242017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:09.261709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:09.263875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:09.266917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:09.268598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:09.271070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:09.271663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:09.450927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:09.463154 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-459a22d7-52f4-4934-92ed-db86ffccef84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 200 len: 1477 microversion: 2.1 time: 0.625582 Oct 27 10:22:09.471644 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1739/3337] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:08 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 1477 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:09.493127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:09.496383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:09.514519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:09.515018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:09.515840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:09.524810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:09.525329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:09.526185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:09.790264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:09.813967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5dace9e8-4370-4a3f-98f6-1a8c622951a9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1489 microversion: 2.1 time: 0.594728 Oct 27 10:22:09.833404 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1599/3338] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:09 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1489 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:09.841987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-62c99360-0b7a-4352-b1c6-2dbf98ba4dc4 req-8b8b0bc3-f162-4aaf-bdea-cf01334e332d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdde4a8b-e672-44ca-8ed3-42c7ca94a052", "tag": "f8deeb59-e3d0-4c24-aeed-6e9ddbeb7fcd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:09.857841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-62c99360-0b7a-4352-b1c6-2dbf98ba4dc4 req-8b8b0bc3-f162-4aaf-bdea-cf01334e332d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:09.858801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-62c99360-0b7a-4352-b1c6-2dbf98ba4dc4 req-8b8b0bc3-f162-4aaf-bdea-cf01334e332d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:09.859610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-62c99360-0b7a-4352-b1c6-2dbf98ba4dc4 req-8b8b0bc3-f162-4aaf-bdea-cf01334e332d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:09.874919 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-62c99360-0b7a-4352-b1c6-2dbf98ba4dc4 req-8b8b0bc3-f162-4aaf-bdea-cf01334e332d service nova] Creating event network-changed:f8deeb59-e3d0-4c24-aeed-6e9ddbeb7fcd for instance cdde4a8b-e672-44ca-8ed3-42c7ca94a052 on n-h2-854663-10 Oct 27 10:22:09.891313 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-62c99360-0b7a-4352-b1c6-2dbf98ba4dc4 req-8b8b0bc3-f162-4aaf-bdea-cf01334e332d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049953 Oct 27 10:22:09.892757 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1600/3339] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:09.910354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:09.910984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:09.911958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:09.920884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:09.921738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:09.922393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:09.923616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:09.924334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:09.925394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:09.929527 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1b34cdb-1062-43f1-ab3e-26717dd47a83 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.450867 Oct 27 10:22:09.948993 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1740/3340] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:09 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:09.967183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8b975e9-6a88-427e-bd12-f737f534996e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1813186314"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:09.980550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8b975e9-6a88-427e-bd12-f737f534996e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:10.008896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8b975e9-6a88-427e-bd12-f737f534996e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:10.009393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8b975e9-6a88-427e-bd12-f737f534996e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:10.009829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8b975e9-6a88-427e-bd12-f737f534996e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:10.010538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8b975e9-6a88-427e-bd12-f737f534996e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:10.011045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8b975e9-6a88-427e-bd12-f737f534996e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:10.011442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8b975e9-6a88-427e-bd12-f737f534996e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:10.093974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:10.160939 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0985de37-3f65-4b76-a7f0-98b494f279f3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 200 len: 1346 microversion: 2.1 time: 0.263635 Oct 27 10:22:10.164636 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1601/3341] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:09 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 1346 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:10.207868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:10.208508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:10.240035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:10.243671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:10.251544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:10.255181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:10.258034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:10.258367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:10.603599 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8b975e9-6a88-427e-bd12-f737f534996e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd/action" status: 202 len: 0 microversion: 2.1 time: 0.651660 Oct 27 10:22:10.611346 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1741/3342] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:22:09 2022] POST /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:22:10.628136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:10.629440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:10.651496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:10.654023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:10.655486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:10.658594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:10.659674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:10.660410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.253795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:11.270936 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29d5f3a1-fdfe-4ee1-9788-32de2e08c1a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1287 microversion: 2.1 time: 0.657864 Oct 27 10:22:11.296845 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1742/3343] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:10 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1287 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:11.302562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb06866e-e5ab-47cf-a4ac-b590db913e42 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5bcf5a60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:11.330199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:11.353662 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-efba3221-a225-4f67-9047-3c6283621684 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1489 microversion: 2.1 time: 1.180766 Oct 27 10:22:11.356284 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1602/3344] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:10 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1489 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:11.365860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:11.367600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:11.373107 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb06866e-e5ab-47cf-a4ac-b590db913e42 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.074864 Oct 27 10:22:11.374773 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1743/3345] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:11 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:11.377086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.377946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.378660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.379801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.380489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.381382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.390074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:11.390863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:11.405482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.406138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.406676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.407495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.408053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.408765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.436259 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 HTTP/1.1 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '67c1dd7f-094e-451b-bbd1-0aceb7873a96'} Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:11.438300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.443788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:11.443788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:11.443788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:11.443788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:11.443788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:11.443788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.443788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.445822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:11.446876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01fe79e1-38e8-4965-9a3f-db83e7b39ed1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 404 len: 111 microversion: 2.1 time: 0.068710 Oct 27 10:22:11.448093 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1744/3346] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:11 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:22:11.466100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:11.466594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:11.473351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.473852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.474290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.475456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.476246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.476930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.533587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:22:11.724216 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d29fd089-6fea-4520-b097-b58c476d5f6d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 204 len: 0 microversion: 2.1 time: 0.274423 Oct 27 10:22:11.725075 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1745/3347] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:22:11 2022] DELETE /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:22:11.736619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:11.739937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:11.740102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:11.748169 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87d6dc37-71d7-4bb6-95e9-2e7858e2ce54 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.389801 Oct 27 10:22:11.763596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.763596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.763596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.763596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.763596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.763596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.764862 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1603/3348] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:11 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:11.769996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:11.772751 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96/os-volume_attachments HTTP/1.1 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': '67c1dd7f-094e-451b-bbd1-0aceb7873a96'} Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:11.775010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:22:11.779414 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:11.781287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:11.784406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:11.785374 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ec81f09-0e53-4bb6-84a2-610340d55de7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.058903 Oct 27 10:22:11.789151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.789151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.789151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.789151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:11.789151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:11.789151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:11.790185 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1746/3349] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:22:11 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:22:12.075342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:12.075952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1844814185", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "aebae77c-7c09-4e55-b34c-9671e2410be6"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:12.087130 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d8c8295-a833-4051-a167-d67bf0e66c59 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1495 microversion: 2.1 time: 0.320449 Oct 27 10:22:12.088514 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1604/3350] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:11 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1495 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:12.177398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] validate_networks() for [('aebae77c-7c09-4e55-b34c-9671e2410be6', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:22:12.300335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:12.300984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:12.314257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:12.315008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:12.316260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:12.317177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:12.317774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:12.318365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:12.467303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:12.476958 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-794677fd-33a2-421c-8a3c-18c8d07db366 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1293 microversion: 2.1 time: 0.181097 Oct 27 10:22:12.478272 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1605/3351] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:12 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:12.483361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81eb0a9e-b501-4675-90cd-43dd8430f101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b2c7820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:12.536342 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81eb0a9e-b501-4675-90cd-43dd8430f101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.056754 Oct 27 10:22:12.544951 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1606/3352] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:12 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:12.771601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:12.772597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:12.779406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:12.779892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:12.780332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:12.781053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:12.781728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:12.782182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:13.168324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:13.183250 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96f595d0-6c14-4a4d-9974-bc8c9a03ada1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.415471 Oct 27 10:22:13.183852 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1607/3353] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:12 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:13.188980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:13.191870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:13.201661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:13.202056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:13.202483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:13.203184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:13.210173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:13.210620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:13.293551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:22:13.294069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:22:13.294507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:22:13.295086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:22:13.295648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:22:13.298121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:13.317472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:13.317951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:13.318572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:13.319535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:13.320161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:13.324454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:13.369895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:22:13.382430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for user 83da5c7956454b278e9f9d6641a01711 and project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:22:13.420255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:22:13.422648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 302d09c5-4dc8-4b9f-a215-9af59ca4d95e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:22:13.561176 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11ba4e5a-e148-4824-ada0-a92bd28a5cd8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490551 Oct 27 10:22:13.562062 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1747/3354] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:22:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:22:13.583609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:13.583943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:13.599441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:13.604102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:13.604102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:13.604551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:13.606635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:13.610461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:13.697596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:13.707237 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f1abbf4-070c-43d8-9d00-b90e16c2d1bf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1495 microversion: 2.1 time: 0.522151 Oct 27 10:22:13.707851 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1608/3355] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:13 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1495 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:13.742023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c62d7b23-935b-4626-a6cb-fdfba3912db6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b501670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:13.824812 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c62d7b23-935b-4626-a6cb-fdfba3912db6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.086160 Oct 27 10:22:13.832930 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1609/3356] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:13 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:13.832930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05b57710-f6b1-4b31-9f24-e3680f80d7ec tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:13.835101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-05b57710-f6b1-4b31-9f24-e3680f80d7ec tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 302d09c5-4dc8-4b9f-a215-9af59ca4d95e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:13.838267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:13.853062 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a885fb1a-2b67-4554-a502-a90094c7f689 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1293 microversion: 2.1 time: 0.283571 Oct 27 10:22:13.857061 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1748/3357] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:13 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1293 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:13.924206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-05b57710-f6b1-4b31-9f24-e3680f80d7ec tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:13.943449 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05b57710-f6b1-4b31-9f24-e3680f80d7ec tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e" status: 200 len: 1215 microversion: 2.1 time: 0.116437 Oct 27 10:22:13.944420 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1610/3358] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:13 2022] GET /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:13.965658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83aa918d-9a88-42fb-bd05-ff0efc97c12e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:13.972512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83aa918d-9a88-42fb-bd05-ff0efc97c12e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 302d09c5-4dc8-4b9f-a215-9af59ca4d95e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:14.030491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83aa918d-9a88-42fb-bd05-ff0efc97c12e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 302d09c5-4dc8-4b9f-a215-9af59ca4d95e] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:22:14.207507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:14.208141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:14.223386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:14.223892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:14.224331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:14.225105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:14.225557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:14.225977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:14.738250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.api [None req-83aa918d-9a88-42fb-bd05-ff0efc97c12e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 302d09c5-4dc8-4b9f-a215-9af59ca4d95e] Instance Mapping does not exist while attempting local delete cleanup. Oct 27 10:22:14.739238 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83aa918d-9a88-42fb-bd05-ff0efc97c12e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e" status: 204 len: 0 microversion: 2.1 time: 0.777571 Oct 27 10:22:14.740567 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1749/3359] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:22:13 2022] DELETE /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e => generated 0 bytes in 779 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:22:14.752279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:14.753327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:14.768718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:14.771247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:14.773722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:14.775981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:14.778071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:14.779197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:14.786000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:14.803550 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-89a0249a-3e27-4cd1-88be-47ce48c4aa7b tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.600280 Oct 27 10:22:14.831140 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1611/3360] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:14 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:14.852429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e1a705f-78e1-4ded-94ca-c8969f0bd0b8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:14.853125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0e1a705f-78e1-4ded-94ca-c8969f0bd0b8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 302d09c5-4dc8-4b9f-a215-9af59ca4d95e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:14.872179 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0e1a705f-78e1-4ded-94ca-c8969f0bd0b8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e1a705f-78e1-4ded-94ca-c8969f0bd0b8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e HTTP/1.1 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '302d09c5-4dc8-4b9f-a215-9af59ca4d95e'} Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:14.874691 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:14.882130 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:14.882130 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:14.882130 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:14.882130 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:22:14.882130 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:14.894048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e1a705f-78e1-4ded-94ca-c8969f0bd0b8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:14.896244 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e1a705f-78e1-4ded-94ca-c8969f0bd0b8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e" status: 404 len: 111 microversion: 2.1 time: 0.060188 Oct 27 10:22:14.899961 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1612/3361] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:14 2022] GET /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:22:14.907220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05a8a313-fdd2-4b7a-8442-45eb03e3789d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d63907430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:14.998655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:15.021197 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b4951027-c99e-477e-bb48-1e6117f2425a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 200 len: 1453 microversion: 2.1 time: 0.273140 Oct 27 10:22:15.026210 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1750/3362] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:14 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 1453 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:15.029738 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05a8a313-fdd2-4b7a-8442-45eb03e3789d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.124483 Oct 27 10:22:15.048635 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1613/3363] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:14 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:15.062441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1454139593", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "aebae77c-7c09-4e55-b34c-9671e2410be6"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:15.071124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:15.072049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:15.090604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:15.091945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:15.094756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:15.096492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:15.103777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:15.105318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:15.230485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] validate_networks() for [('aebae77c-7c09-4e55-b34c-9671e2410be6', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:22:15.922707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:15.926542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:15.937417 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c40d1f1c-0d77-4c13-bd66-416664c585b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1361 microversion: 2.1 time: 0.909795 Oct 27 10:22:15.942559 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1751/3364] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:15 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1361 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:15.955544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7c4f3f47-948f-44d2-81ac-c4dada0009bb req-f9b5f42e-5993-454f-9db6-4186dba182f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c36f35-e7e7-4be9-9d2a-a5c584b6487b", "name": "network-vif-deleted", "tag": "c46376ab-d0ed-477c-bc54-023268393e9a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:15.987292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7c4f3f47-948f-44d2-81ac-c4dada0009bb req-f9b5f42e-5993-454f-9db6-4186dba182f6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:15.987839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7c4f3f47-948f-44d2-81ac-c4dada0009bb req-f9b5f42e-5993-454f-9db6-4186dba182f6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:15.988284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7c4f3f47-948f-44d2-81ac-c4dada0009bb req-f9b5f42e-5993-454f-9db6-4186dba182f6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:16.054793 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7c4f3f47-948f-44d2-81ac-c4dada0009bb req-f9b5f42e-5993-454f-9db6-4186dba182f6 service nova] Creating event network-vif-deleted:c46376ab-d0ed-477c-bc54-023268393e9a for instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b on n-h1-854663-10 Oct 27 10:22:16.072946 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7c4f3f47-948f-44d2-81ac-c4dada0009bb req-f9b5f42e-5993-454f-9db6-4186dba182f6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127508 Oct 27 10:22:16.075784 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1752/3365] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:16.089637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:16.092715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:16.111904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:16.112412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:16.114729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:16.115492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:16.117867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:16.118317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:16.670948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:16.682720 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bde87fb3-7fe5-4cf1-91dd-76d9a6e95f76 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.603412 Oct 27 10:22:16.693428 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1753/3366] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:16 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:16.698512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c906872-8370-4067-b4b5-364a9e8cc9a4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b796d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:16.763360 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c906872-8370-4067-b4b5-364a9e8cc9a4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.068511 Oct 27 10:22:16.793592 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1754/3367] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:16 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:16.800094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:16.807010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:16.827320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:16.837126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:16.837870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:16.839022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:16.840239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:16.841946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:16.874176 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b HTTP/1.1 Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '96c36f35-e7e7-4be9-9d2a-a5c584b6487b'} Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:16.876056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:16.880337 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:16.880337 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:16.880337 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:16.880337 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:16.880337 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:16.880337 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:22:16.880337 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:16.882165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:16.883218 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33c9692c-a945-42ba-9be2-7cb096be049f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 404 len: 111 microversion: 2.1 time: 0.088132 Oct 27 10:22:16.890820 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1755/3368] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:16 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:22:16.892247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:16.892858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:16.899479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:16.902493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:16.903701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:16.904904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:16.905583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:16.906195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:16.928547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:22:16.929582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:22:16.930228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:22:16.930807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:22:16.931452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:22:16.935610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:22:16.952928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:16.953433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:16.953877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:16.954616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:16.958179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:16.958179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:17.002831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:22:17.017841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for user 83da5c7956454b278e9f9d6641a01711 and project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:22:17.063180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:22:17.074607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:22:17.113103 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48a4350c-c718-4b8f-978a-55eca1ed5763 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 204 len: 0 microversion: 2.1 time: 0.223893 Oct 27 10:22:17.113928 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1756/3369] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:22:16 2022] DELETE /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:22:17.124132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:17.125147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:17.133252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:17.133837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:17.134336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:17.135279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:17.135809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:17.136430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:17.234378 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52897122-fb94-4974-9ed7-a35ab9c7519a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.184392 Oct 27 10:22:17.235910 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1614/3370] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:22:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:22:17.240914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:17.242063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:17.251133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:17.251910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:17.252707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:17.254572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:17.255523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:17.256153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:18.018231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:18.028292 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec6b1fae-e860-4d50-9458-e037c35992a2 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1495 microversion: 2.1 time: 0.791002 Oct 27 10:22:18.041695 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1615/3371] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:17 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1495 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:18.055964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:18.057025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:18.070433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:18.073049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:18.073514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:18.074297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:18.074762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:18.075184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:18.106427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:18.120704 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a96fad3-bd0f-467a-a31b-6523864d7080 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1361 microversion: 2.1 time: 0.998320 Oct 27 10:22:18.133553 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1757/3372] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:17 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1361 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:18.154581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-29498546-8641-4f19-b532-0174acf951ac req-bcf39c6b-7913-431d-8a16-66b31b65dce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74d2938-9f25-40b2-abee-11f4d42e46fd", "name": "network-vif-plugged", "status": "completed", "tag": "eea30e87-7401-4aec-9292-4c76c45f04bd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:18.170998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-29498546-8641-4f19-b532-0174acf951ac req-bcf39c6b-7913-431d-8a16-66b31b65dce4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:18.174497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-29498546-8641-4f19-b532-0174acf951ac req-bcf39c6b-7913-431d-8a16-66b31b65dce4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:18.175541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-29498546-8641-4f19-b532-0174acf951ac req-bcf39c6b-7913-431d-8a16-66b31b65dce4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:18.196389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:18.205793 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-26bbeab2-e60a-4ccf-9644-78418c24e8e1 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1219 microversion: 2.1 time: 0.162865 Oct 27 10:22:18.211550 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1616/3373] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:18 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:18.219537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:18.220449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:18.238177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:18.241919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:18.242887 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-29498546-8641-4f19-b532-0174acf951ac req-bcf39c6b-7913-431d-8a16-66b31b65dce4 service nova] Creating event network-vif-plugged:eea30e87-7401-4aec-9292-4c76c45f04bd for instance c74d2938-9f25-40b2-abee-11f4d42e46fd on n-h1-854663-10 Oct 27 10:22:18.243357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:18.245850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:18.246494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:18.247492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:18.250384 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-29498546-8641-4f19-b532-0174acf951ac req-bcf39c6b-7913-431d-8a16-66b31b65dce4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114717 Oct 27 10:22:18.251192 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1758/3374] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:18.257911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11053192-e91c-4a03-841a-53b615a55495 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b75c1f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:18.347588 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11053192-e91c-4a03-841a-53b615a55495 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.094389 Oct 27 10:22:18.350433 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1759/3375] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:18 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:18.875026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e8a49e4c-a039-4ba2-979d-e54514760564 req-e1b5b7d6-c914-4115-9b0e-3ef99ba5fde7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:18.901181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e8a49e4c-a039-4ba2-979d-e54514760564 req-e1b5b7d6-c914-4115-9b0e-3ef99ba5fde7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:18.907895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e8a49e4c-a039-4ba2-979d-e54514760564 req-e1b5b7d6-c914-4115-9b0e-3ef99ba5fde7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:18.908652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e8a49e4c-a039-4ba2-979d-e54514760564 req-e1b5b7d6-c914-4115-9b0e-3ef99ba5fde7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:18.930275 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e8a49e4c-a039-4ba2-979d-e54514760564 req-e1b5b7d6-c914-4115-9b0e-3ef99ba5fde7 service nova] Creating event network-changed:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:22:18.936754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e8a49e4c-a039-4ba2-979d-e54514760564 req-e1b5b7d6-c914-4115-9b0e-3ef99ba5fde7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066114 Oct 27 10:22:18.937820 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1760/3376] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:22:18.972443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:18.996938 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b7a135e9-4589-4664-b0e2-f3f81fbc98ef tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.782177 Oct 27 10:22:19.014935 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1617/3377] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:18 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:19.060482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:19.061600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:19.075571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:19.077745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:19.078312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:19.080816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:19.081449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:19.082272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:19.149137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:19.149766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:19.167369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:19.167907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:19.168344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:19.169100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:19.169554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:19.169979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:20.448769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:20.459430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:20.467965 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1446a623-51e4-4de7-8571-282adefcfd70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1361 microversion: 2.1 time: 1.321381 Oct 27 10:22:20.472746 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3fa74181-02e1-44e6-8f9f-da6bbe06bd33 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1495 microversion: 2.1 time: 1.417189 Oct 27 10:22:20.485012 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1618/3378] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:19 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1361 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:20.485660 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1761/3379] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:19 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1495 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:20.502954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1093b7d-e822-4cf3-a255-47438c48d5e8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b7963a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:20.507117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:20.509769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:20.522142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:20.523015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:20.523783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:20.524741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:20.526154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:20.527103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:20.612499 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1093b7d-e822-4cf3-a255-47438c48d5e8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.125323 Oct 27 10:22:20.615221 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1762/3380] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:20 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:20.629308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:20.635190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:20.654569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:20.656034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:20.658440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:20.660101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:20.669570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:20.670029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:20.718542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:20.736286 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f6da6e77-bdb4-4d17-b6b3-3145215d1891 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1273 microversion: 2.1 time: 0.245900 Oct 27 10:22:20.737687 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1619/3381] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:20 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:20.743614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3a89104b-c36a-42e9-b893-232f4b4ce823 req-e65a2939-f8a1-4721-87ef-3edadab694d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde4a8b-e672-44ca-8ed3-42c7ca94a052", "name": "network-vif-plugged", "status": "completed", "tag": "f8deeb59-e3d0-4c24-aeed-6e9ddbeb7fcd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:20.756082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3a89104b-c36a-42e9-b893-232f4b4ce823 req-e65a2939-f8a1-4721-87ef-3edadab694d3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:20.757803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3a89104b-c36a-42e9-b893-232f4b4ce823 req-e65a2939-f8a1-4721-87ef-3edadab694d3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:20.759067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3a89104b-c36a-42e9-b893-232f4b4ce823 req-e65a2939-f8a1-4721-87ef-3edadab694d3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:20.765817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:20.777957 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3a89104b-c36a-42e9-b893-232f4b4ce823 req-e65a2939-f8a1-4721-87ef-3edadab694d3 service nova] Creating event network-vif-plugged:f8deeb59-e3d0-4c24-aeed-6e9ddbeb7fcd for instance cdde4a8b-e672-44ca-8ed3-42c7ca94a052 on n-h2-854663-10 Oct 27 10:22:20.786731 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3a89104b-c36a-42e9-b893-232f4b4ce823 req-e65a2939-f8a1-4721-87ef-3edadab694d3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047555 Oct 27 10:22:20.787813 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1620/3382] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:20.962246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-04d38348-cc75-4f88-a14f-8c9a0580d37d req-b7f36ae2-b7a5-436d-9844-245353530950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d223963b-e688-4013-8a89-71b392277a1a", "name": "network-vif-deleted", "tag": "972c5745-1993-4b85-b35d-b7db394b9669"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:20.986472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04d38348-cc75-4f88-a14f-8c9a0580d37d req-b7f36ae2-b7a5-436d-9844-245353530950 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:20.988214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04d38348-cc75-4f88-a14f-8c9a0580d37d req-b7f36ae2-b7a5-436d-9844-245353530950 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:20.988919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04d38348-cc75-4f88-a14f-8c9a0580d37d req-b7f36ae2-b7a5-436d-9844-245353530950 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:21.049911 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-04d38348-cc75-4f88-a14f-8c9a0580d37d req-b7f36ae2-b7a5-436d-9844-245353530950 service nova] Creating event network-vif-deleted:972c5745-1993-4b85-b35d-b7db394b9669 for instance d223963b-e688-4013-8a89-71b392277a1a on n-h1-854663-10 Oct 27 10:22:21.067890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-04d38348-cc75-4f88-a14f-8c9a0580d37d req-b7f36ae2-b7a5-436d-9844-245353530950 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110463 Oct 27 10:22:21.068896 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1621/3383] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:22:21.109172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:21.122764 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2a050b4-01f4-449b-9429-45ac134a35e0 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 0.505553 Oct 27 10:22:21.138620 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1763/3384] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:20 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:21.504062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:21.504894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:21.506798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:21.508908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:21.525038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:21.525992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:21.526666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:21.527001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:21.527901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:21.528369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:21.529186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:21.529495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:21.530148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:21.532538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:21.540098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:21.540577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:21.613327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:21.617063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:21.618102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:21.620457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lazy-loading 'fault' on Instance uuid d223963b-e688-4013-8a89-71b392277a1a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:22:22.061277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:22.077095 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-deaad49e-5d99-4237-9a94-a6bd14490f17 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 200 len: 1299 microversion: 2.1 time: 0.577507 Oct 27 10:22:22.093622 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1764/3385] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:21 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 1299 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:22.100140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87337bc6-7948-4e84-8fd7-b9c7376f1481 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d639a8160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:22.243702 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87337bc6-7948-4e84-8fd7-b9c7376f1481 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.148839 Oct 27 10:22:22.252824 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1765/3386] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:22 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:22.284443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:22.310030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:22.350839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:22.357774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:22.362432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:22.366927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:22.369835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:22.393230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:22.448092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:22.485008 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d85487d-2b64-4ff1-8527-7c2a440f084d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1361 microversion: 2.1 time: 0.985291 Oct 27 10:22:22.545045 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1622/3387] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:21 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1361 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:22.566327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:22.566827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:22.586639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:22.587128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:22.587569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:22.589795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:22.590264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:22.590686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:23.360468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:23.553178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:23.558057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:23.583103 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bcd1ded3-b0db-46b7-9d48-e95922f34a9d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1316 microversion: 2.1 time: 1.030255 Oct 27 10:22:23.587372 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf31d59e-1733-4553-9a79-c05f8200b360 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1315 microversion: 2.1 time: 1.327871 Oct 27 10:22:23.588330 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1623/3388] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:22 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1316 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:23.590491 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1766/3389] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:22 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1315 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:23.601515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b787e5b-3c5f-4060-97b1-e2103c5c82a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d63925ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:23.610604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:23.616336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:23.652439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:23.653379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:23.654103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:23.655014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:23.655638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:23.656226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:23.695171 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a HTTP/1.1 Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd223963b-e688-4013-8a89-71b392277a1a'} Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:23.696920 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:23.710737 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:23.710737 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:23.710737 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:23.710737 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:23.710737 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:23.710737 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:22:23.710737 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:23.710737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:23.710737 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16c2bce9-37d3-48e8-ab9d-7d9e3cc1c3d9 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 404 len: 111 microversion: 2.1 time: 0.107791 Oct 27 10:22:23.712067 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b787e5b-3c5f-4060-97b1-e2103c5c82a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.105725 Oct 27 10:22:23.712067 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1767/3390] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:23 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:23.714217 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1624/3391] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:23 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:22:23.714467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:23.714946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:23.738147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:23.738660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:23.740929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:23.741725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:23.742192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:23.742770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:23.907367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-674326797", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "bc393ace-9ca8-46ee-824d-0fc414351037"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:24.033996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] validate_networks() for [('bc393ace-9ca8-46ee-824d-0fc414351037', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:22:24.252822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:24.866019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:24.874988 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab79b839-328d-4cd1-96ed-faf06509468d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1361 microversion: 2.1 time: 1.172045 Oct 27 10:22:24.875608 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1768/3392] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:23 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1361 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:24.899981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8cc7350e-2fc9-48f0-b568-f758a938634b req-057b427c-ce7a-4571-bcd4-231212ce70b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c25d08-f113-4663-8a4f-e0dd23e0bb37", "tag": "ef0007f5-6fea-4bd2-9a0e-b4ff32e1bdfe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:24.939895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8cc7350e-2fc9-48f0-b568-f758a938634b req-057b427c-ce7a-4571-bcd4-231212ce70b2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:24.940287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8cc7350e-2fc9-48f0-b568-f758a938634b req-057b427c-ce7a-4571-bcd4-231212ce70b2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:24.949425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8cc7350e-2fc9-48f0-b568-f758a938634b req-057b427c-ce7a-4571-bcd4-231212ce70b2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:24.998143 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8cc7350e-2fc9-48f0-b568-f758a938634b req-057b427c-ce7a-4571-bcd4-231212ce70b2 service nova] Creating event network-changed:ef0007f5-6fea-4bd2-9a0e-b4ff32e1bdfe for instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 on n-h1-854663-10 Oct 27 10:22:25.019118 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8cc7350e-2fc9-48f0-b568-f758a938634b req-057b427c-ce7a-4571-bcd4-231212ce70b2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142143 Oct 27 10:22:25.023262 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1769/3393] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:25.036876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:25.037752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:25.052114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:25.052602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:25.053939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:25.054678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:25.055131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:25.055555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:25.985037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:25.997711 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6e208ea-2e76-4ec1-aa58-d88c0569cfdf tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1505 microversion: 2.1 time: 0.972647 Oct 27 10:22:25.998976 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1770/3394] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:25 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1505 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:26.004222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:26.009305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:26.019608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:26.020409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:26.025664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:26.035675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:26.036528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:26.037172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:26.319194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:22:26.319741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:22:26.320063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:22:26.320698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:22:26.321105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:22:26.352507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:26.359355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:26.360274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:26.361892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:26.372771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:26.373534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:26.385879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:26.425995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:22:26.439199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for user 6a80ce0f3a4242a9a061a311c4bb50ae and project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:22:26.441511 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d31cc882-193a-4a46-adbd-4fa04a65436b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1315 microversion: 2.1 time: 0.440412 Oct 27 10:22:26.446293 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1771/3395] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:25 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:26.482480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:22:26.482980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f43e1542-07e9-4936-9c63-74013d66672e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d638131f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:26.485345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:22:26.622634 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f43e1542-07e9-4936-9c63-74013d66672e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.170430 Oct 27 10:22:26.623783 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1772/3396] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:26 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:26.651771 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00f89f30-f2a9-4d09-934a-37bbb315bd9a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.748200 Oct 27 10:22:26.653143 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1625/3397] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:22:26.657537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:26.658185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:26.659132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:26.661046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:26.679053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:26.679580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:26.680026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:26.681972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:26.682376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:26.682793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:26.686422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:26.686993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:26.689282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:26.690620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:26.694480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:26.694991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:26.757011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:26.758352 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dca625a0-a60f-4806-8524-26179b136f2d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052/os-instance-actions/req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad" status: 200 len: 313 microversion: 2.1 time: 0.103973 Oct 27 10:22:26.767683 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1626/3398] 10.222.0.76 () {58 vars in 1419 bytes} [Thu Oct 27 10:22:26 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052/os-instance-actions/req-8a165225-4bcd-4d5a-a193-9d5cfb27c3ad => generated 313 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:26.778449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e42593d4-4c1a-44f3-9808-e49328a8cc14 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:26.779458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e42593d4-4c1a-44f3-9808-e49328a8cc14 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:26.949823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e42593d4-4c1a-44f3-9808-e49328a8cc14 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:26.965554 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e42593d4-4c1a-44f3-9808-e49328a8cc14 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1208 microversion: 2.1 time: 0.196430 Oct 27 10:22:26.968953 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1627/3399] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:26 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1208 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:26.986553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9920d530-e4cc-4d3f-8d6d-eecec5cab4ae tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:26.991216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9920d530-e4cc-4d3f-8d6d-eecec5cab4ae tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:27.020746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9920d530-e4cc-4d3f-8d6d-eecec5cab4ae tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:27.021272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9920d530-e4cc-4d3f-8d6d-eecec5cab4ae tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:27.021722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9920d530-e4cc-4d3f-8d6d-eecec5cab4ae tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:27.028110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9920d530-e4cc-4d3f-8d6d-eecec5cab4ae tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:27.029641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9920d530-e4cc-4d3f-8d6d-eecec5cab4ae tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:27.030284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9920d530-e4cc-4d3f-8d6d-eecec5cab4ae tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:27.194871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:27.213695 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-406ebbc6-7d32-45c6-90e9-6b92b064676a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1361 microversion: 2.1 time: 0.583765 Oct 27 10:22:27.216504 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1773/3400] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:26 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1361 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:27.254235 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9920d530-e4cc-4d3f-8d6d-eecec5cab4ae tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "POST /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052/action" status: 202 len: 0 microversion: 2.1 time: 0.281947 Oct 27 10:22:27.256013 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1628/3401] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:22:26 2022] POST /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:22:27.265217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:27.266277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:27.278526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:27.280729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:27.282047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:27.283988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:27.285840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:27.286540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:27.474561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:27.475263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:27.491867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:27.496992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:27.497461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:27.504296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:27.504891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:27.505337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:28.054255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:28.071371 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f5d8b07-f08a-4954-afd5-eef73568ebde tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1507 microversion: 2.1 time: 0.802877 Oct 27 10:22:28.072836 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1774/3402] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:27 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1507 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:28.079868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f271811-1f87-4a27-b21a-a9417c0457ad tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d639a8820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:28.192761 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f271811-1f87-4a27-b21a-a9417c0457ad tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.117894 Oct 27 10:22:28.194589 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1775/3403] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:28 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:28.216305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2c8d9a19-1ce8-47bf-b581-ae392565a447 req-7288b25b-907e-4257-ab9d-fe564c431c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "name": "network-vif-plugged", "status": "completed", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:28.253864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:28.262644 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5976719-7c8f-4440-8d76-dd1e1cad6876 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1315 microversion: 2.1 time: 0.792478 Oct 27 10:22:28.262963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2c8d9a19-1ce8-47bf-b581-ae392565a447 req-7288b25b-907e-4257-ab9d-fe564c431c09 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:28.263597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2c8d9a19-1ce8-47bf-b581-ae392565a447 req-7288b25b-907e-4257-ab9d-fe564c431c09 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:28.264196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2c8d9a19-1ce8-47bf-b581-ae392565a447 req-7288b25b-907e-4257-ab9d-fe564c431c09 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:28.287149 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1629/3404] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:27 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:28.292229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:28.301987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:28.319216 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2c8d9a19-1ce8-47bf-b581-ae392565a447 req-7288b25b-907e-4257-ab9d-fe564c431c09 service nova] Creating event network-vif-plugged:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:22:28.324749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:28.331117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:28.331936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:28.334164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:28.334925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:28.337583 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2c8d9a19-1ce8-47bf-b581-ae392565a447 req-7288b25b-907e-4257-ab9d-fe564c431c09 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141700 Oct 27 10:22:28.343570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:28.358702 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1776/3405] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:28.382657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:28.391270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:28.415819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:28.416692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:28.417379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:28.418788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:28.422496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:28.423194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:28.492574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:28.566042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:28.574469 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6518bdaf-b08c-4c7f-999c-c60de56ad2bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1260 microversion: 2.1 time: 0.286019 Oct 27 10:22:28.582203 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1630/3406] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:28 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1260 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:28.912479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:28.923479 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6851ebfe-2a1a-4648-816d-903468ee6a92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1361 microversion: 2.1 time: 0.563014 Oct 27 10:22:28.924083 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1777/3407] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:28 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1361 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:29.099810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:29.100752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:29.123937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:29.125949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:29.126865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:29.127647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:29.128330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:29.128929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:29.209697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-296e7d11-904f-41d0-bbe3-e668c7ff7479 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5bdd2ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:29.314423 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-296e7d11-904f-41d0-bbe3-e668c7ff7479 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.108680 Oct 27 10:22:29.315021 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1778/3408] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:29 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:29.328586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:29.329255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:29.388605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:29.390550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:29.392715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:29.396844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:29.397573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:29.398226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:29.548964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:29.566006 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-19acd464-2e59-45a3-83ab-bf1a6c8a6b4d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1507 microversion: 2.1 time: 0.470039 Oct 27 10:22:29.580710 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1631/3409] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:29 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:29.607503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:29.608120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:29.629217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:29.629769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:29.630203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:29.631136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:29.631789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:29.632212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:29.753207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:29.767701 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0e4d1df-81c4-4667-b883-95f762c45625 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1266 microversion: 2.1 time: 0.164523 Oct 27 10:22:29.786565 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1632/3410] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:29 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:29.793795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:29.803442 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d733ceb7-3662-44d2-a244-ee4530471198 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1315 microversion: 2.1 time: 0.487338 Oct 27 10:22:29.804633 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1779/3411] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:29 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:29.953074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:29.953684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:29.956784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:29.970430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:29.970918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:29.971352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:29.974428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:29.974890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:29.975323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:30.304409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:30.331500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e076ffec-9b2f-4f2e-a172-7da9c5621409 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d63849790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:30.351543 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38a6fe54-75eb-42e4-a535-ddc781b6c09b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1361 microversion: 2.1 time: 0.390368 Oct 27 10:22:30.352979 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1633/3412] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:29 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1361 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:30.422241 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e076ffec-9b2f-4f2e-a172-7da9c5621409 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.094850 Oct 27 10:22:30.445605 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1780/3413] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:30 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:30.595757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:30.596335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:30.609929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:30.613706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:30.614164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:30.624026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:30.631072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:30.631542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:30.795763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:30.796810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:30.810120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:30.811014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:30.812286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:30.815734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:30.816572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:30.817275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:31.002523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:31.039487 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21fa254a-900b-4bb9-93df-bd6a0b671606 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1266 microversion: 2.1 time: 0.245917 Oct 27 10:22:31.063326 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1781/3414] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:30 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:31.087107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:31.089513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:31.105470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:31.106439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:31.106991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:31.107861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:31.112163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:31.114156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:31.211800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:31.224165 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da4a5bab-fc00-45f1-a1b7-053badbea046 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1505 microversion: 2.1 time: 0.634408 Oct 27 10:22:31.242055 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1634/3415] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:30 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1505 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:31.437924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:31.460445 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56d8ac58-0da7-48cd-be85-c9d563428096 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1315 microversion: 2.1 time: 0.389686 Oct 27 10:22:31.464987 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1782/3416] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:31 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:31.475963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a5840e4-5a92-4881-8d8e-fe748f49c2d8 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '.version_select at 0x7f6d63915040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:31.477427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a5840e4-5a92-4881-8d8e-fe748f49c2d8 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:31.527073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a5840e4-5a92-4881-8d8e-fe748f49c2d8 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:31.529839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a5840e4-5a92-4881-8d8e-fe748f49c2d8 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:31.543682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a5840e4-5a92-4881-8d8e-fe748f49c2d8 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:31.543682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a5840e4-5a92-4881-8d8e-fe748f49c2d8 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:31.543682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a5840e4-5a92-4881-8d8e-fe748f49c2d8 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:31.543682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a5840e4-5a92-4881-8d8e-fe748f49c2d8 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:31.591962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1619616279", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "67635cd8-55d7-4cee-bc51-91ada5cc1176"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:31.643637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a5840e4-5a92-4881-8d8e-fe748f49c2d8 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.176696 Oct 27 10:22:31.644254 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1783/3417] 10.222.0.76 () {58 vars in 1296 bytes} [Thu Oct 27 10:22:31 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052/os-instance-actions => generated 611 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:31.661620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:31.662189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:31.668655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:31.669206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:31.669703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:31.670621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:31.671237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:31.671828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:31.744479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] validate_networks() for [('67635cd8-55d7-4cee-bc51-91ada5cc1176', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:22:32.187044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:32.205916 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aad40fa4-026f-449b-ac6a-dc7d2b324cea tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1547 microversion: 2.1 time: 0.556101 Oct 27 10:22:32.206587 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1784/3418] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:31 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1547 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:32.218401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b495989-c581-40bc-b6b8-5a0ff7f27867 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b635940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:32.352927 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b495989-c581-40bc-b6b8-5a0ff7f27867 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.141487 Oct 27 10:22:32.353808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1785/3419] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:32 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:32.386087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:32.386691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:32.448491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:32.453279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:32.457125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:32.457899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:32.458379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:32.462403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:32.550025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:22:32.787585 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79f3b46e-423e-445d-96cd-bf13fb7108cb tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 204 len: 0 microversion: 2.1 time: 0.431269 Oct 27 10:22:32.789906 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1786/3420] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:22:32 2022] DELETE /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:22:32.809959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:32.810691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:32.821823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:32.822312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:32.822746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:32.823448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:32.823990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:32.824416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.044327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:22:33.045032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:22:33.045823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:22:33.047683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:22:33.048880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:22:33.082874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:33.083366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:33.084227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.087195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:33.087990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:33.093151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.144164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Getting quotas for project 0b1128cfec2a4ae5a5c807bcc19ec623. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:22:33.157997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Getting quotas for user b776c931df234bd0be84e360aebab12f and project 0b1128cfec2a4ae5a5c807bcc19ec623. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:22:33.163889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:33.176386 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b100bc4-ed68-4220-8807-46c218c97855 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1308 microversion: 2.1 time: 0.384793 Oct 27 10:22:33.181532 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1787/3421] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:32 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:33.190907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02168621-5011-407f-8fcb-e2872528beec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:33.195229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02168621-5011-407f-8fcb-e2872528beec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:33.201112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:22:33.206914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:22:33.209066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02168621-5011-407f-8fcb-e2872528beec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:33.213409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02168621-5011-407f-8fcb-e2872528beec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:33.214172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02168621-5011-407f-8fcb-e2872528beec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.215197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02168621-5011-407f-8fcb-e2872528beec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:33.216353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02168621-5011-407f-8fcb-e2872528beec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:33.216816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02168621-5011-407f-8fcb-e2872528beec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.382783 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8029965d-9545-4a7f-93fd-f3fe828986ba tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.136543 Oct 27 10:22:33.388189 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1635/3422] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:22:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:22:33.401005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:33.402148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:33.415962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:33.419186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:33.421990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.425589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:33.430812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:33.431531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.445802 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02168621-5011-407f-8fcb-e2872528beec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.262625 Oct 27 10:22:33.454748 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1788/3423] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:22:33 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:33.460740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2153c785-c396-41f6-acc9-db269e518dcb req-26a188ce-6cb7-4c5a-943f-b12adf4289ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c25d08-f113-4663-8a4f-e0dd23e0bb37", "name": "network-vif-plugged", "status": "completed", "tag": "ef0007f5-6fea-4bd2-9a0e-b4ff32e1bdfe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:33.488733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:33.496063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2153c785-c396-41f6-acc9-db269e518dcb req-26a188ce-6cb7-4c5a-943f-b12adf4289ae service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:33.496651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2153c785-c396-41f6-acc9-db269e518dcb req-26a188ce-6cb7-4c5a-943f-b12adf4289ae service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:33.501232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2153c785-c396-41f6-acc9-db269e518dcb req-26a188ce-6cb7-4c5a-943f-b12adf4289ae service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.540468 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2153c785-c396-41f6-acc9-db269e518dcb req-26a188ce-6cb7-4c5a-943f-b12adf4289ae service nova] Creating event network-vif-plugged:ef0007f5-6fea-4bd2-9a0e-b4ff32e1bdfe for instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 on n-h1-854663-10 Oct 27 10:22:33.565671 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2153c785-c396-41f6-acc9-db269e518dcb req-26a188ce-6cb7-4c5a-943f-b12adf4289ae service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108475 Oct 27 10:22:33.568050 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1789/3424] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:33.616711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:33.617468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:33.659099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:33.659991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:33.673257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.675059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:33.676200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:33.677031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:33.897594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:33.907405 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c3424cd9-9670-409d-b44e-f8cb76624d95 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1315 microversion: 2.1 time: 0.517473 Oct 27 10:22:33.936038 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1636/3425] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:33 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:33.945154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-334bd5a2-d640-4acb-b577-c71ba65af141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b571820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:34.067197 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-334bd5a2-d640-4acb-b577-c71ba65af141 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.129890 Oct 27 10:22:34.075945 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1637/3426] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:33 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:34.082705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d138b913-44d9-4941-8e60-73f9f498b9d3 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:34.094912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d138b913-44d9-4941-8e60-73f9f498b9d3 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:34.264913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:34.276286 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23f38f16-643f-4cd5-9d50-484df4fea5e2 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1511 microversion: 2.1 time: 0.706389 Oct 27 10:22:34.277024 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1790/3427] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:33 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1511 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:34.295568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:34.296216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:34.338393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:34.339012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:34.339529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:34.340643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:34.341056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:34.341506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:34.500273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d138b913-44d9-4941-8e60-73f9f498b9d3 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:34.523750 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d138b913-44d9-4941-8e60-73f9f498b9d3 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1225 microversion: 2.1 time: 0.444809 Oct 27 10:22:34.551233 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1638/3428] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:34 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1225 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:34.783984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-763eb202-2514-4bad-b6d5-039d461b4a5c req-08640c0d-cd64-4110-a466-6761fc981033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2555a6d-9794-4c5a-9213-e36b5a269641", "tag": "54172e73-b2ac-4e54-b2d2-9f04a701f4b8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:34.811659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-763eb202-2514-4bad-b6d5-039d461b4a5c req-08640c0d-cd64-4110-a466-6761fc981033 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:34.814371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-763eb202-2514-4bad-b6d5-039d461b4a5c req-08640c0d-cd64-4110-a466-6761fc981033 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:34.814951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-763eb202-2514-4bad-b6d5-039d461b4a5c req-08640c0d-cd64-4110-a466-6761fc981033 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:34.865293 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-763eb202-2514-4bad-b6d5-039d461b4a5c req-08640c0d-cd64-4110-a466-6761fc981033 service nova] Creating event network-changed:54172e73-b2ac-4e54-b2d2-9f04a701f4b8 for instance e2555a6d-9794-4c5a-9213-e36b5a269641 on n-h1-854663-10 Oct 27 10:22:34.886764 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-763eb202-2514-4bad-b6d5-039d461b4a5c req-08640c0d-cd64-4110-a466-6761fc981033 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106270 Oct 27 10:22:34.889690 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1639/3429] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:22:34.940029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:34.940978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:34.963629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:34.965524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:34.968464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:34.971483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:34.976106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:34.978843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:36.073979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:36.088770 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58a30dd1-b776-41c3-907d-f2f9760eef9c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1315 microversion: 2.1 time: 1.152651 Oct 27 10:22:36.090360 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1640/3430] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:34 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1315 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:36.102474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ca137ba9-49d0-4ba8-86df-4386475d8dd7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b2dc700>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:36.189277 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ca137ba9-49d0-4ba8-86df-4386475d8dd7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.095539 Oct 27 10:22:36.191594 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1641/3431] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:36 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:36.205844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:36.209881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:36.224304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:36.225171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:36.227136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:36.228065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:36.230062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:36.231800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:36.322331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:36.343319 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05a49ecb-8ed1-4ed9-a715-dbb939abb24e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1308 microversion: 2.1 time: 2.065146 Oct 27 10:22:36.356254 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1791/3432] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:34 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1308 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:36.368084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:36.373666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:36.396027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:36.406089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:36.406547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:36.407298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:36.420470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:36.422258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:36.639019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:36.655237 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01569014-fc2e-4673-b898-792adc2354d7 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1283 microversion: 2.1 time: 0.297638 Oct 27 10:22:36.657074 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1792/3433] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:36 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1283 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:36.670977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb234c19-7cec-4483-b99f-f71995a33c2e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a9ad905-98d4-411d-91fe-d986fe72c0c3"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:36.684251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb234c19-7cec-4483-b99f-f71995a33c2e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:36.711672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:36.736351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb234c19-7cec-4483-b99f-f71995a33c2e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:36.736885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb234c19-7cec-4483-b99f-f71995a33c2e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:36.737330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb234c19-7cec-4483-b99f-f71995a33c2e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:36.738046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb234c19-7cec-4483-b99f-f71995a33c2e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:36.738496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb234c19-7cec-4483-b99f-f71995a33c2e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:36.738918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb234c19-7cec-4483-b99f-f71995a33c2e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:36.749893 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef374848-5713-469f-8f8a-57af05e90b1d tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1511 microversion: 2.1 time: 0.554709 Oct 27 10:22:36.750629 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1642/3434] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:36 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1511 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:37.117383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:37.127880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:37.162719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:37.167987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:37.170508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:37.177528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:37.178875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:37.181371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:37.489058 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb234c19-7cec-4483-b99f-f71995a33c2e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829457 Oct 27 10:22:37.495869 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1793/3435] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:22:36 2022] POST /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:37.516007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-185ed5a5-7f7f-43b9-9707-f3635a9fcf92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b635940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:37.653318 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-185ed5a5-7f7f-43b9-9707-f3635a9fcf92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.152752 Oct 27 10:22:37.661885 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1794/3436] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:37 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:37.683225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:37.684142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:37.713548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:37.713964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:37.714406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:37.715925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:37.732626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:37.733130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:38.076518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:38.080258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:38.098181 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1d53b6f7-5126-4bd4-ac74-7f2578410574 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1502 microversion: 2.1 time: 0.983692 Oct 27 10:22:38.098352 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1643/3437] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:37 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1502 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:38.110459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:38.111086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:38.134880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:38.138129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:38.139147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:38.143119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:38.145390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:38.146673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:38.506546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:38.517407 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-357d87d4-da55-44ba-b311-377ffa0f076c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1283 microversion: 2.1 time: 0.413686 Oct 27 10:22:38.526534 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1644/3438] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:38 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1283 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:38.536062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:38.554897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:38.598497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:38.606002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:38.609337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:38.618876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:38.619570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:38.622910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:38.725786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:38.745418 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3204bd8-8cff-4175-8573-528326ca3898 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1308 microversion: 2.1 time: 1.072596 Oct 27 10:22:38.752928 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1795/3439] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:37 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1308 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:38.763471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-51f7cde4-8430-491b-95a7-dad5f5cdb5bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:38.778829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-51f7cde4-8430-491b-95a7-dad5f5cdb5bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:38.793508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51f7cde4-8430-491b-95a7-dad5f5cdb5bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:38.794369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51f7cde4-8430-491b-95a7-dad5f5cdb5bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:38.795025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51f7cde4-8430-491b-95a7-dad5f5cdb5bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:38.796705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51f7cde4-8430-491b-95a7-dad5f5cdb5bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:38.798415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51f7cde4-8430-491b-95a7-dad5f5cdb5bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:38.799234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51f7cde4-8430-491b-95a7-dad5f5cdb5bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:38.807580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:38.859650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d92cb5870244c56be85ea3914938628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3440243e4e364d1ba0ce7b951967c240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:38.869859 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4cbd0eff-81b8-43ea-8f61-8ca0a7f9e0d1 tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 200 len: 1301 microversion: 2.1 time: 0.340480 Oct 27 10:22:38.878364 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1645/3440] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:38 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 1301 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:38.884368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ca6d548f-12fd-44c3-b159-7287821493ed req-aa1e7b93-d0b0-407c-ac3c-59a25df0f991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde4a8b-e672-44ca-8ed3-42c7ca94a052", "name": "network-vif-deleted", "tag": "f8deeb59-e3d0-4c24-aeed-6e9ddbeb7fcd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:38.932974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ca6d548f-12fd-44c3-b159-7287821493ed req-aa1e7b93-d0b0-407c-ac3c-59a25df0f991 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:38.948613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ca6d548f-12fd-44c3-b159-7287821493ed req-aa1e7b93-d0b0-407c-ac3c-59a25df0f991 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:38.950742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ca6d548f-12fd-44c3-b159-7287821493ed req-aa1e7b93-d0b0-407c-ac3c-59a25df0f991 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:38.991640 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ca6d548f-12fd-44c3-b159-7287821493ed req-aa1e7b93-d0b0-407c-ac3c-59a25df0f991 service nova] Creating event network-vif-deleted:f8deeb59-e3d0-4c24-aeed-6e9ddbeb7fcd for instance cdde4a8b-e672-44ca-8ed3-42c7ca94a052 on n-h2-854663-10 Oct 27 10:22:39.022961 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ca6d548f-12fd-44c3-b159-7287821493ed req-aa1e7b93-d0b0-407c-ac3c-59a25df0f991 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135374 Oct 27 10:22:39.024749 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1646/3441] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:39.032385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-abddb8ce-0037-46c1-a40e-e57771388e56 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b45be50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:39.057159 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-51f7cde4-8430-491b-95a7-dad5f5cdb5bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37/action" status: 202 len: 0 microversion: 2.1 time: 0.301836 Oct 27 10:22:39.063237 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1796/3442] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:22:38 2022] POST /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:22:39.078556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:39.084104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:39.161988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:39.177277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:39.180834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:39.181912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:39.183534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:39.186972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:39.208964 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-abddb8ce-0037-46c1-a40e-e57771388e56 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.182570 Oct 27 10:22:39.209565 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1647/3443] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:39 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:39.554265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:39.555397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:39.587606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:39.590452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:39.591151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:39.594722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:39.595478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:39.601312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:39.702848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:39.717471 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9029d42d-163e-4d83-a94b-fc588190fe34 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1507 microversion: 2.1 time: 0.650619 Oct 27 10:22:39.720961 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1797/3444] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:39 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1507 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:39.776705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:39.777746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:39.797266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:39.797791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:39.798243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:39.798989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:39.799442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:39.799868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:40.185185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:40.196924 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2cb15c12-aad8-4720-92f8-013b7d989262 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 0.647703 Oct 27 10:22:40.207417 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1648/3445] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:39 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:40.218976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:40.220477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] [instance: cdde4a8b-e672-44ca-8ed3-42c7ca94a052] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:40.247064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:40.251421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:40.255773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:40.256864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:40.258248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:40.261793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:40.306340 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] HTTP exception thrown: Instance cdde4a8b-e672-44ca-8ed3-42c7ca94a052 could not be found. Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Request method failure captured: Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 HTTP/1.1 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlu_j6ifxueWQkEU30K3PSNiN8FhHX1jkh2EBeedmXnTZlpMoYgPnXq8C-qO6zTtfb14kH9EcfnnfLpGoDqMdbqiMKxGD7e2qp2B4-DDXRIB5TE_1W5pE15y42mF8wYvcBTWlxWEeZknduCWURp9ICCJK7TI9HkQquUsQtRbhJ1V4PA Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 3440243e4e364d1ba0ce7b951967c240 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-InstanceActionsTestJSON-308757548 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3440243e4e364d1ba0ce7b951967c240"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3440243e4e364d1ba0ce7b951967c240"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3440243e4e364d1ba0ce7b951967c240", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3440243e4e364d1ba0ce7b951967c240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-InstanceActionsTestJSON-308757548 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 3440243e4e364d1ba0ce7b951967c240 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-InstanceActionsTestJSON-308757548 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-InstanceActionsTestJSON-308757548-project Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9d92cb5870244c56be85ea3914938628 Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-InstanceActionsTestJSON-308757548-project Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance cdde4a8b-e672-44ca-8ed3-42c7ca94a052 could not be found. Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'cdde4a8b-e672-44ca-8ed3-42c7ca94a052'} Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdde4a8b-e672-44ca-8ed3-42c7ca94a052 could not be found. Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdde4a8b-e672-44ca-8ed3-42c7ca94a052 could not be found. Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:40.308318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:40.313590 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:40.313590 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:40.313590 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:40.313590 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:40.313590 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:40.313590 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdde4a8b-e672-44ca-8ed3-42c7ca94a052 could not be found. Oct 27 10:22:40.313590 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:22:40.319070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] Returning 404 to user: Instance cdde4a8b-e672-44ca-8ed3-42c7ca94a052 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:40.320420 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-105a87d0-d090-4254-99fd-b835614ffd1f tempest-InstanceActionsTestJSON-308757548 tempest-InstanceActionsTestJSON-308757548-project] 10.222.0.76 "GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052" status: 404 len: 111 microversion: 2.1 time: 0.111652 Oct 27 10:22:40.332150 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1649/3446] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:40 2022] GET /compute/v2.1/servers/cdde4a8b-e672-44ca-8ed3-42c7ca94a052 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:22:40.346337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:40.355858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00620be2-7035-40fb-bfe3-5292baac9402 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b3d9040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:40.361747 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8431d276-8792-42be-a2ec-fe96b99ee388 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1308 microversion: 2.1 time: 0.592126 Oct 27 10:22:40.362670 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1798/3447] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:39 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:40.434546 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00620be2-7035-40fb-bfe3-5292baac9402 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.101035 Oct 27 10:22:40.435138 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1650/3448] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:40 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:40.747089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:40.748639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:40.776420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:40.777606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:40.778788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:40.787245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:40.787990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:40.795942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:41.006385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:41.023815 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fb21c81-be86-4348-bdfb-21a78473470a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1487 microversion: 2.1 time: 0.282774 Oct 27 10:22:41.024977 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1799/3449] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:40 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1487 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:41.041876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a253836f-0408-4cd2-8b1d-91d4fc930641 req-ad398971-2a52-4d3e-b15c-36518f0d1f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:41.056854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:41.058951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:41.073838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:41.077151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:41.078302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a253836f-0408-4cd2-8b1d-91d4fc930641 req-ad398971-2a52-4d3e-b15c-36518f0d1f6a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:41.078743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:41.080262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a253836f-0408-4cd2-8b1d-91d4fc930641 req-ad398971-2a52-4d3e-b15c-36518f0d1f6a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:41.081039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:41.081942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:41.082575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a253836f-0408-4cd2-8b1d-91d4fc930641 req-ad398971-2a52-4d3e-b15c-36518f0d1f6a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:41.084100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:41.109411 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a253836f-0408-4cd2-8b1d-91d4fc930641 req-ad398971-2a52-4d3e-b15c-36518f0d1f6a service nova] Creating event network-changed:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:22:41.122803 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a253836f-0408-4cd2-8b1d-91d4fc930641 req-ad398971-2a52-4d3e-b15c-36518f0d1f6a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086564 Oct 27 10:22:41.131794 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1651/3450] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:41.144352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:22:41.236794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:41.237716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:41.253483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:41.254571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:41.255286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:41.256976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:41.264235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:41.265563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:41.313105 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a2274ad-d2fc-4bfe-a000-91b814f14576 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 204 len: 0 microversion: 2.1 time: 0.261128 Oct 27 10:22:41.315373 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1800/3451] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:22:41 2022] DELETE /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:22:41.329871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:41.331262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:41.363375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:41.369272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:41.369272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:41.370431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:41.371436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:41.373504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:41.876677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:41.890640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:41.892557 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af380f2b-5425-406f-a957-7465f10109e8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1493 microversion: 2.1 time: 0.572852 Oct 27 10:22:41.893928 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1801/3452] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:41 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1493 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:41.899186 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e1da273-2809-4150-b168-12de3774b219 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 0.668056 Oct 27 10:22:41.900137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:41.901608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:41.916697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1652/3453] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:41 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:41.916697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71410331-b8df-40fd-96b7-167af2ed193d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b504670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:41.929327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:41.930132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:41.930778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:41.932353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:41.933059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:41.933738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:42.029999 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71410331-b8df-40fd-96b7-167af2ed193d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1438 microversion: 2.1 time: 0.118585 Oct 27 10:22:42.030949 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1653/3454] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:41 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1438 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:42.455202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:42.467721 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eae39313-4554-4e6f-9cb8-630a3eeccfeb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1308 microversion: 2.1 time: 0.572377 Oct 27 10:22:42.485354 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1802/3455] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:41 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1308 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:42.922909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:42.924370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:42.931955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:42.932565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:42.940428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:42.940970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:42.941396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:42.942102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:42.942555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:42.942982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:42.943606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:42.944959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:42.947469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:42.948701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:42.951577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:42.952253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:43.131184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:43.468283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:43.478269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-34393e32-a601-4e58-ac54-4ed753cb9bfa tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 0.550045 Oct 27 10:22:43.502714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:43.507341 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1803/3456] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:42 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:43.512273 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f6966d13-78a4-42e2-9d93-f04e7dd4388d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1493 microversion: 2.1 time: 0.595251 Oct 27 10:22:43.517431 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1654/3457] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:42 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1493 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:43.525436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57a31538-b6ec-4afb-9e04-4c0a86545dee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d63801ca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:43.531710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-188ee2c8-0670-4671-866a-5109a27346dd tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Action: 'create', calling method: .version_select at 0x7f6d5b517550>, body: {"keypair": {"name": "tempest-keypair-1811059652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMQakpeIChqYnaj+3ld9DRbc6sNlB/Z36+AoxUQFD3RZqNolv42dXan+GjqJcf5tweVIcAO7MZ+Mm9km6YuJh4L8YW6yn/YfVhN8dYMsgUTu35IXVx58bZXDDKSIQd+A=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:43.570245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=27 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:43.581774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-188ee2c8-0670-4671-866a-5109a27346dd tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Getting quotas for project 065058d531b2447286141abf2292e6f3. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:22:43.600837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-188ee2c8-0670-4671-866a-5109a27346dd tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Getting quotas for user 6cb951a3d90647148776d44816f51fb2 and project 065058d531b2447286141abf2292e6f3. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:22:43.614413 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57a31538-b6ec-4afb-9e04-4c0a86545dee tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1447 microversion: 2.1 time: 0.100670 Oct 27 10:22:43.625524 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1804/3458] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:43 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:43.631503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:43.632397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:43.647656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:43.648430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:43.649077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:43.649966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:43.650570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:43.651152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:43.670987 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-188ee2c8-0670-4671-866a-5109a27346dd tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.152079 Oct 27 10:22:43.672371 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1655/3459] 10.222.0.76 () {62 vars in 1200 bytes} [Thu Oct 27 10:22:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 10:22:43.693874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be8e89da-2882-46af-9093-19ffbb8384c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b3c1ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:43.788362 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be8e89da-2882-46af-9093-19ffbb8384c5 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 200 len: 1447 microversion: 2.1 time: 0.114308 Oct 27 10:22:43.789210 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1656/3460] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:22:43 2022] GET /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 1447 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:43.807787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0822898-46c7-49a6-afcf-30bdeecb3b82 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b3c1700>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:44.004965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:44.017534 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-991156bd-091f-45b3-b7e8-36c898c2e925 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1308 microversion: 2.1 time: 0.390616 Oct 27 10:22:44.018132 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1805/3461] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:43 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:44.513947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:44.514484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:44.527982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:44.528497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:44.530529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:44.531285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:44.531754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:44.532290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:44.854414 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0822898-46c7-49a6-afcf-30bdeecb3b82 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 204 len: 0 microversion: 2.1 time: 1.050381 Oct 27 10:22:44.855922 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1657/3462] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:43 2022] DELETE /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:22:44.861606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:44.862015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:44.864431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:44.872704 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a0bf5c31-83f2-498e-a487-51740a4f7c4d tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 0.365764 Oct 27 10:22:44.881968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:44.883223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:44.883764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:44.884564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:44.892241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:44.892874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:44.897450 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1806/3463] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:44 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:44.915534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:44.925424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:44.938637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:44.939380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:44.940148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:44.942898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:44.942898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:44.942898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:45.025040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:22:45.145281 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a426d98-c7c3-46b9-88f7-611340c80e2a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 204 len: 0 microversion: 2.1 time: 0.245256 Oct 27 10:22:45.152406 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1807/3464] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:22:44 2022] DELETE /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:22:45.181202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b0f3bc77-2e65-483b-9237-cd0ab97ebf74 req-c45664bf-dbea-4e4a-845b-013f3fb6c717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2555a6d-9794-4c5a-9213-e36b5a269641", "name": "network-vif-plugged", "status": "completed", "tag": "54172e73-b2ac-4e54-b2d2-9f04a701f4b8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:45.203952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:45.214590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b0f3bc77-2e65-483b-9237-cd0ab97ebf74 req-c45664bf-dbea-4e4a-845b-013f3fb6c717 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:45.217095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b0f3bc77-2e65-483b-9237-cd0ab97ebf74 req-c45664bf-dbea-4e4a-845b-013f3fb6c717 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:45.217745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b0f3bc77-2e65-483b-9237-cd0ab97ebf74 req-c45664bf-dbea-4e4a-845b-013f3fb6c717 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:45.219754 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df3deb8e-626d-4ff1-9312-9482acfeee70 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1493 microversion: 2.1 time: 0.362430 Oct 27 10:22:45.220567 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1658/3465] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:44 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1493 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:45.237181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:45.241164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:45.243990 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b0f3bc77-2e65-483b-9237-cd0ab97ebf74 req-c45664bf-dbea-4e4a-845b-013f3fb6c717 service nova] Creating event network-vif-plugged:54172e73-b2ac-4e54-b2d2-9f04a701f4b8 for instance e2555a6d-9794-4c5a-9213-e36b5a269641 on n-h1-854663-10 Oct 27 10:22:45.254740 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b0f3bc77-2e65-483b-9237-cd0ab97ebf74 req-c45664bf-dbea-4e4a-845b-013f3fb6c717 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080095 Oct 27 10:22:45.257007 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1808/3466] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:45.259038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:45.267338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:45.267912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:45.268699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:45.269197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:45.269783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:45.321542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ebf14487-47cd-462a-a11c-2fc92fb163cf req-5e523b3b-73b7-4917-b0fd-a1820f89b929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd90237-f15f-45a7-9678-6f24718aa343", "tag": "19b3a7f7-ae15-4ef9-8cee-d366b25f0556"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:45.343970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ebf14487-47cd-462a-a11c-2fc92fb163cf req-5e523b3b-73b7-4917-b0fd-a1820f89b929 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:45.344455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ebf14487-47cd-462a-a11c-2fc92fb163cf req-5e523b3b-73b7-4917-b0fd-a1820f89b929 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:45.347736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ebf14487-47cd-462a-a11c-2fc92fb163cf req-5e523b3b-73b7-4917-b0fd-a1820f89b929 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:45.379286 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ebf14487-47cd-462a-a11c-2fc92fb163cf req-5e523b3b-73b7-4917-b0fd-a1820f89b929 service nova] Creating event network-changed:19b3a7f7-ae15-4ef9-8cee-d366b25f0556 for instance 3dd90237-f15f-45a7-9678-6f24718aa343 on n-h2-854663-10 Oct 27 10:22:45.387662 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ebf14487-47cd-462a-a11c-2fc92fb163cf req-5e523b3b-73b7-4917-b0fd-a1820f89b929 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076700 Oct 27 10:22:45.388596 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1809/3467] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:22:45.407747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-101633354", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9817231a-6843-4f63-80f8-30528217ef12"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:45.469301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] validate_networks() for [('9817231a-6843-4f63-80f8-30528217ef12', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:22:45.665797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:45.683555 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b7f19e0-eedc-4ed7-81ed-55393f6f2d88 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1308 microversion: 2.1 time: 0.461048 Oct 27 10:22:45.685863 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1659/3468] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:45 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:45.907218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:45.918734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:45.954599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:45.955481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:45.957532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:45.964031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:45.965198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:45.970416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:46.717326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:22:46.718432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:22:46.719086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:22:46.720590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:22:46.721216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:22:46.742683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:46.748392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:46.749259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:46.751402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:46.753933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:46.755448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:46.842420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:22:46.859748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for user 8074ee4104864f7b8010104133bd2fef and project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:22:46.887166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:22:46.890684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:22:46.980959 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36336179-9e42-45af-8b6d-97ee119df2e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.577481 Oct 27 10:22:46.991928 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1810/3469] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:22:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:22:46.997621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:46.998328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:47.027921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:47.028428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:47.030694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:47.031736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:47.036985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:47.037729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:47.100488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:47.180364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:47.190850 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2f2f4e3-e988-4061-bbe7-4ccf5f2ce775 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 1.293292 Oct 27 10:22:47.205782 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1660/3470] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:45 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:22:47.225378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:47.235383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:47.259655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:47.261336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:47.262427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:47.264564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:47.265555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:47.266217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:47.302650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:47.318663 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e629108a-33b0-40da-ac88-970e0e5ddd9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 200 len: 1285 microversion: 2.1 time: 0.320116 Oct 27 10:22:47.319334 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1811/3471] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:46 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 1285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:47.347923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38a3aa83-d592-466e-8e12-6518af46718e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:47.351901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38a3aa83-d592-466e-8e12-6518af46718e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:47.565371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38a3aa83-d592-466e-8e12-6518af46718e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:47.580233 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38a3aa83-d592-466e-8e12-6518af46718e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1207 microversion: 2.1 time: 0.252574 Oct 27 10:22:47.581280 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1812/3472] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:47 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1207 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:47.596645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-30fe013a-afcb-42f7-b0a5-b17dd8073fb2 req-d1f9a2fb-dde1-4f80-b9ab-50f256419fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c25d08-f113-4663-8a4f-e0dd23e0bb37", "name": "network-vif-deleted", "tag": "ef0007f5-6fea-4bd2-9a0e-b4ff32e1bdfe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:47.622025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-30fe013a-afcb-42f7-b0a5-b17dd8073fb2 req-d1f9a2fb-dde1-4f80-b9ab-50f256419fd1 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:47.622535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-30fe013a-afcb-42f7-b0a5-b17dd8073fb2 req-d1f9a2fb-dde1-4f80-b9ab-50f256419fd1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:47.638424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-30fe013a-afcb-42f7-b0a5-b17dd8073fb2 req-d1f9a2fb-dde1-4f80-b9ab-50f256419fd1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:47.663841 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-30fe013a-afcb-42f7-b0a5-b17dd8073fb2 req-d1f9a2fb-dde1-4f80-b9ab-50f256419fd1 service nova] Creating event network-vif-deleted:ef0007f5-6fea-4bd2-9a0e-b4ff32e1bdfe for instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 on n-h1-854663-10 Oct 27 10:22:47.683991 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-30fe013a-afcb-42f7-b0a5-b17dd8073fb2 req-d1f9a2fb-dde1-4f80-b9ab-50f256419fd1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081236 Oct 27 10:22:47.688477 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1813/3473] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:47.767937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:47.783897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c50f9e6-1438-4382-9392-cbd7f172e462 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1308 microversion: 2.1 time: 0.576711 Oct 27 10:22:47.785936 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1661/3474] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:47 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:48.239519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:48.241642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:48.253109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:48.253966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:48.254650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:48.256049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:48.256798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:48.257452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:48.301929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1144768848", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7fe96726-88d4-484f-beaf-573b4c494d68"}, {"port": "2af433f7-16ef-4d73-be18-2d94fa8044b0", "tag": "port-1"}, {"port": "8ff1e688-864c-4428-89c9-709f26bba641", "tag": "port-2"}, {"uuid": "5caa480e-3c5a-4ce4-b364-01a4877e3ab2", "tag": "net-1"}, {"uuid": "5caa480e-3c5a-4ce4-b364-01a4877e3ab2"}, {"uuid": "692b755d-6b23-48a9-ab9a-e39ceb556ffa", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "692b755d-6b23-48a9-ab9a-e39ceb556ffa", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "67de5d15-690f-4173-8388-edc6c7875dff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ba5aea0b-d621-469f-857f-6cee49e8a32a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4cb8d566-a15d-44ef-83d2-f50656ecfa0f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1941578244"}], "key_name": "tempest-keypair-1811059652", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:48.491964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:48.501251 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1877db51-671f-4c19-9809-f74d84e0b12c tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 0.272904 Oct 27 10:22:48.513415 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1814/3475] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:48 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:48.540830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:48.541488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:48.547902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:48.548397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:48.548864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:48.549571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:48.550036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:48.550458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:48.562826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] validate_networks() for [('7fe96726-88d4-484f-beaf-573b4c494d68', None, None, None, None, None), (None, None, '2af433f7-16ef-4d73-be18-2d94fa8044b0', None, None, None), (None, None, '8ff1e688-864c-4428-89c9-709f26bba641', None, None, None), ('5caa480e-3c5a-4ce4-b364-01a4877e3ab2', None, None, None, None, None), ('5caa480e-3c5a-4ce4-b364-01a4877e3ab2', None, None, None, None, None), ('692b755d-6b23-48a9-ab9a-e39ceb556ffa', '10.2.2.100', None, None, None, None), ('692b755d-6b23-48a9-ab9a-e39ceb556ffa', '10.2.2.200', None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:22:48.567161 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 HTTP/1.1 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b3c25d08-f113-4663-8a4f-e0dd23e0bb37'} Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:48.568932 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0153eb0a-48c6-4c6c-86b6-9bd08f428d4f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 404 len: 111 microversion: 2.1 time: 0.054706 Oct 27 10:22:48.573883 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1815/3476] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:48 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:22:48.609981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:48.609981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:48.624979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:48.625406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:48.625851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:48.626573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:48.627036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:48.627467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:48.797750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:48.807709 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50205a66-8f34-4b0f-9d8e-f171f6c1fd0c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1259 microversion: 2.1 time: 0.203033 Oct 27 10:22:48.809077 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1816/3477] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:48 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:48.814865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1555787639", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "aebae77c-7c09-4e55-b34c-9671e2410be6"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:48.882291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] validate_networks() for [('aebae77c-7c09-4e55-b34c-9671e2410be6', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:22:50.009845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:22:50.010488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:22:50.010713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:22:50.011666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:22:50.013941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:22:50.024021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:50.024465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:50.025184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:50.026094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:50.026738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:50.027373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:50.054641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:22:50.061938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for user 83da5c7956454b278e9f9d6641a01711 and project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:22:50.078498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:22:50.081466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:22:50.142397 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3b00edf-b842-4df3-8643-510a637e8200 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331792 Oct 27 10:22:50.144446 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1817/3478] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:22:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:22:50.151467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:50.153263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:50.163752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:50.164813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:50.166608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:50.169518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:50.173219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:50.173720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:50.666233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:50.684122 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b003e28-025c-40ba-846e-f3e55d2526f7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1487 microversion: 2.1 time: 0.537868 Oct 27 10:22:50.685062 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1818/3479] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:50 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1487 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:50.704703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:50.705337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:50.714525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:50.715159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:50.715688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:50.716393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:50.716783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:50.717256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:51.080264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:51.097591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd5fb126-0618-4f9e-9f44-a23aa798d568 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 0.411193 Oct 27 10:22:51.098683 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1819/3480] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:50 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:51.103464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-261751cd-7148-4a34-94ce-198a7195610c req-8af3fa52-73ef-497a-aa5f-d236f015d2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74d2938-9f25-40b2-abee-11f4d42e46fd", "name": "network-vif-deleted", "tag": "eea30e87-7401-4aec-9292-4c76c45f04bd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:51.109290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:51.123031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-261751cd-7148-4a34-94ce-198a7195610c req-8af3fa52-73ef-497a-aa5f-d236f015d2b9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:51.123554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-261751cd-7148-4a34-94ce-198a7195610c req-8af3fa52-73ef-497a-aa5f-d236f015d2b9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:51.124075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-261751cd-7148-4a34-94ce-198a7195610c req-8af3fa52-73ef-497a-aa5f-d236f015d2b9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:51.145179 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-261751cd-7148-4a34-94ce-198a7195610c req-8af3fa52-73ef-497a-aa5f-d236f015d2b9 service nova] Creating event network-vif-deleted:eea30e87-7401-4aec-9292-4c76c45f04bd for instance c74d2938-9f25-40b2-abee-11f4d42e46fd on n-h1-854663-10 Oct 27 10:22:51.151611 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-261751cd-7148-4a34-94ce-198a7195610c req-8af3fa52-73ef-497a-aa5f-d236f015d2b9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051444 Oct 27 10:22:51.153203 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1820/3481] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:51.160732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:51.161780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:51.175538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:51.176783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:51.177370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:51.178346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:51.192413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:51.192972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:51.639999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:51.649802 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46672152-9f75-4267-84fa-aad249829653 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1307 microversion: 2.1 time: 0.494420 Oct 27 10:22:51.651247 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1821/3482] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:51 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1307 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:51.678286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:51.679216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:51.698569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:51.699107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:51.699925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:51.700968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:51.701795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:51.703276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:52.189210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:52.206061 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f8cfddb-8198-44bb-9f23-c606dbab85b5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1275 microversion: 2.1 time: 0.553216 Oct 27 10:22:52.207059 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1822/3483] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:51 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1275 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:52.213143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-acd4e2cb-122f-41a8-9e3d-4c294826e7bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:52.221748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-acd4e2cb-122f-41a8-9e3d-4c294826e7bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:52.238430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd4e2cb-122f-41a8-9e3d-4c294826e7bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:52.238940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd4e2cb-122f-41a8-9e3d-4c294826e7bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:52.239381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd4e2cb-122f-41a8-9e3d-4c294826e7bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:52.240114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd4e2cb-122f-41a8-9e3d-4c294826e7bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:52.244725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd4e2cb-122f-41a8-9e3d-4c294826e7bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:52.247043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd4e2cb-122f-41a8-9e3d-4c294826e7bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:52.331763 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-acd4e2cb-122f-41a8-9e3d-4c294826e7bd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "PUT /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1082 microversion: 2.1 time: 0.123255 Oct 27 10:22:52.341453 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1823/3484] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 10:22:52 2022] PUT /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1082 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:52.350260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:52.350948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:52.360875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:52.361508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:52.362069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:52.363074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:52.363491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:52.364155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:52.894122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:52.913994 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba143204-d172-432b-9962-703bc2a55083 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 0.570651 Oct 27 10:22:52.915178 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1824/3485] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:52 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:52.939314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:52.940519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:52.950657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:52.951407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:52.952136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:52.953217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:52.954598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:52.955715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:53.323059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:53.332749 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71abcf9a-d509-46a9-8ca3-9b5b20d46a1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1508 microversion: 2.1 time: 0.416425 Oct 27 10:22:53.333593 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1825/3486] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:52 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:53.339449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:53.340458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:53.347028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:53.347724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:53.348324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:53.349206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:53.349956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:53.350540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:53.642371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:53.868283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:53.877292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-430fd188-bb4e-4536-8b08-49797bcabf9b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1307 microversion: 2.1 time: 0.541583 Oct 27 10:22:53.878525 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1826/3487] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:53 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1307 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:53.892637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-04afc317-d33c-4f8b-8e57-fca23129356a req-f5dea55e-22b0-449e-ba69-edbe28e16459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd90237-f15f-45a7-9678-6f24718aa343", "name": "network-vif-plugged", "status": "completed", "tag": "19b3a7f7-ae15-4ef9-8cee-d366b25f0556"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:53.909476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-04afc317-d33c-4f8b-8e57-fca23129356a req-f5dea55e-22b0-449e-ba69-edbe28e16459 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:53.910065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-04afc317-d33c-4f8b-8e57-fca23129356a req-f5dea55e-22b0-449e-ba69-edbe28e16459 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:53.911019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-04afc317-d33c-4f8b-8e57-fca23129356a req-f5dea55e-22b0-449e-ba69-edbe28e16459 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:53.927948 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-04afc317-d33c-4f8b-8e57-fca23129356a req-f5dea55e-22b0-449e-ba69-edbe28e16459 service nova] Creating event network-vif-plugged:19b3a7f7-ae15-4ef9-8cee-d366b25f0556 for instance 3dd90237-f15f-45a7-9678-6f24718aa343 on n-h2-854663-10 Oct 27 10:22:53.937266 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-04afc317-d33c-4f8b-8e57-fca23129356a req-f5dea55e-22b0-449e-ba69-edbe28e16459 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056385 Oct 27 10:22:53.937704 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1827/3488] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:53.943865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:53.944759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:53.952538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:53.953224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:53.953764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:53.954579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:53.955190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:53.955716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.292998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:22:54.293699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:22:54.294356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:22:54.294908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:22:54.295548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:22:54.306446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.307066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.307590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.311270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:54.315380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.315949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.316447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.320022 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2923b4ef-7b9c-4111-8971-463e44da9869 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1315 microversion: 2.1 time: 0.380835 Oct 27 10:22:54.320698 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1828/3489] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:53 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:54.326927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:54.327559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:54.333825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.334631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.335073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.335771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.336223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.336647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.347459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Getting quotas for project 065058d531b2447286141abf2292e6f3. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:22:54.353964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Getting quotas for user 6cb951a3d90647148776d44816f51fb2 and project 065058d531b2447286141abf2292e6f3. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:22:54.552220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:54.562725 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25070118-d97e-475f-882b-9e3ce299a909 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1508 microversion: 2.1 time: 0.240739 Oct 27 10:22:54.563321 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1829/3490] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:54 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:54.567771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c16e563a-6363-44e1-bdff-54c06a9052bf req-272933d3-2b80-4eac-9220-89cfa46aa306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6046b640-0df2-4ff7-9a74-88ddb8572b5a", "tag": "2d2e70b5-9907-48f8-9309-a8acf57a6271"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:54.573499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:22:54.577038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='67de5d15-690f-4173-8388-edc6c7875dff',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ba5aea0b-d621-469f-857f-6cee49e8a32a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4cb8d566-a15d-44ef-83d2-f50656ecfa0f',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:22:54.587518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c16e563a-6363-44e1-bdff-54c06a9052bf req-272933d3-2b80-4eac-9220-89cfa46aa306 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.588803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c16e563a-6363-44e1-bdff-54c06a9052bf req-272933d3-2b80-4eac-9220-89cfa46aa306 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.589651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c16e563a-6363-44e1-bdff-54c06a9052bf req-272933d3-2b80-4eac-9220-89cfa46aa306 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.622562 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c16e563a-6363-44e1-bdff-54c06a9052bf req-272933d3-2b80-4eac-9220-89cfa46aa306 service nova] Creating event network-changed:2d2e70b5-9907-48f8-9309-a8acf57a6271 for instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a on n-h1-854663-10 Oct 27 10:22:54.628159 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c16e563a-6363-44e1-bdff-54c06a9052bf req-272933d3-2b80-4eac-9220-89cfa46aa306 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063688 Oct 27 10:22:54.628974 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1830/3491] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:54.638935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-49eb5146-57a9-4247-8597-cb5b5eec4ce1 req-c34e509d-49b3-4430-b430-ce52fd93d5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adfa7709-dcb6-47e3-bc91-2c3f4510b3b9", "tag": "7f21f4ad-6e4b-49a1-9ff7-b3a359019136"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:54.654494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-49eb5146-57a9-4247-8597-cb5b5eec4ce1 req-c34e509d-49b3-4430-b430-ce52fd93d5cd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.655389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-49eb5146-57a9-4247-8597-cb5b5eec4ce1 req-c34e509d-49b3-4430-b430-ce52fd93d5cd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.656819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-49eb5146-57a9-4247-8597-cb5b5eec4ce1 req-c34e509d-49b3-4430-b430-ce52fd93d5cd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.679589 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-49eb5146-57a9-4247-8597-cb5b5eec4ce1 req-c34e509d-49b3-4430-b430-ce52fd93d5cd service nova] Creating event network-changed:7f21f4ad-6e4b-49a1-9ff7-b3a359019136 for instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 on n-h2-854663-10 Oct 27 10:22:54.685512 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-49eb5146-57a9-4247-8597-cb5b5eec4ce1 req-c34e509d-49b3-4430-b430-ce52fd93d5cd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054757 Oct 27 10:22:54.686230 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1831/3492] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:54.692729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:54.693635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:54.701973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.702701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.703308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.704190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.704989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.705711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.882578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:54.896641 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-305050b0-d702-4afd-a91f-dbb025380e12 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 0.208948 Oct 27 10:22:54.912649 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1832/3493] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:54 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:54.918641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:54.919370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:54.925899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.927007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.927819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.928700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:54.929300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:54.929909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:54.934903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:54.966107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:22:55.109971 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c3fb18e-520d-46d4-903c-9e67f7f8ed8b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 204 len: 0 microversion: 2.1 time: 0.194895 Oct 27 10:22:55.111164 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1833/3494] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:22:54 2022] DELETE /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:22:55.118587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:55.122390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:55.132593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.133555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.134124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.135004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.135607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.136243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.177438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lazy-loading 'flavor' on Instance uuid b54c5675-6a87-4213-a858-dd71fc93e9c7 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:22:55.189173 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a026c446-773f-404c-ba13-d6bbbc4b4f41 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.892604 Oct 27 10:22:55.193081 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1662/3495] 10.222.0.76 () {62 vars in 1189 bytes} [Thu Oct 27 10:22:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 6897 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:22:55.203444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:55.205547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:55.220284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.220823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.221269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.221977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.222429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.222863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.353273 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1c7fa58-e418-4bd9-9bb4-752a4e78ed55 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/action" status: 200 len: 32 microversion: 2.1 time: 0.239365 Oct 27 10:22:55.363261 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1834/3496] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:22:55 2022] POST /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:22:55.370370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:55.371437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:55.378742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.379555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.380150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.381034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.381633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.382257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.432218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:55.456347 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c884822e-5828-4ff2-b85f-40f0b0d01b7f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1307 microversion: 2.1 time: 0.261147 Oct 27 10:22:55.458502 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1663/3497] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:55 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1307 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:55.467800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5e74f93-0509-45a6-907a-f69af25eea9c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:55.468467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5e74f93-0509-45a6-907a-f69af25eea9c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:55.545514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5e74f93-0509-45a6-907a-f69af25eea9c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:55.555435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5e74f93-0509-45a6-907a-f69af25eea9c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:55.560981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5e74f93-0509-45a6-907a-f69af25eea9c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:55.562705 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5e74f93-0509-45a6-907a-f69af25eea9c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1286 microversion: 2.32 time: 0.103011 Oct 27 10:22:55.579671 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1664/3498] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:22:55 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:22:55.590229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:55.596066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:55.600803 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3996c4ac-9a52-4aff-a5d7-4657d3285cfa tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1514 microversion: 2.1 time: 0.235829 Oct 27 10:22:55.601667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:55.602330 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1835/3499] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:55 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:55.609067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:55.614280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:55.614801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.623611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.625897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.626769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.629040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.632343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.636651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.640197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.644079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.645004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.645570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.646094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.899593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:55.902321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:55.911162 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1faba1d-ab53-4950-b003-0c3409f0df8e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.306974 Oct 27 10:22:55.912680 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1836/3500] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:55 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:55.914981 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bfc84f1b-6f27-4550-89b8-d33906991064 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1315 microversion: 2.1 time: 0.333268 Oct 27 10:22:55.920696 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1665/3501] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:55 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:55.931348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:55.931972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:55.940277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.940906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.941418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.942179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.942841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.943340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:56.085566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:56.094135 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63a61a06-d63f-4fb0-bfde-182479fb02d4 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1325 microversion: 2.1 time: 0.178446 Oct 27 10:22:56.095046 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1837/3502] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:55 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1325 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:56.485486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:56.487183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:56.498812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:56.499371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:56.500425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:56.501392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:56.502023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:56.502510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:56.595561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f190376c-c944-488b-a8ff-010554fb76e0 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:56.601277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f190376c-c944-488b-a8ff-010554fb76e0 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:56.782489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f190376c-c944-488b-a8ff-010554fb76e0 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:56.798978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f190376c-c944-488b-a8ff-010554fb76e0 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:56.802693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f190376c-c944-488b-a8ff-010554fb76e0 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:56.808339 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f190376c-c944-488b-a8ff-010554fb76e0 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1286 microversion: 2.32 time: 0.221573 Oct 27 10:22:56.811714 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1838/3503] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:22:56 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1286 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:22:56.816948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:56.817571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:56.845931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:56.846438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:56.850231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:56.854685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:56.855427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:56.857639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:56.946492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:56.970415 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d77508f-8338-4c70-a4fd-03384b7f2ef2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1307 microversion: 2.1 time: 0.489577 Oct 27 10:22:56.972908 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1666/3504] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:56 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1307 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:57.005132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:57.010193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:57.037171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.037999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.038442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:57.039823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.040447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.043936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:57.676139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:57.685878 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40f02e26-1b5e-4e88-933f-b25c60d3a08e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1514 microversion: 2.1 time: 0.873050 Oct 27 10:22:57.689958 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1839/3505] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:56 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1514 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:57.708730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:57.709877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:57.749140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:57.753113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.753623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.759224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:57.763200 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71dd47d1-0085-4e0a-9186-5ecfc42d8404 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.787935 Oct 27 10:22:57.766037 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1667/3506] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:56 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:57.781404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:57.785439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:57.786318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.787024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.787474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:57.796146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:57.805386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.805895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.806342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:57.807140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.807603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.808034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.283832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:58.301758 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da583f74-8ab7-4360-a0e3-a0c2839bfce6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1315 microversion: 2.1 time: 0.605724 Oct 27 10:22:58.316700 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1840/3507] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:57 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:58.316922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:58.325961 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-228d1068-b850-45d0-9168-c20babaaebfe tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1521 microversion: 2.1 time: 0.558260 Oct 27 10:22:58.327643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:58.328285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:58.329921 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1668/3508] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:57 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:58.352026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.352527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.352994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.353706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.354197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.354617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.356781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:58.357614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:58.375062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.375565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.377573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.378332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.378811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.389417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.696860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:58.708445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:58.710458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:58.712436 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca9e832f-d0ee-4787-b404-51fe5f973da9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1584 microversion: 2.32 time: 0.407587 Oct 27 10:22:58.728951 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1841/3509] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:22:58 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1584 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:22:58.742427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:58.743221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:58.751092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.774083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.778390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.783560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.787585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.791011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.882307 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] HTTP exception thrown: Action 999 not found Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Request method failure captured: Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343/os-instance-actions/999 HTTP/1.1 Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlvmmHZaDgH5hWC8aQ6CZ593xt8CKQpGYXXxSe_pKf5XsRwxAm9mN97X4L4shVA3dHPXWKO-j1zx5JP5xt7HCOC8l4B3V5nXHP6lCGw1aNmDjSCtcjp2t_C6-ArlEObg3NFy2eiJ6jb0fPRVV1fgyRMRr42ONJ2Z5aXjxEmGfmCaq1M Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0b1128cfec2a4ae5a5c807bcc19ec623 Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1397743781 Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0b1128cfec2a4ae5a5c807bcc19ec623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0b1128cfec2a4ae5a5c807bcc19ec623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0b1128cfec2a4ae5a5c807bcc19ec623", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0b1128cfec2a4ae5a5c807bcc19ec623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1397743781 Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0b1128cfec2a4ae5a5c807bcc19ec623 Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1397743781 Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-InstanceActionsNegativeTestJSON-1397743781-project Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b776c931df234bd0be84e360aebab12f Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1397743781-project Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: exception: Action 999 not found Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': '3dd90237-f15f-45a7-9678-6f24718aa343', 'id': '999'} Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 27 10:22:58.912927 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:58.923498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Returning 404 to user: Action 999 not found {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:58.928314 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41d0b0b6-8092-4027-b17b-ab976597b2ff tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.196434 Oct 27 10:22:58.931330 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1842/3510] 10.222.0.76 () {58 vars in 1308 bytes} [Thu Oct 27 10:22:58 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343/os-instance-actions/999 => generated 66 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:22:58.946823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:58.951503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:58.967865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.968899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.969160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.969965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.970545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.971098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.041985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.047203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.047939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.049885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lazy-loading 'fault' on Instance uuid e2555a6d-9794-4c5a-9213-e36b5a269641 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:22:59.105639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:59.118732 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc931573-32f5-414b-960a-5425f9023656 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1307 microversion: 2.1 time: 0.787520 Oct 27 10:22:59.133607 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1669/3511] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:58 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1307 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:59.140635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1168443e-01ab-4b10-9e0f-1f5c150ac636 req-7be6023e-badf-4635-bb9d-420248398746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2555a6d-9794-4c5a-9213-e36b5a269641", "name": "network-vif-deleted", "tag": "54172e73-b2ac-4e54-b2d2-9f04a701f4b8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:59.162888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1168443e-01ab-4b10-9e0f-1f5c150ac636 req-7be6023e-badf-4635-bb9d-420248398746 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.168127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1168443e-01ab-4b10-9e0f-1f5c150ac636 req-7be6023e-badf-4635-bb9d-420248398746 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.168675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1168443e-01ab-4b10-9e0f-1f5c150ac636 req-7be6023e-badf-4635-bb9d-420248398746 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.190906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:59.194463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:59.197150 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1168443e-01ab-4b10-9e0f-1f5c150ac636 req-7be6023e-badf-4635-bb9d-420248398746 service nova] Creating event network-vif-deleted:54172e73-b2ac-4e54-b2d2-9f04a701f4b8 for instance e2555a6d-9794-4c5a-9213-e36b5a269641 on n-h1-854663-10 Oct 27 10:22:59.200869 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad37c31b-9d24-45d4-9b37-c40734dae3a3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 200 len: 1319 microversion: 2.1 time: 0.266830 Oct 27 10:22:59.211560 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1168443e-01ab-4b10-9e0f-1f5c150ac636 req-7be6023e-badf-4635-bb9d-420248398746 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076604 Oct 27 10:22:59.212176 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1670/3512] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:59.223801 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1843/3513] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:58 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:59.224324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:59.225153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:59.231630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6575c8d6-74d4-43ad-9af4-981df9263d94 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '.version_select at 0x7f6d5ae291f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:59.232872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6575c8d6-74d4-43ad-9af4-981df9263d94 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3d7cd55c-7617-4f6b-b3fe-e0bce69eabac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:59.239823 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6575c8d6-74d4-43ad-9af4-981df9263d94 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] HTTP exception thrown: Instance 3d7cd55c-7617-4f6b-b3fe-e0bce69eabac could not be found. Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6575c8d6-74d4-43ad-9af4-981df9263d94 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Request method failure captured: Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/3d7cd55c-7617-4f6b-b3fe-e0bce69eabac/os-instance-actions HTTP/1.1 Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlvmmHZaDgH5hWC8aQ6CZ593xt8CKQpGYXXxSe_pKf5XsRwxAm9mN97X4L4shVA3dHPXWKO-j1zx5JP5xt7HCOC8l4B3V5nXHP6lCGw1aNmDjSCtcjp2t_C6-ArlEObg3NFy2eiJ6jb0fPRVV1fgyRMRr42ONJ2Z5aXjxEmGfmCaq1M Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0b1128cfec2a4ae5a5c807bcc19ec623 Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1397743781 Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0b1128cfec2a4ae5a5c807bcc19ec623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0b1128cfec2a4ae5a5c807bcc19ec623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0b1128cfec2a4ae5a5c807bcc19ec623", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0b1128cfec2a4ae5a5c807bcc19ec623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1397743781 Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0b1128cfec2a4ae5a5c807bcc19ec623 Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1397743781 Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-InstanceActionsNegativeTestJSON-1397743781-project Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b776c931df234bd0be84e360aebab12f Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1397743781-project Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 3d7cd55c-7617-4f6b-b3fe-e0bce69eabac could not be found. Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': '3d7cd55c-7617-4f6b-b3fe-e0bce69eabac'} Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7cd55c-7617-4f6b-b3fe-e0bce69eabac could not be found. Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:22:59.242819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7cd55c-7617-4f6b-b3fe-e0bce69eabac could not be found. Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7cd55c-7617-4f6b-b3fe-e0bce69eabac could not be found. Oct 27 10:22:59.247003 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:22:59.250505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6575c8d6-74d4-43ad-9af4-981df9263d94 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Returning 404 to user: Instance 3d7cd55c-7617-4f6b-b3fe-e0bce69eabac could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:22:59.251635 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6575c8d6-74d4-43ad-9af4-981df9263d94 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3d7cd55c-7617-4f6b-b3fe-e0bce69eabac/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.026215 Oct 27 10:22:59.252960 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1844/3514] 10.222.0.76 () {58 vars in 1296 bytes} [Thu Oct 27 10:22:59 2022] GET /compute/v2.1/servers/3d7cd55c-7617-4f6b-b3fe-e0bce69eabac/os-instance-actions => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:22:59.258870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.265380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.266306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.267194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.269213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.269771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.270717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:59.274450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:59.287926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.299553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.302229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.307189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.308060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.309815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.370606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:22:59.584311 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56f37bb4-2831-4e01-a5f6-7103a1a1ea59 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 204 len: 0 microversion: 2.1 time: 0.324547 Oct 27 10:22:59.588843 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1845/3515] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:22:59 2022] DELETE /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:22:59.597023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:59.598037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:59.611674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.612318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.613630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.614609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.615192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.615992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.646148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:22:59.652964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:59.658015 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0bea98e0-7801-41ca-b729-9826365c204a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.437836 Oct 27 10:22:59.676240 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1671/3516] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:59 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:59.683809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2580cf0d-4be7-4add-82ba-7194339db1c5 req-e4dd6dd3-d02f-45f5-91c8-47be793d821d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6046b640-0df2-4ff7-9a74-88ddb8572b5a", "name": "network-vif-plugged", "status": "completed", "tag": "2d2e70b5-9907-48f8-9309-a8acf57a6271"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:59.707979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2580cf0d-4be7-4add-82ba-7194339db1c5 req-e4dd6dd3-d02f-45f5-91c8-47be793d821d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.708467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2580cf0d-4be7-4add-82ba-7194339db1c5 req-e4dd6dd3-d02f-45f5-91c8-47be793d821d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.708918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2580cf0d-4be7-4add-82ba-7194339db1c5 req-e4dd6dd3-d02f-45f5-91c8-47be793d821d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.733141 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2580cf0d-4be7-4add-82ba-7194339db1c5 req-e4dd6dd3-d02f-45f5-91c8-47be793d821d service nova] Creating event network-vif-plugged:2d2e70b5-9907-48f8-9309-a8acf57a6271 for instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a on n-h1-854663-10 Oct 27 10:22:59.743286 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2580cf0d-4be7-4add-82ba-7194339db1c5 req-e4dd6dd3-d02f-45f5-91c8-47be793d821d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065198 Oct 27 10:22:59.744258 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1672/3517] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:59.749754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:59.750462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:59.757312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.758164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.758784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.759889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.760506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.761200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.039214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:00.126813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:00.135767 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-284f3ac0-368a-4b10-b093-6dd25db9e857 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1527 microversion: 2.1 time: 0.390245 Oct 27 10:23:00.137070 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1673/3518] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:59 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1527 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:00.141943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:00.142593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:00.149165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.149772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.150385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.151444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.151903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.152396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.189011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:00.199234 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69ef0b49-4e81-4d95-9a14-cccc45e74dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1315 microversion: 2.1 time: 0.608360 Oct 27 10:23:00.213351 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1846/3519] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:22:59 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:00.224522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:00.225480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:00.232214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.233025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.234056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.234943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.235559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.236331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.309577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:00.319176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:00.320630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:00.321828 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4a0ea6f7-7102-4e35-bd72-db9d1ffbbec9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1594 microversion: 2.32 time: 0.183732 Oct 27 10:23:00.322400 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1674/3520] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:00 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1594 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:00.327385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:00.328244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:00.349914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.350671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.351318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.352620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.353441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.353891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.377391 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 HTTP/1.1 Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e2555a6d-9794-4c5a-9213-e36b5a269641'} Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:00.378862 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:00.384557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:00.384557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:00.384557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:00.384557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:23:00.384557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:23:00.384557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:23:00.384557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:00.386453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:23:00.387360 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf936a85-1341-453a-8999-7e655ecebf28 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 404 len: 111 microversion: 2.1 time: 0.063797 Oct 27 10:23:00.388290 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1675/3521] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:00 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:23:00.527981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-880229722", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "bc393ace-9ca8-46ee-824d-0fc414351037"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:00.594335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] validate_networks() for [('bc393ace-9ca8-46ee-824d-0fc414351037', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:23:00.688202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:00.700714 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6dce809-58a9-4e7b-bcec-51d87b51cd9d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1307 microversion: 2.1 time: 0.485505 Oct 27 10:23:00.701599 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1847/3522] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:00 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1307 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:00.707112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:00.707869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:00.718209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.721345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.722464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.723664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.724350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.725151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:01.917504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:01.932362 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1de1089-4b05-4f8c-9a80-5f9ee9a6a0c1 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 1.229275 Oct 27 10:23:01.966490 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1848/3523] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:00 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:01.982163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:01.983604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:01.994030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:01.995947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:01.997477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.002931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.006628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.007784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.077878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.078459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.078979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.080444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lazy-loading 'fault' on Instance uuid 3dd90237-f15f-45a7-9678-6f24718aa343 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:23:02.152925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b776c931df234bd0be84e360aebab12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1128cfec2a4ae5a5c807bcc19ec623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:02.169537 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd549ed3-eee9-4726-a595-8950430b6e9f tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 200 len: 1315 microversion: 2.1 time: 0.201862 Oct 27 10:23:02.170664 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1849/3524] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:01 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:02.175572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:02.177429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:02.189610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.196469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.197008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.197770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.198236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.198662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.368194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:23:02.370502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:23:02.372483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:23:02.373183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:23:02.374487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:23:02.389823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.390677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.391278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.392185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.392864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.393538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.435439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:23:02.443201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Getting quotas for user 6a80ce0f3a4242a9a061a311c4bb50ae and project ed8efc7328ad48c89e3fc3109f1e674e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:23:02.461256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:23:02.464744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:23:02.580361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:02.591220 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16e3b075-3809-46ea-a70e-29a2045e7409 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.066817 Oct 27 10:23:02.592821 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1676/3525] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:23:02.598081 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-07c4a637-d062-461e-bb52-943fd26c2a97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1501 microversion: 2.1 time: 0.425888 Oct 27 10:23:02.598761 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1850/3526] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:02 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1501 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:02.600342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:02.601259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:02.606432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:02.607044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:02.611053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.611799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.612834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.614022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.615397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.616898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.625288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.625779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.627236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.627236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.627517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.627961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.068501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:03.079781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:03.085789 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db62d822-6d7a-48e1-88fc-85d3b46c42d6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1307 microversion: 2.1 time: 0.485936 Oct 27 10:23:03.086737 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1851/3527] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:02 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1307 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:03.094555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7823eaab-a127-48ef-b9bb-313fdce29cd4 req-aec922f7-def8-4044-aedf-8ed51d9415c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfa7709-dcb6-47e3-bc91-2c3f4510b3b9", "name": "network-vif-plugged", "status": "completed", "tag": "7f21f4ad-6e4b-49a1-9ff7-b3a359019136"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:03.097529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:03.099223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:03.100629 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-428968f7-923d-44fd-b235-21e05f97690e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1662 microversion: 2.32 time: 0.506237 Oct 27 10:23:03.113377 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1677/3528] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:02 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1662 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:03.125126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7823eaab-a127-48ef-b9bb-313fdce29cd4 req-aec922f7-def8-4044-aedf-8ed51d9415c9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.125441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-21902f88-6fc7-4ad0-a1a0-bcdda6cba38e req-040bd56b-0a16-477f-bc3b-51957128582e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd90237-f15f-45a7-9678-6f24718aa343", "name": "network-vif-deleted", "tag": "19b3a7f7-ae15-4ef9-8cee-d366b25f0556"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:03.126187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7823eaab-a127-48ef-b9bb-313fdce29cd4 req-aec922f7-def8-4044-aedf-8ed51d9415c9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.126941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7823eaab-a127-48ef-b9bb-313fdce29cd4 req-aec922f7-def8-4044-aedf-8ed51d9415c9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.136372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-21902f88-6fc7-4ad0-a1a0-bcdda6cba38e req-040bd56b-0a16-477f-bc3b-51957128582e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.137216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-21902f88-6fc7-4ad0-a1a0-bcdda6cba38e req-040bd56b-0a16-477f-bc3b-51957128582e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.137661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-21902f88-6fc7-4ad0-a1a0-bcdda6cba38e req-040bd56b-0a16-477f-bc3b-51957128582e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.142520 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7823eaab-a127-48ef-b9bb-313fdce29cd4 req-aec922f7-def8-4044-aedf-8ed51d9415c9 service nova] Creating event network-vif-plugged:7f21f4ad-6e4b-49a1-9ff7-b3a359019136 for instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 on n-h2-854663-10 Oct 27 10:23:03.148431 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7823eaab-a127-48ef-b9bb-313fdce29cd4 req-aec922f7-def8-4044-aedf-8ed51d9415c9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060409 Oct 27 10:23:03.149750 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1852/3529] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:03.150154 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-21902f88-6fc7-4ad0-a1a0-bcdda6cba38e req-040bd56b-0a16-477f-bc3b-51957128582e service nova] Creating event network-vif-deleted:19b3a7f7-ae15-4ef9-8cee-d366b25f0556 for instance 3dd90237-f15f-45a7-9678-6f24718aa343 on n-h2-854663-10 Oct 27 10:23:03.155685 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-21902f88-6fc7-4ad0-a1a0-bcdda6cba38e req-040bd56b-0a16-477f-bc3b-51957128582e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040781 Oct 27 10:23:03.156709 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1678/3530] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:03.157463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29827c03-4c19-4155-9eb1-65b5002c8bd1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:03.158341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29827c03-4c19-4155-9eb1-65b5002c8bd1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:03.162816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:03.163456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:03.170756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.171255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.171698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.172640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.173138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.173566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.213381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lazy-loading 'flavor' on Instance uuid 6046b640-0df2-4ff7-9a74-88ddb8572b5a {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:23:03.405548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29827c03-4c19-4155-9eb1-65b5002c8bd1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:03.422509 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29827c03-4c19-4155-9eb1-65b5002c8bd1 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1208 microversion: 2.1 time: 0.271139 Oct 27 10:23:03.425289 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1853/3531] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:03 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1208 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:03.437196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:03.438019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:03.451929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.453132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.456073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.457252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.457872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.458451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.537052 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-759e83cf-1441-44e6-a35b-6f0831dc48e7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a/action" status: 202 len: 0 microversion: 2.1 time: 0.378162 Oct 27 10:23:03.539867 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1679/3532] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:23:03 2022] POST /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:23:03.548465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:03.551996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] [instance: 3dd90237-f15f-45a7-9678-6f24718aa343] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:03.570562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.572271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.573068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.574567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.575637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.576773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.600528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] HTTP exception thrown: Instance 3dd90237-f15f-45a7-9678-6f24718aa343 could not be found. Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Request method failure captured: Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 HTTP/1.1 Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlvmmHZaDgH5hWC8aQ6CZ593xt8CKQpGYXXxSe_pKf5XsRwxAm9mN97X4L4shVA3dHPXWKO-j1zx5JP5xt7HCOC8l4B3V5nXHP6lCGw1aNmDjSCtcjp2t_C6-ArlEObg3NFy2eiJ6jb0fPRVV1fgyRMRr42ONJ2Z5aXjxEmGfmCaq1M Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0b1128cfec2a4ae5a5c807bcc19ec623 Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1397743781 Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0b1128cfec2a4ae5a5c807bcc19ec623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0b1128cfec2a4ae5a5c807bcc19ec623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0b1128cfec2a4ae5a5c807bcc19ec623", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0b1128cfec2a4ae5a5c807bcc19ec623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1397743781 Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0b1128cfec2a4ae5a5c807bcc19ec623 Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1397743781 Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-InstanceActionsNegativeTestJSON-1397743781-project Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: b776c931df234bd0be84e360aebab12f Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1397743781-project Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 3dd90237-f15f-45a7-9678-6f24718aa343 could not be found. Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '3dd90237-f15f-45a7-9678-6f24718aa343'} Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd90237-f15f-45a7-9678-6f24718aa343 could not be found. Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd90237-f15f-45a7-9678-6f24718aa343 could not be found. Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:03.603437 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:03.607746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:03.607746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:03.607746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:03.607746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:03.607746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:23:03.607746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:23:03.607746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd90237-f15f-45a7-9678-6f24718aa343 could not be found. Oct 27 10:23:03.607746 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:03.610500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] Returning 404 to user: Instance 3dd90237-f15f-45a7-9678-6f24718aa343 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:23:03.611867 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-971f74e0-c8c6-4595-ab1f-df0599932726 tempest-InstanceActionsNegativeTestJSON-1397743781 tempest-InstanceActionsNegativeTestJSON-1397743781-project] 10.222.0.76 "GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343" status: 404 len: 111 microversion: 2.1 time: 0.068178 Oct 27 10:23:03.613945 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1680/3533] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:03 2022] GET /compute/v2.1/servers/3dd90237-f15f-45a7-9678-6f24718aa343 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:23:03.619907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:03.620576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:03.641063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.641551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.641989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.644751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:03.645209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:03.645639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:03.846551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:03.859643 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-64507085-84c2-4183-9c20-0e8c1c3f64ce tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.433065 Oct 27 10:23:03.880464 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1854/3534] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:03 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:04.083706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:04.095208 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5026f16e-ee53-47b4-83cf-8e4cf699b015 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.479964 Oct 27 10:23:04.095723 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1681/3535] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:03 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:04.119987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:04.122497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:04.132108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:04.132812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:04.138955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:04.143407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:04.143920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:04.146016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:04.146637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:04.147503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:04.148520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:04.149314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:04.149804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:04.150244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:04.150661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:04.153123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:04.730838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:04.741350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:04.751544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:04.755657 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c5012cf-2d52-481f-85ab-e7e6d7b556b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1307 microversion: 2.1 time: 0.641699 Oct 27 10:23:04.756497 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1855/3536] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:04 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1307 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:04.757322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:04.759106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd9c466a-2c04-4d02-afb4-a20c4dd69c23 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1662 microversion: 2.32 time: 0.631054 Oct 27 10:23:04.767000 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1682/3537] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:04 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1662 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:04.768485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:04.769187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:04.784258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:04.793005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:04.793777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:04.794667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:04.795136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:04.795710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:04.888354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:04.889222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:04.896359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:04.897275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:04.897972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:04.898899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:04.899671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:04.900442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:04.922648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:04.935065 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-86034429-2ff1-4f27-bd37-4b1034c15fdf tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1278 microversion: 2.1 time: 0.177243 Oct 27 10:23:04.949981 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1856/3538] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:04 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:05.190180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:05.207645 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-61c27da5-9e02-4eea-8ed1-9c060855e08a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.323937 Oct 27 10:23:05.208809 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1683/3539] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:04 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:05.213668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:05.218408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:05.235203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-327375646", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "0eb0c01e-000b-416e-94ef-ab8df39bb5f3"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:05.256009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:05.256776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:05.257350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:05.258132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:05.258683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:05.259203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:05.340292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] validate_networks() for [('0eb0c01e-000b-416e-94ef-ab8df39bb5f3', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:23:05.735924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:05.749845 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-db55c1ea-d172-487e-8002-6c67f2d15165 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.539144 Oct 27 10:23:05.751401 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1684/3540] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:05 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:05.782642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:05.783445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:05.791374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:05.804297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:05.805993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:05.807420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:05.808185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:05.808885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:06.783931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:06.798110 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80fa236d-0903-47fc-b89c-78e0d6d76348 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 200 len: 1486 microversion: 2.1 time: 1.022327 Oct 27 10:23:06.802754 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1685/3541] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:05 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 1486 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:06.809256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:06.810121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:06.816854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:06.817701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:06.818287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:06.819129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:06.819715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:06.820274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:07.105741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:23:07.107009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:23:07.107682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:23:07.108234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:23:07.108827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:23:07.127263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:07.129932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:07.130631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:07.134886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:07.135783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:07.137465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:07.243739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Getting quotas for project 133d557efa3a468b8b1dc7cb22d2da3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:23:07.262776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:07.264766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Getting quotas for user 32f75c99fc894705bf4d74b26583fc51 and project 133d557efa3a468b8b1dc7cb22d2da3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:23:07.300753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:23:07.324756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:23:07.383975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:07.407264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:07.410810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:07.414554 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-069a3a9e-5e6e-4f1a-8cae-3f1e3361c39c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1709 microversion: 2.32 time: 0.609348 Oct 27 10:23:07.419900 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1686/3542] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:06 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1709 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:07.432504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:07.435077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:07.448787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:07.450457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:07.454044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:07.455053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:07.455678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:07.456266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:07.470756 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c084c3d8-7ad3-4c67-bba0-c2e85ac17e7a tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.366994 Oct 27 10:23:07.477015 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1857/3543] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:23:07.490066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:07.491074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:07.520113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:07.521231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:07.523448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:07.525082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:07.528291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:07.530161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.011588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:08.025068 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-514c7901-cf7e-432b-a831-933a8b586d3a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1308 microversion: 2.1 time: 0.599913 Oct 27 10:23:08.042902 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1687/3544] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:07 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1308 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:08.053864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:08.056323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:08.073331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.075045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.075499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.076240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.080804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.081517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.146266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:08.155549 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68f36b8b-eb38-4fac-b95a-7c7259d66092 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.677250 Oct 27 10:23:08.158669 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1858/3545] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:07 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:08.174192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3c7eeb6-c935-4d4f-b418-7247fb0fc9a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1821856527"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:08.190043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3c7eeb6-c935-4d4f-b418-7247fb0fc9a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:08.214717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3c7eeb6-c935-4d4f-b418-7247fb0fc9a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.215351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3c7eeb6-c935-4d4f-b418-7247fb0fc9a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.215795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3c7eeb6-c935-4d4f-b418-7247fb0fc9a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.216519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3c7eeb6-c935-4d4f-b418-7247fb0fc9a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.217049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3c7eeb6-c935-4d4f-b418-7247fb0fc9a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.217476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3c7eeb6-c935-4d4f-b418-7247fb0fc9a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.858984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:08.861601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:08.876195 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b2c04c4e-7425-4294-bcf1-ae27248015bd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.831171 Oct 27 10:23:08.889274 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1688/3546] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:08 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:08.898456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:08.911752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:08.914505 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3c7eeb6-c935-4d4f-b418-7247fb0fc9a8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9/action" status: 202 len: 0 microversion: 2.1 time: 0.754423 Oct 27 10:23:08.917794 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1859/3547] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:23:08 2022] POST /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:23:08.939149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.940022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.940747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.940868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:08.941744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:08.942727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.953603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.954412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.965960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.966473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.966923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.971915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.972442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.972952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:09.278436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:09.289406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:09.303997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:09.305753 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b011bfe8-8b6d-44c6-a93a-8e584c4da919 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1254 microversion: 2.21 time: 0.415290 Oct 27 10:23:09.306975 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1689/3548] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:08 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1254 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:09.318770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bd450c2-41c3-4a45-92ed-5d9a2a41bc0f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d637a1e50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:09.399685 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bd450c2-41c3-4a45-92ed-5d9a2a41bc0f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24" status: 200 len: 1412 microversion: 2.1 time: 0.091280 Oct 27 10:23:09.418652 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1690/3549] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:23:09 2022] GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:09.439606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:09.442404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:09.458859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:09.461133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:09.469138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:09.472172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:09.474310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:09.474941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:09.823045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:09.845129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:09.847479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:09.851530 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-73f1d016-b662-40bc-9c0f-99e37969f8e2 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1756 microversion: 2.32 time: 0.926181 Oct 27 10:23:09.863387 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1860/3550] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:08 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1756 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:09.876271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:09.876911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:09.892466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:09.895686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:09.897043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:09.897803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:09.898271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:09.902484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:10.156432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:10.176286 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4f739f2-b8c7-49ee-badb-a7268f861b83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1308 microversion: 2.1 time: 0.741633 Oct 27 10:23:10.196689 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1691/3551] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:09 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1308 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:10.204506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:10.205761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:10.214666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:10.215588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:10.216259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:10.217187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:10.220624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:10.222442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:10.595574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:10.613490 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2d292c7-3486-43b0-891e-b277eaf76f4d tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.746856 Oct 27 10:23:10.614797 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1861/3552] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:09 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:10.624246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:10.635045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:10.638765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:10.662556 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-335be2cd-20f4-4158-9eea-3f07add49ea6 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.465749 Oct 27 10:23:10.684120 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1692/3553] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:10 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:10.697717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:10.698345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:10.701027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:10.702467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:10.712194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:10.713229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:10.713417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:10.713732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:10.714184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:10.714391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:10.715002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:10.715566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:10.715767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:10.716008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:10.907520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:10.918519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:10.920251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:10.921881 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-641697b6-c5eb-4de0-bcf1-5b940ec4a5ba tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1316 microversion: 2.21 time: 0.233394 Oct 27 10:23:10.938127 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1693/3554] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:10 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:10.955344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75c51f4f-dae9-45d4-a39f-6025051bbc8e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b5018b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:11.026713 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-75c51f4f-dae9-45d4-a39f-6025051bbc8e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24" status: 200 len: 1412 microversion: 2.1 time: 0.086461 Oct 27 10:23:11.028043 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1694/3555] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:23:10 2022] GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:11.033722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:11.035398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:11.043204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:11.044078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:11.044728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:11.045635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:11.046248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:11.047154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:11.065144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:11.077245 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d9aa7db-7c69-4edb-b95a-19016173de3d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.460903 Oct 27 10:23:11.099058 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1862/3556] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:10 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:11.107541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:11.108773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:11.122580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:11.123468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:11.124124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:11.125166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:11.125937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:11.127346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:11.160327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:11.396156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:11.410426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:11.412407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:11.414601 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b90fb935-1dfe-4417-9cb3-7e32fb94c126 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1803 microversion: 2.32 time: 0.385272 Oct 27 10:23:11.432345 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1695/3557] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:11 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1803 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:11.443129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:11.446284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-29dc9889-82c9-4a94-bc22-407221570e6e req-05207439-e629-44f9-9168-687cadb21005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1851c26-861c-4d76-9d98-0d9528ec46b0", "tag": "9ef9d678-5579-44ed-acbe-aed80724c619"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:11.451878 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab773101-e7a6-40e7-8f49-83cd3043df6d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.350167 Oct 27 10:23:11.452480 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1863/3558] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:11 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:11.474219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:11.474836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:11.477361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-29dc9889-82c9-4a94-bc22-407221570e6e req-05207439-e629-44f9-9168-687cadb21005 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:11.478103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-29dc9889-82c9-4a94-bc22-407221570e6e req-05207439-e629-44f9-9168-687cadb21005 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:11.481351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-29dc9889-82c9-4a94-bc22-407221570e6e req-05207439-e629-44f9-9168-687cadb21005 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:11.481500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:11.482216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:11.482854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:11.483943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:11.484556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:11.486936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:11.528748 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-29dc9889-82c9-4a94-bc22-407221570e6e req-05207439-e629-44f9-9168-687cadb21005 service nova] Creating event network-changed:9ef9d678-5579-44ed-acbe-aed80724c619 for instance a1851c26-861c-4d76-9d98-0d9528ec46b0 on n-h1-854663-10 Oct 27 10:23:11.534626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-29dc9889-82c9-4a94-bc22-407221570e6e req-05207439-e629-44f9-9168-687cadb21005 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100493 Oct 27 10:23:11.535790 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1696/3559] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:11.543305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:11.544060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:11.550771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:11.551279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:11.552043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:11.552796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:11.553258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:11.553692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.034067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:12.062533 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8a69f25e-3d0b-4be1-8509-a6f4a69b782a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.524847 Oct 27 10:23:12.081810 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1697/3560] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:11 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:12.089705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:12.091223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:12.098180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.098904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.099420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.100207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.100800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.101460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.182136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:12.196154 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61e17e40-bee2-4f01-88ce-d404c3e7f66c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1308 microversion: 2.1 time: 0.725844 Oct 27 10:23:12.232906 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1864/3561] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:11 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1308 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:12.238226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:12.252732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:12.269445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.270322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.270910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.271780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.274010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.274640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.415026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:12.454738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=14 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:12.587038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:12.610108 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e4451c6-6c77-4484-a2e2-ee4c2078f509 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.523813 Oct 27 10:23:12.612790 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1698/3562] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:12 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:12.621459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:12.635955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:12.646172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.647048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.647726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.648679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.649353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.649998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.672421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:12.684441 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53576faf-3de4-4fe7-b35c-7fe73eb76960 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.449755 Oct 27 10:23:12.685078 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1865/3563] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:12 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:12.692632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3ae1e3b-73c8-425c-812b-e71e8eeff09f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5aa16550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:12.792259 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3ae1e3b-73c8-425c-812b-e71e8eeff09f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24" status: 200 len: 1412 microversion: 2.1 time: 0.104570 Oct 27 10:23:12.795632 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1866/3564] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:23:12 2022] GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:12.809904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc343542-ab9d-489b-bc32-14bcb3cdd6a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1936925070"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:12.816507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc343542-ab9d-489b-bc32-14bcb3cdd6a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:12.843478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc343542-ab9d-489b-bc32-14bcb3cdd6a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.844223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc343542-ab9d-489b-bc32-14bcb3cdd6a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.846447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc343542-ab9d-489b-bc32-14bcb3cdd6a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.848537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc343542-ab9d-489b-bc32-14bcb3cdd6a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.851209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc343542-ab9d-489b-bc32-14bcb3cdd6a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.853160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc343542-ab9d-489b-bc32-14bcb3cdd6a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.925451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:12.934798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:12.936821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:12.939116 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62c0edd3-9cfa-4763-9417-a484bea909a7 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1358 microversion: 2.21 time: 0.325154 Oct 27 10:23:12.940511 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1699/3565] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:12 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:12.946408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:12.947197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:12.953792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.954273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.954870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:12.955786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:12.956382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:12.956993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:13.265102 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc343542-ab9d-489b-bc32-14bcb3cdd6a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.467693 Oct 27 10:23:13.266999 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1867/3566] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:23:12 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 27 10:23:13.275542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:13.276577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:13.298591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:13.300057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:13.301624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:13.303796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:13.304553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:13.305326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:13.498435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:13.520229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:13.524779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:13.526371 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e3b42a4-bc08-4913-ae79-e79ace3f58de tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1850 microversion: 2.32 time: 0.584568 Oct 27 10:23:13.530486 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1700/3567] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:12 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1850 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:13.639879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:13.640500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:13.655758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:13.658984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:13.659629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:13.662128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:13.663530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:13.665011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:13.985859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:13.994868 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4eeba7c1-5e3c-4185-af93-e03ab58dc08f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1308 microversion: 2.1 time: 0.726315 Oct 27 10:23:14.001446 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1868/3568] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:13 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1308 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:14.011087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:14.013729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:14.028539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:14.031307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:14.033016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:14.035186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:14.035924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:14.036520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:14.823222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:14.837077 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d91fc4b-e830-450c-9393-4ba0c426ea33 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 1.202667 Oct 27 10:23:14.840884 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1701/3569] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:13 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:14.855055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9989c61-4419-4071-89da-e3d525af35a7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b4eee50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:14.955543 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9989c61-4419-4071-89da-e3d525af35a7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24" status: 200 len: 1412 microversion: 2.1 time: 0.113446 Oct 27 10:23:14.967575 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1702/3570] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:23:14 2022] GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:14.980454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:14.981108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:15.007536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:15.014057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:15.017485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:15.018930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:15.022070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:15.025158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:15.187836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:15.199306 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1e5bc0b-d68f-4d17-b513-612847f32c5c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 1.196295 Oct 27 10:23:15.220988 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1869/3571] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:14 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:15.231509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:15.233748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:15.253874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:15.255430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:15.255953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:15.257540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:15.260956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:15.261509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:16.239850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:16.251834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:16.277067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:16.278567 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05c0e832-6812-461f-a150-0d4fa203ee0b tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1358 microversion: 2.21 time: 1.309798 Oct 27 10:23:16.279050 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1703/3572] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:14 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1358 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:16.291045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:16.291666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:16.313432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:16.314290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:16.314788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:16.315619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:16.328345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:16.329137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:16.378181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:16.395215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:16.403984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:16.406316 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6001517-b8e8-4a08-b740-638421ea6bd5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1850 microversion: 2.32 time: 1.183784 Oct 27 10:23:16.410919 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1870/3573] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:15 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1850 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:16.422530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-56d7ff31-82f7-4b1e-bc22-d0e080b539fe req-d68579ea-53a3-4762-b5c8-19525a65c4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a75dcf-70b8-44d6-9cae-ce48c093efc3", "tag": "504104da-e40e-4893-80c9-e3db705a3bae"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:16.451565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-56d7ff31-82f7-4b1e-bc22-d0e080b539fe req-d68579ea-53a3-4762-b5c8-19525a65c4ff service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:16.452543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-56d7ff31-82f7-4b1e-bc22-d0e080b539fe req-d68579ea-53a3-4762-b5c8-19525a65c4ff service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:16.454378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-56d7ff31-82f7-4b1e-bc22-d0e080b539fe req-d68579ea-53a3-4762-b5c8-19525a65c4ff service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:16.479718 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-56d7ff31-82f7-4b1e-bc22-d0e080b539fe req-d68579ea-53a3-4762-b5c8-19525a65c4ff service nova] Creating event network-changed:504104da-e40e-4893-80c9-e3db705a3bae for instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 on n-h2-854663-10 Oct 27 10:23:16.487612 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-56d7ff31-82f7-4b1e-bc22-d0e080b539fe req-d68579ea-53a3-4762-b5c8-19525a65c4ff service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075028 Oct 27 10:23:16.489085 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1871/3574] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:16.499521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:16.500410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:16.508927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:16.509750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:16.510575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:16.512128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:16.513142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:16.513772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:17.126031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:17.150793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:17.159420 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-669484c6-7a56-4aef-a482-7554a98ae819 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1308 microversion: 2.1 time: 0.879333 Oct 27 10:23:17.160180 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78ecedb7-5b4f-4b22-a6f8-f60ffd843b36 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.665085 Oct 27 10:23:17.161051 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1872/3575] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:16 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:17.162574 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1704/3576] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:16 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1308 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:17.166898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-14ab98d0-1978-4599-a278-f30044b57b8c req-88d32830-a1a7-4eca-8fef-e4f35ba2ed63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfa7709-dcb6-47e3-bc91-2c3f4510b3b9", "name": "network-vif-plugged", "status": "completed", "tag": "7f21f4ad-6e4b-49a1-9ff7-b3a359019136"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:17.181972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-277ac945-3f0a-4029-8c35-c30afb884710 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d63778160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:17.206453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-14ab98d0-1978-4599-a278-f30044b57b8c req-88d32830-a1a7-4eca-8fef-e4f35ba2ed63 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:17.213850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-14ab98d0-1978-4599-a278-f30044b57b8c req-88d32830-a1a7-4eca-8fef-e4f35ba2ed63 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:17.214293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-14ab98d0-1978-4599-a278-f30044b57b8c req-88d32830-a1a7-4eca-8fef-e4f35ba2ed63 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:17.235459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:17.244566 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-14ab98d0-1978-4599-a278-f30044b57b8c req-88d32830-a1a7-4eca-8fef-e4f35ba2ed63 service nova] Creating event network-vif-plugged:7f21f4ad-6e4b-49a1-9ff7-b3a359019136 for instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 on n-h2-854663-10 Oct 27 10:23:17.262659 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-277ac945-3f0a-4029-8c35-c30afb884710 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24" status: 200 len: 1412 microversion: 2.1 time: 0.094434 Oct 27 10:23:17.263225 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1705/3577] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:23:17 2022] GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:17.271233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:17.272622 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-14ab98d0-1978-4599-a278-f30044b57b8c req-88d32830-a1a7-4eca-8fef-e4f35ba2ed63 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110056 Oct 27 10:23:17.273485 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1873/3578] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:17.285380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:17.293498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ffe91120-b4d3-4362-8a65-7b82188be8ba req-1b8b7dbb-1620-4320-878a-138d93969dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "tag": "ea6b7f3d-eab2-4913-848a-baf2f2b76986"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:17.299562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:17.300706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:17.303739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:17.304875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:17.305528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:17.307465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:17.320254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=24 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:17.324597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ffe91120-b4d3-4362-8a65-7b82188be8ba req-1b8b7dbb-1620-4320-878a-138d93969dd7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:17.325569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ffe91120-b4d3-4362-8a65-7b82188be8ba req-1b8b7dbb-1620-4320-878a-138d93969dd7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:17.326208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ffe91120-b4d3-4362-8a65-7b82188be8ba req-1b8b7dbb-1620-4320-878a-138d93969dd7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:17.342394 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ffe91120-b4d3-4362-8a65-7b82188be8ba req-1b8b7dbb-1620-4320-878a-138d93969dd7 service nova] Creating event network-changed:ea6b7f3d-eab2-4913-848a-baf2f2b76986 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:23:17.430972 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ffe91120-b4d3-4362-8a65-7b82188be8ba req-1b8b7dbb-1620-4320-878a-138d93969dd7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151085 Oct 27 10:23:17.435903 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1874/3579] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:17.464637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:17.468504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:17.498451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:17.501047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:17.501587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:17.504800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:17.505309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:17.510007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:18.066115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:18.077727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:18.080994 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a17c1d3a-b139-4b9e-a77b-854a9c9001e9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.816240 Oct 27 10:23:18.093106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:18.093106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:18.099871 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1706/3580] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:17 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:18.100439 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6453c9f8-c03e-4a71-8d10-8257cfde4695 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1358 microversion: 2.21 time: 0.653296 Oct 27 10:23:18.108757 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1875/3581] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:17 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1358 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:18.108985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:18.108985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:18.130121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:18.133637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:18.134085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:18.134904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:18.135820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:18.138164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:18.210376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:18.211082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:18.219038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:18.219352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:18.224815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:18.229504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:18.230131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:18.230644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:18.899105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:18.906688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:18.916305 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b375cfc-c11f-4e36-9196-8940333a8cb4 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1308 microversion: 2.1 time: 0.710061 Oct 27 10:23:18.916836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:18.918538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:18.919857 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1876/3582] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:18 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1308 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:18.929469 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4836234f-02b1-4b86-a5b7-a2188224e1d5 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1871 microversion: 2.32 time: 0.826009 Oct 27 10:23:18.931466 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1707/3583] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:18 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1871 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:18.935303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:18.936235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:18.943773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7810da5b-b68f-4761-9332-6a8708e13cad tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d637520d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:18.955635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:18.960579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:18.961174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:18.963505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:18.964099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:18.964835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:19.266102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:19.277489 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd32decc-05c0-4eac-9de7-a162be663e98 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.356130 Oct 27 10:23:19.278403 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1877/3584] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:18 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:19.292743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:19.293987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:19.314988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:19.318685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:19.319262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:19.329226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:19.330620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:19.331994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:19.900569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:19.909885 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-badd76a4-8a1d-4874-9e1f-903c79c4d967 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.624284 Oct 27 10:23:19.916899 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1878/3585] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:19 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:19.934735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:19.935783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:19.949371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:19.950373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:19.951002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:19.953590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:19.955990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:19.965715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:20.550413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:20.559501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:20.560975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:20.562110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6a6558b-76ed-4218-a882-4ddace6ea282 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1358 microversion: 2.21 time: 0.643921 Oct 27 10:23:20.577378 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1879/3586] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:19 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1358 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:20.593350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-392cc6cd-aa11-4345-855a-a3794f585419 req-93d6895c-307c-49f3-866f-fdc8d5585c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1851c26-861c-4d76-9d98-0d9528ec46b0", "name": "network-vif-plugged", "status": "completed", "tag": "9ef9d678-5579-44ed-acbe-aed80724c619"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:20.635026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-392cc6cd-aa11-4345-855a-a3794f585419 req-93d6895c-307c-49f3-866f-fdc8d5585c0b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:20.635517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-392cc6cd-aa11-4345-855a-a3794f585419 req-93d6895c-307c-49f3-866f-fdc8d5585c0b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:20.635945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-392cc6cd-aa11-4345-855a-a3794f585419 req-93d6895c-307c-49f3-866f-fdc8d5585c0b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:20.694544 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-392cc6cd-aa11-4345-855a-a3794f585419 req-93d6895c-307c-49f3-866f-fdc8d5585c0b service nova] Creating event network-vif-plugged:9ef9d678-5579-44ed-acbe-aed80724c619 for instance a1851c26-861c-4d76-9d98-0d9528ec46b0 on n-h1-854663-10 Oct 27 10:23:20.721860 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-392cc6cd-aa11-4345-855a-a3794f585419 req-93d6895c-307c-49f3-866f-fdc8d5585c0b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142861 Oct 27 10:23:20.722498 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1880/3587] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:20.755582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:20.759301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:20.791468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:20.791962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:20.792401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:20.793275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:20.793777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:20.794198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:21.875859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:21.904192 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cccb04dd-1ea5-41df-a8ec-c559854afd97 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1308 microversion: 2.1 time: 1.169735 Oct 27 10:23:21.905282 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1881/3588] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:20 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1308 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:21.949011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:21.949806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:21.990140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:21.990963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:21.991569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:21.995409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:21.996616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:21.999171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:22.071027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:22.556592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:22.576235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:22.580020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:22.581621 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-103655ad-80bf-42fa-bc99-2a5a73cf0ad4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1892 microversion: 2.32 time: 0.675289 Oct 27 10:23:22.615488 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1882/3589] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:21 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1892 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:22.632322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e43f890a-3f19-47ac-aacc-0dbe790a7677 req-1879930a-1dfe-4521-80b6-933368a92ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "tag": "2af433f7-16ef-4d73-be18-2d94fa8044b0"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:22.645376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e43f890a-3f19-47ac-aacc-0dbe790a7677 req-1879930a-1dfe-4521-80b6-933368a92ab6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:22.646049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e43f890a-3f19-47ac-aacc-0dbe790a7677 req-1879930a-1dfe-4521-80b6-933368a92ab6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:22.646654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e43f890a-3f19-47ac-aacc-0dbe790a7677 req-1879930a-1dfe-4521-80b6-933368a92ab6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:22.667166 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e43f890a-3f19-47ac-aacc-0dbe790a7677 req-1879930a-1dfe-4521-80b6-933368a92ab6 service nova] Creating event network-changed:2af433f7-16ef-4d73-be18-2d94fa8044b0 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:23:22.730421 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e43f890a-3f19-47ac-aacc-0dbe790a7677 req-1879930a-1dfe-4521-80b6-933368a92ab6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107027 Oct 27 10:23:22.733724 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1883/3590] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:22.748028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:22.751426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:22.772200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:22.773693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:22.774570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:22.777612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:22.779463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:22.780196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:23.310024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:23.330734 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79257bf5-8be6-40bc-a6db-735b4ababf30 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.594736 Oct 27 10:23:23.331685 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1884/3591] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:22 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:23.336782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:23.343322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:23.356491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:23.362873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:23.364228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:23.366129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:23.366862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:23.367532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:23.903837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:23.912101 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65a794a9-1bf7-4064-b814-9ac385a3831a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.579253 Oct 27 10:23:23.928703 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1885/3592] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:23 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:23.928703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:23.928703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:23.945437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:23.948406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:23.949093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:23.952956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:23.953556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:23.954275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:24.476716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:24.486234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:24.487694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:24.502983 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eaa52dda-026a-4cbd-9abe-7cef916d2169 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1358 microversion: 2.21 time: 0.568962 Oct 27 10:23:24.503682 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1886/3593] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:23 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1358 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:24.527842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b55407b3-671f-4c38-a00a-383f73b987dd req-b731be1c-7c90-4814-9438-8a3ae71d8528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "name": "network-vif-plugged", "status": "completed", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:24.563934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b55407b3-671f-4c38-a00a-383f73b987dd req-b731be1c-7c90-4814-9438-8a3ae71d8528 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:24.565249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b55407b3-671f-4c38-a00a-383f73b987dd req-b731be1c-7c90-4814-9438-8a3ae71d8528 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:24.565985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b55407b3-671f-4c38-a00a-383f73b987dd req-b731be1c-7c90-4814-9438-8a3ae71d8528 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:24.585964 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b55407b3-671f-4c38-a00a-383f73b987dd req-b731be1c-7c90-4814-9438-8a3ae71d8528 service nova] Creating event network-vif-plugged:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:23:24.595031 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b55407b3-671f-4c38-a00a-383f73b987dd req-b731be1c-7c90-4814-9438-8a3ae71d8528 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086097 Oct 27 10:23:24.596257 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1887/3594] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:24.602889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:24.604008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:24.614142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:24.617350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:24.618006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:24.619724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:24.621969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:24.622788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:25.379728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:25.451983 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22b087a0-c9b5-43c1-8171-25aaf4983008 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1488 microversion: 2.1 time: 0.845737 Oct 27 10:23:25.455327 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1888/3595] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:24 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1488 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:25.465694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:25.469568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:25.493227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:25.500974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:25.504433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:25.506722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:25.509313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:25.510031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:26.617580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:26.629323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:26.653319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:26.655551 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-169d44cb-602f-4f4f-90f6-5055805245b1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1892 microversion: 2.32 time: 1.197592 Oct 27 10:23:26.658056 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1889/3596] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:25 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1892 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:26.685952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:26.690150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:26.718435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:26.722739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:26.723423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:26.725626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:26.737533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:26.738204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:27.352654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:27.364620 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-087daf6f-3517-411c-8b36-b198931c0e69 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1734 microversion: 2.1 time: 0.705005 Oct 27 10:23:27.377416 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1890/3597] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:26 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1734 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:27.392772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0c7a5bde-9d9e-4c12-a0d3-78c18b449657 req-24e9ed70-a8da-46f7-8c66-bbb4e698ed32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "tag": "8ff1e688-864c-4428-89c9-709f26bba641"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:27.412899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0c7a5bde-9d9e-4c12-a0d3-78c18b449657 req-24e9ed70-a8da-46f7-8c66-bbb4e698ed32 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:27.417707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0c7a5bde-9d9e-4c12-a0d3-78c18b449657 req-24e9ed70-a8da-46f7-8c66-bbb4e698ed32 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:27.423656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0c7a5bde-9d9e-4c12-a0d3-78c18b449657 req-24e9ed70-a8da-46f7-8c66-bbb4e698ed32 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:27.451473 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0c7a5bde-9d9e-4c12-a0d3-78c18b449657 req-24e9ed70-a8da-46f7-8c66-bbb4e698ed32 service nova] Creating event network-changed:8ff1e688-864c-4428-89c9-709f26bba641 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:23:27.474550 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0c7a5bde-9d9e-4c12-a0d3-78c18b449657 req-24e9ed70-a8da-46f7-8c66-bbb4e698ed32 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095454 Oct 27 10:23:27.476217 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1891/3598] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:27.483343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:27.497346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:27.512843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:27.513635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:27.514223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:27.515077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:27.515679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:27.517277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:28.119169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:28.204894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:28.220443 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02be3e0b-6ee6-4a25-ad84-3f7c38eb2f87 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.742259 Oct 27 10:23:28.241537 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1892/3599] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:27 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:28.248592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ccbfca3-8e97-458e-86f0-d68cc1603e8a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1137724550"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:28.252065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ccbfca3-8e97-458e-86f0-d68cc1603e8a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:28.259778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ccbfca3-8e97-458e-86f0-d68cc1603e8a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:28.260600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ccbfca3-8e97-458e-86f0-d68cc1603e8a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:28.261874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ccbfca3-8e97-458e-86f0-d68cc1603e8a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:28.262843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ccbfca3-8e97-458e-86f0-d68cc1603e8a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:28.263513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ccbfca3-8e97-458e-86f0-d68cc1603e8a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:28.264173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ccbfca3-8e97-458e-86f0-d68cc1603e8a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:28.427903 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ccbfca3-8e97-458e-86f0-d68cc1603e8a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "PUT /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1074 microversion: 2.1 time: 0.182544 Oct 27 10:23:28.428963 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1893/3600] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 10:23:28 2022] PUT /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1074 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:28.447165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:28.449555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:28.472415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:28.473859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:28.477706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:28.478737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:28.479462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:28.480466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:28.909126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=87 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:29.614596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:29.628514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:29.630360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:29.631714 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c031fd4-9e64-4a93-ae39-50e7f7c9b2af tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1358 microversion: 2.21 time: 1.199442 Oct 27 10:23:29.633527 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1894/3601] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:28 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1358 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:29.643894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-57edd96a-a89c-4ac0-a8a8-82042befd54f req-9da44103-fb6a-4b50-a97a-e30fb835a0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a75dcf-70b8-44d6-9cae-ce48c093efc3", "name": "network-vif-plugged", "status": "completed", "tag": "504104da-e40e-4893-80c9-e3db705a3bae"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:29.675955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-57edd96a-a89c-4ac0-a8a8-82042befd54f req-9da44103-fb6a-4b50-a97a-e30fb835a0d5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:29.687710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-57edd96a-a89c-4ac0-a8a8-82042befd54f req-9da44103-fb6a-4b50-a97a-e30fb835a0d5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:29.688163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-57edd96a-a89c-4ac0-a8a8-82042befd54f req-9da44103-fb6a-4b50-a97a-e30fb835a0d5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:29.723228 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-57edd96a-a89c-4ac0-a8a8-82042befd54f req-9da44103-fb6a-4b50-a97a-e30fb835a0d5 service nova] Creating event network-vif-plugged:504104da-e40e-4893-80c9-e3db705a3bae for instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 on n-h2-854663-10 Oct 27 10:23:29.754849 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-57edd96a-a89c-4ac0-a8a8-82042befd54f req-9da44103-fb6a-4b50-a97a-e30fb835a0d5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119389 Oct 27 10:23:29.755506 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1895/3602] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:29.783218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:29.784152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:29.806871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:29.807371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:29.807811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:29.814218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:29.814668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:29.815118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:30.633809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:30.648960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:30.655161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:30.659675 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f0cc6a4-071a-4bb1-b469-c40664d0d49f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.901125 Oct 27 10:23:30.679965 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1896/3603] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:29 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:30.702662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:30.704447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:30.722463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:30.723559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:30.724071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:30.724890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:30.729343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:30.729897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:31.052479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:31.071039 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28d2351d-6e37-4675-8515-22f41e082ee3 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1714 microversion: 2.1 time: 0.386721 Oct 27 10:23:31.079113 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1897/3604] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:30 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1714 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:31.086788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:31.092575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:31.115242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:31.117098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:31.118417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:31.121174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:31.122118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:31.123829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:31.535439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:31.550703 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67e9bbfe-a96d-4f71-8db0-a28603c262e8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1500 microversion: 2.1 time: 0.469938 Oct 27 10:23:31.552555 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1898/3605] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:31 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1500 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:31.557205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:31.563363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:31.580810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:31.594945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:31.595730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:31.596711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:31.597260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:31.597835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:32.154712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:32.172422 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea16191c-63b1-474e-810e-db31693ff50c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1507 microversion: 2.1 time: 0.619037 Oct 27 10:23:32.179713 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1899/3606] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:31 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1507 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:32.190594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-019e77d3-55b3-4170-bc41-a3d289c04650 req-4b03d889-02fd-4d44-ba4c-e042d4c5654a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "tag": "83bb0a57-9239-4158-bc07-2fedf58045e6"}, {"name": "network-changed", "server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "tag": "933ec73d-9a1a-4d23-9d8c-110265b3b6e0"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:32.224874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-019e77d3-55b3-4170-bc41-a3d289c04650 req-4b03d889-02fd-4d44-ba4c-e042d4c5654a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:32.226562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-019e77d3-55b3-4170-bc41-a3d289c04650 req-4b03d889-02fd-4d44-ba4c-e042d4c5654a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:32.240018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-019e77d3-55b3-4170-bc41-a3d289c04650 req-4b03d889-02fd-4d44-ba4c-e042d4c5654a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:32.266603 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-019e77d3-55b3-4170-bc41-a3d289c04650 req-4b03d889-02fd-4d44-ba4c-e042d4c5654a service nova] Creating event network-changed:83bb0a57-9239-4158-bc07-2fedf58045e6 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:23:32.278078 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-019e77d3-55b3-4170-bc41-a3d289c04650 req-4b03d889-02fd-4d44-ba4c-e042d4c5654a service nova] Creating event network-changed:933ec73d-9a1a-4d23-9d8c-110265b3b6e0 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:23:32.297185 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-019e77d3-55b3-4170-bc41-a3d289c04650 req-4b03d889-02fd-4d44-ba4c-e042d4c5654a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.115422 Oct 27 10:23:32.297916 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1900/3607] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:32.610782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1133198217", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "37746d93-6e6b-4c6d-b361-01480812d0b9"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:34.778347 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7810da5b-b68f-4761-9332-6a8708e13cad tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24" status: 200 len: 1421 microversion: 2.1 time: 15.844446 Oct 27 10:23:34.779393 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1708/3608] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:23:18 2022] GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 => generated 1421 bytes in 15847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:34.784002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] validate_networks() for [('37746d93-6e6b-4c6d-b361-01480812d0b9', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:23:34.788212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:34.793545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:34.810517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:34.812511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:34.815463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:34.816688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:34.817391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:34.819914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.056362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:35.071439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:35.078634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:35.081730 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35d706ef-7a22-4104-89e1-0b2b67ea5b02 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1551 microversion: 2.21 time: 0.300303 Oct 27 10:23:35.082357 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1709/3609] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:34 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1551 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:35.097044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:35.101352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:35.124371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.124893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.125328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.126035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.126487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.126911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.353748 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] HTTP exception thrown: Cannot 'detach_volume' instance b54c5675-6a87-4213-a858-dd71fc93e9c7 while it is in vm_state rescued Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Request method failure captured: Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments/0a9ad905-98d4-411d-91fe-d986fe72c0c3 HTTP/1.1 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsu-3_w5LGZIvZif4TTAP6HRONgNGme2C9gImyb4W0g9Upsi7Y2bHorvYIAfIK1OJaF4pOA8nmy8Y4T0BPo3Z6b72CJIADNwIlaiQrBL1QEHegWtPyuQbLI5lnUkUsZwbu1MPjFEe-CeaqflWsbqJ87tWOxBka5KpPfYl0fSmtf6VA Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9067a31bfee345fca080e7621aa60015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9067a31bfee345fca080e7621aa60015", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5fc08f1ad238424896dcefb0fa0b20c5 Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot 'detach_volume' instance b54c5675-6a87-4213-a858-dd71fc93e9c7 while it is in vm_state rescued Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'server_id': 'b54c5675-6a87-4213-a858-dd71fc93e9c7', 'id': '0a9ad905-98d4-411d-91fe-d986fe72c0c3'} Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b54c5675-6a87-4213-a858-dd71fc93e9c7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b54c5675-6a87-4213-a858-dd71fc93e9c7 while it is in vm_state rescued Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:35.356580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:35.364608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:35.364608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:35.364608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:23:35.364608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:23:35.364608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b54c5675-6a87-4213-a858-dd71fc93e9c7 while it is in vm_state rescued Oct 27 10:23:35.364608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:35.364608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Returning 409 to user: Cannot 'detach_volume' instance b54c5675-6a87-4213-a858-dd71fc93e9c7 while it is in vm_state rescued {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:23:35.364608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-03efbd13-d67c-4029-9cb5-855dd2cdf3e7 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments/0a9ad905-98d4-411d-91fe-d986fe72c0c3" status: 409 len: 152 microversion: 2.1 time: 0.272120 Oct 27 10:23:35.364608 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1710/3610] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:23:35 2022] DELETE /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments/0a9ad905-98d4-411d-91fe-d986fe72c0c3 => generated 152 bytes in 278 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:23:35.370579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:35.371491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:35.384263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.384832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.385281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.386444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.387092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.394688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.574869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:23:35.575703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:23:35.576356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:23:35.577950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:23:35.578764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:23:35.592685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.593594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.594267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.595213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.595879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.596535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.623784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Getting quotas for project b36d1d526c1349128590dc6fc4578fa8. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:23:35.630788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:35.633099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Getting quotas for user 53b1aeed31ae4f13a19bb57be589385e and project b36d1d526c1349128590dc6fc4578fa8. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:23:35.651926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Going to run 2 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:23:35.656918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 29b136e0-a7fa-416c-a6b9-ffed49a93bcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:23:35.715691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=29b136e0-a7fa-416c-a6b9-ffed49a93bcb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:23:35.799238 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15986fa1-0abf-4e41-9f26-33b727cca86e tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.498010 Oct 27 10:23:35.800820 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1901/3611] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:23:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:23:35.810397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:35.811038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:35.832439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.832860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.833307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.834031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.834484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.834917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.868393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:35.878738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:35.890199 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3c9e28a-7a04-48f8-a65f-95c05090432b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1500 microversion: 2.1 time: 0.525522 Oct 27 10:23:35.890855 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1711/3612] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:35 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1500 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:35.910083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:35.910717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:35.933811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.934577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.935028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.935755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.936231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.936702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:36.331226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:36.355564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:36.357420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:36.359137 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d73cf8c1-e8fe-40a6-ae50-a06f619ae7b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.557685 Oct 27 10:23:36.365204 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1902/3613] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:35 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:36.377575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-65c65e8d-e32b-4508-bc6c-8152f1b094df req-2e8fb412-d730-4bc2-8147-6f0e7d48b1bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "tag": "ddc37743-d9c0-4cc7-9a0d-2fc905d04b07"}, {"name": "network-changed", "server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "tag": "5e400934-2aff-4c7a-bc1e-a86b095a134a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:36.412879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-65c65e8d-e32b-4508-bc6c-8152f1b094df req-2e8fb412-d730-4bc2-8147-6f0e7d48b1bb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:36.413658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-65c65e8d-e32b-4508-bc6c-8152f1b094df req-2e8fb412-d730-4bc2-8147-6f0e7d48b1bb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:36.419780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-65c65e8d-e32b-4508-bc6c-8152f1b094df req-2e8fb412-d730-4bc2-8147-6f0e7d48b1bb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:36.466590 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-65c65e8d-e32b-4508-bc6c-8152f1b094df req-2e8fb412-d730-4bc2-8147-6f0e7d48b1bb service nova] Creating event network-changed:ddc37743-d9c0-4cc7-9a0d-2fc905d04b07 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:23:36.482230 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-65c65e8d-e32b-4508-bc6c-8152f1b094df req-2e8fb412-d730-4bc2-8147-6f0e7d48b1bb service nova] Creating event network-changed:5e400934-2aff-4c7a-bc1e-a86b095a134a for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:23:36.496451 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-65c65e8d-e32b-4508-bc6c-8152f1b094df req-2e8fb412-d730-4bc2-8147-6f0e7d48b1bb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.122226 Oct 27 10:23:36.497593 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1903/3614] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:36.506576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35fed6ea-3587-4592-b80d-ccdd159a27c2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a889670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:36.519501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:36.538442 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fe4a12a-5fe8-4ff7-8019-1fad070e1d97 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1528 microversion: 2.1 time: 0.637565 Oct 27 10:23:36.539999 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1712/3615] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:35 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1528 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:36.551516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:36.552112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:36.588525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:36.600359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:36.600883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:36.601658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:36.602134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:36.602569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:36.650488 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35fed6ea-3587-4592-b80d-ccdd159a27c2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24" status: 200 len: 1421 microversion: 2.1 time: 0.151652 Oct 27 10:23:36.651739 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1904/3616] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:23:36 2022] GET /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 => generated 1421 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:36.655493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:23:36.661993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61c38cf7-f5e3-4bdf-9179-2cf9436c2c02 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:36.662554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61c38cf7-f5e3-4bdf-9179-2cf9436c2c02 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:36.683767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c38cf7-f5e3-4bdf-9179-2cf9436c2c02 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:36.684254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c38cf7-f5e3-4bdf-9179-2cf9436c2c02 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:36.694914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c38cf7-f5e3-4bdf-9179-2cf9436c2c02 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:36.703709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c38cf7-f5e3-4bdf-9179-2cf9436c2c02 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:36.706449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c38cf7-f5e3-4bdf-9179-2cf9436c2c02 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:36.712967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c38cf7-f5e3-4bdf-9179-2cf9436c2c02 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:36.932533 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f7f28d9-8d9a-4378-a89a-a448f72881e4 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 204 len: 0 microversion: 2.21 time: 0.387373 Oct 27 10:23:36.940645 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1713/3617] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:23:36 2022] DELETE /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:23:36.963033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:36.990867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:36.993618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Searching by: {'deleted': False, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:23:37.017262 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61c38cf7-f5e3-4bdf-9179-2cf9436c2c02 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/action" status: 202 len: 0 microversion: 2.1 time: 0.355608 Oct 27 10:23:37.019952 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1905/3618] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:23:36 2022] POST /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:23:37.038103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:37.040386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:37.041752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:37.044600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:37.045387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:37.046519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e71640a-69e8-4b64-95c2-67550d38e918 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:37.047194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:37.068800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e71640a-69e8-4b64-95c2-67550d38e918 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:37.073490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e71640a-69e8-4b64-95c2-67550d38e918 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:37.076150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e71640a-69e8-4b64-95c2-67550d38e918 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:37.101653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:23:37.131181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e71640a-69e8-4b64-95c2-67550d38e918 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:23:37.181969 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2bb3e254-26a2-4ec1-bfb1-90a8b43167c6 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.238892 Oct 27 10:23:37.197557 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1714/3619] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:23:36 2022] GET /compute/v2.1/servers => generated 677 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:37.203084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:37.208718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:37.219770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:37.224697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:37.225724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:37.226711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:37.228739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:37.236679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:37.246732 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e71640a-69e8-4b64-95c2-67550d38e918 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "POST /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0/action" status: 202 len: 0 microversion: 2.1 time: 0.224888 Oct 27 10:23:37.247346 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1906/3620] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:23:37 2022] POST /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:23:37.269234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1445523687", "imageRef": "cd22eb09-0c92-4072-988b-956297f16b24", "flavorRef": "452", "networks": [{"uuid": "9817231a-6843-4f63-80f8-30528217ef12"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:37.583930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:37.613687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:37.615587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:37.620117 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b996dc48-01d4-4060-8049-c0a720558c0d tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1557 microversion: 2.21 time: 0.421099 Oct 27 10:23:37.620874 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1715/3621] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:37 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1557 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:37.644801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:37.645449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:37.682980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:37.683770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:37.684220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:37.687780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:37.688304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:37.688779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:38.067906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:38.078974 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-459fafaf-eadd-4483-af3d-6b7e20d45af8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1722 microversion: 2.1 time: 0.456990 Oct 27 10:23:38.080928 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1716/3622] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:37 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1722 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:38.086583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:38.087451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:38.095089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:38.095857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:38.096464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:38.097398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:38.097999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:38.098828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:38.354682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:38.364249 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a4a17d32-6670-4a5a-a104-f48d466887c0 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1224 microversion: 2.1 time: 0.282005 Oct 27 10:23:38.377302 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1717/3623] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:38 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1224 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:38.404755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:38.405531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:38.437855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:38.439192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:38.441076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:38.444911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:38.447218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:38.456967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:38.925356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:38.940528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f394c02-cd0b-4310-8a99-687623994b15 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1510 microversion: 2.1 time: 0.561930 Oct 27 10:23:38.960339 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1718/3624] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:38 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:38.968024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:38.972520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:38.986997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:38.989332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:38.992259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:38.994960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:38.995554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:38.997350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:40.067943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:40.082837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:40.084292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:40.085539 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92400e56-471a-4d55-a431-5250ef730b35 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 1.123832 Oct 27 10:23:40.101419 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1719/3625] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:38 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:40.103284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:40.103934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:40.118544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:40.119050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:40.119492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:40.120219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:40.124138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:40.124654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:40.271424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] validate_networks() for [('9817231a-6843-4f63-80f8-30528217ef12', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:23:40.693131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:40.710768 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96d89ec9-f980-4a31-be4c-6adbd7509ab2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1523 microversion: 2.1 time: 0.612361 Oct 27 10:23:40.741028 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1720/3626] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:40 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:40.890996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-04bb3027-172e-4e8c-b0cb-3c0c7d85e459 req-e336a689-78f6-48ee-ba50-c0366eca79b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6046b640-0df2-4ff7-9a74-88ddb8572b5a", "name": "network-vif-plugged", "status": "completed", "tag": "2d2e70b5-9907-48f8-9309-a8acf57a6271"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:40.916962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04bb3027-172e-4e8c-b0cb-3c0c7d85e459 req-e336a689-78f6-48ee-ba50-c0366eca79b6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:40.920545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04bb3027-172e-4e8c-b0cb-3c0c7d85e459 req-e336a689-78f6-48ee-ba50-c0366eca79b6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:40.921241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04bb3027-172e-4e8c-b0cb-3c0c7d85e459 req-e336a689-78f6-48ee-ba50-c0366eca79b6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:40.953328 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-04bb3027-172e-4e8c-b0cb-3c0c7d85e459 req-e336a689-78f6-48ee-ba50-c0366eca79b6 service nova] Creating event network-vif-plugged:2d2e70b5-9907-48f8-9309-a8acf57a6271 for instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a on n-h1-854663-10 Oct 27 10:23:40.966842 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-04bb3027-172e-4e8c-b0cb-3c0c7d85e459 req-e336a689-78f6-48ee-ba50-c0366eca79b6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224092 Oct 27 10:23:40.970295 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1721/3627] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:40.984101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:40.990767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:41.007486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.011005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.013134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.015475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.018743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.019398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.086743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.087413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.087999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.088617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lazy-loading 'fault' on Instance uuid d9a75dcf-70b8-44d6-9cae-ce48c093efc3 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:23:41.187627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:41.201551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:41.203414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f75c99fc894705bf4d74b26583fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133d557efa3a468b8b1dc7cb22d2da3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:41.205130 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef6afc78-b44a-45c1-9e00-336a4f91c27f tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 200 len: 1348 microversion: 2.21 time: 0.228619 Oct 27 10:23:41.206045 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1722/3628] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:40 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 1348 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:41.211987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:41.212954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:41.223394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.224181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.224917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.225877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.226593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.227239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.615620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:41.620898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:41.632819 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5cb8a739-2cea-44f5-afb9-0a2fcac6a80a tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1722 microversion: 2.1 time: 0.424956 Oct 27 10:23:41.646686 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1723/3629] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:41 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:41.653953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:41.654578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:41.663122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.663618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.664424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.664790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.665056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:23:41.665526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.665678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.666290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:23:41.666977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:23:41.667711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:23:41.668947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:23:41.687742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.688607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.689521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.690416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.691510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.692109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.747426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:23:41.761436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for user 8074ee4104864f7b8010104133bd2fef and project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:23:41.795540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:23:41.798116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd22eb09-0c92-4072-988b-956297f16b24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:23:41.848630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:41.892607 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dcb3c78d-eb57-45ca-a6da-dcbfd7a1f082 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1278 microversion: 2.1 time: 0.248001 Oct 27 10:23:41.895643 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1724/3630] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:41 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:41.910492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:41.911133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:41.914039 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7ab5b65-8b41-4610-985c-6f130826e6ce tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.649188 Oct 27 10:23:41.921337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.921761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.922256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.922993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.924582 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1907/3631] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:23:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:23:41.932682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.932682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.944481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-54af1ffd-89c2-41ef-a328-9a6586aa59dd req-9bf2f005-a543-4714-8cf8-038f313a182e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a75dcf-70b8-44d6-9cae-ce48c093efc3", "name": "network-vif-deleted", "tag": "504104da-e40e-4893-80c9-e3db705a3bae"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:41.963563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-54af1ffd-89c2-41ef-a328-9a6586aa59dd req-9bf2f005-a543-4714-8cf8-038f313a182e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.964325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-54af1ffd-89c2-41ef-a328-9a6586aa59dd req-9bf2f005-a543-4714-8cf8-038f313a182e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.965049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-54af1ffd-89c2-41ef-a328-9a6586aa59dd req-9bf2f005-a543-4714-8cf8-038f313a182e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.983708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-54af1ffd-89c2-41ef-a328-9a6586aa59dd req-9bf2f005-a543-4714-8cf8-038f313a182e service nova] Creating event network-vif-deleted:504104da-e40e-4893-80c9-e3db705a3bae for instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 on n-h2-854663-10 Oct 27 10:23:41.999386 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-54af1ffd-89c2-41ef-a328-9a6586aa59dd req-9bf2f005-a543-4714-8cf8-038f313a182e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071591 Oct 27 10:23:42.001026 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1908/3632] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:42.011373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:42.012606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:42.020619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:42.021427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:42.021858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:42.022700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:42.023148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:42.023565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:42.327301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:42.336823 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21826ea7-dd99-475e-a8b4-58dc7b2e0fd5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1510 microversion: 2.1 time: 0.439909 Oct 27 10:23:42.337416 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1725/3633] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:41 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:42.358672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:42.359879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:42.371872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:42.372440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:42.372918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:42.373736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:42.374239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:42.374673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:42.555878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:42.568183 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5373c25-3f80-449f-8ee2-ed65f76d2413 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.564984 Oct 27 10:23:42.569314 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1909/3634] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:42 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:42.576340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:42.578540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:42.600292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:42.601626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:42.602086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:42.602848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:42.603310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:42.603738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.483262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:43.504874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:43.508715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:43.513223 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f08c294-db75-45df-9299-fe1b6979cd22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1523 microversion: 2.1 time: 0.942590 Oct 27 10:23:43.513812 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1910/3635] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:42 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1523 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:43.515916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:43.517397 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ba745c8c-ba3a-4a63-8cf3-07e28c6acf92 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 1.165745 Oct 27 10:23:43.517956 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1726/3636] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:42 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:43.523051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:43.537552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:43.539696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:43.540376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:43.547742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.548302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.548788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.549515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.549981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.550414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.553736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.554226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.554660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.555447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.555890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.559041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.573525 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] HTTP exception thrown: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Request method failure captured: Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 HTTP/1.1 Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlwIXJRyOjsJIuJ7bVE7NFAw0roYZwX3CUZ6YgvNbO6qkdfsgNWHWIkRNvB5GTq3WCfYFCKBVZ39_bk1iLEQxNGbGxhx9bPsWoqJTdVBUJJEP-I9_JNj2ynTLpS5J4fmW-EPq3hiaJARhmlz6gVlFc1U6yXQdzR4PsaklhqIWTQcovA Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 133d557efa3a468b8b1dc7cb22d2da3c Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1358583439 Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/133d557efa3a468b8b1dc7cb22d2da3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/133d557efa3a468b8b1dc7cb22d2da3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_133d557efa3a468b8b1dc7cb22d2da3c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/133d557efa3a468b8b1dc7cb22d2da3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-InstanceActionsV221TestJSON-1358583439 Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 133d557efa3a468b8b1dc7cb22d2da3c Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1358583439 Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-InstanceActionsV221TestJSON-1358583439-project Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 32f75c99fc894705bf4d74b26583fc51 Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-InstanceActionsV221TestJSON-1358583439-project Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd9a75dcf-70b8-44d6-9cae-ce48c093efc3'} Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:43.575898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Returning 404 to user: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-19b9e6e7-b1d8-491b-ba5a-9e03cb5ef6b9 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 404 len: 111 microversion: 2.21 time: 0.053730 Oct 27 10:23:43.582946 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1727/3637] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:43 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:23:43.591208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-04100e84-e390-433d-8f1c-6602a8945bc9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2083774863"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:43.595110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-04100e84-e390-433d-8f1c-6602a8945bc9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:43.602025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04100e84-e390-433d-8f1c-6602a8945bc9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.602682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04100e84-e390-433d-8f1c-6602a8945bc9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.603197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04100e84-e390-433d-8f1c-6602a8945bc9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.604091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04100e84-e390-433d-8f1c-6602a8945bc9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.604568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04100e84-e390-433d-8f1c-6602a8945bc9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.605021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04100e84-e390-433d-8f1c-6602a8945bc9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.768682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:43.782437 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8298557d-77bb-4a69-b0b0-a293d4349b5d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1260 microversion: 2.1 time: 0.263073 Oct 27 10:23:43.787808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1911/3638] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:43 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:43.798039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:43.798691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:43.823983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.824480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.824936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.825637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.826082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.826497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.948698 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-04100e84-e390-433d-8f1c-6602a8945bc9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.363785 Oct 27 10:23:43.955219 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1728/3639] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:23:43 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 27 10:23:43.972755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:43.974496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:43.991271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.996801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.998324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.002024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.007511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.007982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.368185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:44.383244 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7c4d9ad-e4e4-43b0-840e-1b518055ac31 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1320 microversion: 2.1 time: 0.426057 Oct 27 10:23:44.384101 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1729/3640] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:43 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1320 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:44.393141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-d8b5a798-a569-4c04-8af0-b5bcb86f7371 req-be5b6a21-5013-423e-a1f5-19072f02d2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfa7709-dcb6-47e3-bc91-2c3f4510b3b9", "name": "network-vif-unplugged", "status": "completed", "tag": "7f21f4ad-6e4b-49a1-9ff7-b3a359019136"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:44.415926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d8b5a798-a569-4c04-8af0-b5bcb86f7371 req-be5b6a21-5013-423e-a1f5-19072f02d2b6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.416627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d8b5a798-a569-4c04-8af0-b5bcb86f7371 req-be5b6a21-5013-423e-a1f5-19072f02d2b6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.418152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d8b5a798-a569-4c04-8af0-b5bcb86f7371 req-be5b6a21-5013-423e-a1f5-19072f02d2b6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.439671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:44.452568 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-304a6808-b4bd-4488-a903-9283af9bec38 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1728 microversion: 2.1 time: 0.663364 Oct 27 10:23:44.457474 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1912/3641] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:43 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1728 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:44.459468 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-d8b5a798-a569-4c04-8af0-b5bcb86f7371 req-be5b6a21-5013-423e-a1f5-19072f02d2b6 service nova] Creating event network-vif-unplugged:7f21f4ad-6e4b-49a1-9ff7-b3a359019136 for instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 on n-h2-854663-10 Oct 27 10:23:44.463763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:44.464369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:44.471185 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-d8b5a798-a569-4c04-8af0-b5bcb86f7371 req-be5b6a21-5013-423e-a1f5-19072f02d2b6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081352 Oct 27 10:23:44.475389 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1730/3642] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:44.484757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8bdbcf1b-bd6a-43f3-89b3-75686540a5a8 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '.version_select at 0x7f6d637addc0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:44.487200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8bdbcf1b-bd6a-43f3-89b3-75686540a5a8 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:44.494374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bdbcf1b-bd6a-43f3-89b3-75686540a5a8 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.496070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bdbcf1b-bd6a-43f3-89b3-75686540a5a8 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.496933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bdbcf1b-bd6a-43f3-89b3-75686540a5a8 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.497838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bdbcf1b-bd6a-43f3-89b3-75686540a5a8 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.498441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bdbcf1b-bd6a-43f3-89b3-75686540a5a8 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.498588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.499037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.499398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bdbcf1b-bd6a-43f3-89b3-75686540a5a8 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.499529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.500142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.500588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.501058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.636079 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8bdbcf1b-bd6a-43f3-89b3-75686540a5a8 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.158937 Oct 27 10:23:44.637084 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1731/3643] 10.222.0.76 () {60 vars in 1337 bytes} [Thu Oct 27 10:23:44 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3/os-instance-actions => generated 611 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:23:44.651509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c2914110-4897-4600-877e-5b95a44db409 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:44.652073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c2914110-4897-4600-877e-5b95a44db409 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:44.659630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2914110-4897-4600-877e-5b95a44db409 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.660132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2914110-4897-4600-877e-5b95a44db409 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.660575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2914110-4897-4600-877e-5b95a44db409 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.661398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2914110-4897-4600-877e-5b95a44db409 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.661864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2914110-4897-4600-877e-5b95a44db409 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.662292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2914110-4897-4600-877e-5b95a44db409 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.838421 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c2914110-4897-4600-877e-5b95a44db409 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.190682 Oct 27 10:23:44.846532 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1732/3644] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:23:44 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:44.850586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:44.851198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:44.859959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.860444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.860913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.861605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.862049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.862461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.890484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:44.904126 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3218cfb-3f7c-47c2-9628-03a39e97d0ac tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1510 microversion: 2.1 time: 0.444206 Oct 27 10:23:44.905625 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1913/3645] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:44 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:44.921258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:44.921902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:44.932218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.932750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.933258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.934134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.934581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.934995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:45.743335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:45.761211 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1f8a536-15e6-4a31-9739-319e06f061f7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1523 microversion: 2.1 time: 0.920604 Oct 27 10:23:45.761908 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1733/3646] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:44 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1523 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:45.785548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:45.787333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:45.812835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:45.813744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:45.814432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:45.816999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:45.817844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:45.819323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:45.854017 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] HTTP exception thrown: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Request method failure captured: Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 HTTP/1.1 Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlwIXJRyOjsJIuJ7bVE7NFAw0roYZwX3CUZ6YgvNbO6qkdfsgNWHWIkRNvB5GTq3WCfYFCKBVZ39_bk1iLEQxNGbGxhx9bPsWoqJTdVBUJJEP-I9_JNj2ynTLpS5J4fmW-EPq3hiaJARhmlz6gVlFc1U6yXQdzR4PsaklhqIWTQcovA Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 133d557efa3a468b8b1dc7cb22d2da3c Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1358583439 Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/133d557efa3a468b8b1dc7cb22d2da3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/133d557efa3a468b8b1dc7cb22d2da3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_133d557efa3a468b8b1dc7cb22d2da3c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/133d557efa3a468b8b1dc7cb22d2da3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-InstanceActionsV221TestJSON-1358583439 Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 133d557efa3a468b8b1dc7cb22d2da3c Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1358583439 Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-InstanceActionsV221TestJSON-1358583439-project Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 32f75c99fc894705bf4d74b26583fc51 Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-InstanceActionsV221TestJSON-1358583439-project Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd9a75dcf-70b8-44d6-9cae-ce48c093efc3'} Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:23:45.856383 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:45.862688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Returning 404 to user: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:23:45.863788 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bce272a7-95d9-42a5-99a1-58d7273bc130 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 404 len: 111 microversion: 2.21 time: 0.096744 Oct 27 10:23:45.869459 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1734/3647] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:23:45 2022] DELETE /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:23:45.877825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:45.883065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:45.895186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:45.897094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:45.903389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:45.904833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:45.905476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:45.906073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:45.934998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:45.950362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:45.961609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:45.969145 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5be77a5-f185-4b03-9ce2-1bd5e85859bc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 1.063346 Oct 27 10:23:45.970200 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1914/3648] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:44 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:45.989163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:45.990224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:45.999633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:46.008591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:46.009430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:46.010386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:46.012357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:46.013060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:46.097805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:46.115074 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-628beb69-42ac-4c62-904b-921ea41c450c tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1266 microversion: 2.1 time: 0.242976 Oct 27 10:23:46.116313 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1735/3649] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:45 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:46.234666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-66288d9c-1e04-4319-8864-d0a0be13ba61 req-9a8059fe-cefd-487a-b6e6-938babab211b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7785104-5e6b-4ac3-a20c-d18267bc7b18", "tag": "664d4030-9e2e-4805-b62f-4e36a469f877"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:46.250214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-66288d9c-1e04-4319-8864-d0a0be13ba61 req-9a8059fe-cefd-487a-b6e6-938babab211b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:46.256897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-66288d9c-1e04-4319-8864-d0a0be13ba61 req-9a8059fe-cefd-487a-b6e6-938babab211b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:46.257603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-66288d9c-1e04-4319-8864-d0a0be13ba61 req-9a8059fe-cefd-487a-b6e6-938babab211b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:46.282694 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-66288d9c-1e04-4319-8864-d0a0be13ba61 req-9a8059fe-cefd-487a-b6e6-938babab211b service nova] Creating event network-changed:664d4030-9e2e-4805-b62f-4e36a469f877 for instance d7785104-5e6b-4ac3-a20c-d18267bc7b18 on n-h2-854663-10 Oct 27 10:23:46.295413 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-66288d9c-1e04-4319-8864-d0a0be13ba61 req-9a8059fe-cefd-487a-b6e6-938babab211b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177367 Oct 27 10:23:46.296331 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1736/3650] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:46.307627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:46.311206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] [instance: d9a75dcf-70b8-44d6-9cae-ce48c093efc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:46.328069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:46.333483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:46.334240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:46.335399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:46.336190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:46.336827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:46.377200 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] HTTP exception thrown: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Request method failure captured: Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 HTTP/1.1 Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlwIXJRyOjsJIuJ7bVE7NFAw0roYZwX3CUZ6YgvNbO6qkdfsgNWHWIkRNvB5GTq3WCfYFCKBVZ39_bk1iLEQxNGbGxhx9bPsWoqJTdVBUJJEP-I9_JNj2ynTLpS5J4fmW-EPq3hiaJARhmlz6gVlFc1U6yXQdzR4PsaklhqIWTQcovA Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 133d557efa3a468b8b1dc7cb22d2da3c Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1358583439 Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/133d557efa3a468b8b1dc7cb22d2da3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/133d557efa3a468b8b1dc7cb22d2da3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_133d557efa3a468b8b1dc7cb22d2da3c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/133d557efa3a468b8b1dc7cb22d2da3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-InstanceActionsV221TestJSON-1358583439 Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 133d557efa3a468b8b1dc7cb22d2da3c Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1358583439 Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-InstanceActionsV221TestJSON-1358583439-project Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 32f75c99fc894705bf4d74b26583fc51 Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-InstanceActionsV221TestJSON-1358583439-project Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd9a75dcf-70b8-44d6-9cae-ce48c093efc3'} Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:46.379200 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:46.384101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:46.384101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:46.384101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:46.384101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:46.384101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:23:46.384101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:23:46.384101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. Oct 27 10:23:46.384101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:23:46.385446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] Returning 404 to user: Instance d9a75dcf-70b8-44d6-9cae-ce48c093efc3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:23:46.387391 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-956f7285-dd9d-4033-b31c-05c408720a20 tempest-InstanceActionsV221TestJSON-1358583439 tempest-InstanceActionsV221TestJSON-1358583439-project] 10.222.0.76 "GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3" status: 404 len: 111 microversion: 2.21 time: 0.089064 Oct 27 10:23:46.392611 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1737/3651] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:46 2022] GET /compute/v2.1/servers/d9a75dcf-70b8-44d6-9cae-ce48c093efc3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:23:46.418503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:46.419123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:46.437940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:46.438434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:46.438875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:46.439588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:46.440041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:46.440466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:46.982439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:47.000772 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a461208-fdec-4b1b-b561-6afcf2735d90 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1320 microversion: 2.1 time: 1.024416 Oct 27 10:23:47.001837 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1915/3652] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:45 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1320 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:47.028983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-036722f1-b60e-4fd2-abe3-59ea3a3410d7 req-0a2e2416-5555-47ad-a1c2-6f55535f446f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b136e0-a7fa-416c-a6b9-ffed49a93bcb", "tag": "10113174-f031-4c56-b839-04635ae67218"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:47.066846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-036722f1-b60e-4fd2-abe3-59ea3a3410d7 req-0a2e2416-5555-47ad-a1c2-6f55535f446f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:47.073916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:47.076642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-036722f1-b60e-4fd2-abe3-59ea3a3410d7 req-0a2e2416-5555-47ad-a1c2-6f55535f446f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:47.083525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-036722f1-b60e-4fd2-abe3-59ea3a3410d7 req-0a2e2416-5555-47ad-a1c2-6f55535f446f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:47.124708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-036722f1-b60e-4fd2-abe3-59ea3a3410d7 req-0a2e2416-5555-47ad-a1c2-6f55535f446f service nova] Creating event network-changed:10113174-f031-4c56-b839-04635ae67218 for instance 29b136e0-a7fa-416c-a6b9-ffed49a93bcb on n-h1-854663-10 Oct 27 10:23:47.137185 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-036722f1-b60e-4fd2-abe3-59ea3a3410d7 req-0a2e2416-5555-47ad-a1c2-6f55535f446f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123271 Oct 27 10:23:47.138307 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1916/3653] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:47.147813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3e2f5dea-22d3-4078-87c7-773d293f20cc req-110415b7-a59b-40a6-ab24-a69cfb5db6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "name": "network-vif-unplugged", "status": "completed", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:47.186203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3e2f5dea-22d3-4078-87c7-773d293f20cc req-110415b7-a59b-40a6-ab24-a69cfb5db6e8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:47.188121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3e2f5dea-22d3-4078-87c7-773d293f20cc req-110415b7-a59b-40a6-ab24-a69cfb5db6e8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:47.191214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3e2f5dea-22d3-4078-87c7-773d293f20cc req-110415b7-a59b-40a6-ab24-a69cfb5db6e8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:47.218144 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3e2f5dea-22d3-4078-87c7-773d293f20cc req-110415b7-a59b-40a6-ab24-a69cfb5db6e8 service nova] Creating event network-vif-unplugged:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:23:47.231139 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3e2f5dea-22d3-4078-87c7-773d293f20cc req-110415b7-a59b-40a6-ab24-a69cfb5db6e8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091320 Oct 27 10:23:47.232409 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1917/3654] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:47.248358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:47.249628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:47.259954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:47.274682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:47.279446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:47.280318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:47.295018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:47.301268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:48.122889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:48.142274 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3836b53a-cec4-465f-b17f-134e2f9023eb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1510 microversion: 2.1 time: 1.748256 Oct 27 10:23:48.161264 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1738/3655] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:46 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1510 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:48.185740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:48.186577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:48.229084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:48.229970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:48.230898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:48.231890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:48.232542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:48.234827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:48.239201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:48.287240 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5cd685e2-29fc-4e04-b142-484ffdb7a559 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1523 microversion: 2.1 time: 1.051631 Oct 27 10:23:48.300301 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1918/3656] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:47 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1523 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:48.306783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:48.313658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:48.342136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:48.366571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:48.383192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:48.384360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:48.385477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:48.386235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:49.252684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:49.272132 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1fb3e2d0-a3f7-4c42-a430-d43565407edd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.969761 Oct 27 10:23:49.287965 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1919/3657] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:48 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:49.296109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:49.297066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:49.303965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:49.304750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:49.305361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:49.306260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:49.306869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:49.307440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:49.679155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:49.707983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:49.716716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:49.719957 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eca611ca-28d6-4858-aed1-0cb9c043acc6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 1.550228 Oct 27 10:23:49.720395 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1739/3658] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:48 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:49.745353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a42fc48c-c86b-437a-84a0-7c5b41716b8e req-9fbe8096-2a05-433f-9212-19cde1a78787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab62d458-94d6-4867-ab01-c5d090a4474b", "tag": "29d044bb-5eb5-4712-a0b6-8676435702fa"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:49.776941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a42fc48c-c86b-437a-84a0-7c5b41716b8e req-9fbe8096-2a05-433f-9212-19cde1a78787 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:49.777779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a42fc48c-c86b-437a-84a0-7c5b41716b8e req-9fbe8096-2a05-433f-9212-19cde1a78787 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:49.779757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a42fc48c-c86b-437a-84a0-7c5b41716b8e req-9fbe8096-2a05-433f-9212-19cde1a78787 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:49.827045 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a42fc48c-c86b-437a-84a0-7c5b41716b8e req-9fbe8096-2a05-433f-9212-19cde1a78787 service nova] Creating event network-changed:29d044bb-5eb5-4712-a0b6-8676435702fa for instance ab62d458-94d6-4867-ab01-c5d090a4474b on n-h2-854663-10 Oct 27 10:23:49.844162 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a42fc48c-c86b-437a-84a0-7c5b41716b8e req-9fbe8096-2a05-433f-9212-19cde1a78787 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117439 Oct 27 10:23:49.848424 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1740/3659] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:49.865138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:49.867291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:49.896741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:49.897242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:49.897743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:49.898429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:49.898875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:49.899301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:50.306720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:50.321384 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45d1bef0-4cf9-4268-a082-185f7a3343e3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1320 microversion: 2.1 time: 1.031810 Oct 27 10:23:50.321641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:50.322413 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1920/3660] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:49 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1320 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:50.337608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d530c694-fd4e-4de0-91f5-fc9f1b8cf396 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1510 microversion: 2.1 time: 0.480162 Oct 27 10:23:50.337608 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1741/3661] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:49 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:50.356944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-31f76390-6875-440c-8220-054700da7d95 req-0f61afd5-ad7f-46fc-b7bc-d8ef08ebd88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "name": "network-vif-plugged", "status": "completed", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:50.359391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:50.360021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:50.374693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-31f76390-6875-440c-8220-054700da7d95 req-0f61afd5-ad7f-46fc-b7bc-d8ef08ebd88e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:50.375444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-31f76390-6875-440c-8220-054700da7d95 req-0f61afd5-ad7f-46fc-b7bc-d8ef08ebd88e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:50.376060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-31f76390-6875-440c-8220-054700da7d95 req-0f61afd5-ad7f-46fc-b7bc-d8ef08ebd88e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:50.376687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:50.380103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:50.380694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:50.381449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:50.382833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:50.383359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:50.419796 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-31f76390-6875-440c-8220-054700da7d95 req-0f61afd5-ad7f-46fc-b7bc-d8ef08ebd88e service nova] Creating event network-vif-plugged:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:23:50.430748 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-31f76390-6875-440c-8220-054700da7d95 req-0f61afd5-ad7f-46fc-b7bc-d8ef08ebd88e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090682 Oct 27 10:23:50.433854 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1921/3662] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:50.546201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:50.547160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:50.559199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:50.559998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:50.560605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:50.571547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:50.572303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:50.572935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:50.629694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:51.451911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:51.465333 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1a05dbcb-c7ca-425e-94b5-66020f74540d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1523 microversion: 2.1 time: 1.111213 Oct 27 10:23:51.469139 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1742/3663] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:50 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1523 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:51.485033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:51.486226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:51.496780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:51.497560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:51.499784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:51.500754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:51.505298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:51.506621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:51.561977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:51.715701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:51.775792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:52.180398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:52.199173 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4dfda30b-880a-4032-9176-364fc1a2d4be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 1.760405 Oct 27 10:23:52.200104 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1922/3664] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:50 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:52.205331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:52.214656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:52.233315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:52.234009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:52.235318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:52.242188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:52.242856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:52.243485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:52.403902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:52.424401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:52.426842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:52.430764 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f93d903-1245-41a6-8df2-f685f28844ad tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.960312 Oct 27 10:23:52.440634 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1743/3665] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:51 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:52.458429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:52.459234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:52.477056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:52.477912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:52.478804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:52.479658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:52.484372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:52.484990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:52.495925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:52.504432 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad1dd58b-6b31-4d00-81a4-f81cf73fbdb8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1320 microversion: 2.1 time: 0.302871 Oct 27 10:23:52.525192 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1923/3666] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:52 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:52.537350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-fa1265d1-533d-4835-a9be-f68083eec5d0 req-ec08fef1-5861-4032-a427-2c607a7f05b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54c5675-6a87-4213-a858-dd71fc93e9c7", "tag": "71360be2-953d-4a1c-9c77-3a1b49634b01"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:52.559491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa1265d1-533d-4835-a9be-f68083eec5d0 req-ec08fef1-5861-4032-a427-2c607a7f05b8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:52.564708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa1265d1-533d-4835-a9be-f68083eec5d0 req-ec08fef1-5861-4032-a427-2c607a7f05b8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:52.565445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa1265d1-533d-4835-a9be-f68083eec5d0 req-ec08fef1-5861-4032-a427-2c607a7f05b8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:52.588603 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-fa1265d1-533d-4835-a9be-f68083eec5d0 req-ec08fef1-5861-4032-a427-2c607a7f05b8 service nova] Creating event network-changed:71360be2-953d-4a1c-9c77-3a1b49634b01 for instance b54c5675-6a87-4213-a858-dd71fc93e9c7 on n-h2-854663-10 Oct 27 10:23:52.604693 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-fa1265d1-533d-4835-a9be-f68083eec5d0 req-ec08fef1-5861-4032-a427-2c607a7f05b8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077699 Oct 27 10:23:52.611360 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1924/3667] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:52.629089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:52.630145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:52.637349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:52.638147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:52.638802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:52.642358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:52.643178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:52.643947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:53.099579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:53.110610 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bb8bdc89-ac8a-4e07-8408-fa8a49f57ca7 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1510 microversion: 2.1 time: 0.666159 Oct 27 10:23:53.115195 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1744/3668] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:52 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1510 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:53.236819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:53.237447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:53.244681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:53.245179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:53.245602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:53.246605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:53.247017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:53.247470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:53.286209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:53.333954 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-589ecddf-d725-4b60-be03-12c13c67b5ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1523 microversion: 2.1 time: 0.720760 Oct 27 10:23:53.372452 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1925/3669] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:52 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1523 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:53.486447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:53.487348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:53.495380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:53.496370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:53.497169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:53.498458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:53.499139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:53.500305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:54.674823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:54.692906 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f56cf9e4-39a7-4592-80b5-b1f685862c79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 1.461635 Oct 27 10:23:54.696619 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1745/3670] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:53 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:54.710666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:54.713508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:54.736406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:54.737233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:54.738701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:54.742383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:54.744051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:54.744674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:55.272371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:55.287268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:55.305827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:55.308222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:55.310157 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d71520b9-d969-4ba5-99de-74ec79de2e47 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1320 microversion: 2.1 time: 0.607240 Oct 27 10:23:55.325227 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1746/3671] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:54 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:55.332112 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a04efe6-ec3e-4498-9f88-8229ad5e245b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 1.849751 Oct 27 10:23:55.335550 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1926/3672] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:53 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:23:55.345440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:55.346263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:55.350224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:55.355579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:55.376446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:55.381292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:55.383000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:55.383653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:55.390577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:55.391522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:55.392377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:55.393330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:55.394443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:55.396009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:55.397375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:55.398843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.116165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:56.124717 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6dbf7d7e-2ed2-429c-b400-915f6b31b917 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1523 microversion: 2.1 time: 0.786344 Oct 27 10:23:56.137462 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1927/3673] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:55 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1523 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:56.166357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-080424df-f75a-456c-9506-9a9443a964b9 req-468e539b-d06d-47d4-b2d9-ed60e218b1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54c5675-6a87-4213-a858-dd71fc93e9c7", "tag": "71360be2-953d-4a1c-9c77-3a1b49634b01"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:56.183711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-080424df-f75a-456c-9506-9a9443a964b9 req-468e539b-d06d-47d4-b2d9-ed60e218b1d2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.184199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-080424df-f75a-456c-9506-9a9443a964b9 req-468e539b-d06d-47d4-b2d9-ed60e218b1d2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.184631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-080424df-f75a-456c-9506-9a9443a964b9 req-468e539b-d06d-47d4-b2d9-ed60e218b1d2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.197741 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-080424df-f75a-456c-9506-9a9443a964b9 req-468e539b-d06d-47d4-b2d9-ed60e218b1d2 service nova] Creating event network-changed:71360be2-953d-4a1c-9c77-3a1b49634b01 for instance b54c5675-6a87-4213-a858-dd71fc93e9c7 on n-h2-854663-10 Oct 27 10:23:56.204070 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-080424df-f75a-456c-9506-9a9443a964b9 req-468e539b-d06d-47d4-b2d9-ed60e218b1d2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050390 Oct 27 10:23:56.205349 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1928/3674] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:56.213477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-bf6db7ed-2cb2-46ca-84f9-913e917f2c96 req-d488b9a5-83d6-47bc-9a10-e89f350d6479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7785104-5e6b-4ac3-a20c-d18267bc7b18", "name": "network-vif-plugged", "status": "completed", "tag": "664d4030-9e2e-4805-b62f-4e36a469f877"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:56.226916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bf6db7ed-2cb2-46ca-84f9-913e917f2c96 req-d488b9a5-83d6-47bc-9a10-e89f350d6479 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.227680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bf6db7ed-2cb2-46ca-84f9-913e917f2c96 req-d488b9a5-83d6-47bc-9a10-e89f350d6479 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.228291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bf6db7ed-2cb2-46ca-84f9-913e917f2c96 req-d488b9a5-83d6-47bc-9a10-e89f350d6479 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.247744 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-bf6db7ed-2cb2-46ca-84f9-913e917f2c96 req-d488b9a5-83d6-47bc-9a10-e89f350d6479 service nova] Creating event network-vif-plugged:664d4030-9e2e-4805-b62f-4e36a469f877 for instance d7785104-5e6b-4ac3-a20c-d18267bc7b18 on n-h2-854663-10 Oct 27 10:23:56.253929 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-bf6db7ed-2cb2-46ca-84f9-913e917f2c96 req-d488b9a5-83d6-47bc-9a10-e89f350d6479 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047027 Oct 27 10:23:56.255813 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1929/3675] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:56.263349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:56.265471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:56.274835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.276226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.277096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.278005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.278816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.279442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.291368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:56.315200 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35f8ee4e-d508-4f08-9f90-9b40df923dec tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1510 microversion: 2.1 time: 0.988429 Oct 27 10:23:56.326075 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1747/3676] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:55 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1510 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:56.340779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:56.341765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:56.349073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.349819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.350419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.351293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.351909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.352479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.723499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:56.726353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:56.736588 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a9deeff5-f32e-4aa6-9158-e3688dce8657 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1320 microversion: 2.1 time: 0.400538 Oct 27 10:23:56.737586 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7968648d-8a40-46c9-bd8b-357241794cbd tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.480225 Oct 27 10:23:56.749164 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1930/3677] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:56 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:56.752549 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1748/3678] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:56 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:56.759126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:56.759744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:56.766784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.767532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.768159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.769079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.769692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.770277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:57.163547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:57.165410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:57.177117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:57.177924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:57.183480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:57.184772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:57.187648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:57.188424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:57.272422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:57.287420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:57.290679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:57.296650 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3dcc5942-1fad-4386-8115-adb5f7a4e890 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.545888 Oct 27 10:23:57.297644 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1931/3679] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:56 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:23:57.342501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:57.344208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:57.361412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:57.362214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:57.364559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:57.365678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:57.367004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:57.367619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:57.595293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:57.619217 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-781e393a-e18c-42e0-b5aa-d7104b856c51 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1505 microversion: 2.1 time: 0.457304 Oct 27 10:23:57.625048 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1749/3680] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:57 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:57.734009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:57.746352 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82182c37-dd57-481d-9432-978154b5e08d tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1510 microversion: 2.1 time: 0.407442 Oct 27 10:23:57.761695 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1932/3681] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:57 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:57.769158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:57.770109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:57.774187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:57.775222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:57.782325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:57.783218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:57.783893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:57.784022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:57.784447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:57.785525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:57.785918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:57.786183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:57.786662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:57.786909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:57.787133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:57.787566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:58.082971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:58.093841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:58.102561 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef066120-4eac-4f4f-a5f3-1987ef323518 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1320 microversion: 2.1 time: 0.339472 Oct 27 10:23:58.106907 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1750/3682] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:57 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1320 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:58.109265 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-adfd06b0-5581-46ee-971c-3a6a3f83e6b6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.338953 Oct 27 10:23:58.120685 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1933/3683] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:57 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:58.271647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-fcf6db5e-36c3-4802-9998-a5a87a3e2779 req-602155aa-0dc5-44ad-9ffa-02571a3a6dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b136e0-a7fa-416c-a6b9-ffed49a93bcb", "name": "network-vif-plugged", "status": "completed", "tag": "10113174-f031-4c56-b839-04635ae67218"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:58.278357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:58.295287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fcf6db5e-36c3-4802-9998-a5a87a3e2779 req-602155aa-0dc5-44ad-9ffa-02571a3a6dd4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:58.300861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fcf6db5e-36c3-4802-9998-a5a87a3e2779 req-602155aa-0dc5-44ad-9ffa-02571a3a6dd4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:58.302299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fcf6db5e-36c3-4802-9998-a5a87a3e2779 req-602155aa-0dc5-44ad-9ffa-02571a3a6dd4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:58.325976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:58.327319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:58.336083 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-fcf6db5e-36c3-4802-9998-a5a87a3e2779 req-602155aa-0dc5-44ad-9ffa-02571a3a6dd4 service nova] Creating event network-vif-plugged:10113174-f031-4c56-b839-04635ae67218 for instance 29b136e0-a7fa-416c-a6b9-ffed49a93bcb on n-h1-854663-10 Oct 27 10:23:58.338152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:58.340140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:58.342203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:58.343174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:58.344250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:58.347028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:58.350064 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-fcf6db5e-36c3-4802-9998-a5a87a3e2779 req-602155aa-0dc5-44ad-9ffa-02571a3a6dd4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082064 Oct 27 10:23:58.352828 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1751/3684] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:58.655211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:58.656034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:58.662888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:58.663785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:58.664467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:58.665462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:58.666143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:58.666774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:58.684837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:58.696910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:58.698642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:58.700242 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d0854a97-9c4b-4884-9cf0-56828d9e5b4d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.378606 Oct 27 10:23:58.700837 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1934/3685] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:58 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:23:58.776968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:58.777619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:58.784497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:58.785248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:58.785685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:58.786391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:58.786993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:58.787420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:58.878211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:58.889888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-844c69c8-1131-462d-a5d3-bca23126963e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1505 microversion: 2.1 time: 0.239000 Oct 27 10:23:58.890786 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1752/3686] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:58 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:58.958671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:58.981520 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b60ab03-5b11-424a-9970-528c053415cd tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1487 microversion: 2.1 time: 0.195505 Oct 27 10:23:58.981520 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1935/3687] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:58 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1487 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:59.005559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9175cc25-1061-4422-a7fc-b3050a31372f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-555940417"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:59.008795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9175cc25-1061-4422-a7fc-b3050a31372f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:59.016814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9175cc25-1061-4422-a7fc-b3050a31372f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.017945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9175cc25-1061-4422-a7fc-b3050a31372f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.018666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9175cc25-1061-4422-a7fc-b3050a31372f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.019986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9175cc25-1061-4422-a7fc-b3050a31372f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.021472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9175cc25-1061-4422-a7fc-b3050a31372f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.022175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9175cc25-1061-4422-a7fc-b3050a31372f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.119836 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9175cc25-1061-4422-a7fc-b3050a31372f tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "PUT /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1059 microversion: 2.1 time: 0.117376 Oct 27 10:23:59.123230 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1753/3688] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 10:23:58 2022] PUT /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1059 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:59.130468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:59.131166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:59.142621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.143113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.145145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:59.145972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:59.146655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.147802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.150506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.151141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.176025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.187375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.188134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.191641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.192299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.192967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.460297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:59.463957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:59.473521 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f63642b-3493-4a49-ae59-19cfc7ba486a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.339237 Oct 27 10:23:59.473710 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5090e25d-f898-4b57-9ec6-4d0ac484e336 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1320 microversion: 2.1 time: 0.347572 Oct 27 10:23:59.474114 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1754/3689] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:59 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:59.488526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:59.489147 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1936/3690] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:59 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1320 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:59.489296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:59.513424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.514372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.515080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.518882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.519771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.520462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.725152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:59.727709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:59.728328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:59.735398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.735900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.736359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.737099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.737550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.737973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.739868 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f2c5501f-5fee-4b1e-af5f-0f752f27bafb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1486 microversion: 2.1 time: 0.263270 Oct 27 10:23:59.743813 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1755/3691] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:59 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1486 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:59.769523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:59.770203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:59.787662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.792285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.796353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.797263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.797839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.798409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.138219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:00.150064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:00.155300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:00.159040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:00.159991 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-033cfe23-787c-4a8d-98cf-046865854beb tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1486 microversion: 2.1 time: 0.396036 Oct 27 10:24:00.161060 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1756/3692] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:59 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1486 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:00.166098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:00.166950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:00.174094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.175290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.175290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.176157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.176829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.177353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.189996 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f35cbd08-5e92-42d3-82a4-47e07a82dd0d tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.466280 Oct 27 10:24:00.205113 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1937/3693] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:23:59 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:24:00.205726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:00.205833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:00.225090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.226880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.228114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.229979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.231946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.232383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.301767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:00.475207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:00.489504 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c8ff576d-4d80-4b28-b2a9-6554c10278a9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1505 microversion: 2.1 time: 0.327194 Oct 27 10:24:00.491071 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1757/3694] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:00 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:00.509418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0d8ab3a0-48d6-4a38-a19a-b57b59c65f3f req-8fb2c6c2-f7f6-452b-b73e-df09d28fd95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6046b640-0df2-4ff7-9a74-88ddb8572b5a", "name": "network-vif-unplugged", "status": "completed", "tag": "2d2e70b5-9907-48f8-9309-a8acf57a6271"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:00.533852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0d8ab3a0-48d6-4a38-a19a-b57b59c65f3f req-8fb2c6c2-f7f6-452b-b73e-df09d28fd95c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.534098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0d8ab3a0-48d6-4a38-a19a-b57b59c65f3f req-8fb2c6c2-f7f6-452b-b73e-df09d28fd95c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.534535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0d8ab3a0-48d6-4a38-a19a-b57b59c65f3f req-8fb2c6c2-f7f6-452b-b73e-df09d28fd95c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.549807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:00.568177 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0d8ab3a0-48d6-4a38-a19a-b57b59c65f3f req-8fb2c6c2-f7f6-452b-b73e-df09d28fd95c service nova] Creating event network-vif-unplugged:2d2e70b5-9907-48f8-9309-a8acf57a6271 for instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a on n-h1-854663-10 Oct 27 10:24:00.575396 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c81803b-5f51-42a7-bafe-f90f357b3e0e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 204 len: 0 microversion: 2.1 time: 0.378239 Oct 27 10:24:00.581368 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1938/3695] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:00 2022] DELETE /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:00.588609 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0d8ab3a0-48d6-4a38-a19a-b57b59c65f3f req-8fb2c6c2-f7f6-452b-b73e-df09d28fd95c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096238 Oct 27 10:24:00.589220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:00.590616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:00.593165 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1758/3696] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:00.599293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:00.600255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:00.607448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.607947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.608828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.609564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.610006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.610432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.615455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:00.624349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.627146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.627811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.634323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.635051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.635673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.998298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:01.009537 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb260203-2a03-4694-853a-693110498009 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.429793 Oct 27 10:24:01.021445 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1939/3697] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:00 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:01.021445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:01.026117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:01.037272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:01.037771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:01.038213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:01.038926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:01.039548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:01.039825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:01.116879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:01.128532 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c90dd5c9-849b-4f3a-a2c2-f444dd76c956 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1320 microversion: 2.1 time: 0.531582 Oct 27 10:24:01.129265 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1759/3698] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:00 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1320 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:01.227638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:01.229387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:01.249951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:01.250441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:01.250905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:01.251090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:01.256904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:01.257565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:01.258143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:01.259936 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8224de2d-b2da-480d-ad4d-8dc9053f8750 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1492 microversion: 2.1 time: 0.245210 Oct 27 10:24:01.261237 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1940/3699] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:01 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1492 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:01.514611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:01.521571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:01.523926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:01.524928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:01.534406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:01.535323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:01.536212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:01.537337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:01.538069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:01.538438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:01.538804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:01.539928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:01.546741 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a12485e5-ca1d-4151-849d-e93b79745bca tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.326611 Oct 27 10:24:01.551052 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1760/3700] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:01 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:01.805124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:01.821579 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2da833f8-b360-4f08-94bb-c46bed926399 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1505 microversion: 2.1 time: 0.299268 Oct 27 10:24:01.825345 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1941/3701] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:01 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:02.041818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:02.043656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:02.067184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:02.069609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:02.071563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:02.072520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:02.084684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:02.088450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:02.153578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:02.154524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:02.182025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:02.182926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:02.187754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:02.188824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:02.190035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:02.190722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:02.591680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:02.604399 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ef3949f-ce73-40eb-a2cf-0cf19eb0ac76 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 200 len: 1508 microversion: 2.1 time: 0.452498 Oct 27 10:24:02.608437 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1942/3702] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:02 2022] GET /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 1508 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:02.621118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:02.634686 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35759adc-d879-4794-bb09-4ee1013c215e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.603595 Oct 27 10:24:02.649028 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1761/3703] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:02 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:02.654703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:02.654916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:02.654916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:02.662547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:02.663317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:02.664757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:02.665216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:02.669887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:02.671105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:02.673041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:02.675691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:02.679046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:02.679757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:02.680733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:02.682096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:02.682762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:03.263468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:03.274115 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d497795-24a7-411e-bbef-cb5494469927 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1492 microversion: 2.1 time: 0.650745 Oct 27 10:24:03.289926 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1943/3704] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:02 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1492 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:03.305008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:03.318242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:03.318864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 29b136e0-a7fa-416c-a6b9-ffed49a93bcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:03.339991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:03.348542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:03.354290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:03.355399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:03.358145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:03.358659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:03.360984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:03.379326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:03.382227 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e4af99c-6257-43bc-93d3-b6b49c7502a9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.731031 Oct 27 10:24:03.384762 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1762/3705] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:02 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:03.400273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:03.414381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:03.440289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:03.442246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:03.444082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:03.445423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:03.447358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:03.450123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:03.837075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:03.868637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9512d286-94d7-4cfd-bf04-79adca12f565 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/29b136e0-a7fa-416c-a6b9-ffed49a93bcb" status: 200 len: 1320 microversion: 2.1 time: 0.576997 Oct 27 10:24:03.889321 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1944/3706] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:03 2022] GET /compute/v2.1/servers/29b136e0-a7fa-416c-a6b9-ffed49a93bcb => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:03.907091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:03.911314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:03.927372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:03.929094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:03.929709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:03.930649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:03.931308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:03.933762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:03.977526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:03.986198 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5030b6b2-dd1c-4428-be2b-0e22e7cd3431 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 200 len: 1508 microversion: 2.1 time: 0.598104 Oct 27 10:24:03.986809 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1763/3707] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:03 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 1508 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:04.035625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5e779a63-9dde-4835-bebe-72428bc956ff req-3ec50929-d854-4e91-bb61-5a2887b7542e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1851c26-861c-4d76-9d98-0d9528ec46b0", "name": "network-vif-deleted", "tag": "9ef9d678-5579-44ed-acbe-aed80724c619"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:04.069135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5e779a63-9dde-4835-bebe-72428bc956ff req-3ec50929-d854-4e91-bb61-5a2887b7542e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:04.069732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5e779a63-9dde-4835-bebe-72428bc956ff req-3ec50929-d854-4e91-bb61-5a2887b7542e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:04.070192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5e779a63-9dde-4835-bebe-72428bc956ff req-3ec50929-d854-4e91-bb61-5a2887b7542e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:04.113268 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5e779a63-9dde-4835-bebe-72428bc956ff req-3ec50929-d854-4e91-bb61-5a2887b7542e service nova] Creating event network-vif-deleted:9ef9d678-5579-44ed-acbe-aed80724c619 for instance a1851c26-861c-4d76-9d98-0d9528ec46b0 on n-h1-854663-10 Oct 27 10:24:04.119349 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5e779a63-9dde-4835-bebe-72428bc956ff req-3ec50929-d854-4e91-bb61-5a2887b7542e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096567 Oct 27 10:24:04.133176 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1764/3708] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:04.148032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:04.149968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:04.165252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:04.167350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:04.168238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:04.171397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:04.172086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:04.173370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:04.235292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:04.246101 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-84bcdf0a-03aa-40a3-b0d8-86dd49aa5c73 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.353508 Oct 27 10:24:04.247374 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1945/3709] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:03 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:04.249427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:04.265764 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.compute.api [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Working on deleting snapshot 2a2b29e7-daff-4074-88d4-b85e4796fca9 from shelved instance... Oct 27 10:24:04.316048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:04.317304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:04.338193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:04.339053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:04.341033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:04.341997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:04.342822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:04.343478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:04.415815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:04.416716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:04.419614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:04.421906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lazy-loading 'fault' on Instance uuid a1851c26-861c-4d76-9d98-0d9528ec46b0 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:24:04.520968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:04.536785 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5fc60933-1670-4f0b-a6a1-c5fc2e69c17b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 200 len: 1309 microversion: 2.1 time: 0.222648 Oct 27 10:24:04.538361 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1946/3710] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:04 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:04.546918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:04.554079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:04.569901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:04.572637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:04.574714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:04.579955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:04.580701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:04.581241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:05.189591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:05.200312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:05.201786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:05.202967 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-792f46b8-c755-4899-af46-5a6f2a226e31 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.663068 Oct 27 10:24:05.208276 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1947/3711] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:04 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:05.213821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:05.214598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 29b136e0-a7fa-416c-a6b9-ffed49a93bcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:05.231790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:05.232284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:05.233788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:05.238420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:05.238849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:05.239150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:05.470184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:05.481290 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44da49cd-e68d-40ef-b688-27aaf18df6e7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/29b136e0-a7fa-416c-a6b9-ffed49a93bcb" status: 200 len: 1507 microversion: 2.1 time: 0.271842 Oct 27 10:24:05.496706 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1948/3712] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:05 2022] GET /compute/v2.1/servers/29b136e0-a7fa-416c-a6b9-ffed49a93bcb => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:05.507276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:05.510702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:05.525010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:05.525533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:05.525966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:05.526678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:05.527173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:05.528090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:05.693420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Doing local delete in cell 9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) {{(pid=120719) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 27 10:24:05.694148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:05.694623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:05.695053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:05.695473 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.compute.api [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 27 10:24:05.706949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] deallocate_for_instance() {{(pid=120719) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 27 10:24:06.180048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:06.204839 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ebc24a55-3462-46b2-8dab-700771c81ac9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.714124 Oct 27 10:24:06.218437 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1949/3713] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:05 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:06.399672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1464701169", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "3c7a2d07-8f34-452c-ada3-3fe9bd2d5d15"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:06.488054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] validate_networks() for [('3c7a2d07-8f34-452c-ada3-3fe9bd2d5d15', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:24:07.138397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:24:07.142062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:24:07.142854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:24:07.143695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:24:07.144939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:24:07.164028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.165399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.166064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.167004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.167839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.168481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.228400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Updating instance_info_cache with network_info: [] {{(pid=120719) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:24:07.249996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Getting quotas for project d18b9a2f9c34475eb3ef1dd2cbeaa320. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:24:07.259186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Getting quotas for user 42cda02f04334e57aa66529ca56d9a75 and project d18b9a2f9c34475eb3ef1dd2cbeaa320. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:24:07.305571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:24:07.319450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:24:07.407654 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7450e22-aad9-4673-9fd0-edb37462c125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200352 Oct 27 10:24:07.418430 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1950/3714] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:24:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:24:07.439197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:07.481160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 29b136e0-a7fa-416c-a6b9-ffed49a93bcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:07.503254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.504494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.506284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.508704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.511135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.511737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.559812 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1720044-5a7d-4517-9f89-eff2e46f1f9d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 204 len: 0 microversion: 2.1 time: 3.425030 Oct 27 10:24:07.562056 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1765/3715] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:04 2022] DELETE /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 0 bytes in 3428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:07.565237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 29b136e0-a7fa-416c-a6b9-ffed49a93bcb] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:07.577083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:07.577772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:07.594351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.595590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.601623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.602388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.603005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.603446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.685296 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 HTTP/1.1 Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'a1851c26-861c-4d76-9d98-0d9528ec46b0'} Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:07.687066 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:07.692924 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:07.692924 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:07.692924 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:07.692924 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:07.692924 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:07.692924 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:07.692924 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:07.692924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:07.701742 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fbf9885e-1ea9-4755-a0df-bd23691ff0f8 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 404 len: 111 microversion: 2.1 time: 0.137870 Oct 27 10:24:07.708971 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1766/3716] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:07 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:07.717443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:07.728316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:07.750284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.751142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.751289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.751896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.752343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.752793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.770834 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03155f0f-1048-4f04-b492-4a00d222c1f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "DELETE /compute/v2.1/servers/29b136e0-a7fa-416c-a6b9-ffed49a93bcb" status: 204 len: 0 microversion: 2.1 time: 0.349649 Oct 27 10:24:07.771444 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1951/3717] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:07 2022] DELETE /compute/v2.1/servers/29b136e0-a7fa-416c-a6b9-ffed49a93bcb => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:07.779745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-be39b0bd-a662-4354-9e89-c2a12d608a7a req-ef32fecb-7789-494d-ae50-e8fe280291ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6046b640-0df2-4ff7-9a74-88ddb8572b5a", "name": "network-vif-deleted", "tag": "2d2e70b5-9907-48f8-9309-a8acf57a6271"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:07.789962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be39b0bd-a662-4354-9e89-c2a12d608a7a req-ef32fecb-7789-494d-ae50-e8fe280291ed service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.790469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be39b0bd-a662-4354-9e89-c2a12d608a7a req-ef32fecb-7789-494d-ae50-e8fe280291ed service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.790880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be39b0bd-a662-4354-9e89-c2a12d608a7a req-ef32fecb-7789-494d-ae50-e8fe280291ed service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.805601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_external_events [req-be39b0bd-a662-4354-9e89-c2a12d608a7a req-ef32fecb-7789-494d-ae50-e8fe280291ed service nova] Unable to find a host for instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a. Dropping event network-vif-deleted {{(pid=120720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 10:24:07.807769 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-be39b0bd-a662-4354-9e89-c2a12d608a7a req-ef32fecb-7789-494d-ae50-e8fe280291ed service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.035131 Oct 27 10:24:07.808897 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1952/3718] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 10:24:07.813997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:07.814678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:07.821972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.822459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.822889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:07.823592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:07.824368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:07.825151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.172100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:08.174648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:08.187748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:08.190310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:08.191689 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c3689c9-094c-4351-9e9a-57e37207c068 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.481521 Oct 27 10:24:08.192427 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1767/3719] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:07 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:08.202154 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74cf62d8-772f-42f6-8419-1b5d29b5cf08 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.391305 Oct 27 10:24:08.202776 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1953/3720] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:07 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:08.208755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-578535", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "3c7a2d07-8f34-452c-ada3-3fe9bd2d5d15"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:08.219977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:08.221829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:08.258048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:08.258453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:08.258898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.259599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:08.260050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:08.260465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.291156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] validate_networks() for [('3c7a2d07-8f34-452c-ada3-3fe9bd2d5d15', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:24:08.317518 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a HTTP/1.1 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '6046b640-0df2-4ff7-9a74-88ddb8572b5a'} Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:08.319234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.324480 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:08.324480 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:08.324480 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:08.324480 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:08.324480 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:08.324480 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:24:08.324480 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.324480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:08.324480 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8cd5e1b5-2cf0-4d9b-8fea-4c1db4831752 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 404 len: 111 microversion: 2.1 time: 0.112206 Oct 27 10:24:08.344635 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1954/3721] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:08 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:08.357457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:08.362080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:08.379900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:08.380834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:08.382309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.385118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:08.385806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:08.387129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.427598 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 HTTP/1.1 Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a1851c26-861c-4d76-9d98-0d9528ec46b0'} Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:08.430262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-453f466e-573b-459c-92b7-06413de5d734 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 404 len: 111 microversion: 2.1 time: 0.086889 Oct 27 10:24:08.444406 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1955/3722] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:08 2022] DELETE /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:08.450219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:08.450219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:08.457621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:08.458198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:08.458730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.460027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:08.461237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:08.461882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.520102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:08.560441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: d7785104-5e6b-4ac3-a20c-d18267bc7b18] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:08.722776 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e7de88f-d19d-4fd5-87bd-d8560ce8a947 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18" status: 204 len: 0 microversion: 2.1 time: 0.278290 Oct 27 10:24:08.723426 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1956/3723] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:08 2022] DELETE /compute/v2.1/servers/d7785104-5e6b-4ac3-a20c-d18267bc7b18 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:08.767205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-57ecce36-4d37-4523-838b-53f9ccd4fad2 req-68a44a74-5c44-4893-91d9-424f98e06848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab62d458-94d6-4867-ab01-c5d090a4474b", "name": "network-vif-plugged", "status": "completed", "tag": "29d044bb-5eb5-4712-a0b6-8676435702fa"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:08.792492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-57ecce36-4d37-4523-838b-53f9ccd4fad2 req-68a44a74-5c44-4893-91d9-424f98e06848 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:08.793360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-57ecce36-4d37-4523-838b-53f9ccd4fad2 req-68a44a74-5c44-4893-91d9-424f98e06848 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:08.794334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-57ecce36-4d37-4523-838b-53f9ccd4fad2 req-68a44a74-5c44-4893-91d9-424f98e06848 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.832332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-57ecce36-4d37-4523-838b-53f9ccd4fad2 req-68a44a74-5c44-4893-91d9-424f98e06848 service nova] Creating event network-vif-plugged:29d044bb-5eb5-4712-a0b6-8676435702fa for instance ab62d458-94d6-4867-ab01-c5d090a4474b on n-h2-854663-10 Oct 27 10:24:08.844218 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-57ecce36-4d37-4523-838b-53f9ccd4fad2 req-68a44a74-5c44-4893-91d9-424f98e06848 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113664 Oct 27 10:24:08.848390 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1957/3724] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:08.862927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:08.863649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: a1851c26-861c-4d76-9d98-0d9528ec46b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:08.881594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:08.883573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:08.886103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.887427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:08.887902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:08.888335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:08.927043 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 HTTP/1.1 Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a1851c26-861c-4d76-9d98-0d9528ec46b0'} Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:08.929304 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance a1851c26-861c-4d76-9d98-0d9528ec46b0 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a39085e1-ba8f-45dc-8de5-d941662e1ee5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0" status: 404 len: 111 microversion: 2.1 time: 0.081346 Oct 27 10:24:08.935681 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1958/3725] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:08 2022] GET /compute/v2.1/servers/a1851c26-861c-4d76-9d98-0d9528ec46b0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:08.945567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2043282367", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "aebae77c-7c09-4e55-b34c-9671e2410be6"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:09.063071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:24:09.063499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:24:09.063974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:24:09.064381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:24:09.065121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:24:09.077290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:09.077782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:09.078221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:09.078962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:09.079402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] validate_networks() for [('aebae77c-7c09-4e55-b34c-9671e2410be6', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:24:09.079549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:09.079829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:09.144467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Getting quotas for project d18b9a2f9c34475eb3ef1dd2cbeaa320. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:24:09.155872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Getting quotas for user 42cda02f04334e57aa66529ca56d9a75 and project d18b9a2f9c34475eb3ef1dd2cbeaa320. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:24:09.181836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:24:09.185121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:24:09.315553 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7e705fd-0c6d-47f2-a37f-f909e08a72a1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121837 Oct 27 10:24:09.316267 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1768/3726] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:24:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:24:09.335268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:09.341006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:09.358593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:09.359472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:09.361128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:09.363919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:09.364603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:09.366802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:09.404617 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 HTTP/1.1 Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e2555a6d-9794-4c5a-9213-e36b5a269641'} Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:09.406462 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:09.419211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:09.430483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:09.439105 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dfed9009-0f02-439e-80dc-45fdb1632fd3 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 404 len: 111 microversion: 2.1 time: 0.107639 Oct 27 10:24:09.443275 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1769/3727] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:09 2022] DELETE /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:09.466884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-367911664", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "37746d93-6e6b-4c6d-b361-01480812d0b9"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:09.580646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] validate_networks() for [('37746d93-6e6b-4c6d-b361-01480812d0b9', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:24:10.075230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:24:10.075789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:24:10.076242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:24:10.076693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:24:10.077107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:24:10.097092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:10.098061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:10.098723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:10.099741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:10.103791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:10.105128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:10.159602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:24:10.187351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for user 83da5c7956454b278e9f9d6641a01711 and project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:24:10.233828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:24:10.241744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:24:10.408360 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8834b404-2f33-4a44-b304-b6070cf39e57 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472471 Oct 27 10:24:10.419174 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1959/3728] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:24:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:24:10.442666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:10.443692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:10.463552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:10.468052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:10.468786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:10.472110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:10.477071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:10.491118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:11.643886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:11.660888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:11.669776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:11.672123 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24b024d0-12b0-437c-b63a-2a7dbafd187b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 1.251534 Oct 27 10:24:11.673335 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1960/3729] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:10 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:11.678760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:11.679690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:11.700446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:11.701408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:11.702090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:11.703100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:11.703783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:11.704430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:11.705419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:24:11.706490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:24:11.707159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:24:11.708544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:24:11.709652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:24:11.735667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:11.736549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:11.737021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:11.738174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:11.738654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:11.739054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:11.816508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Getting quotas for project b36d1d526c1349128590dc6fc4578fa8. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:24:11.840072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Getting quotas for user 53b1aeed31ae4f13a19bb57be589385e and project b36d1d526c1349128590dc6fc4578fa8. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:24:11.886891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Going to run 2 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:24:11.889227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 3841656a-1e90-4c6a-a779-9200eebbbcc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:24:12.001516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=3841656a-1e90-4c6a-a779-9200eebbbcc8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:24:12.035789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:12.045943 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff8fbf79-25ae-4632-b6ed-cae648ea885a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1308 microversion: 2.1 time: 0.371215 Oct 27 10:24:12.053777 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1961/3730] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:11 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:12.074572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:12.077080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: e2555a6d-9794-4c5a-9213-e36b5a269641] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:12.093567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.094492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.095214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.096153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.096925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.097691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.124254 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 HTTP/1.1 Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'e2555a6d-9794-4c5a-9213-e36b5a269641'} Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:12.128634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.133844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:12.133844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:12.133844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:12.133844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:12.133844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:12.133844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. Oct 27 10:24:12.133844 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.139114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance e2555a6d-9794-4c5a-9213-e36b5a269641 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:12.140692 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d931889b-9179-4c7e-a69f-9ff72cba8d83 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641" status: 404 len: 111 microversion: 2.1 time: 0.075358 Oct 27 10:24:12.141921 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1962/3731] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:12 2022] GET /compute/v2.1/servers/e2555a6d-9794-4c5a-9213-e36b5a269641 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:12.149121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-59998889", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "451", "networks": [{"uuid": "3c7a2d07-8f34-452c-ada3-3fe9bd2d5d15"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:12.178875 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-725b9070-b0d8-4249-9b62-a699341c62fe tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.733705 Oct 27 10:24:12.180303 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1770/3732] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:24:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 2736 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 10:24:12.188858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:12.190330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:12.219951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.221252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.225496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.226736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.233792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.234316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.286162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] validate_networks() for [('3c7a2d07-8f34-452c-ada3-3fe9bd2d5d15', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:24:12.459358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:12.472050 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5407f319-69b4-433e-9c22-6592f077be74 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1211 microversion: 2.1 time: 0.290110 Oct 27 10:24:12.473158 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1771/3733] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:12 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1211 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:12.482902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-799fa91d-b1c9-442b-9826-919472bde264 req-877dc355-bd18-44c8-b089-07cd7834f944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b136e0-a7fa-416c-a6b9-ffed49a93bcb", "name": "network-vif-deleted", "tag": "10113174-f031-4c56-b839-04635ae67218"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:12.510897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-799fa91d-b1c9-442b-9826-919472bde264 req-877dc355-bd18-44c8-b089-07cd7834f944 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.511451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-799fa91d-b1c9-442b-9826-919472bde264 req-877dc355-bd18-44c8-b089-07cd7834f944 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.511885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-799fa91d-b1c9-442b-9826-919472bde264 req-877dc355-bd18-44c8-b089-07cd7834f944 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.541362 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-799fa91d-b1c9-442b-9826-919472bde264 req-877dc355-bd18-44c8-b089-07cd7834f944 service nova] Creating event network-vif-deleted:10113174-f031-4c56-b839-04635ae67218 for instance 29b136e0-a7fa-416c-a6b9-ffed49a93bcb on n-h1-854663-10 Oct 27 10:24:12.549612 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-799fa91d-b1c9-442b-9826-919472bde264 req-877dc355-bd18-44c8-b089-07cd7834f944 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073485 Oct 27 10:24:12.554337 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1772/3734] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:12.560579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-583016a7-87bb-4b9a-95ef-5dc9de3cd72a req-3304b985-3b3e-4a42-8f9c-dc4d4e32f3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-plugged", "status": "completed", "tag": "8ff1e688-864c-4428-89c9-709f26bba641"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:12.577757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-583016a7-87bb-4b9a-95ef-5dc9de3cd72a req-3304b985-3b3e-4a42-8f9c-dc4d4e32f3ec service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.578403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-583016a7-87bb-4b9a-95ef-5dc9de3cd72a req-3304b985-3b3e-4a42-8f9c-dc4d4e32f3ec service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.578840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-583016a7-87bb-4b9a-95ef-5dc9de3cd72a req-3304b985-3b3e-4a42-8f9c-dc4d4e32f3ec service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.602819 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-583016a7-87bb-4b9a-95ef-5dc9de3cd72a req-3304b985-3b3e-4a42-8f9c-dc4d4e32f3ec service nova] Creating event network-vif-plugged:8ff1e688-864c-4428-89c9-709f26bba641 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:24:12.621262 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-583016a7-87bb-4b9a-95ef-5dc9de3cd72a req-3304b985-3b3e-4a42-8f9c-dc4d4e32f3ec service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064822 Oct 27 10:24:12.622110 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1773/3735] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:12.628351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:12.634253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:12.658078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.658586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.659103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.659847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.660292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.660743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.686363 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b HTTP/1.1 Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '96c36f35-e7e7-4be9-9d2a-a5c584b6487b'} Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:12.688071 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7a01945-b11c-494c-9244-9dc00a9d4c1a tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 404 len: 111 microversion: 2.1 time: 0.065485 Oct 27 10:24:12.692989 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1774/3736] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:12 2022] DELETE /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:12.699891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:12.715992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:12.717523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Searching by: {'deleted': False, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:12.746144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.746690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.747185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.747923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.748373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.748824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.776422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:24:12.825634 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-baf81cf6-c129-4c62-9099-deff2585c178 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.132902 Oct 27 10:24:12.826533 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1775/3737] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:24:12 2022] GET /compute/v2.1/servers => generated 1003 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:12.841270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:12.842432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 96c36f35-e7e7-4be9-9d2a-a5c584b6487b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:12.858587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.859419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.860094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.861738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.864984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.865789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.879543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:12.906204 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b HTTP/1.1 Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '96c36f35-e7e7-4be9-9d2a-a5c584b6487b'} Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:12.913207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.918703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:12.918703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:12.918703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:12.918703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:12.918703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:12.918703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. Oct 27 10:24:12.918703 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:12.920244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 96c36f35-e7e7-4be9-9d2a-a5c584b6487b could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:12.923950 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e7fcb30-5076-42b3-bbd0-dabbb43564b6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b" status: 404 len: 111 microversion: 2.1 time: 0.095360 Oct 27 10:24:12.925142 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1776/3738] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:12 2022] GET /compute/v2.1/servers/96c36f35-e7e7-4be9-9d2a-a5c584b6487b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:12.931742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:12.932650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:12.971781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.974426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.976724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:12.977748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:12.981283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:12.982301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:13.495433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:24:13.496083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:24:13.496557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:24:13.497015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:24:13.497484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:24:13.518027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:13.519906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:13.520708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:13.523022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:13.524388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:13.525747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:13.562460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:13.584381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Getting quotas for project d18b9a2f9c34475eb3ef1dd2cbeaa320. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:24:13.591405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:13.607764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Getting quotas for user 42cda02f04334e57aa66529ca56d9a75 and project d18b9a2f9c34475eb3ef1dd2cbeaa320. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:24:13.607990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:13.609859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:13.614159 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38fe11ca-8784-4bc2-bac0-819bf4a0d95c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.687712 Oct 27 10:24:13.616964 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1777/3739] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:12 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:13.622591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8764d45-cd32-4cd6-aef7-b287fee915f3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:13.626966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d8764d45-cd32-4cd6-aef7-b287fee915f3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:13.648758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:24:13.651354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:24:13.811775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8764d45-cd32-4cd6-aef7-b287fee915f3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:13.821505 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8764d45-cd32-4cd6-aef7-b287fee915f3 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1217 microversion: 2.1 time: 0.202919 Oct 27 10:24:13.834139 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1778/3740] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:13 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:13.842076 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddcc83f3-d630-4e61-bc96-f26379022967 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697659 Oct 27 10:24:13.845579 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1963/3741] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:24:13.855280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:13.856169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:13.862441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:13.869819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:13.889600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:13.890105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:13.890547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:13.891254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:13.891707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:13.892128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:13.896892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:13.897534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:13.900815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:13.901816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:13.905463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:13.906496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:14.005458 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a HTTP/1.1 Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd223963b-e688-4013-8a89-71b392277a1a'} Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:14.008650 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:14.019127 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef84125a-2a1d-4122-9711-8f7430484d00 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 404 len: 111 microversion: 2.1 time: 0.174651 Oct 27 10:24:14.022772 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1779/3742] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:13 2022] DELETE /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:14.040723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:14.045542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:14.068016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:14.076384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:14.079247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:14.079906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:14.085779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:14.086893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:14.089170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:14.418946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:14.429699 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc8778f0-512f-4fb6-a2ca-b6559217ddc0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1267 microversion: 2.1 time: 0.404351 Oct 27 10:24:14.456842 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1780/3743] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:14 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1267 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:14.476030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eab94658-4f7b-4df6-b6ed-119df9651fa2 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:14.477274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eab94658-4f7b-4df6-b6ed-119df9651fa2 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:14.567897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:14.579450 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da2d8077-b8a8-466d-9faa-c67955306368 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1487 microversion: 2.1 time: 0.729087 Oct 27 10:24:14.616020 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1964/3744] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:13 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1487 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:14.623944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:14.624580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: d223963b-e688-4013-8a89-71b392277a1a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:14.644543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:14.645071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:14.645509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:14.646260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:14.648913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:14.650221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:14.655425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eab94658-4f7b-4df6-b6ed-119df9651fa2 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:14.665440 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eab94658-4f7b-4df6-b6ed-119df9651fa2 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1219 microversion: 2.1 time: 0.207320 Oct 27 10:24:14.674939 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1781/3745] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:14 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1219 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:14.683003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:14.703684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:14.735468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:14.735973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:14.736415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:14.737171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:14.743596 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a HTTP/1.1 Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'd223963b-e688-4013-8a89-71b392277a1a'} Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:14.745425 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.758103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:14.758103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:14.758103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:14.758103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:14.758103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:14.758103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. Oct 27 10:24:14.758103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:14.758103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance d223963b-e688-4013-8a89-71b392277a1a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:14.761811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:14.761811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:14.762249 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e057f0b-0291-4727-9a36-0a0514cc9a84 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a" status: 404 len: 111 microversion: 2.1 time: 0.129884 Oct 27 10:24:14.762249 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1965/3746] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:14 2022] GET /compute/v2.1/servers/d223963b-e688-4013-8a89-71b392277a1a => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:14.762249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cd055920-f81a-4376-8edb-3e63e186e2ba req-d11c68e7-ac4c-46c9-ba1e-9fb7df3e5c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7785104-5e6b-4ac3-a20c-d18267bc7b18", "name": "network-vif-deleted", "tag": "664d4030-9e2e-4805-b62f-4e36a469f877"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:14.814354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cd055920-f81a-4376-8edb-3e63e186e2ba req-d11c68e7-ac4c-46c9-ba1e-9fb7df3e5c6d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:14.816776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cd055920-f81a-4376-8edb-3e63e186e2ba req-d11c68e7-ac4c-46c9-ba1e-9fb7df3e5c6d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:14.817611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cd055920-f81a-4376-8edb-3e63e186e2ba req-d11c68e7-ac4c-46c9-ba1e-9fb7df3e5c6d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:14.863556 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cd055920-f81a-4376-8edb-3e63e186e2ba req-d11c68e7-ac4c-46c9-ba1e-9fb7df3e5c6d service nova] Creating event network-vif-deleted:664d4030-9e2e-4805-b62f-4e36a469f877 for instance d7785104-5e6b-4ac3-a20c-d18267bc7b18 on n-h2-854663-10 Oct 27 10:24:14.865352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:14.879772 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cd055920-f81a-4376-8edb-3e63e186e2ba req-d11c68e7-ac4c-46c9-ba1e-9fb7df3e5c6d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126107 Oct 27 10:24:14.881233 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1966/3747] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:14.898656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:14.900921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:14.917121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:14.918783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:14.920063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:14.923306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:14.923926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:14.924393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.106992 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d17068bf-ec8b-4daa-9876-56f775a30f31 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 204 len: 0 microversion: 2.1 time: 0.430685 Oct 27 10:24:15.107609 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1782/3748] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:14 2022] DELETE /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:15.128640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-91426587-9b49-46d6-b1d1-2e1a1f0e8644 req-1a18ddda-19a9-4418-894e-a463b0556c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-plugged", "status": "completed", "tag": "83bb0a57-9239-4158-bc07-2fedf58045e6"}, {"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-plugged", "status": "completed", "tag": "2af433f7-16ef-4d73-be18-2d94fa8044b0"}, {"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-plugged", "status": "completed", "tag": "ea6b7f3d-eab2-4913-848a-baf2f2b76986"}, {"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-plugged", "status": "completed", "tag": "ddc37743-d9c0-4cc7-9a0d-2fc905d04b07"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:15.168511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-91426587-9b49-46d6-b1d1-2e1a1f0e8644 req-1a18ddda-19a9-4418-894e-a463b0556c36 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.169227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-91426587-9b49-46d6-b1d1-2e1a1f0e8644 req-1a18ddda-19a9-4418-894e-a463b0556c36 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.169839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-91426587-9b49-46d6-b1d1-2e1a1f0e8644 req-1a18ddda-19a9-4418-894e-a463b0556c36 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.198213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-91426587-9b49-46d6-b1d1-2e1a1f0e8644 req-1a18ddda-19a9-4418-894e-a463b0556c36 service nova] Creating event network-vif-plugged:83bb0a57-9239-4158-bc07-2fedf58045e6 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:24:15.198825 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-91426587-9b49-46d6-b1d1-2e1a1f0e8644 req-1a18ddda-19a9-4418-894e-a463b0556c36 service nova] Creating event network-vif-plugged:2af433f7-16ef-4d73-be18-2d94fa8044b0 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:24:15.200153 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-91426587-9b49-46d6-b1d1-2e1a1f0e8644 req-1a18ddda-19a9-4418-894e-a463b0556c36 service nova] Creating event network-vif-plugged:ea6b7f3d-eab2-4913-848a-baf2f2b76986 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:24:15.202904 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-91426587-9b49-46d6-b1d1-2e1a1f0e8644 req-1a18ddda-19a9-4418-894e-a463b0556c36 service nova] Creating event network-vif-plugged:ddc37743-d9c0-4cc7-9a0d-2fc905d04b07 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:24:15.225620 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-91426587-9b49-46d6-b1d1-2e1a1f0e8644 req-1a18ddda-19a9-4418-894e-a463b0556c36 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.105477 Oct 27 10:24:15.226774 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1783/3749] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:15.232282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:15.233395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:15.248895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.249978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.252760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.255053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.259038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.259963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.281139 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 HTTP/1.1 Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '1ba664ff-9f3e-44a7-9921-fd60d7bb22c4'} Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:15.283199 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.287537 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.290411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:15.291628 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-937855e6-384c-42f9-8f0e-3ebc7860ea03 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 404 len: 111 microversion: 2.1 time: 0.063474 Oct 27 10:24:15.296551 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1784/3750] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:15 2022] DELETE /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:15.303519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:15.304547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:15.312210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.313249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.314391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.315344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.316007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.316628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.336432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:15.351927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:15.358997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:15.362594 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa512d46-0644-4722-8bef-699ce15946bb tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 0.477690 Oct 27 10:24:15.377448 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1967/3751] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:14 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:15.409307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:15.410121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:15.427046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.427535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.428292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.429026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.429477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.429901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.640092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:15.660507 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b3ad7e7-c868-4a6e-9675-93420db88982 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1213 microversion: 2.1 time: 0.362182 Oct 27 10:24:15.679834 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1785/3752] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:15 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1213 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:15.688327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:15.689194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:15.698038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.699192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.700116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.701099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.701918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.702512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.727751 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 HTTP/1.1 Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '1ba664ff-9f3e-44a7-9921-fd60d7bb22c4'} Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:15.729767 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.738965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:15.738965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:15.738965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:15.738965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:15.738965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:15.738965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. Oct 27 10:24:15.738965 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:15.742692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:15.744069 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e5849d3-3f35-4e3b-81b6-128980e82b51 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4" status: 404 len: 111 microversion: 2.1 time: 0.060581 Oct 27 10:24:15.745943 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1786/3753] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:15 2022] GET /compute/v2.1/servers/1ba664ff-9f3e-44a7-9921-fd60d7bb22c4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:15.755697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:15.756843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:15.765381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.766278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.767528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.768873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:15.769576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:15.770359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:15.964056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:15.974067 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6eb088fb-7b46-4aa0-87b5-b325573fe04c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1275 microversion: 2.1 time: 0.226339 Oct 27 10:24:15.974835 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1787/3754] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:15 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:15.995821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:15.996762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:16.003657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.004337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.004981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.005857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.006469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.007107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.132399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:16.140169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:16.142906 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f71a5dee-7410-4382-bfb0-da7a72ac3e22 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1215 microversion: 2.1 time: 0.152464 Oct 27 10:24:16.144343 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1788/3755] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:15 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:16.163668 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6471772-69d0-435c-90be-2f6032714478 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1493 microversion: 2.1 time: 0.784973 Oct 27 10:24:16.164200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:16.165013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:16.181759 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1968/3756] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:15 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1493 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:16.183585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.184712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.184997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.185804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.186415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.187431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.230700 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e HTTP/1.1 Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'cdce1098-3933-4f19-bd78-fc6e60559a8e'} Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:16.233157 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.238401 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.240727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:16.243099 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25f7104a-10a4-4218-87a4-157dd3d004a5 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 404 len: 111 microversion: 2.1 time: 0.097103 Oct 27 10:24:16.243965 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1789/3757] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:16 2022] DELETE /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:16.252588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:16.253341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: cdce1098-3933-4f19-bd78-fc6e60559a8e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:16.267119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.267706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.268217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.269774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.270310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.270806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.303929 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e HTTP/1.1 Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'cdce1098-3933-4f19-bd78-fc6e60559a8e'} Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:16.310859 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.316569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.316569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:16.316569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:16.316569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:16.316569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:16.316569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. Oct 27 10:24:16.316569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.316569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance cdce1098-3933-4f19-bd78-fc6e60559a8e could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:16.318375 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83c75ba0-395b-47c0-99ca-3543201c46f6 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e" status: 404 len: 111 microversion: 2.1 time: 0.069855 Oct 27 10:24:16.323064 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1969/3758] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:16 2022] GET /compute/v2.1/servers/cdce1098-3933-4f19-bd78-fc6e60559a8e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:16.331618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-593b087a-d8e5-4851-82a4-e6da2e869b9e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:16.332637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-593b087a-d8e5-4851-82a4-e6da2e869b9e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 574114a0-06fb-4ba7-8afb-9c817d38f005] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:16.345911 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-593b087a-d8e5-4851-82a4-e6da2e869b9e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-593b087a-d8e5-4851-82a4-e6da2e869b9e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005 HTTP/1.1 Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '574114a0-06fb-4ba7-8afb-9c817d38f005'} Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:16.347865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.352270 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.352270 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:16.352270 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:16.352270 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:16.352270 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:16.352270 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.352270 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.354310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-593b087a-d8e5-4851-82a4-e6da2e869b9e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:16.355637 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-593b087a-d8e5-4851-82a4-e6da2e869b9e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005" status: 404 len: 111 microversion: 2.1 time: 0.028036 Oct 27 10:24:16.361767 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1790/3759] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:16 2022] DELETE /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:16.370114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99173a09-2721-435d-bb9a-bb7c0ab6fb6b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:16.371635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99173a09-2721-435d-bb9a-bb7c0ab6fb6b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 574114a0-06fb-4ba7-8afb-9c817d38f005] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:16.381092 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-99173a09-2721-435d-bb9a-bb7c0ab6fb6b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.395835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:16.406102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99173a09-2721-435d-bb9a-bb7c0ab6fb6b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005 HTTP/1.1 Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '574114a0-06fb-4ba7-8afb-9c817d38f005'} Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:16.415329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:16.421133 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:16.421133 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:16.421133 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:16.421133 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. Oct 27 10:24:16.421133 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:16.426592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.426929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99173a09-2721-435d-bb9a-bb7c0ab6fb6b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 574114a0-06fb-4ba7-8afb-9c817d38f005 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:16.427685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.427849 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99173a09-2721-435d-bb9a-bb7c0ab6fb6b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005" status: 404 len: 111 microversion: 2.1 time: 0.062139 Oct 27 10:24:16.431026 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1970/3760] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:16 2022] GET /compute/v2.1/servers/574114a0-06fb-4ba7-8afb-9c817d38f005 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:16.434322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.435720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.437066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.438467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.463285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:16.484478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:16.484478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.484478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.484478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.484478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.484478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.484478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.627579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:16.974222 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e68ab057-c34b-481f-a525-2d96ed1a9d8e tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "DELETE /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 204 len: 0 microversion: 2.1 time: 0.535625 Oct 27 10:24:16.978344 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1971/3761] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:16 2022] DELETE /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:16.983461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:16.984169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:16.993704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.994774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:16.997026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:16.998889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:16.999594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:17.000340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:17.135460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:17.147542 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b1e9002-5781-4bfd-9f27-a9744faa2efc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1275 microversion: 2.1 time: 0.170293 Oct 27 10:24:17.148833 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1972/3762] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:16 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:17.155504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:17.156556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:17.171030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:17.173096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:17.174780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:17.179052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:17.179987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:17.190588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:17.571740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:17.590113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:17.595193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:17.598407 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93d24e16-afc5-4254-b3b8-15eb00a8d873 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 1.206440 Oct 27 10:24:17.600878 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1791/3763] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:16 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:24:17.610572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:17.620123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:17.638063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:17.638951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:17.639591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:17.640821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:17.642872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:17.643613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:17.662044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:17.675473 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ce78c09-bceb-4e11-96d0-6a07a07e7f3c tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1478 microversion: 2.1 time: 0.525173 Oct 27 10:24:17.679549 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1973/3764] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:17 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1478 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:17.691025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:17.692065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:17.707118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:17.707992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:17.708762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:17.710989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:17.711748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:17.714015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:17.881231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:17.893748 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc37c527-8698-4549-9659-92862a8d245f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1273 microversion: 2.1 time: 0.289631 Oct 27 10:24:17.913064 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1792/3765] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:17 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:17.918656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:17.927889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:17.937838 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb87131e-444e-479d-843b-abf6d8205051 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1271 microversion: 2.1 time: 0.256942 Oct 27 10:24:17.938359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:17.944484 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1974/3766] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:17 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:17.952509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-97dd66b8-a52b-4b05-a99f-53e01f694d76 req-5c6a10cf-e618-432e-a96c-6fcd7c9c13e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-plugged", "status": "completed", "tag": "933ec73d-9a1a-4d23-9d8c-110265b3b6e0"}, {"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-plugged", "status": "completed", "tag": "5e400934-2aff-4c7a-bc1e-a86b095a134a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:17.964183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:17.971706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:17.972500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:17.973489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:17.974582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:17.975247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:17.997739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-97dd66b8-a52b-4b05-a99f-53e01f694d76 req-5c6a10cf-e618-432e-a96c-6fcd7c9c13e8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:18.002925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-97dd66b8-a52b-4b05-a99f-53e01f694d76 req-5c6a10cf-e618-432e-a96c-6fcd7c9c13e8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:18.003763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-97dd66b8-a52b-4b05-a99f-53e01f694d76 req-5c6a10cf-e618-432e-a96c-6fcd7c9c13e8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:18.045373 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-97dd66b8-a52b-4b05-a99f-53e01f694d76 req-5c6a10cf-e618-432e-a96c-6fcd7c9c13e8 service nova] Creating event network-vif-plugged:933ec73d-9a1a-4d23-9d8c-110265b3b6e0 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:24:18.045883 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-97dd66b8-a52b-4b05-a99f-53e01f694d76 req-5c6a10cf-e618-432e-a96c-6fcd7c9c13e8 service nova] Creating event network-vif-plugged:5e400934-2aff-4c7a-bc1e-a86b095a134a for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:24:18.062575 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-97dd66b8-a52b-4b05-a99f-53e01f694d76 req-5c6a10cf-e618-432e-a96c-6fcd7c9c13e8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.116376 Oct 27 10:24:18.063515 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1975/3767] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:18.068639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-fa2c5eb0-9f06-4b57-aaf5-ce3446e7d34d req-758d97ba-d90d-4de4-8533-a3499669ed9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a26b4e0-7122-4ddf-8cde-c15d3720517f", "tag": "b5a1020c-5882-4d04-832e-25d851f5d24f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:18.086828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa2c5eb0-9f06-4b57-aaf5-ce3446e7d34d req-758d97ba-d90d-4de4-8533-a3499669ed9a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:18.087303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa2c5eb0-9f06-4b57-aaf5-ce3446e7d34d req-758d97ba-d90d-4de4-8533-a3499669ed9a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:18.087734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa2c5eb0-9f06-4b57-aaf5-ce3446e7d34d req-758d97ba-d90d-4de4-8533-a3499669ed9a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:18.113337 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-fa2c5eb0-9f06-4b57-aaf5-ce3446e7d34d req-758d97ba-d90d-4de4-8533-a3499669ed9a service nova] Creating event network-changed:b5a1020c-5882-4d04-832e-25d851f5d24f for instance 1a26b4e0-7122-4ddf-8cde-c15d3720517f on n-h2-854663-10 Oct 27 10:24:18.132319 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-fa2c5eb0-9f06-4b57-aaf5-ce3446e7d34d req-758d97ba-d90d-4de4-8533-a3499669ed9a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067288 Oct 27 10:24:18.132873 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1976/3768] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:18.143988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7a3e4e71-c777-488f-ac0e-9ace3a02d717 req-539a2f24-2f67-407c-8d7c-f43b4c3e0f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc187b6-d1ef-46d1-aead-aefd533b174c", "tag": "4a7906e3-0bae-4891-942c-be7dc72f9b38"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:18.181043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7a3e4e71-c777-488f-ac0e-9ace3a02d717 req-539a2f24-2f67-407c-8d7c-f43b4c3e0f17 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:18.181683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7a3e4e71-c777-488f-ac0e-9ace3a02d717 req-539a2f24-2f67-407c-8d7c-f43b4c3e0f17 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:18.189805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7a3e4e71-c777-488f-ac0e-9ace3a02d717 req-539a2f24-2f67-407c-8d7c-f43b4c3e0f17 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:18.210826 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7a3e4e71-c777-488f-ac0e-9ace3a02d717 req-539a2f24-2f67-407c-8d7c-f43b4c3e0f17 service nova] Creating event network-changed:4a7906e3-0bae-4891-942c-be7dc72f9b38 for instance dcc187b6-d1ef-46d1-aead-aefd533b174c on n-h1-854663-10 Oct 27 10:24:18.221409 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7a3e4e71-c777-488f-ac0e-9ace3a02d717 req-539a2f24-2f67-407c-8d7c-f43b4c3e0f17 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087074 Oct 27 10:24:18.222399 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1977/3769] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:18.233083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:18.237246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:18.258761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:18.259262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:18.259695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:18.260403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:18.260886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:18.261367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:18.272081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:18.347204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:18.356501 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d32dd2c-4dc8-4f7e-8bb7-4f804ec80127 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1493 microversion: 2.1 time: 0.441846 Oct 27 10:24:18.362064 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1793/3770] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:17 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1493 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:18.408325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:18.422892 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e307d79f-e03d-46da-99b4-98aee41a09f8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1275 microversion: 2.1 time: 0.199007 Oct 27 10:24:18.428277 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1978/3771] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:18 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:18.629893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:18.630696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:18.642895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:18.643548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:18.644492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:18.647019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:18.649311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:18.649956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:18.710627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:18.711692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:18.723030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:18.723810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:18.725232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:18.726141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:18.727813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:18.729000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.592486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:19.619249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:19.627624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:19.633579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:19.635555 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8ec2aaa6-fbf2-4908-aa51-c02982304cf6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1880 microversion: 2.32 time: 1.010001 Oct 27 10:24:19.644962 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7360239-1647-4dd9-a6cd-be067d041651 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1478 microversion: 2.1 time: 0.938443 Oct 27 10:24:19.646316 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1979/3773] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:18 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1478 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:19.649289 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1794/3773] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:18 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1880 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:19.658461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:19.660978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:19.674840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:19.675015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:19.675830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:19.676529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.677571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:19.679559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:19.679734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:19.680426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.691218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:19.691911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:19.692517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.693608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:19.694245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:19.694831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.780824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:19.794661 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7a04ec7-d99d-4dc9-95f7-7ad4bbe73156 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1273 microversion: 2.1 time: 0.146996 Oct 27 10:24:19.801594 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1980/3774] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:19 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:19.810426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:19.816900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:19.834234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:19.834727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:19.835347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.836057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:19.836509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:19.836963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.841199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:19.852276 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f70a4adf-7dbd-4c1b-9e7a-8432c1abd259 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1277 microversion: 2.1 time: 0.201236 Oct 27 10:24:19.853405 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1795/3775] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:19 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:19.860820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:19.861743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:19.869171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:19.869997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:19.870772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.871903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:19.873384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:19.874015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.909648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:19.910154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:19.910657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:19.911129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lazy-loading 'fault' on Instance uuid ab62d458-94d6-4867-ab01-c5d090a4474b {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:24:20.086720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:20.100652 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a6f0276-dcfc-4609-962c-9f033cfc432d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 200 len: 1298 microversion: 2.1 time: 0.297571 Oct 27 10:24:20.100902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:20.102258 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1981/3776] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:19 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 1298 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:20.114045 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60bd8089-2c77-4f57-88a9-cc4d1ceaa167 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1275 microversion: 2.1 time: 0.258573 Oct 27 10:24:20.115574 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1796/3777] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:19 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:20.339118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f8b24a3c-ff56-4fe8-915f-f3ab7494518d req-afbc44cd-de21-48ae-95fe-aba9d7beda7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab62d458-94d6-4867-ab01-c5d090a4474b", "name": "network-vif-deleted", "tag": "29d044bb-5eb5-4712-a0b6-8676435702fa"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:20.381528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f8b24a3c-ff56-4fe8-915f-f3ab7494518d req-afbc44cd-de21-48ae-95fe-aba9d7beda7d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:20.385514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f8b24a3c-ff56-4fe8-915f-f3ab7494518d req-afbc44cd-de21-48ae-95fe-aba9d7beda7d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:20.386219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f8b24a3c-ff56-4fe8-915f-f3ab7494518d req-afbc44cd-de21-48ae-95fe-aba9d7beda7d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:20.441292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f8b24a3c-ff56-4fe8-915f-f3ab7494518d req-afbc44cd-de21-48ae-95fe-aba9d7beda7d service nova] Creating event network-vif-deleted:29d044bb-5eb5-4712-a0b6-8676435702fa for instance ab62d458-94d6-4867-ab01-c5d090a4474b on n-h2-854663-10 Oct 27 10:24:20.458121 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f8b24a3c-ff56-4fe8-915f-f3ab7494518d req-afbc44cd-de21-48ae-95fe-aba9d7beda7d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118118 Oct 27 10:24:20.464066 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1982/3778] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:20.666207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:20.673464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:20.674325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:20.676894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:20.689136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:20.690967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:20.692747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:20.693018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:20.693727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:20.696197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:20.697228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:20.698359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:20.699631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:20.700086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:20.700836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:20.701436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.082917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:21.093956 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b2d5f91-d789-4c21-9d6d-71494bec7648 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1478 microversion: 2.1 time: 0.425208 Oct 27 10:24:21.094759 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1983/3779] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:20 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1478 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:21.099059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:21.099674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:21.126456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.126697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.151982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.162631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.163413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.163958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.184922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:21.207139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:21.214997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:21.220332 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4a82fce-134c-4ffd-a64b-4d7168e0e4d4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2832 microversion: 2.32 time: 0.558119 Oct 27 10:24:21.225258 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1797/3780] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:24:20 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2832 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:21.233715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:21.234508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:21.242607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.243683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.245629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.247755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.248411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.249076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.257257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:21.413361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:21.424433 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73acf047-2542-4cef-8b1c-dcf8e7cdc940 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1277 microversion: 2.1 time: 0.197897 Oct 27 10:24:21.427040 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1798/3781] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:21 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:21.445700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:21.451041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:21.461879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.471755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.472996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.474317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.474969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.475571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.493401 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b HTTP/1.1 Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'ab62d458-94d6-4867-ab01-c5d090a4474b'} Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:21.495039 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:21.500464 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:21.500464 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:21.500464 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:21.500464 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:21.500464 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:24:21.500464 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:21.511033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:21.511583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:21.511990 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-85bfcf97-50d8-4ae9-a54f-7e35615242f3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 404 len: 111 microversion: 2.1 time: 0.083751 Oct 27 10:24:21.518499 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1799/3782] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:21 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:21.523194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81970cae-a9c9-4044-b7dd-ac3bc857540b tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1315 microversion: 2.1 time: 0.427560 Oct 27 10:24:21.536647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:21.537611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:21.544936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.545685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.546987 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1984/3783] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:21 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:21.552648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2673c122-6a16-4681-8a56-ed412d9b40cc req-1f8ab9b1-ac5f-4cff-bd26-3186f2605592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b74d37-2197-4675-beed-2a9a93ebc2da", "name": "network-vif-deleted", "tag": "48fadaa3-acbd-4889-a75f-d05fbcd40b94"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:21.557957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.560337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.562304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.568872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.609563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2673c122-6a16-4681-8a56-ed412d9b40cc req-1f8ab9b1-ac5f-4cff-bd26-3186f2605592 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.611310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2673c122-6a16-4681-8a56-ed412d9b40cc req-1f8ab9b1-ac5f-4cff-bd26-3186f2605592 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.612880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2673c122-6a16-4681-8a56-ed412d9b40cc req-1f8ab9b1-ac5f-4cff-bd26-3186f2605592 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.645301 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2673c122-6a16-4681-8a56-ed412d9b40cc req-1f8ab9b1-ac5f-4cff-bd26-3186f2605592 service nova] Creating event network-vif-deleted:48fadaa3-acbd-4889-a75f-d05fbcd40b94 for instance 57b74d37-2197-4675-beed-2a9a93ebc2da on n-h1-854663-10 Oct 27 10:24:21.670483 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2673c122-6a16-4681-8a56-ed412d9b40cc req-1f8ab9b1-ac5f-4cff-bd26-3186f2605592 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122845 Oct 27 10:24:21.672611 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1985/3784] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:21.699693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-633090af-596b-42a5-bc62-ead4833b8a32 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:21.701231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-633090af-596b-42a5-bc62-ead4833b8a32 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:21.709129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633090af-596b-42a5-bc62-ead4833b8a32 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.709829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633090af-596b-42a5-bc62-ead4833b8a32 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.710444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633090af-596b-42a5-bc62-ead4833b8a32 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.711337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633090af-596b-42a5-bc62-ead4833b8a32 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:21.712006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633090af-596b-42a5-bc62-ead4833b8a32 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:21.712593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633090af-596b-42a5-bc62-ead4833b8a32 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:21.951450 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-633090af-596b-42a5-bc62-ead4833b8a32 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.277518 Oct 27 10:24:21.957699 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1986/3785] 10.222.0.76 () {60 vars in 1316 bytes} [Thu Oct 27 10:24:21 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec/os-interface => generated 1831 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:24:21.965879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d7954ca-16ea-4f31-aef6-ee332f59a9b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a8359d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:22.065022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:22.082200 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee3a0d68-a554-49a4-bcf3-09a9320a3109 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.562294 Oct 27 10:24:22.085022 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1800/3786] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:21 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:22.123093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:22.123675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:22.134956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:22.135410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:22.136544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:22.137555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:22.138297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:22.138790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:22.347217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lazy-loading 'services' on Instance uuid b54c5675-6a87-4213-a858-dd71fc93e9c7 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:24:22.524797 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1371dbd0-11f5-47f1-aac9-23a5cb32f364 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments/0a9ad905-98d4-411d-91fe-d986fe72c0c3" status: 202 len: 0 microversion: 2.1 time: 0.424898 Oct 27 10:24:22.537849 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1801/3787] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:24:22 2022] DELETE /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments/0a9ad905-98d4-411d-91fe-d986fe72c0c3 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:24:22.565032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:22.566102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:22.587459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:22.588295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:22.588986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:22.590290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:22.593206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:22.595714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:22.668997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:22.669400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:22.670004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:22.670592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lazy-loading 'fault' on Instance uuid 57b74d37-2197-4675-beed-2a9a93ebc2da {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:24:22.761773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:23.183700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a80ce0f3a4242a9a061a311c4bb50ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8efc7328ad48c89e3fc3109f1e674e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:23.195140 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5aec7001-e2aa-4b4c-9abe-2f2aac9ee94b tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 200 len: 1282 microversion: 2.1 time: 0.655371 Oct 27 10:24:23.195933 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1802/3788] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:22 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 1282 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:23.204064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:23.210705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:23.220145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:23.221047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:23.221667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:23.222586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:23.223199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:23.223782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:23.270104 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d7954ca-16ea-4f31-aef6-ee332f59a9b8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24" status: 204 len: 0 microversion: 2.1 time: 1.311002 Oct 27 10:24:23.271354 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1987/3789] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:21 2022] DELETE /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 => generated 0 bytes in 1313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:23.279661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8ade73d-d491-442b-87f8-5e6de918c137 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:23.282031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8ade73d-d491-442b-87f8-5e6de918c137 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:23.289864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ade73d-d491-442b-87f8-5e6de918c137 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:23.290481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ade73d-d491-442b-87f8-5e6de918c137 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:23.291172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ade73d-d491-442b-87f8-5e6de918c137 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:23.292436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ade73d-d491-442b-87f8-5e6de918c137 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:23.293158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ade73d-d491-442b-87f8-5e6de918c137 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:23.294081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ade73d-d491-442b-87f8-5e6de918c137 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:23.334909 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8ade73d-d491-442b-87f8-5e6de918c137 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059159 Oct 27 10:24:23.335663 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1988/3790] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:24:23 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:23.341195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:23.342490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:23.351341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:23.352499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:23.353040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:23.354079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:23.354531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:23.355117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:23.548455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:23.634714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=18 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:24.380069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:24.396702 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea3b9c70-9ebf-4532-886a-cdaea8044561 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1315 microversion: 2.1 time: 1.059590 Oct 27 10:24:24.404348 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1989/3791] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:23 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1315 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:24.415439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:24.416364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:24.423909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:24.424582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:24.425049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:24.425752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:24.426192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:24.426798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:24.487586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:24.502595 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7172859d-9c13-42bf-b411-6a293f4c176f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 1.304331 Oct 27 10:24:24.504123 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1803/3792] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:23 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:24.521335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:24.522920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:24.536294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:24.541089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:24.541837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:24.544011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:24.546128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:24.546783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:24.660045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=16 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:24.718702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:24.728131 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f2a464c-7557-424c-b8ae-e7856cfcefc2 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.322167 Oct 27 10:24:24.728685 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1990/3793] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:24 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:24.744492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:24.746746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:24.765807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:24.766322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:24.766766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:24.767683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:24.768342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:24.768801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:24.801213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:24.937101 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b733011-7928-4846-bb74-04a51e56bd22 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 204 len: 0 microversion: 2.1 time: 0.206612 Oct 27 10:24:24.938036 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1991/3794] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:24 2022] DELETE /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:24.951902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:24.953075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] [instance: 57b74d37-2197-4675-beed-2a9a93ebc2da] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:24.974314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:24.974952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:24.975486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:24.976450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:24.977029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:24.977567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:25.015135 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] HTTP exception thrown: Instance 57b74d37-2197-4675-beed-2a9a93ebc2da could not be found. Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Request method failure captured: Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da HTTP/1.1 Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltKDNgCgcTKIVZu0O1Nitj-NwNsJJ05M-mF6M2EDHEd3I4egyeI61g3ddNPfCzRgpXa-XHP-gZc_VDkf-Ra249-sKxgcgtUh73XmVfuNbPUR0ufaF_pAyNM2oc1ihPYnLW42OpjA8QMk8417_AONRo6RrROS6rdxXbV_kTo4WV_6QU Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ed8efc7328ad48c89e3fc3109f1e674e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ed8efc7328ad48c89e3fc3109f1e674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestJSON-1966307438 Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ed8efc7328ad48c89e3fc3109f1e674e Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestJSON-1966307438 Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6a80ce0f3a4242a9a061a311c4bb50ae Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestJSON-1966307438-project Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 57b74d37-2197-4675-beed-2a9a93ebc2da could not be found. Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '57b74d37-2197-4675-beed-2a9a93ebc2da'} Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b74d37-2197-4675-beed-2a9a93ebc2da could not be found. Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b74d37-2197-4675-beed-2a9a93ebc2da could not be found. Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:25.023281 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b74d37-2197-4675-beed-2a9a93ebc2da could not be found. Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] Returning 404 to user: Instance 57b74d37-2197-4675-beed-2a9a93ebc2da could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94af076a-c289-4bf9-b780-0aa0211c6328 tempest-ServersTestJSON-1966307438 tempest-ServersTestJSON-1966307438-project] 10.222.0.76 "GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da" status: 404 len: 111 microversion: 2.1 time: 0.086408 Oct 27 10:24:25.031421 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1992/3795] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:24 2022] GET /compute/v2.1/servers/57b74d37-2197-4675-beed-2a9a93ebc2da => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:25.043849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e7f974c-cc1d-4cff-9b90-dbe93fcfc782 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:25.055144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e7f974c-cc1d-4cff-9b90-dbe93fcfc782 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:25.062022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e7f974c-cc1d-4cff-9b90-dbe93fcfc782 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:25.062943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e7f974c-cc1d-4cff-9b90-dbe93fcfc782 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:25.063499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e7f974c-cc1d-4cff-9b90-dbe93fcfc782 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:25.064315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e7f974c-cc1d-4cff-9b90-dbe93fcfc782 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:25.064930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e7f974c-cc1d-4cff-9b90-dbe93fcfc782 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:25.065463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e7f974c-cc1d-4cff-9b90-dbe93fcfc782 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:25.131913 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e7f974c-cc1d-4cff-9b90-dbe93fcfc782 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102817 Oct 27 10:24:25.137060 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1993/3796] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:24:25 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:25.147312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0b365640-d101-422b-bdb5-0aec174d7163 req-0adbdb3e-9470-412f-a9f7-bb9fb657e0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3841656a-1e90-4c6a-a779-9200eebbbcc8", "tag": "a17862bd-07be-422c-b2f7-76426e7841b5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:25.152644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:25.162668 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50e4150f-9153-4ac9-96e6-7f79a7643ccc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.656544 Oct 27 10:24:25.163215 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1804/3797] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:24 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:25.176919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0b365640-d101-422b-bdb5-0aec174d7163 req-0adbdb3e-9470-412f-a9f7-bb9fb657e0a2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:25.176919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0b365640-d101-422b-bdb5-0aec174d7163 req-0adbdb3e-9470-412f-a9f7-bb9fb657e0a2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:25.177298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0b365640-d101-422b-bdb5-0aec174d7163 req-0adbdb3e-9470-412f-a9f7-bb9fb657e0a2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:25.186929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-636397649", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9817231a-6843-4f63-80f8-30528217ef12"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:25.209415 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0b365640-d101-422b-bdb5-0aec174d7163 req-0adbdb3e-9470-412f-a9f7-bb9fb657e0a2 service nova] Creating event network-changed:a17862bd-07be-422c-b2f7-76426e7841b5 for instance 3841656a-1e90-4c6a-a779-9200eebbbcc8 on n-h1-854663-10 Oct 27 10:24:25.214726 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0b365640-d101-422b-bdb5-0aec174d7163 req-0adbdb3e-9470-412f-a9f7-bb9fb657e0a2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075967 Oct 27 10:24:25.215360 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1994/3798] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:25.230088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4a51f6a-f771-4e09-9241-39a759e93983 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-522405531"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:25.233250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4a51f6a-f771-4e09-9241-39a759e93983 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:25.250661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4a51f6a-f771-4e09-9241-39a759e93983 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:25.251175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4a51f6a-f771-4e09-9241-39a759e93983 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:25.251608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4a51f6a-f771-4e09-9241-39a759e93983 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:25.252321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4a51f6a-f771-4e09-9241-39a759e93983 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:25.252830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4a51f6a-f771-4e09-9241-39a759e93983 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:25.253245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4a51f6a-f771-4e09-9241-39a759e93983 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:25.256994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] validate_networks() for [('9817231a-6843-4f63-80f8-30528217ef12', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:24:25.522028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:25.560143 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4a51f6a-f771-4e09-9241-39a759e93983 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.343179 Oct 27 10:24:25.565074 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1995/3799] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:24:25 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 27 10:24:25.571582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3019f329-8424-4a3a-8402-e88540079031 req-b868bc67-caf7-4d43-913f-f6e06c0582cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4d5987-7e66-4029-a235-894334151d30", "tag": "728f35fa-6941-4935-814d-4337c8eca41b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:25.586758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3019f329-8424-4a3a-8402-e88540079031 req-b868bc67-caf7-4d43-913f-f6e06c0582cd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:25.587782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3019f329-8424-4a3a-8402-e88540079031 req-b868bc67-caf7-4d43-913f-f6e06c0582cd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:25.588761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3019f329-8424-4a3a-8402-e88540079031 req-b868bc67-caf7-4d43-913f-f6e06c0582cd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:25.603668 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3019f329-8424-4a3a-8402-e88540079031 req-b868bc67-caf7-4d43-913f-f6e06c0582cd service nova] Creating event network-changed:728f35fa-6941-4935-814d-4337c8eca41b for instance 3e4d5987-7e66-4029-a235-894334151d30 on n-h1-854663-10 Oct 27 10:24:25.611250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3019f329-8424-4a3a-8402-e88540079031 req-b868bc67-caf7-4d43-913f-f6e06c0582cd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043525 Oct 27 10:24:25.612215 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1996/3800] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:25.618020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:25.618723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:25.626792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:25.627280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:25.627715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:25.628413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:25.628916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:25.629511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:26.101143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:26.110503 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4327da13-3b52-4d81-b02c-af710d944ada tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1315 microversion: 2.1 time: 0.496998 Oct 27 10:24:26.114832 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1997/3801] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:25 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:26.133353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:26.133895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:26.142812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:26.147776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:26.161470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:26.162605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:26.163113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:26.163693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.218107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:27.233657 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-885ba42b-d081-45b1-817b-122b53cb33f8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 1.117584 Oct 27 10:24:27.234252 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1998/3802] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:26 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:27.238696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:27.247508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:27.254305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.256775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.257392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.258589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.269499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.270252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.388767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:24:27.389607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:24:27.390021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:24:27.390427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:24:27.390896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:24:27.402601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.403118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.403552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.404279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.404761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.405184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.460756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:24:27.476596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Getting quotas for user 8074ee4104864f7b8010104133bd2fef and project 0848cca168854db48e34e9d939e97600. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:24:27.506929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:24:27.510870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:24:27.570869 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-06f71b43-a77a-4ccb-bcf2-b66b209661da tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.391308 Oct 27 10:24:27.571359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:27.572071 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1805/3803] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:24:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:24:27.579906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:27.580393 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-85c296c1-5f5c-4b08-92a6-33d506a74e57 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.345114 Oct 27 10:24:27.580965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:27.588465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.589299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.590010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.590968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.591590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.592315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.602285 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1999/3804] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:27 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:27.611924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-059f6859-3296-4e56-9965-429eb2589702 req-f7eb0926-f447-4f3a-b0c4-d4ea0295d057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a26b4e0-7122-4ddf-8cde-c15d3720517f", "name": "network-vif-plugged", "status": "completed", "tag": "b5a1020c-5882-4d04-832e-25d851f5d24f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:27.637453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-059f6859-3296-4e56-9965-429eb2589702 req-f7eb0926-f447-4f3a-b0c4-d4ea0295d057 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.637912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-059f6859-3296-4e56-9965-429eb2589702 req-f7eb0926-f447-4f3a-b0c4-d4ea0295d057 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.638351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-059f6859-3296-4e56-9965-429eb2589702 req-f7eb0926-f447-4f3a-b0c4-d4ea0295d057 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.668534 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-059f6859-3296-4e56-9965-429eb2589702 req-f7eb0926-f447-4f3a-b0c4-d4ea0295d057 service nova] Creating event network-vif-plugged:b5a1020c-5882-4d04-832e-25d851f5d24f for instance 1a26b4e0-7122-4ddf-8cde-c15d3720517f on n-h2-854663-10 Oct 27 10:24:27.682919 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-059f6859-3296-4e56-9965-429eb2589702 req-f7eb0926-f447-4f3a-b0c4-d4ea0295d057 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079293 Oct 27 10:24:27.685043 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2000/3805] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:27.930553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:27.939495 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d20cc13-7d9f-491e-9900-7cc0fe2d366b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.365376 Oct 27 10:24:27.940116 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1806/3806] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:27 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:27.951632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a9e3c8b-26f2-4a3f-9f20-ee0d2a699948 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:27.954011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a9e3c8b-26f2-4a3f-9f20-ee0d2a699948 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:27.959469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:27.960269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:27.967996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.972228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c8b-26f2-4a3f-9f20-ee0d2a699948 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.972765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c8b-26f2-4a3f-9f20-ee0d2a699948 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.973647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c8b-26f2-4a3f-9f20-ee0d2a699948 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.973862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.973988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c8b-26f2-4a3f-9f20-ee0d2a699948 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.974346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c8b-26f2-4a3f-9f20-ee0d2a699948 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.974769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c8b-26f2-4a3f-9f20-ee0d2a699948 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.975105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:27.977190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:27.980778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:27.981535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:28.072279 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a9e3c8b-26f2-4a3f-9f20-ee0d2a699948 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.380236 Oct 27 10:24:28.077842 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2001/3807] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:24:27 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments => generated 197 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:28.083624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-160b4d11-1923-4b60-b0b5-c6a76d6d95cd req-ab4eb245-bd45-4bc4-8f2c-43b7601ab835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf71b7a0-da61-4a46-9825-c8fc74c7f3f0", "tag": "24b7fa82-0d78-42e4-95bf-f27da4e3d81f"}, {"name": "network-changed", "server_uuid": "04983eac-8861-47ff-9a90-a53c22f6e316", "tag": "bd3c1065-ba6d-430b-8fb1-59b1268a09cb"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:28.091703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:28.096743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-160b4d11-1923-4b60-b0b5-c6a76d6d95cd req-ab4eb245-bd45-4bc4-8f2c-43b7601ab835 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:28.097447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-160b4d11-1923-4b60-b0b5-c6a76d6d95cd req-ab4eb245-bd45-4bc4-8f2c-43b7601ab835 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:28.098301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-160b4d11-1923-4b60-b0b5-c6a76d6d95cd req-ab4eb245-bd45-4bc4-8f2c-43b7601ab835 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:28.135743 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-160b4d11-1923-4b60-b0b5-c6a76d6d95cd req-ab4eb245-bd45-4bc4-8f2c-43b7601ab835 service nova] Creating event network-changed:24b7fa82-0d78-42e4-95bf-f27da4e3d81f for instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 on n-h2-854663-10 Oct 27 10:24:28.136588 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-160b4d11-1923-4b60-b0b5-c6a76d6d95cd req-ab4eb245-bd45-4bc4-8f2c-43b7601ab835 service nova] Creating event network-changed:bd3c1065-ba6d-430b-8fb1-59b1268a09cb for instance 04983eac-8861-47ff-9a90-a53c22f6e316 on n-h1-854663-10 Oct 27 10:24:28.155629 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-160b4d11-1923-4b60-b0b5-c6a76d6d95cd req-ab4eb245-bd45-4bc4-8f2c-43b7601ab835 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076183 Oct 27 10:24:28.164522 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2002/3808] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:28.178583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-51bbf206-a1bc-4dfd-9a4f-b0e6423cae6b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:28.179990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-51bbf206-a1bc-4dfd-9a4f-b0e6423cae6b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:28.435974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-51bbf206-a1bc-4dfd-9a4f-b0e6423cae6b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:28.451024 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-51bbf206-a1bc-4dfd-9a4f-b0e6423cae6b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1207 microversion: 2.1 time: 0.281069 Oct 27 10:24:28.451654 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2003/3809] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:28 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1207 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:28.471519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3cf03a5b-ac22-4639-8d3d-119b04e09613 req-8816e59f-89ec-48c5-9162-1d0ac967bc5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "tag": "ea6b7f3d-eab2-4913-848a-baf2f2b76986"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:28.488962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3cf03a5b-ac22-4639-8d3d-119b04e09613 req-8816e59f-89ec-48c5-9162-1d0ac967bc5c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:28.489766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3cf03a5b-ac22-4639-8d3d-119b04e09613 req-8816e59f-89ec-48c5-9162-1d0ac967bc5c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:28.490394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3cf03a5b-ac22-4639-8d3d-119b04e09613 req-8816e59f-89ec-48c5-9162-1d0ac967bc5c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:28.502949 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3cf03a5b-ac22-4639-8d3d-119b04e09613 req-8816e59f-89ec-48c5-9162-1d0ac967bc5c service nova] Creating event network-changed:ea6b7f3d-eab2-4913-848a-baf2f2b76986 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:24:28.508864 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3cf03a5b-ac22-4639-8d3d-119b04e09613 req-8816e59f-89ec-48c5-9162-1d0ac967bc5c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042747 Oct 27 10:24:28.510700 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2004/3810] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:28.516234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:28.525858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:28.539508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:28.547309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:28.548214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:28.549357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:28.550157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:28.551066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.031496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:29.046363 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-613ea87f-9cff-417e-b769-86d0494e128d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1315 microversion: 2.1 time: 1.104655 Oct 27 10:24:29.047465 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1807/3811] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:27 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1315 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:29.054396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:29.055081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:29.061908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.062674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.063161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.064106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.064627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.065951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.207205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:29.217214 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5550e212-bca2-4e9f-91ac-580be64db001 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 0.704922 Oct 27 10:24:29.218882 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2005/3812] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:28 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:29.224829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:29.225731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:29.251700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.252197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.252636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.257727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.258547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.259172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.314112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:29.326527 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb18b6f6-d2ac-4609-8f4b-0bbe218549f2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1684 microversion: 2.1 time: 0.273859 Oct 27 10:24:29.328007 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1808/3813] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:29 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1684 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:29.333320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86cf4593-7f19-431c-9bf5-dfe2665824b4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:29.336097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86cf4593-7f19-431c-9bf5-dfe2665824b4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:29.345209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cf4593-7f19-431c-9bf5-dfe2665824b4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.345897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cf4593-7f19-431c-9bf5-dfe2665824b4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.346534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cf4593-7f19-431c-9bf5-dfe2665824b4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.347423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cf4593-7f19-431c-9bf5-dfe2665824b4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.348182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cf4593-7f19-431c-9bf5-dfe2665824b4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.348796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cf4593-7f19-431c-9bf5-dfe2665824b4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.383483 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86cf4593-7f19-431c-9bf5-dfe2665824b4 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053847 Oct 27 10:24:29.384442 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1809/3814] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:24:29 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:24:29.478669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:29.479284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:29.485667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.486163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.486603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.487298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.487743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.488170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.580460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:29.590152 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-44e31be3-386d-411e-95b8-082081c17a45 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1203 microversion: 2.1 time: 0.115283 Oct 27 10:24:29.599487 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1810/3815] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:29 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1203 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:29.599487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:29.603039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:29.610237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.610855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.611362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.612302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.612815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.613246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.642888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] HTTP exception thrown: Cannot 'reboot' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Request method failure captured: Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21/action HTTP/1.1 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 28 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsu-3_w5LGZIvZif4TTAP6HRONgNGme2C9gImyb4W0g9Upsi7Y2bHorvYIAfIK1OJaF4pOA8nmy8Y4T0BPo3Z6b72CJIADNwIlaiQrBL1QEHegWtPyuQbLI5lnUkUsZwbu1MPjFEe-CeaqflWsbqJ87tWOxBka5KpPfYl0fSmtf6VA Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9067a31bfee345fca080e7621aa60015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9067a31bfee345fca080e7621aa60015", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5fc08f1ad238424896dcefb0fa0b20c5 Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: {"reboot": {"type": "HARD"}} Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot 'reboot' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'bb55bff3-d743-41bf-a855-7405357d6f21', 'body': {'reboot': {'type': 'HARD'}}} Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb55bff3-d743-41bf-a855-7405357d6f21 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:24:29.644608 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Returning 409 to user: Cannot 'reboot' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e028ca95-a420-4043-bb3e-aaf6cbb7efaf tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21/action" status: 409 len: 145 microversion: 2.1 time: 0.054182 Oct 27 10:24:29.649069 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1811/3816] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:24:29 2022] POST /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21/action => generated 145 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:24:29.658468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:29.664159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:29.664775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:29.670994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.671545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.671986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.672723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.673181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.673608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.677284 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1faadc4a-cd1b-4c60-9c63-dedf63095290 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.456758 Oct 27 10:24:29.678591 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2006/3817] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:29 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:29.707912 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] HTTP exception thrown: Cannot 'rebuild' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Request method failure captured: Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21/action HTTP/1.1 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 65 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsu-3_w5LGZIvZif4TTAP6HRONgNGme2C9gImyb4W0g9Upsi7Y2bHorvYIAfIK1OJaF4pOA8nmy8Y4T0BPo3Z6b72CJIADNwIlaiQrBL1QEHegWtPyuQbLI5lnUkUsZwbu1MPjFEe-CeaqflWsbqJ87tWOxBka5KpPfYl0fSmtf6VA Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9067a31bfee345fca080e7621aa60015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9067a31bfee345fca080e7621aa60015", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5fc08f1ad238424896dcefb0fa0b20c5 Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot 'rebuild' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'bb55bff3-d743-41bf-a855-7405357d6f21', 'body': {'rebuild': {'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a'}}} Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb55bff3-d743-41bf-a855-7405357d6f21 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:24:29.709774 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Returning 409 to user: Cannot 'rebuild' instance bb55bff3-d743-41bf-a855-7405357d6f21 while it is in vm_state rescued {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f182a0f-b574-4dad-a437-fe016192b6fa tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "POST /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21/action" status: 409 len: 146 microversion: 2.1 time: 0.057377 Oct 27 10:24:29.722043 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1812/3818] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:24:29 2022] POST /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21/action => generated 146 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 10:24:29.725825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:29.726358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:29.732600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.733237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.733841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.734605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.735288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.735780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.765437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:29.768961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-75c50098-b684-4979-a697-776110a8af78 req-f41e71a2-48ea-4089-ba94-994b5b66e130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc187b6-d1ef-46d1-aead-aefd533b174c", "name": "network-vif-plugged", "status": "completed", "tag": "4a7906e3-0bae-4891-942c-be7dc72f9b38"}, {"server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "name": "network-vif-unplugged", "status": "completed", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:29.779783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-75c50098-b684-4979-a697-776110a8af78 req-f41e71a2-48ea-4089-ba94-994b5b66e130 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.780266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-75c50098-b684-4979-a697-776110a8af78 req-f41e71a2-48ea-4089-ba94-994b5b66e130 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.780728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-75c50098-b684-4979-a697-776110a8af78 req-f41e71a2-48ea-4089-ba94-994b5b66e130 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.797418 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-75c50098-b684-4979-a697-776110a8af78 req-f41e71a2-48ea-4089-ba94-994b5b66e130 service nova] Creating event network-vif-plugged:4a7906e3-0bae-4891-942c-be7dc72f9b38 for instance dcc187b6-d1ef-46d1-aead-aefd533b174c on n-h1-854663-10 Oct 27 10:24:29.799194 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-75c50098-b684-4979-a697-776110a8af78 req-f41e71a2-48ea-4089-ba94-994b5b66e130 service nova] Creating event network-vif-unplugged:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:24:29.810394 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-75c50098-b684-4979-a697-776110a8af78 req-f41e71a2-48ea-4089-ba94-994b5b66e130 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045143 Oct 27 10:24:29.811528 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1813/3819] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:24:29.869250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17ecaed4-f89b-44af-9ab2-d03abb543c5b tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 204 len: 0 microversion: 2.1 time: 0.151294 Oct 27 10:24:29.870543 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2007/3820] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:29 2022] DELETE /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:29.880900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:29.882310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:29.890162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.891009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.891675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:29.892586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:29.893215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:29.893805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.077547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:30.078612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:30.086308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.086869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.087299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.088046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.089369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.089912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.191007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:30.201646 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac914284-61df-421d-b523-18f8d99db04e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1688 microversion: 2.1 time: 0.326205 Oct 27 10:24:30.203484 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1814/3821] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:29 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1688 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:30.230548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0f24750e-9532-40d8-be82-6c9f19611c66 req-b033094f-6e7c-4fc4-9323-f2d267801d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfa7709-dcb6-47e3-bc91-2c3f4510b3b9", "name": "network-vif-deleted", "tag": "7f21f4ad-6e4b-49a1-9ff7-b3a359019136"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:30.253919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0f24750e-9532-40d8-be82-6c9f19611c66 req-b033094f-6e7c-4fc4-9323-f2d267801d03 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.254622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0f24750e-9532-40d8-be82-6c9f19611c66 req-b033094f-6e7c-4fc4-9323-f2d267801d03 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.255223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0f24750e-9532-40d8-be82-6c9f19611c66 req-b033094f-6e7c-4fc4-9323-f2d267801d03 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.267605 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0f24750e-9532-40d8-be82-6c9f19611c66 req-b033094f-6e7c-4fc4-9323-f2d267801d03 service nova] Creating event network-vif-deleted:7f21f4ad-6e4b-49a1-9ff7-b3a359019136 for instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 on n-h2-854663-10 Oct 27 10:24:30.274433 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0f24750e-9532-40d8-be82-6c9f19611c66 req-b033094f-6e7c-4fc4-9323-f2d267801d03 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050047 Oct 27 10:24:30.275625 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1815/3822] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:30.281554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:30.282505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:30.291009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.291777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.292592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.293565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.299746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.300436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:30.301074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.311647 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7f597cb-f03e-428c-b21b-0e5ebf518566 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1315 microversion: 2.1 time: 0.239603 Oct 27 10:24:30.312242 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2008/3823] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:30 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:30.351378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:30.352004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:30.364541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.365067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.365496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.369972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.370615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.371674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.481276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:30.492025 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-14bfcb6d-f52b-4372-ba0a-9c4c5ba9f8d6 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 0.214942 Oct 27 10:24:30.494184 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1816/3824] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:30 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:30.612854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:30.615153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:30.615931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:30.624286 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f24ef31-d1d4-4b03-9398-fbb2530774a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1684 microversion: 2.1 time: 0.276677 Oct 27 10:24:30.625146 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2009/3825] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:30 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1684 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:30.631796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.632518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.634117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.634903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.636146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.638880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.647030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:30.703540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:30.703927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:30.711097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.711849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.712514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.713456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:30.714752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:30.715429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:30.733709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:30.749693 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ce34b8e-4581-4e7c-a397-4051db6a1d03 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1259 microversion: 2.1 time: 0.140186 Oct 27 10:24:30.750403 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1817/3826] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:30 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:31.002914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:31.019270 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c4dba04-3aec-4848-a89e-fd6dfc7f079b tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.319143 Oct 27 10:24:31.019978 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2010/3827] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:30 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:31.226215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:31.228175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:31.232505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:31.236156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:31.236755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:31.237260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:31.238275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:31.238939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:31.239623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:31.338983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:31.339975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:31.349644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:31.350568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:31.351230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:31.353241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:31.354001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:31.354623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:31.883482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:31.892827 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0229b609-ce65-49e2-8616-a63de69604ab tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1688 microversion: 2.1 time: 0.670653 Oct 27 10:24:31.894069 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1818/3828] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:31 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1688 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:31.899206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:31.900035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:31.916494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:31.917523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:31.918246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:31.919192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:31.919866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:31.920535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:32.076788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:32.096024 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f2fa9f7-b011-4c74-97b2-ef0f98c13345 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1315 microversion: 2.1 time: 0.762883 Oct 27 10:24:32.097267 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2011/3829] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:31 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:32.105027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:32.106136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:32.113117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:32.113957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:32.114573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:32.115474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:32.116105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:32.116837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:32.352179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:32.366322 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bc86c0b-aa7a-4545-813c-70be90786700 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 0.470362 Oct 27 10:24:32.367560 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1819/3830] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:31 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:32.374351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:32.375269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:32.428755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:32.429913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:32.430616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:32.431529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:32.432307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:32.433755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:32.574567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:32.576298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:32.597553 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9ff5bdd-20c5-4cec-bc51-1569f433beb6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1259 microversion: 2.1 time: 0.228587 Oct 27 10:24:32.598850 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1eb1a55-b6de-49a2-a533-5eda7b7db74b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1684 microversion: 2.1 time: 0.498558 Oct 27 10:24:32.624228 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1820/3831] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:32 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:32.633039 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2012/3832] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:32 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1684 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:32.639500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:32.641776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:32.659723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:32.661097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:32.663162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:32.668265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:32.669086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:32.669760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:32.933706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:32.935609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:32.947686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:32.948458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:32.949126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:32.950104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:32.950970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:32.951566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:33.190538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:33.207025 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3cce83d3-624f-41f4-9f47-10db1f536017 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.580477 Oct 27 10:24:33.210332 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1821/3833] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:32 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:33.220907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:33.224294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:33.249826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:33.251780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:33.254660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:33.257069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:33.258981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:33.260511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:33.339014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:33.363360 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-acd3b6b8-3a6b-4c3f-afea-aa3bab7ba917 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1688 microversion: 2.1 time: 0.445677 Oct 27 10:24:33.366568 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2013/3834] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:32 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1688 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:33.394363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:33.395464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:33.403457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:33.404615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:33.405245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:33.406156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:33.406833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:33.407260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:33.414035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:33.611975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:33.622641 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c479572-dfef-4c22-83da-c983a61d9dae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1315 microversion: 2.1 time: 0.410479 Oct 27 10:24:33.638554 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1822/3835] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:33 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:33.647236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e7913655-f768-4e64-bee6-4baf93a06e6a req-13031212-3625-4ab9-9c68-e145a59cdf64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3841656a-1e90-4c6a-a779-9200eebbbcc8", "name": "network-vif-plugged", "status": "completed", "tag": "a17862bd-07be-422c-b2f7-76426e7841b5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:33.660463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e7913655-f768-4e64-bee6-4baf93a06e6a req-13031212-3625-4ab9-9c68-e145a59cdf64 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:33.661231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e7913655-f768-4e64-bee6-4baf93a06e6a req-13031212-3625-4ab9-9c68-e145a59cdf64 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:33.662270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e7913655-f768-4e64-bee6-4baf93a06e6a req-13031212-3625-4ab9-9c68-e145a59cdf64 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:33.678664 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e7913655-f768-4e64-bee6-4baf93a06e6a req-13031212-3625-4ab9-9c68-e145a59cdf64 service nova] Creating event network-vif-plugged:a17862bd-07be-422c-b2f7-76426e7841b5 for instance 3841656a-1e90-4c6a-a779-9200eebbbcc8 on n-h1-854663-10 Oct 27 10:24:33.684993 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e7913655-f768-4e64-bee6-4baf93a06e6a req-13031212-3625-4ab9-9c68-e145a59cdf64 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044300 Oct 27 10:24:33.686153 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1823/3836] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:33.693184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:33.694511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:33.701582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:33.702897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:33.703499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:33.704575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:33.705212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:33.705822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:33.855477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:33.881358 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a5cc729-6abc-4de1-ac02-844836eade0a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 0.491444 Oct 27 10:24:33.884653 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2014/3837] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:33 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:33.895169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:33.898962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:33.904447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:33.930816 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5dc8d3af-b740-4aa9-adf7-f770b187a8b0 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1259 microversion: 2.1 time: 0.237539 Oct 27 10:24:33.931534 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1824/3838] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:33 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1259 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:33.937284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:33.937822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:33.938249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:33.943089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:33.943771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:33.945404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:34.202191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:34.211346 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b04f10cc-6f5f-413d-a73f-fd93e191eb99 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.324812 Oct 27 10:24:34.212583 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2015/3839] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:33 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:34.241979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:34.242723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:34.253238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:34.253707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:34.254134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:34.254830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:34.255273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:34.255690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:34.396356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:34.397240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:34.413039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:34.413039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:34.413039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:34.413461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:34.413551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:34.413935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:34.467370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:34.479723 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc9e982a-cb23-4f69-94e3-6ee1cf79def5 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.246562 Oct 27 10:24:34.488893 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1825/3840] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:34 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:34.674006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:34.676695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:34.679951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:34.691116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-459d8905-319b-48b7-a5cb-0592854a486e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1688 microversion: 2.1 time: 0.300040 Oct 27 10:24:34.691754 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2016/3841] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:34 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1688 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:34.716680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:34.717178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:34.717617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:34.718330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:34.718777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:34.730299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:34.909300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:34.909824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:34.921706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:34.922149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:34.922714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:34.927080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:34.928936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:34.929361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.007156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:35.020693 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5a2147a3-c766-43f7-aa47-f663b8cf48f9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1315 microversion: 2.1 time: 0.373061 Oct 27 10:24:35.022954 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1826/3842] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:34 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:35.032452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:35.036458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:35.061860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:35.062357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:35.066238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.067307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:35.069024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:35.069732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.252288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:35.264627 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf9212e8-d961-4c58-bb6e-673e0d97bcd3 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1265 microversion: 2.1 time: 0.239461 Oct 27 10:24:35.277993 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1827/3843] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:35 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:35.287468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:35.295059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:35.311756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:35.312525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:35.313184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.314361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:35.315314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:35.315903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.371375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:35.396317 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-199de406-8608-43db-88c0-f2fc0921a45e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 0.487778 Oct 27 10:24:35.397037 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2017/3844] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:34 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:35.505321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:35.506260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:35.520543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:35.525412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:35.526465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.530495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:35.532240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:35.533081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.631788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:35.648965 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b523e14c-a441-4233-970a-9631ef2d8766 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.365635 Oct 27 10:24:35.650223 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1828/3845] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:35 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:35.717982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a7b0a82c-b9f6-4052-9a18-0f0ace2046ca req-a096b8c4-aac1-4c47-8340-9ba20fae3ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "name": "network-vif-plugged", "status": "completed", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}, {"server_uuid": "cf71b7a0-da61-4a46-9825-c8fc74c7f3f0", "name": "network-vif-plugged", "status": "completed", "tag": "24b7fa82-0d78-42e4-95bf-f27da4e3d81f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:35.735821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a7b0a82c-b9f6-4052-9a18-0f0ace2046ca req-a096b8c4-aac1-4c47-8340-9ba20fae3ea8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:35.736310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a7b0a82c-b9f6-4052-9a18-0f0ace2046ca req-a096b8c4-aac1-4c47-8340-9ba20fae3ea8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:35.736766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a7b0a82c-b9f6-4052-9a18-0f0ace2046ca req-a096b8c4-aac1-4c47-8340-9ba20fae3ea8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.751601 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a7b0a82c-b9f6-4052-9a18-0f0ace2046ca req-a096b8c4-aac1-4c47-8340-9ba20fae3ea8 service nova] Creating event network-vif-plugged:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:24:35.752835 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a7b0a82c-b9f6-4052-9a18-0f0ace2046ca req-a096b8c4-aac1-4c47-8340-9ba20fae3ea8 service nova] Creating event network-vif-plugged:24b7fa82-0d78-42e4-95bf-f27da4e3d81f for instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 on n-h2-854663-10 Oct 27 10:24:35.760892 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a7b0a82c-b9f6-4052-9a18-0f0ace2046ca req-a096b8c4-aac1-4c47-8340-9ba20fae3ea8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053436 Oct 27 10:24:35.766805 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1829/3846] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:35.773181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:35.774152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:35.800502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:35.801024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:35.801463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.807524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:35.809840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:35.810560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:35.876575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:35.886746 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8fece0e1-9623-4077-a80f-ee0f405e53cc tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.384335 Oct 27 10:24:35.908080 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2018/3847] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:35 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:35.972279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:35.982539 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b198d870-9105-4dec-9350-ce6dc722c7ef tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1621 microversion: 2.1 time: 0.214159 Oct 27 10:24:35.994183 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1830/3848] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:35 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1621 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:36.048402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:36.049393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:36.060309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:36.063109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:36.063820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:36.065530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:36.069000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:36.069745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:36.292046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:36.292046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:36.316507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:36.318758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:36.319495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:36.321220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:36.323339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:36.326242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:36.537122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:36.545453 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ebb21b7-888b-46e2-b451-8da3e21a7ca0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1315 microversion: 2.1 time: 0.501832 Oct 27 10:24:36.557045 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2019/3849] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:36 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:36.562474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7acc2f61-cd05-4ab4-b248-e8ba945997bd req-db0ee593-3810-4971-af73-fceb278f4616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54c5675-6a87-4213-a858-dd71fc93e9c7", "name": "network-vif-deleted", "tag": "71360be2-953d-4a1c-9c77-3a1b49634b01"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:36.601134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7acc2f61-cd05-4ab4-b248-e8ba945997bd req-db0ee593-3810-4971-af73-fceb278f4616 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:36.601864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7acc2f61-cd05-4ab4-b248-e8ba945997bd req-db0ee593-3810-4971-af73-fceb278f4616 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:36.602483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7acc2f61-cd05-4ab4-b248-e8ba945997bd req-db0ee593-3810-4971-af73-fceb278f4616 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:36.626085 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7acc2f61-cd05-4ab4-b248-e8ba945997bd req-db0ee593-3810-4971-af73-fceb278f4616 service nova] Creating event network-vif-deleted:71360be2-953d-4a1c-9c77-3a1b49634b01 for instance b54c5675-6a87-4213-a858-dd71fc93e9c7 on n-h2-854663-10 Oct 27 10:24:36.641582 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:24:36.641977 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 10:24:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.76) !!! Oct 27 10:24:36.649797 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7acc2f61-cd05-4ab4-b248-e8ba945997bd req-db0ee593-3810-4971-af73-fceb278f4616 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091399 Oct 27 10:24:36.660500 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2020/3850] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:36.673143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:36.677288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:36.695087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:36.696045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:36.696924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:36.698034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:36.700035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:36.700721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:36.794125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:36.808424 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-966c156d-9062-4708-a3b7-99f53ac6ea4f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1307 microversion: 2.1 time: 0.520992 Oct 27 10:24:36.809674 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1831/3851] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:36 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1307 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:36.814653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:36.815470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:36.823936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:36.824806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:36.825403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:36.826644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:36.827286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:36.827865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:37.260446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:37.269202 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-054631cc-6b1c-4c2c-8efb-a544cb44125b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 0.607142 Oct 27 10:24:37.269787 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2021/3852] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:36 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:37.302798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:37.309002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:37.309638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:37.315093 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83f52371-7c97-42dc-b0cf-86f510678bd1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.504162 Oct 27 10:24:37.316508 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1832/3853] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:36 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:37.321610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:37.322898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:37.331039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:37.332040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:37.333035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:37.334015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:37.334697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:37.335377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:37.367878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:37.371412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:37.373365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:37.377029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:37.379940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:37.381223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:37.422428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:37.485821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:37.489735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:37.495895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:37.496635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lazy-loading 'fault' on Instance uuid b54c5675-6a87-4213-a858-dd71fc93e9c7 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:24:37.516712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:37.665950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:37.683168 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d4510eb-5023-4fec-b692-335b56da2c04 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 200 len: 1335 microversion: 2.1 time: 0.364842 Oct 27 10:24:37.699984 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1833/3854] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:37 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 1335 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:37.717792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:37.718819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:37.725875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:37.727052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:37.727751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:37.728969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:37.729714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:37.730433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:37.821784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:37.836633 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e96af85-a236-430b-b7df-24649649bb92 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.565621 Oct 27 10:24:37.870709 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2022/3855] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:37 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:37.877357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:37.881640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:37.902695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:37.911917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:37.913128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:37.914645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:37.915904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:37.916516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:38.250647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:38.260406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:38.274592 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd8945a9-6b38-4ee1-8a7b-f1203b589800 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1501 microversion: 2.1 time: 0.571057 Oct 27 10:24:38.278402 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1834/3856] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:37 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1501 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:38.300164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2f2b541b-582d-49e4-ac7a-a370df0e8e59 req-d06991b7-6b3f-4295-b95e-cbaf39fa0b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04983eac-8861-47ff-9a90-a53c22f6e316", "name": "network-vif-plugged", "status": "completed", "tag": "bd3c1065-ba6d-430b-8fb1-59b1268a09cb"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:38.359930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2f2b541b-582d-49e4-ac7a-a370df0e8e59 req-d06991b7-6b3f-4295-b95e-cbaf39fa0b53 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:38.362131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2f2b541b-582d-49e4-ac7a-a370df0e8e59 req-d06991b7-6b3f-4295-b95e-cbaf39fa0b53 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:38.364423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2f2b541b-582d-49e4-ac7a-a370df0e8e59 req-d06991b7-6b3f-4295-b95e-cbaf39fa0b53 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:38.401939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:38.414549 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29645b20-ce5d-4acc-8f3d-8361524ac5be tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1307 microversion: 2.1 time: 0.540944 Oct 27 10:24:38.417526 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2023/3857] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:37 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1307 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:38.454681 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2f2b541b-582d-49e4-ac7a-a370df0e8e59 req-d06991b7-6b3f-4295-b95e-cbaf39fa0b53 service nova] Creating event network-vif-plugged:bd3c1065-ba6d-430b-8fb1-59b1268a09cb for instance 04983eac-8861-47ff-9a90-a53c22f6e316 on n-h1-854663-10 Oct 27 10:24:38.455787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:38.456583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:38.470342 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2f2b541b-582d-49e4-ac7a-a370df0e8e59 req-d06991b7-6b3f-4295-b95e-cbaf39fa0b53 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188362 Oct 27 10:24:38.472588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:38.473445 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1835/3858] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:38.496161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:38.524291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:38.525198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:38.530160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:38.531427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:38.534832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e19c226-1d96-48ab-b889-1553a0a794eb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:38.536718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:38.577285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e19c226-1d96-48ab-b889-1553a0a794eb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:38.577783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e19c226-1d96-48ab-b889-1553a0a794eb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:38.578221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e19c226-1d96-48ab-b889-1553a0a794eb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:38.811718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e19c226-1d96-48ab-b889-1553a0a794eb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Going to try to stop instance {{(pid=120719) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:24:38.943239 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e19c226-1d96-48ab-b889-1553a0a794eb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0/action" status: 202 len: 0 microversion: 2.1 time: 0.464664 Oct 27 10:24:38.951365 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1836/3859] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:24:38 2022] POST /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:24:38.970548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:38.974734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:38.996225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:38.996843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:38.997372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:38.998113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:38.998567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.001138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.019982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:39.043335 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f213ed52-3ac3-41c2-8237-580b9b141f5c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 0.607983 Oct 27 10:24:39.059165 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2024/3860] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:38 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:39.076723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:39.077356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: b54c5675-6a87-4213-a858-dd71fc93e9c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:39.114875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:39.115433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.115876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.116592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:39.118027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.118460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.162767 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] HTTP exception thrown: Instance b54c5675-6a87-4213-a858-dd71fc93e9c7 could not be found. Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Request method failure captured: Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 HTTP/1.1 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsu-3_w5LGZIvZif4TTAP6HRONgNGme2C9gImyb4W0g9Upsi7Y2bHorvYIAfIK1OJaF4pOA8nmy8Y4T0BPo3Z6b72CJIADNwIlaiQrBL1QEHegWtPyuQbLI5lnUkUsZwbu1MPjFEe-CeaqflWsbqJ87tWOxBka5KpPfYl0fSmtf6VA Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9067a31bfee345fca080e7621aa60015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9067a31bfee345fca080e7621aa60015", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5fc08f1ad238424896dcefb0fa0b20c5 Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b54c5675-6a87-4213-a858-dd71fc93e9c7 could not be found. Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b54c5675-6a87-4213-a858-dd71fc93e9c7'} Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54c5675-6a87-4213-a858-dd71fc93e9c7 could not be found. Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54c5675-6a87-4213-a858-dd71fc93e9c7 could not be found. Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:39.165676 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54c5675-6a87-4213-a858-dd71fc93e9c7 could not be found. Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Returning 404 to user: Instance b54c5675-6a87-4213-a858-dd71fc93e9c7 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bedd7322-31b9-41ee-a6dd-c300d694235e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7" status: 404 len: 111 microversion: 2.1 time: 0.105896 Oct 27 10:24:39.170545 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2025/3861] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:39 2022] GET /compute/v2.1/servers/b54c5675-6a87-4213-a858-dd71fc93e9c7 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:39.180094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-88fda818-335a-4f29-858f-9d79447be0ac req-e09d3cdc-09fc-4085-866e-945262113b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "826e3d51-19ca-436c-9a76-33e12444508d", "tag": "31c4acab-36cb-4fc6-b011-f7ee980934c3"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:39.211968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-88fda818-335a-4f29-858f-9d79447be0ac req-e09d3cdc-09fc-4085-866e-945262113b95 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:39.213254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-88fda818-335a-4f29-858f-9d79447be0ac req-e09d3cdc-09fc-4085-866e-945262113b95 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.213714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-88fda818-335a-4f29-858f-9d79447be0ac req-e09d3cdc-09fc-4085-866e-945262113b95 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.249387 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-88fda818-335a-4f29-858f-9d79447be0ac req-e09d3cdc-09fc-4085-866e-945262113b95 service nova] Creating event network-changed:31c4acab-36cb-4fc6-b011-f7ee980934c3 for instance 826e3d51-19ca-436c-9a76-33e12444508d on n-h2-854663-10 Oct 27 10:24:39.261364 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-88fda818-335a-4f29-858f-9d79447be0ac req-e09d3cdc-09fc-4085-866e-945262113b95 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088225 Oct 27 10:24:39.270615 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2026/3862] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:39.277404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:39.290823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:39.308532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:39.309419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.310036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.311686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:39.312324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.312966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.499584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:39.534406 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7061bdf1-f896-43e7-acf4-cf8058782fe1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.579615 Oct 27 10:24:39.535897 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1837/3863] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:38 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:39.548490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:39.551224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:39.570826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:39.571331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.571764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.573041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:39.573711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.574650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.831451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:39.840975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b30c1496-dc67-4a88-b870-3c85570e8a36 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.303123 Oct 27 10:24:39.857604 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1838/3864] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:39 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:39.865482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5848d35b-3f7c-43a8-a48c-1e845a10a4dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '.version_select at 0x7f6d5a674c10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:39.890316 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5848d35b-3f7c-43a8-a48c-1e845a10a4dd tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734995899" status: 202 len: 0 microversion: 2.1 time: 0.029231 Oct 27 10:24:39.891454 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1839/3865] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:24:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734995899 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:24:39.903102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:39.904510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:39.915665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:39.916739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.917946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.919217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:39.919884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:39.920510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:39.944366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:39.953261 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f34952c-e003-4dcf-a3cb-acc8c3d7d8cb tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1317 microversion: 2.1 time: 0.680097 Oct 27 10:24:39.959163 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2027/3866] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:39 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:40.069944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:40.070623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:40.088252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:40.088851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:40.089557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:40.091014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:40.091972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:40.092834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:40.172151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:40.199190 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec0cb05c-600b-43fc-adbe-f8b29ecb07ea tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1307 microversion: 2.1 time: 0.302037 Oct 27 10:24:40.201466 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1840/3867] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:39 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1307 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:40.388718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:40.418955 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f2c2dfa-ef15-43e2-b294-ab880bc0a7cb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 0.354781 Oct 27 10:24:40.419845 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2028/3868] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:40 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:40.489120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4974fe1f-6a94-43ba-b9c3-0accaf218f71 req-bc641e6d-12f4-4b5a-bebc-ebf8fbeeb9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4d5987-7e66-4029-a235-894334151d30", "name": "network-vif-plugged", "status": "completed", "tag": "728f35fa-6941-4935-814d-4337c8eca41b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:40.515236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4974fe1f-6a94-43ba-b9c3-0accaf218f71 req-bc641e6d-12f4-4b5a-bebc-ebf8fbeeb9c4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:40.515947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4974fe1f-6a94-43ba-b9c3-0accaf218f71 req-bc641e6d-12f4-4b5a-bebc-ebf8fbeeb9c4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:40.519887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4974fe1f-6a94-43ba-b9c3-0accaf218f71 req-bc641e6d-12f4-4b5a-bebc-ebf8fbeeb9c4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:40.534257 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4974fe1f-6a94-43ba-b9c3-0accaf218f71 req-bc641e6d-12f4-4b5a-bebc-ebf8fbeeb9c4 service nova] Creating event network-vif-plugged:728f35fa-6941-4935-814d-4337c8eca41b for instance 3e4d5987-7e66-4029-a235-894334151d30 on n-h1-854663-10 Oct 27 10:24:40.540325 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4974fe1f-6a94-43ba-b9c3-0accaf218f71 req-bc641e6d-12f4-4b5a-bebc-ebf8fbeeb9c4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054340 Oct 27 10:24:40.541564 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1841/3869] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:40.563472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:40.564213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:40.582411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:40.584857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:40.588354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:40.590093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:40.591945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:40.592578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:40.865471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:40.866151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:40.878857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:40.878857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:40.878857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:40.879424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:40.905491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:40.909093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:40.909545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:40.916436 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff51a9e5-6bdc-42c1-b662-8f760b9ed3a9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.357467 Oct 27 10:24:40.933971 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2029/3870] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:40 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:41.024062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:41.025692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:41.071544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.072160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.072795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.073652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.074218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.074540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.270819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:41.282609 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12ee9607-1796-48ef-8558-798a0f45823e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.421402 Oct 27 10:24:41.286490 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1842/3871] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:40 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:41.305299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:41.309180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:41.332495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:41.336598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.337189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.340069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.340267 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3dbb9f6-1b03-44ac-b61c-69b45f66f7e8 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 200 len: 1504 microversion: 2.1 time: 0.324778 Oct 27 10:24:41.352432 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2030/3872] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:41 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:41.354138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.354985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.360857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.378591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:41.381745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 3841656a-1e90-4c6a-a779-9200eebbbcc8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:41.395375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.396186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.396932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.397910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.398586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.399226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.715844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:41.730684 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-374fc9fe-7ddf-4cd7-bc7d-3e4712036f92 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1307 microversion: 2.1 time: 0.440092 Oct 27 10:24:41.731281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1843/3873] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:41 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1307 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:41.739863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:41.742839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:41.744465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:41.751693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.752531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.753160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.754301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.754916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.755267 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05469d7d-942b-4c7f-a61d-b11f7fb323f7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8" status: 200 len: 1505 microversion: 2.1 time: 0.388195 Oct 27 10:24:41.755698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.767297 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2031/3874] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:41 2022] GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:41.783547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:41.784047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 3841656a-1e90-4c6a-a779-9200eebbbcc8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:41.809700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.810651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.811273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.812237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:41.812912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:41.813519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:41.861160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 3841656a-1e90-4c6a-a779-9200eebbbcc8] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:41.881314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:41.950022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:41.971703 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1354726d-2ff2-4c20-84d0-1e91f7066712 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1319 microversion: 2.1 time: 0.238263 Oct 27 10:24:41.972967 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1844/3875] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:41 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:41.991870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:41.996040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:42.016279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.017205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.018240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.020699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.021452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.024714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.065218 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8023dc14-8c68-4953-a630-974c5f26b3e9 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8" status: 204 len: 0 microversion: 2.1 time: 0.285374 Oct 27 10:24:42.067865 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2032/3876] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:41 2022] DELETE /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:42.078941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:42.080230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:42.114402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.115217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.115680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.117262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.118977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.120058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.222277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:42.340227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:42.365042 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1510c4e7-cf9e-4f73-bd8c-40fd2fed516d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.384272 Oct 27 10:24:42.376694 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1845/3877] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:41 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:42.390055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:42.394150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:42.404776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.405148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.405586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.406305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.406755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.407177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.462117 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10a80907-ba2e-41b3-a4ba-11e21e778de7 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "DELETE /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 204 len: 0 microversion: 2.1 time: 0.389314 Oct 27 10:24:42.467685 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2033/3878] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:42 2022] DELETE /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:24:42.477036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:42.481559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 3841656a-1e90-4c6a-a779-9200eebbbcc8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:42.492819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.493354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.493888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.494604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.495055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.495604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.902569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:42.911897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ebee8422-b893-4c4d-9827-ae1737a3603f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.535076 Oct 27 10:24:42.916705 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1846/3879] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:42 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:42.927870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:42.929260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:42.948971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.950904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.954324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.955520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:42.956174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:42.956839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:42.982471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:42.998377 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b20503c2-29c4-4d64-b796-5631a3916eea tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8" status: 200 len: 1511 microversion: 2.1 time: 0.528949 Oct 27 10:24:43.012719 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2034/3880] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:42 2022] GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8 => generated 1511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:43.022360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:43.026487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:43.051078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.051570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.052015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:43.052749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.053208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.053956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:43.256647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:43.269735 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0bf8809b-562e-4932-9f4c-8b2d11532b6a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1307 microversion: 2.1 time: 0.351561 Oct 27 10:24:43.275311 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1847/3881] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:42 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1307 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:43.359212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:43.367855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e542ad58-1c0b-470b-bac7-5d7269098d84 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1511 microversion: 2.1 time: 0.365002 Oct 27 10:24:43.376701 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2035/3882] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:43 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:43.399874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:43.400128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:43.400743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:43.401313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:43.408496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.409331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.409771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:43.410802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.411292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.411758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:43.412563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.413041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.413973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:43.426581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.427097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.427554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:43.712091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:43.722405 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab22f423-8141-436a-b0b2-d8a6c439926e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1513 microversion: 2.1 time: 0.327704 Oct 27 10:24:43.723008 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2036/3883] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:43 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1513 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:43.748033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:43.750220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:43.759562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.760596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.761640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:43.762758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.763484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.764169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:43.806191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:43.847155 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e9ab2ba0-2aca-4bcf-ae5c-ba15c9854d1f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.452401 Oct 27 10:24:43.847952 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1848/3884] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:43 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:43.942844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:43.943846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:43.960980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.961480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.961901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:43.962624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:43.963078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:43.973698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.119376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:44.138721 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4e80466-2571-455f-a0ab-989d7e402ae9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f" status: 200 len: 1508 microversion: 2.1 time: 0.394959 Oct 27 10:24:44.140354 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2037/3885] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:43 2022] GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:44.165449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:44.166910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 3841656a-1e90-4c6a-a779-9200eebbbcc8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:44.176361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.177272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.177971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.179372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.183024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.183947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.242963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:44.253220 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb897764-e6dc-41aa-a939-0cb6811784e5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.316790 Oct 27 10:24:44.262405 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1849/3886] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:43 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:44.283479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:44.300150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:44.305769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:44.322052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.322915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.323644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.324777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.325490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.326135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.479412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:44.497475 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2bf181fa-2291-40cb-83b0-2087053aab3c tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8" status: 200 len: 1511 microversion: 2.1 time: 0.344203 Oct 27 10:24:44.498322 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2038/3887] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:44 2022] GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8 => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:44.503120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:44.503986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:44.510211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:24:44.515679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.521596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.522607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.524187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.524892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.525528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.638794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:44.647806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.648650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.649327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.790160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:44.806061 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2612e98d-3fa4-4e44-9ee5-68d1cd5dac23 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1307 microversion: 2.1 time: 0.306177 Oct 27 10:24:44.819574 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2039/3888] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:44 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:44.837118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3d630a31-3473-4c7a-a77f-1be3f72abed7 req-bb3a176e-2b05-42cc-bf3f-f6a862c7c6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826e3d51-19ca-436c-9a76-33e12444508d", "name": "network-vif-plugged", "status": "completed", "tag": "31c4acab-36cb-4fc6-b011-f7ee980934c3"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:44.858783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3d630a31-3473-4c7a-a77f-1be3f72abed7 req-bb3a176e-2b05-42cc-bf3f-f6a862c7c6e2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.859256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3d630a31-3473-4c7a-a77f-1be3f72abed7 req-bb3a176e-2b05-42cc-bf3f-f6a862c7c6e2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.859688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3d630a31-3473-4c7a-a77f-1be3f72abed7 req-bb3a176e-2b05-42cc-bf3f-f6a862c7c6e2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.894025 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3d630a31-3473-4c7a-a77f-1be3f72abed7 req-bb3a176e-2b05-42cc-bf3f-f6a862c7c6e2 service nova] Creating event network-vif-plugged:31c4acab-36cb-4fc6-b011-f7ee980934c3 for instance 826e3d51-19ca-436c-9a76-33e12444508d on n-h2-854663-10 Oct 27 10:24:44.902685 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3d630a31-3473-4c7a-a77f-1be3f72abed7 req-bb3a176e-2b05-42cc-bf3f-f6a862c7c6e2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076440 Oct 27 10:24:44.916268 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2040/3889] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:44.937499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:44.943836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:44.965809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.967809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.969709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:44.976061 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fde87080-e38f-44cf-8d9b-61e6c9b33c43 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.712457 Oct 27 10:24:44.977257 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1850/3890] 10.222.0.76 () {58 vars in 1167 bytes} [Thu Oct 27 10:24:44 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:44.979266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:44.981538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:44.982185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:45.008733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:45.014346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:45.017480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1464701169', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:45.038868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:45.039612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:45.041116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:45.047266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:45.048004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:45.048610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:45.284592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:24:45.605087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:45.624431 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67a25afb-b97a-4ea0-a236-6904690da33f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.700447 Oct 27 10:24:45.625330 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2041/3891] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:44 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:45.630477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:45.631325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:45.633953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:45.640932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:45.641700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:45.642321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:45.643209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:45.643825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:45.644546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:45.842969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:45.857467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:45.866449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:45.867867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:45.869303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:46.099743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:46.119335 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7aa99713-4939-4466-b516-a8550a9d96d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.492335 Oct 27 10:24:46.136008 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2042/3892] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:45 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:46.141989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:46.142859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 3841656a-1e90-4c6a-a779-9200eebbbcc8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:46.159015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:46.161413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:46.161951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:46.162885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:46.165978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:46.166673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:46.337490 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a269e625-2032-4374-a5ad-7374f601d200 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1464701169" status: 200 len: 1516 microversion: 2.1 time: 1.339586 Oct 27 10:24:46.338167 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1851/3893] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:24:44 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1464701169 => generated 1516 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:46.357406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:46.358533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:46.403846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:46.422830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:46.424510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:46.431345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:46.436379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:46.437338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:46.609218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:46.624088 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6312be2-22b9-4cf0-adeb-ac651aa22517 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8" status: 200 len: 1511 microversion: 2.1 time: 0.486699 Oct 27 10:24:46.627620 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2043/3894] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:46 2022] GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8 => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:46.642408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-fa860b45-e0fb-418d-9069-7b6634879f8e req-9a47d9c2-d4d0-49e4-9d59-afdae200296b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04983eac-8861-47ff-9a90-a53c22f6e316", "name": "network-vif-deleted", "tag": "bd3c1065-ba6d-430b-8fb1-59b1268a09cb"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:46.682097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa860b45-e0fb-418d-9069-7b6634879f8e req-9a47d9c2-d4d0-49e4-9d59-afdae200296b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:46.683010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa860b45-e0fb-418d-9069-7b6634879f8e req-9a47d9c2-d4d0-49e4-9d59-afdae200296b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:46.685659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fa860b45-e0fb-418d-9069-7b6634879f8e req-9a47d9c2-d4d0-49e4-9d59-afdae200296b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:46.717973 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-fa860b45-e0fb-418d-9069-7b6634879f8e req-9a47d9c2-d4d0-49e4-9d59-afdae200296b service nova] Creating event network-vif-deleted:bd3c1065-ba6d-430b-8fb1-59b1268a09cb for instance 04983eac-8861-47ff-9a90-a53c22f6e316 on n-h1-854663-10 Oct 27 10:24:46.726263 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-fa860b45-e0fb-418d-9069-7b6634879f8e req-9a47d9c2-d4d0-49e4-9d59-afdae200296b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097213 Oct 27 10:24:46.732922 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2044/3895] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:46.738357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:46.754587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:46.760017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:46.770482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:46.774968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:46.777599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:46.778655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:46.781303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:46.782065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:47.023844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:24:47.113333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:47.128455 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea41a528-7c4a-4e43-979c-766eb5709172 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1307 microversion: 2.1 time: 0.777404 Oct 27 10:24:47.129802 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1852/3896] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:46 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1307 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:47.144566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:47.145716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:47.156879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:47.157040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:47.158282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:47.158917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:47.159792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:47.163674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:47.165022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:47.187419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:47.192861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:47.193560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:47.612006 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-49ee593a-d7e6-4ebf-8979-42b1bcd32d9a tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.877128 Oct 27 10:24:47.613067 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2045/3897] 10.222.0.76 () {58 vars in 1173 bytes} [Thu Oct 27 10:24:46 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:47.632375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:47.641428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:47.652189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:47.663506 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dba75965-c47e-4cf8-b706-dbc12a89701b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.532172 Oct 27 10:24:47.664608 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1853/3898] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:47 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:47.673778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:47.674704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:47.675822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:47.676813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:47.677439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:47.679605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:47.689500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ed8c6db4-e793-4f56-9fee-2c6b38de7809 req-c0cf4210-a43e-486a-95c1-244dac2f9b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3841656a-1e90-4c6a-a779-9200eebbbcc8", "name": "network-vif-deleted", "tag": "a17862bd-07be-422c-b2f7-76426e7841b5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:47.703696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ed8c6db4-e793-4f56-9fee-2c6b38de7809 req-c0cf4210-a43e-486a-95c1-244dac2f9b24 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:47.704997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ed8c6db4-e793-4f56-9fee-2c6b38de7809 req-c0cf4210-a43e-486a-95c1-244dac2f9b24 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:47.706082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ed8c6db4-e793-4f56-9fee-2c6b38de7809 req-c0cf4210-a43e-486a-95c1-244dac2f9b24 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:47.737815 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ed8c6db4-e793-4f56-9fee-2c6b38de7809 req-c0cf4210-a43e-486a-95c1-244dac2f9b24 service nova] Creating event network-vif-deleted:a17862bd-07be-422c-b2f7-76426e7841b5 for instance 3841656a-1e90-4c6a-a779-9200eebbbcc8 on n-h1-854663-10 Oct 27 10:24:47.756247 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ed8c6db4-e793-4f56-9fee-2c6b38de7809 req-c0cf4210-a43e-486a-95c1-244dac2f9b24 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070788 Oct 27 10:24:47.762703 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1854/3899] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:47.783988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:47.809117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:47.809563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.compute.servers [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Removing options 'limit' from query {{(pid=120719) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 10:24:47.810445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:47.831454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:47.832480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:47.833490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:47.834955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:47.835732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:47.836335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:47.927981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:47.943770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:47.944510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:47.945131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.063808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:48.066438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:48.079602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af8e91a1-31b7-48c6-872c-814ec089622c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.452902 Oct 27 10:24:48.080125 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2046/3900] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:47 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:48.096907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:48.100612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 3841656a-1e90-4c6a-a779-9200eebbbcc8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:48.116173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.118030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.119523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.120845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.123882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.124535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.160443 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-51977362-6aff-41ce-8410-a4f3e9879a74 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.395730 Oct 27 10:24:48.170033 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1855/3901] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 10:24:47 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:48.176746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:48.177910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:48.187385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.188253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.189053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.190008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.190801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.192410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.221552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.222118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.222743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.223196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lazy-loading 'fault' on Instance uuid 3841656a-1e90-4c6a-a779-9200eebbbcc8 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:24:48.364776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1aeed31ae4f13a19bb57be589385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36d1d526c1349128590dc6fc4578fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:48.392078 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c312a63-1c62-4780-8eaa-e945a5d8587f tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8" status: 200 len: 1307 microversion: 2.1 time: 0.309879 Oct 27 10:24:48.407371 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2047/3902] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:48 2022] GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8 => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:48.427966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:48.439133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:48.440144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:48.446837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.447328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.447784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.448829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.449371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.450251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.661314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:24:48.662104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:48.700510 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-351e2067-e4f7-4589-a2cc-22baedf888c4 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1487 microversion: 2.1 time: 0.534447 Oct 27 10:24:48.703095 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1856/3903] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:48 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1487 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:48.719637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:48.720892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:48.737269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.738026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.738999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.739911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.740593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.741860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.815420 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cdb5288b-6ab6-4829-88fc-4d83833f7f80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?status=active" status: 200 len: 1006 microversion: 2.1 time: 0.401078 Oct 27 10:24:48.816602 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2048/3904] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:24:48 2022] GET /compute/v2.1/servers?status=active => generated 1006 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:48.822040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d0cda471-70b4-4a49-9166-f42b2925a6d9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-711740301"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:48.825005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d0cda471-70b4-4a49-9166-f42b2925a6d9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:48.832025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cda471-70b4-4a49-9166-f42b2925a6d9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.832922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cda471-70b4-4a49-9166-f42b2925a6d9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.833542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cda471-70b4-4a49-9166-f42b2925a6d9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:48.834517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cda471-70b4-4a49-9166-f42b2925a6d9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:48.835205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cda471-70b4-4a49-9166-f42b2925a6d9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:48.835801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0cda471-70b4-4a49-9166-f42b2925a6d9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.107987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:49.131861 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fdaaf2d-94aa-4831-85d7-c31d0ced189c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.422788 Oct 27 10:24:49.135384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1857/3905] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:48 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:49.153018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:49.171011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:49.172334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.compute.servers [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Removing options 'limit' from query {{(pid=120719) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 10:24:49.175484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:49.201228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.201629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.202112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.204831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.205563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.208284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.276214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:24:49.336744 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-edb14b47-313f-4750-8d30-601550a67024 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1006 microversion: 2.1 time: 0.199604 Oct 27 10:24:49.355337 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d0cda471-70b4-4a49-9166-f42b2925a6d9 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "POST /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d/action" status: 202 len: 0 microversion: 2.1 time: 0.535313 Oct 27 10:24:49.356021 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2049/3906] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:24:48 2022] POST /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:24:49.360432 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1858/3907] 10.222.0.76 () {58 vars in 1150 bytes} [Thu Oct 27 10:24:49 2022] GET /compute/v2.1/servers?limit=100000 => generated 1006 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:49.372082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:49.387543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:49.388525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:49.388740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:49.402358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.403155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.403702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.414752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.415923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.417843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.417952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:49.438712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.439219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.439657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.440390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.440867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.441287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.509471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:24:49.574302 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec2f4e18-6e68-4ec9-903a-c5aca01eab7f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 1006 microversion: 2.1 time: 0.209371 Oct 27 10:24:49.575031 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1859/3908] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:24:49 2022] GET /compute/v2.1/servers => generated 1006 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:49.591995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2b0fcab-39db-40fb-b5e3-e36a8e8d3a88 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5b3d90d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:49.673751 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e2b0fcab-39db-40fb-b5e3-e36a8e8d3a88 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891" status: 200 len: 1411 microversion: 2.1 time: 0.087111 Oct 27 10:24:49.674727 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1860/3909] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:24:49 2022] GET /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891 => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:49.687013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:49.687836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 3841656a-1e90-4c6a-a779-9200eebbbcc8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:49.714587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.718070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.718799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.720792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.723728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.723883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:49.724967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.735318 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-712cdd33-5095-4ecd-9abc-0bd6f1894322 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.363849 Oct 27 10:24:49.735599 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2050/3910] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:49 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:49.758879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:49.771387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:49.772263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:49.775916 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] HTTP exception thrown: Instance 3841656a-1e90-4c6a-a779-9200eebbbcc8 could not be found. Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Request method failure captured: Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8 HTTP/1.1 Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlwic9pc4RzqJD3ZSMaNJ_ekAe3Y-m9a343vaBXV-7As_NfjfpzRFEi8skcawcC7w-pCJmakI8c-jKQJQD4a28uPX-li4CpAEGi4YIJKDiiCcb1C8tCpQSsNGJoyi9L1nR78Fwkm75CLurN_KSNWfNHddB5XKTkNb1Tq1dJMAXa7C3k Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: b36d1d526c1349128590dc6fc4578fa8 Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-MultipleCreateTestJSON-852287729 Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b36d1d526c1349128590dc6fc4578fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b36d1d526c1349128590dc6fc4578fa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b36d1d526c1349128590dc6fc4578fa8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b36d1d526c1349128590dc6fc4578fa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-MultipleCreateTestJSON-852287729 Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: b36d1d526c1349128590dc6fc4578fa8 Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-MultipleCreateTestJSON-852287729 Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-MultipleCreateTestJSON-852287729-project Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 53b1aeed31ae4f13a19bb57be589385e Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-MultipleCreateTestJSON-852287729-project Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 3841656a-1e90-4c6a-a779-9200eebbbcc8 could not be found. Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '3841656a-1e90-4c6a-a779-9200eebbbcc8'} Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3841656a-1e90-4c6a-a779-9200eebbbcc8 could not be found. Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3841656a-1e90-4c6a-a779-9200eebbbcc8 could not be found. Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:49.783715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:49.789887 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:49.789887 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:49.789887 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:49.789887 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:49.789887 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:49.789887 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3841656a-1e90-4c6a-a779-9200eebbbcc8 could not be found. Oct 27 10:24:49.789887 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:49.793554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Returning 404 to user: Instance 3841656a-1e90-4c6a-a779-9200eebbbcc8 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:49.796100 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-66d077a7-97b9-4c57-aa78-1e797c41b098 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8" status: 404 len: 111 microversion: 2.1 time: 0.118550 Oct 27 10:24:49.799589 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1861/3911] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:49 2022] GET /compute/v2.1/servers/3841656a-1e90-4c6a-a779-9200eebbbcc8 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:49.822765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.826803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.827254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.831681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.832189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.832687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.832930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ef95af7-88c5-413f-bf62-46b2cb72b86f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a65d1f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:49.915459 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ef95af7-88c5-413f-bf62-46b2cb72b86f tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891" status: 200 len: 1411 microversion: 2.1 time: 0.114219 Oct 27 10:24:49.916355 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1862/3912] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:24:49 2022] GET /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891 => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:49.924621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:49.925272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] [instance: 04983eac-8861-47ff-9a90-a53c22f6e316] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:49.934132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.934794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.935239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.935952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:49.939057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:49.940404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:49.988881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:24:49.994864 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] HTTP exception thrown: Instance 04983eac-8861-47ff-9a90-a53c22f6e316 could not be found. Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Request method failure captured: Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 HTTP/1.1 Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlwic9pc4RzqJD3ZSMaNJ_ekAe3Y-m9a343vaBXV-7As_NfjfpzRFEi8skcawcC7w-pCJmakI8c-jKQJQD4a28uPX-li4CpAEGi4YIJKDiiCcb1C8tCpQSsNGJoyi9L1nR78Fwkm75CLurN_KSNWfNHddB5XKTkNb1Tq1dJMAXa7C3k Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: b36d1d526c1349128590dc6fc4578fa8 Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-MultipleCreateTestJSON-852287729 Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b36d1d526c1349128590dc6fc4578fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b36d1d526c1349128590dc6fc4578fa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b36d1d526c1349128590dc6fc4578fa8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b36d1d526c1349128590dc6fc4578fa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-MultipleCreateTestJSON-852287729 Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: b36d1d526c1349128590dc6fc4578fa8 Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-MultipleCreateTestJSON-852287729 Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-MultipleCreateTestJSON-852287729-project Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 53b1aeed31ae4f13a19bb57be589385e Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-MultipleCreateTestJSON-852287729-project Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 04983eac-8861-47ff-9a90-a53c22f6e316 could not be found. Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '04983eac-8861-47ff-9a90-a53c22f6e316'} Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04983eac-8861-47ff-9a90-a53c22f6e316 could not be found. Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04983eac-8861-47ff-9a90-a53c22f6e316 could not be found. Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:49.996771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:50.004445 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:50.004445 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:50.004445 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:50.004445 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:50.004445 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:50.004445 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04983eac-8861-47ff-9a90-a53c22f6e316 could not be found. Oct 27 10:24:50.004445 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:24:50.007277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] Returning 404 to user: Instance 04983eac-8861-47ff-9a90-a53c22f6e316 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:50.008432 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95f65de3-1815-4ad9-be92-4f93edfbd600 tempest-MultipleCreateTestJSON-852287729 tempest-MultipleCreateTestJSON-852287729-project] 10.222.0.76 "GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316" status: 404 len: 111 microversion: 2.1 time: 0.089390 Oct 27 10:24:50.014613 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1863/3913] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:49 2022] GET /compute/v2.1/servers/04983eac-8861-47ff-9a90-a53c22f6e316 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:24:50.023180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5badaebc-976a-4c00-acdb-61e045031a7d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5ace8040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:50.131322 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-031c3e91-6380-4acf-8744-00473067144f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.394610 Oct 27 10:24:50.140817 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2051/3914] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:24:49 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:50.150658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:50.156613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:50.190015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.servers [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Removing options 'limit' from query {{(pid=120720) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 10:24:50.192300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:50.213423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.220549 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5badaebc-976a-4c00-acdb-61e045031a7d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891" status: 204 len: 0 microversion: 2.1 time: 0.203980 Oct 27 10:24:50.221441 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1864/3915] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:50 2022] DELETE /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:50.226220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.226551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:50.227128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.227262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:50.228868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.229608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.230882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.234340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:50.250727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.251236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.255110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.256138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.256621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.260431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.274925 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e82365e3-ea68-4667-9838-07d4ed6599f3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.128534 Oct 27 10:24:50.276414 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2052/3916] 10.222.0.76 () {58 vars in 1140 bytes} [Thu Oct 27 10:24:50 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:50.291576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6f5741d-7567-4311-9d9b-403483b640f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a889790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:50.316048 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-d6f5741d-7567-4311-9d9b-403483b640f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Image not found. Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6f5741d-7567-4311-9d9b-403483b640f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891 HTTP/1.1 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'e5d478d7-eda1-4dbd-9618-9c426223e891'} Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e5d478d7-eda1-4dbd-9618-9c426223e891 Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 10:24:50.318906 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5d478d7-eda1-4dbd-9618-9c426223e891 could not be found. Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6f5741d-7567-4311-9d9b-403483b640f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6f5741d-7567-4311-9d9b-403483b640f8 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891" status: 404 len: 62 microversion: 2.1 time: 0.042351 Oct 27 10:24:50.326569 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2053/3917] 10.222.0.76 () {58 vars in 1233 bytes} [Thu Oct 27 10:24:50 2022] GET /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:24:50.333159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:50.337964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:50.338745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1464701169', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:24:50.346016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.346506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.347101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.347996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.348521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.348987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.494084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:24:50.577896 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bca97f9-5181-459d-a39c-cde90ae93c7c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1464701169" status: 200 len: 346 microversion: 2.1 time: 0.251576 Oct 27 10:24:50.589724 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2054/3918] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 10:24:50 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1464701169 => generated 346 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:50.599881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:50.602544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:50.603204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:50.615385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.615626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b93c8c10-fae3-46b9-849f-59393b41bebe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.392691 Oct 27 10:24:50.615873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.617017 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1865/3919] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:50 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:50.621056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.622085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.622581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.623021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.629507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c210f250-9dbb-4c66-a63a-58f6d1f46dad tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:50.641358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c210f250-9dbb-4c66-a63a-58f6d1f46dad tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.653463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c210f250-9dbb-4c66-a63a-58f6d1f46dad tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.654282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c210f250-9dbb-4c66-a63a-58f6d1f46dad tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.695694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c210f250-9dbb-4c66-a63a-58f6d1f46dad tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Going to try to stop instance {{(pid=120719) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:24:50.783976 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c210f250-9dbb-4c66-a63a-58f6d1f46dad tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "POST /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c/action" status: 202 len: 0 microversion: 2.1 time: 0.162355 Oct 27 10:24:50.784842 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1866/3920] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:24:50 2022] POST /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:24:50.848323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:50.849072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:50.862440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.863337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.863949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.865357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.865793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.866228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.891100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:50.910776 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39c963e7-dc64-419d-8d5e-6a4a9c446daf tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1505 microversion: 2.1 time: 0.314326 Oct 27 10:24:50.927685 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2055/3921] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:50 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:50.936149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:50.937993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:50.952639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.953121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.953571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:50.954286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:50.954795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:50.955178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:51.281053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:51.293534 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6e0e4c5-41de-43d2-9e0f-98154f718846 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.466371 Oct 27 10:24:51.297339 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1867/3922] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:50 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:51.645826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:51.647200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:51.655475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:51.656405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:51.657755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:51.658702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:51.659355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:51.659954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:51.822964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:51.844692 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c01d42d1-9688-4daa-8655-35b60b206a77 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.916864 Oct 27 10:24:51.847576 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2056/3923] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:50 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:51.945425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:51.947029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:51.965547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:51.967528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:51.968507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:51.969555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:51.971322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:51.971999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:52.062742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:52.076045 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ebbae75a-69cd-4297-8006-9f419afdd551 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.434984 Oct 27 10:24:52.076640 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1868/3924] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:51 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:52.334756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:52.335416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:52.347692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:52.358865 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b4bd7ed-3493-4509-ba1b-eb26f73d58eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1505 microversion: 2.1 time: 0.419689 Oct 27 10:24:52.359492 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2057/3925] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:51 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:52.380987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:52.381792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:52.384261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:52.385625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:52.387071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:52.390603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:52.747831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:52.757344 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b92cf52-bf81-4c8b-b14d-a813c0f06dac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.430685 Oct 27 10:24:52.771917 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1869/3926] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:52 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:52.881406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:52.882282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:52.903835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:52.914441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:52.921090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:52.923692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:52.926504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:52.926991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:53.103343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:53.104221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:53.115236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:53.119146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:53.122895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:53.128082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:53.129144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:53.130883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:53.237246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:53.249325 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7c6f068-d616-4779-a4e4-b35d2d356785 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.374624 Oct 27 10:24:53.251164 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2058/3927] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:52 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:53.266423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:53.269391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:53.282836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:53.283593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:53.284218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:53.285407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:53.286221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:53.289900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:53.356289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:53.550045 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-690091ff-0641-47d0-8782-ab366fb40465 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "DELETE /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 204 len: 0 microversion: 2.1 time: 0.295787 Oct 27 10:24:53.550045 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2059/3928] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:53 2022] DELETE /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:53.564316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:53.565066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:53.586893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:53.587379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:53.587802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:53.589889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:53.590371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:53.599353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:53.599587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:53.618650 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7e927f4-cee6-4094-a6e1-5ff06b1af86c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.513162 Oct 27 10:24:53.619988 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1870/3929] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:53 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:53.627101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:53.634389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:53.664018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:53.666181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:53.668627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:53.672196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:53.676454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:53.680280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:53.680953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:54.128546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:54.150228 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8d77af4-80ac-4872-a1e1-830320e07c84 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1487 microversion: 2.1 time: 0.593267 Oct 27 10:24:54.156103 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2060/3930] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:53 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1487 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:54.181737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:54.186603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:54.215953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:54.217257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:54.219352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:54.221720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:54.226549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:54.231475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:54.314238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:54.325454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:54.334161 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3b4e3fc-d959-4c2d-9980-93a0053dca00 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1508 microversion: 2.1 time: 0.712254 Oct 27 10:24:54.335536 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1871/3931] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:53 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1508 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:54.364731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:54.365632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:54.382268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:54.383488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:54.385008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:54.386970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:54.387996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:54.388686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:54.432635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:54.554026 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38430356-32c5-476a-936e-c166e522910d tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 204 len: 0 microversion: 2.1 time: 0.214510 Oct 27 10:24:54.554854 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1872/3932] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:54 2022] DELETE /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:54.566919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:54.567806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:54.575885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:54.576561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:54.577160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:54.578827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:54.578827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:54.579221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:54.730691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:54.747114 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc1879b7-6b52-463d-bc15-9f18798a471a tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.585663 Oct 27 10:24:54.750730 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2061/3933] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:54 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:54.763451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cd154e17-b698-46b0-b122-19ebbde70301 req-3bab2007-f02e-4a6c-8cf8-977eb3dbd3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826e3d51-19ca-436c-9a76-33e12444508d", "name": "network-vif-plugged", "status": "completed", "tag": "31c4acab-36cb-4fc6-b011-f7ee980934c3"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:54.803925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cd154e17-b698-46b0-b122-19ebbde70301 req-3bab2007-f02e-4a6c-8cf8-977eb3dbd3df service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:54.806121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cd154e17-b698-46b0-b122-19ebbde70301 req-3bab2007-f02e-4a6c-8cf8-977eb3dbd3df service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:54.807832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cd154e17-b698-46b0-b122-19ebbde70301 req-3bab2007-f02e-4a6c-8cf8-977eb3dbd3df service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:54.841696 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cd154e17-b698-46b0-b122-19ebbde70301 req-3bab2007-f02e-4a6c-8cf8-977eb3dbd3df service nova] Creating event network-vif-plugged:31c4acab-36cb-4fc6-b011-f7ee980934c3 for instance 826e3d51-19ca-436c-9a76-33e12444508d on n-h2-854663-10 Oct 27 10:24:54.857651 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cd154e17-b698-46b0-b122-19ebbde70301 req-3bab2007-f02e-4a6c-8cf8-977eb3dbd3df service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105192 Oct 27 10:24:54.859225 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2062/3934] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:54.870266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d7f36bd-8a51-4158-a9a8-a7b33405f167 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5aa160d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:54.907293 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6d7f36bd-8a51-4158-a9a8-a7b33405f167 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Image not found. Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d7f36bd-8a51-4158-a9a8-a7b33405f167 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891 HTTP/1.1 Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'e5d478d7-eda1-4dbd-9618-9c426223e891'} Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e5d478d7-eda1-4dbd-9618-9c426223e891 to delete Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5d478d7-eda1-4dbd-9618-9c426223e891 could not be found. Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:54.909970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:24:54.915326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d7f36bd-8a51-4158-a9a8-a7b33405f167 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:24:54.918672 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d7f36bd-8a51-4158-a9a8-a7b33405f167 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891" status: 404 len: 62 microversion: 2.1 time: 0.056744 Oct 27 10:24:54.920870 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2063/3935] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:54 2022] DELETE /compute/v2.1/images/e5d478d7-eda1-4dbd-9618-9c426223e891 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:24:54.932992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:54.934585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:54.954708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:54.957513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:54.958920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:54.963203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:54.964855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:54.965703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:55.061536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:55.081127 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f92d3ee2-20b1-4d70-8622-1916700950f4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.522933 Oct 27 10:24:55.098520 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1873/3936] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:54 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:55.122941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:55.125335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:55.154045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:55.154549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:55.154993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:55.155732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:55.156190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:55.156617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:55.202082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:55.213789 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94e24e26-f15f-457f-a494-95401f5faa93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.289815 Oct 27 10:24:55.215933 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2064/3937] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:54 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:55.263414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:24:55.366467 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.compute.api [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Instance is already in deleting state, ignoring this request Oct 27 10:24:55.367320 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be38accc-5938-4a8d-afc4-3ae7d907448b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 204 len: 0 microversion: 2.1 time: 0.267319 Oct 27 10:24:55.368091 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1874/3938] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:24:55 2022] DELETE /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:24:55.369827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:55.372465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:55.387303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:55.388006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:55.402369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:55.407537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:55.407852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:55.411124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:55.411637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:55.412086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:55.414666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:55.422076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:55.428232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:55.429884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:55.436584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:55.440712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:55.790698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:55.806893 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-381a7138-ca17-45ad-b0e5-4863f41d8dc7 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1493 microversion: 2.1 time: 0.431020 Oct 27 10:24:55.811358 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1875/3939] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:55 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1493 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:55.818672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:55.826208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:55.842060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:55.844408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:55.845150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:55.846333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:55.847052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:55.847706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:55.857266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:55.866910 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13ba6a9d-1b8f-4e25-b8fd-455ae85cc4d8 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1508 microversion: 2.1 time: 0.507319 Oct 27 10:24:55.881547 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2065/3940] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:55 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1508 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:56.080379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:56.095487 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2de6a051-d06a-42aa-bab9-f177393dc417 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.282682 Oct 27 10:24:56.096021 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1876/3941] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:55 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:56.115473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:56.116103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:56.123398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:56.124183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:56.125088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:56.126069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:56.126524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:56.126970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:56.242676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:56.243571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:56.259578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:56.261182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:56.261972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:56.264897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:56.266808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:56.267351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:56.499115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:56.508407 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba034b9b-7b0e-4fd3-9d6e-2fa28678acaa tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.398226 Oct 27 10:24:56.512707 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2066/3942] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:56 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:56.632944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:56.650789 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-766cc448-d3b8-4b85-b28b-387fc92e6530 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.415073 Oct 27 10:24:56.669091 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1877/3943] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:56 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:56.833368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:56.840716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:56.854503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:56.855076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:56.859326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:56.860765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:56.865347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:56.866023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:56.894659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:56.895780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:56.909581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:56.910078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:56.913131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:56.916160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:56.919395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:56.920759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:57.151691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:57.326312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:57.338361 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-454ac847-1c24-42ca-b39a-b5f632660d2e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1493 microversion: 2.1 time: 0.509571 Oct 27 10:24:57.339019 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2067/3944] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:56 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1493 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:57.357996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:57.359229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:57.374450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:57.375462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:57.377412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:57.379300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:57.381273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:57.383377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:57.420783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:57.435682 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7351bad-4b5a-41c7-a743-fb14041fb874 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1508 microversion: 2.1 time: 0.545959 Oct 27 10:24:57.436828 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1878/3945] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:56 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1508 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:57.542181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:57.543548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:57.559299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:57.563063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:57.563824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:57.565848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:57.566495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:57.567124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:57.638723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:57.660631 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-84c196db-d131-4c86-807e-0501048dd00d tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.315574 Oct 27 10:24:57.661355 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2068/3946] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:57 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:57.684118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:57.686553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:57.717394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:57.717904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:57.718351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:57.719071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:57.719528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:57.719950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:57.881842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:57.898967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe8e80f3-c033-4ce2-8735-d4ed041048c1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.359439 Oct 27 10:24:57.913967 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1879/3947] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:57 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:58.045289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:58.054960 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3a22e00-7d97-4138-b1e5-da731cf28ae3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1679 microversion: 2.1 time: 0.380563 Oct 27 10:24:58.056701 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2069/3948] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:57 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1679 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:24:58.192686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-41bb57e9-ec55-48fa-8cce-d4540b8eeed1 req-c15ae37d-9743-4f31-9266-f5b712ea4ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826e3d51-19ca-436c-9a76-33e12444508d", "name": "network-vif-unplugged", "status": "completed", "tag": "31c4acab-36cb-4fc6-b011-f7ee980934c3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:58.213425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:58.219150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-41bb57e9-ec55-48fa-8cce-d4540b8eeed1 req-c15ae37d-9743-4f31-9266-f5b712ea4ad8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:58.219721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-41bb57e9-ec55-48fa-8cce-d4540b8eeed1 req-c15ae37d-9743-4f31-9266-f5b712ea4ad8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:58.221951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-41bb57e9-ec55-48fa-8cce-d4540b8eeed1 req-c15ae37d-9743-4f31-9266-f5b712ea4ad8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:58.253574 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-41bb57e9-ec55-48fa-8cce-d4540b8eeed1 req-c15ae37d-9743-4f31-9266-f5b712ea4ad8 service nova] Creating event network-vif-unplugged:31c4acab-36cb-4fc6-b011-f7ee980934c3 for instance 826e3d51-19ca-436c-9a76-33e12444508d on n-h2-854663-10 Oct 27 10:24:58.266722 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-41bb57e9-ec55-48fa-8cce-d4540b8eeed1 req-c15ae37d-9743-4f31-9266-f5b712ea4ad8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077681 Oct 27 10:24:58.268995 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1880/3949] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:58.365294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:58.366797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:58.378615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:58.384476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:58.386271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:58.390277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:58.391309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:58.392215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:58.460296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:58.461158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:58.472059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:58.472059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:58.473129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:58.474724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:58.474958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:58.476954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:58.693166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:58.706667 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb8e1e70-3d09-42dc-bb84-4642f9160672 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1493 microversion: 2.1 time: 0.345979 Oct 27 10:24:58.708874 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2070/3950] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:58 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1493 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:58.724177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:58.725287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:58.744026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:58.745565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:58.747219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:58.749506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:58.750235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:58.751205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:59.034104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:59.042797 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c53de520-3f83-4c32-a841-c474a10d6450 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 200 len: 1508 microversion: 2.1 time: 0.586641 Oct 27 10:24:59.060847 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1881/3951] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:58 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 1508 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:59.078697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-867e4fa2-4363-43b4-8ca0-e6d5760c63d9 req-bbb61867-ec3b-4fee-a1da-786187e4ef95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb55bff3-d743-41bf-a855-7405357d6f21", "name": "network-vif-deleted", "tag": "d9b0f266-7b46-4532-95d3-2b1db9fbf625"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:59.095059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-867e4fa2-4363-43b4-8ca0-e6d5760c63d9 req-bbb61867-ec3b-4fee-a1da-786187e4ef95 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:59.095658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-867e4fa2-4363-43b4-8ca0-e6d5760c63d9 req-bbb61867-ec3b-4fee-a1da-786187e4ef95 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:59.096176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-867e4fa2-4363-43b4-8ca0-e6d5760c63d9 req-bbb61867-ec3b-4fee-a1da-786187e4ef95 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:59.132880 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-867e4fa2-4363-43b4-8ca0-e6d5760c63d9 req-bbb61867-ec3b-4fee-a1da-786187e4ef95 service nova] Creating event network-vif-deleted:d9b0f266-7b46-4532-95d3-2b1db9fbf625 for instance bb55bff3-d743-41bf-a855-7405357d6f21 on n-h2-854663-10 Oct 27 10:24:59.139570 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-867e4fa2-4363-43b4-8ca0-e6d5760c63d9 req-bbb61867-ec3b-4fee-a1da-786187e4ef95 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077268 Oct 27 10:24:59.145340 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1882/3952] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:59.172151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:59.172962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:59.186796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:59.187695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:59.188453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:59.189565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:59.190024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:59.190490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:59.225389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:59.244379 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18598404-d65a-4997-a1b5-83d99c821b32 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.531989 Oct 27 10:24:59.245171 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2071/3953] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:58 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:59.252123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:59.267063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:59.287869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:59.292017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:59.292637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:59.293496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:59.293956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:59.297792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:59.476041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:24:59.649213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:59.659485 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c79041e-1c6f-49d3-9dd1-fe4084370ff8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.411031 Oct 27 10:24:59.660186 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2072/3954] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:59 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:59.671791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:59.685261 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bdb97cb8-cca3-4b78-bb39-7ab5d36a7d34 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.538432 Oct 27 10:24:59.686180 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1883/3955] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:59 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:24:59.735559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:59.736264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:59.743412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:59.744655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:59.744655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:59.745597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:59.746583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:59.747127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:59.780258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:59.781059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:59.781494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:59.782108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lazy-loading 'fault' on Instance uuid 826e3d51-19ca-436c-9a76-33e12444508d {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:24:59.836222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:59.846234 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30611c25-9cc9-4d7c-8d44-e5cf69686101 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1297 microversion: 2.1 time: 0.115221 Oct 27 10:24:59.847425 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2073/3956] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:59 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1297 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:00.081624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:00.082175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: bb55bff3-d743-41bf-a855-7405357d6f21] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:00.116851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.119280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.120026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.122888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.123660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.124206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.147853 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] HTTP exception thrown: Instance bb55bff3-d743-41bf-a855-7405357d6f21 could not be found. Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Request method failure captured: Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 HTTP/1.1 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsu-3_w5LGZIvZif4TTAP6HRONgNGme2C9gImyb4W0g9Upsi7Y2bHorvYIAfIK1OJaF4pOA8nmy8Y4T0BPo3Z6b72CJIADNwIlaiQrBL1QEHegWtPyuQbLI5lnUkUsZwbu1MPjFEe-CeaqflWsbqJ87tWOxBka5KpPfYl0fSmtf6VA Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9067a31bfee345fca080e7621aa60015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9067a31bfee345fca080e7621aa60015", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5fc08f1ad238424896dcefb0fa0b20c5 Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance bb55bff3-d743-41bf-a855-7405357d6f21 could not be found. Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'bb55bff3-d743-41bf-a855-7405357d6f21'} Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb55bff3-d743-41bf-a855-7405357d6f21 could not be found. Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb55bff3-d743-41bf-a855-7405357d6f21 could not be found. Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:00.150438 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb55bff3-d743-41bf-a855-7405357d6f21 could not be found. Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Returning 404 to user: Instance bb55bff3-d743-41bf-a855-7405357d6f21 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1257daae-51cd-4ddf-aa29-e44f92c8461e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21" status: 404 len: 111 microversion: 2.1 time: 0.078543 Oct 27 10:25:00.155653 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1884/3957] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:00 2022] GET /compute/v2.1/servers/bb55bff3-d743-41bf-a855-7405357d6f21 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:00.162799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:00.164139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:00.173915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.174463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.175721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.176780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.178856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.182018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.221306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:25:00.277375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:00.279639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:00.288257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.288832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.289556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.290472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.291191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.291791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.332774 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7331dd6-d738-4c70-9c14-3501e03bed0c tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 204 len: 0 microversion: 2.1 time: 0.173693 Oct 27 10:25:00.334297 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2074/3958] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:00 2022] DELETE /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:00.343690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:00.345284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:00.352805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.353287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.353868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.354659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.355281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.355977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.398836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:00.611531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:00.620388 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7bcfdf25-f625-4e85-adbe-6dc766ffd7f8 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.349709 Oct 27 10:25:00.621247 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1885/3959] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:00 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:00.670890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:00.679682 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f2368af-5a35-4720-921a-86a4eb0bca0e tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.340676 Oct 27 10:25:00.680415 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2075/3960] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:00 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:00.712645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:00.713317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:00.719866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.720966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.721570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.722608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.723450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.724039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.825341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:00.826127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:00.832777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.833559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.834063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.834837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:00.835358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:00.835853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:00.981784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:00.991108 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2da4023f-2585-40e5-9238-88dec8ee9583 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.283352 Oct 27 10:25:00.991991 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1886/3961] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:00 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:01.008866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:01.010118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:01.017941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.018789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.019621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:01.020563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.022055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.023205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:01.070665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:01.076740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:01.079146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:01.086519 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2847d8d-c4ab-4a72-bd4e-41e7ab3abc3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.265330 Oct 27 10:25:01.087651 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2076/3962] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:00 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:01.103245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.103900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.104347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:01.104880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lazy-loading 'fault' on Instance uuid 826e3d51-19ca-436c-9a76-33e12444508d {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:25:01.166407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8efcc4e4-7a88-41d6-8754-e3136aedce8b req-25b812c7-6f18-40da-93bd-af27d7caae35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826e3d51-19ca-436c-9a76-33e12444508d", "name": "network-vif-deleted", "tag": "31c4acab-36cb-4fc6-b011-f7ee980934c3"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:01.188317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8efcc4e4-7a88-41d6-8754-e3136aedce8b req-25b812c7-6f18-40da-93bd-af27d7caae35 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.189595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8efcc4e4-7a88-41d6-8754-e3136aedce8b req-25b812c7-6f18-40da-93bd-af27d7caae35 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.190778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8efcc4e4-7a88-41d6-8754-e3136aedce8b req-25b812c7-6f18-40da-93bd-af27d7caae35 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:01.209162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:01.220110 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d895cb2f-fc75-45fb-b728-2052edcfa799 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1297 microversion: 2.1 time: 0.223459 Oct 27 10:25:01.220775 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1887/3963] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:00 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1297 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:01.226256 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8efcc4e4-7a88-41d6-8754-e3136aedce8b req-25b812c7-6f18-40da-93bd-af27d7caae35 service nova] Creating event network-vif-deleted:31c4acab-36cb-4fc6-b011-f7ee980934c3 for instance 826e3d51-19ca-436c-9a76-33e12444508d on n-h2-854663-10 Oct 27 10:25:01.231359 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8efcc4e4-7a88-41d6-8754-e3136aedce8b req-25b812c7-6f18-40da-93bd-af27d7caae35 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075985 Oct 27 10:25:01.232258 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2077/3964] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:01.649150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:01.650306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:01.661885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.662378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.663004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:01.664696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.665166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.665599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:01.718288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:01.721297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:01.747965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.751634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.752270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:01.756185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.757180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.758121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:01.988577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:02.003358 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f996e98c-9c9d-4449-b5b2-9c903dd75636 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.359957 Oct 27 10:25:02.004061 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1888/3965] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:01 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:02.020725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:02.021647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:02.028517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:02.029344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:02.030042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:02.031075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:02.031790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:02.032639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:02.196763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:02.213020 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17e84f3f-7567-40ff-b294-41fbb96cb547 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.511415 Oct 27 10:25:02.215165 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2078/3966] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:01 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:02.246982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:02.247893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:02.261625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:02.264188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:02.265148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:02.267505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:02.268461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:02.270402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:02.345300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:02.346256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:02.346912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:02.347532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lazy-loading 'fault' on Instance uuid 826e3d51-19ca-436c-9a76-33e12444508d {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:25:02.431778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8074ee4104864f7b8010104133bd2fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848cca168854db48e34e9d939e97600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:02.446814 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7676689-b4b1-4923-badd-8febd8cd91d1 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 200 len: 1297 microversion: 2.1 time: 0.205164 Oct 27 10:25:02.451505 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2079/3967] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:02 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 1297 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:02.458806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:02.471311 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5af56a7-df32-496d-8257-5dd6cffaf801 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.454637 Oct 27 10:25:02.472565 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1889/3968] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:02 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:03.037927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:03.038893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:03.057547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.058095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.061062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.063342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.064925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.066322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.246879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:03.253392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:03.273048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.276180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.278621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.281380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.281996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.283809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.360969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:03.373667 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02e7524e-9e77-475a-bfdd-8fa989c830cd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.345480 Oct 27 10:25:03.389552 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2080/3969] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:03 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:03.475154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:03.476905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 826e3d51-19ca-436c-9a76-33e12444508d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:03.498579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.506158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.506765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.513757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.514494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.515247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.538043 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance 826e3d51-19ca-436c-9a76-33e12444508d could not be found. Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d HTTP/1.1 Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 826e3d51-19ca-436c-9a76-33e12444508d could not be found. Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '826e3d51-19ca-436c-9a76-33e12444508d'} Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826e3d51-19ca-436c-9a76-33e12444508d could not be found. Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826e3d51-19ca-436c-9a76-33e12444508d could not be found. Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:03.540491 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:03.546742 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:03.546742 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:03.546742 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:03.546742 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:03.546742 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826e3d51-19ca-436c-9a76-33e12444508d could not be found. Oct 27 10:25:03.546742 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:03.570250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance 826e3d51-19ca-436c-9a76-33e12444508d could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:03.571767 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-564d4441-44a3-4dd4-a18a-2f6f3cea44eb tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d" status: 404 len: 111 microversion: 2.1 time: 0.101175 Oct 27 10:25:03.584193 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2081/3970] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:03 2022] GET /compute/v2.1/servers/826e3d51-19ca-436c-9a76-33e12444508d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:25:03.610100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:03.615183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:03.628806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.629703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.631621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.633854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.634561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.635508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.695495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:03.709627 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb774caa-3a9d-4240-b27f-538fdc48ee56 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1521 microversion: 2.1 time: 0.473471 Oct 27 10:25:03.710266 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1890/3971] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:03 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:03.733523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:03.734223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:03.749529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.749529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.749872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.750641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.751100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.751585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.023614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:04.039841 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10f73eb3-9ea4-4025-b704-c711be7fb80e tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.451262 Oct 27 10:25:04.040836 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2082/3972] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:03 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:04.046152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.046652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.054203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:04.056494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.057168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.057697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.058663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.059421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.060381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.081936 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b HTTP/1.1 Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ab62d458-94d6-4867-ab01-c5d090a4474b'} Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:04.084835 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.090585 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.092568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:04.094241 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4dc2a3a8-0416-4f0a-bce2-2a7fea0753e2 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 404 len: 111 microversion: 2.1 time: 0.051778 Oct 27 10:25:04.095612 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2083/3973] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:04 2022] DELETE /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:04.110525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:04.123034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.124539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: ab62d458-94d6-4867-ab01-c5d090a4474b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.126538 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d6e4f7e-53dd-47ce-a850-c3b981051467 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.412762 Oct 27 10:25:04.129782 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1891/3974] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:03 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:04.135736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.136317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.137005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.137921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.138442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.138928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.161495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.162274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.165801 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b HTTP/1.1 Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ab62d458-94d6-4867-ab01-c5d090a4474b'} Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.167705 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.176837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.176837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.176837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:04.176837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:04.176837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. Oct 27 10:25:04.176837 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.176837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance ab62d458-94d6-4867-ab01-c5d090a4474b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:04.178464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.178464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.179132 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c210671d-25b1-4c32-ba8b-8c0c56c31c99 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b" status: 404 len: 111 microversion: 2.1 time: 0.074473 Oct 27 10:25:04.179718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.181406 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2084/3975] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] GET /compute/v2.1/servers/ab62d458-94d6-4867-ab01-c5d090a4474b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:04.188541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a83d0e1a-3151-4dca-8fa7-98a3db2eb621 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5bdd2ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.193324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.193938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.194730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.227358 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a83d0e1a-3151-4dca-8fa7-98a3db2eb621 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Image not found. Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a83d0e1a-3151-4dca-8fa7-98a3db2eb621 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 HTTP/1.1 Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'cd22eb09-0c92-4072-988b-956297f16b24'} Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd22eb09-0c92-4072-988b-956297f16b24 to delete Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd22eb09-0c92-4072-988b-956297f16b24 could not be found. Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.229503 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a83d0e1a-3151-4dca-8fa7-98a3db2eb621 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:04.235036 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a83d0e1a-3151-4dca-8fa7-98a3db2eb621 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24" status: 404 len: 62 microversion: 2.1 time: 0.049017 Oct 27 10:25:04.237356 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2085/3976] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] DELETE /compute/v2.1/images/cd22eb09-0c92-4072-988b-956297f16b24 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:25:04.242024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.242593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.252210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.253362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.254593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.255817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.256430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.257212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.289512 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 HTTP/1.1 Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'adfa7709-dcb6-47e3-bc91-2c3f4510b3b9'} Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:04.291662 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32681ce5-02f4-43b6-9c35-58620273af60 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 404 len: 111 microversion: 2.1 time: 0.055599 Oct 27 10:25:04.298412 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2086/3977] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:04 2022] DELETE /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:04.304685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.304685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: adfa7709-dcb6-47e3-bc91-2c3f4510b3b9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.312137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.312646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.313093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.314034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.314647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.315358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.338068 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 HTTP/1.1 Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'adfa7709-dcb6-47e3-bc91-2c3f4510b3b9'} Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.341010 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.347358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.347358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.347358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:04.347358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:04.347358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. Oct 27 10:25:04.347358 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.349336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:04.351079 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5c206ac-c4fe-4b93-8949-cf598e487e37 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9" status: 404 len: 111 microversion: 2.1 time: 0.053241 Oct 27 10:25:04.355754 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2087/3978] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] GET /compute/v2.1/servers/adfa7709-dcb6-47e3-bc91-2c3f4510b3b9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:04.363816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d050e907-ee00-459e-8341-ee7fa991416d req-de39a55d-c98b-46db-84bc-386bfb0ea91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "name": "network-vif-unplugged", "status": "completed", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:04.376337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d050e907-ee00-459e-8341-ee7fa991416d req-de39a55d-c98b-46db-84bc-386bfb0ea91c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.377276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d050e907-ee00-459e-8341-ee7fa991416d req-de39a55d-c98b-46db-84bc-386bfb0ea91c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.378076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d050e907-ee00-459e-8341-ee7fa991416d req-de39a55d-c98b-46db-84bc-386bfb0ea91c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.406776 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d050e907-ee00-459e-8341-ee7fa991416d req-de39a55d-c98b-46db-84bc-386bfb0ea91c service nova] Creating event network-vif-unplugged:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:25:04.423518 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d050e907-ee00-459e-8341-ee7fa991416d req-de39a55d-c98b-46db-84bc-386bfb0ea91c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066112 Oct 27 10:25:04.424639 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2088/3979] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:04.432086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e1526e1-2fcb-4eb7-8e78-eb42cc769ef6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d63813160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.473587 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6e1526e1-2fcb-4eb7-8e78-eb42cc769ef6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Image not found. Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e1526e1-2fcb-4eb7-8e78-eb42cc769ef6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 HTTP/1.1 Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '226c4a7b-f550-439f-958c-ebe44cb1a9f8'} Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 226c4a7b-f550-439f-958c-ebe44cb1a9f8 to delete Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 226c4a7b-f550-439f-958c-ebe44cb1a9f8 could not be found. Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.476768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e1526e1-2fcb-4eb7-8e78-eb42cc769ef6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:04.482843 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e1526e1-2fcb-4eb7-8e78-eb42cc769ef6 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8" status: 404 len: 62 microversion: 2.1 time: 0.052399 Oct 27 10:25:04.484905 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2089/3980] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] DELETE /compute/v2.1/images/226c4a7b-f550-439f-958c-ebe44cb1a9f8 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:25:04.492283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.494609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.498589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:04.510197 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-244d49e1-2641-400a-b05e-4c1acc5c4a40 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.353809 Oct 27 10:25:04.511545 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1892/3981] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:04.517012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.517661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.521900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.522608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.524776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.525438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.526049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.526910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.527714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.528360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.531848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.536378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.539069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.540459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.545300 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd HTTP/1.1 Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'c74d2938-9f25-40b2-abee-11f4d42e46fd'} Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:04.547386 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ec50e23-9d1c-429d-bc0f-2016b99eda15 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 404 len: 111 microversion: 2.1 time: 0.036187 Oct 27 10:25:04.552514 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1893/3982] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:04 2022] DELETE /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:04.556868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.557635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.564451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.565355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.565882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.567110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.567559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.568055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.947197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:04.955691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:04.968417 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-562f45cc-d3e5-4ba2-b927-d9b2606eaefd tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.484037 Oct 27 10:25:04.969344 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c3ade727-4ca5-43f7-8873-9181113289c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.416345 Oct 27 10:25:04.970577 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1894/3983] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:04.976110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.976960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: c74d2938-9f25-40b2-abee-11f4d42e46fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.984345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.985132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.985808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2090/3984] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:04.986098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.987161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.987822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.988462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.001192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:05.001960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:05.007638 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:05.009699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.010196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd HTTP/1.1 Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'c74d2938-9f25-40b2-abee-11f4d42e46fd'} Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.011313 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.018061 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:05.018061 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:05.018061 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:05.018061 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:05.018061 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. Oct 27 10:25:05.018061 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.018677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.018677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.018677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.018677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.020129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance c74d2938-9f25-40b2-abee-11f4d42e46fd could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:05.021285 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0095324f-f24f-46e1-8966-2a6701284c1e tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd" status: 404 len: 111 microversion: 2.1 time: 0.049439 Oct 27 10:25:05.022118 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1895/3985] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] GET /compute/v2.1/servers/c74d2938-9f25-40b2-abee-11f4d42e46fd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:05.030762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4658f25a-86e3-41e9-9255-e35355ac041b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:05.048785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4658f25a-86e3-41e9-9255-e35355ac041b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:05.057519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4658f25a-86e3-41e9-9255-e35355ac041b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.058257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4658f25a-86e3-41e9-9255-e35355ac041b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.059058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4658f25a-86e3-41e9-9255-e35355ac041b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.060893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4658f25a-86e3-41e9-9255-e35355ac041b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.061627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4658f25a-86e3-41e9-9255-e35355ac041b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.062231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4658f25a-86e3-41e9-9255-e35355ac041b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.148004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:05.171022 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eceeaba7-89a9-4d1c-806f-e4d1819bc45f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1479 microversion: 2.1 time: 0.181524 Oct 27 10:25:05.173844 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2091/3986] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1479 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:05.179116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33af1813-d924-432f-8544-31344d40e282 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5a802550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:05.232897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4658f25a-86e3-41e9-9255-e35355ac041b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.209307 Oct 27 10:25:05.234403 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1896/3987] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:25:05 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:25:05.242573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:05.243828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:05.254091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.255686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.256574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.263697 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-33af1813-d924-432f-8544-31344d40e282 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Image not found. Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33af1813-d924-432f-8544-31344d40e282 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 HTTP/1.1 Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: exception: Image not found. Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a5a80c46-4cec-4448-ba7e-c22f1aee1951'} Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a5a80c46-4cec-4448-ba7e-c22f1aee1951 to delete Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a5a80c46-4cec-4448-ba7e-c22f1aee1951 could not be found. Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.265543 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:25:05.271381 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.274600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33af1813-d924-432f-8544-31344d40e282 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Image not found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:05.275028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.275504 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33af1813-d924-432f-8544-31344d40e282 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951" status: 404 len: 62 microversion: 2.1 time: 0.100499 Oct 27 10:25:05.276057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.276287 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2092/3988] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:05 2022] DELETE /compute/v2.1/images/a5a80c46-4cec-4448-ba7e-c22f1aee1951 => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:25:05.277824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.297756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6bed369a-de82-4834-a68f-70d414cebf26 req-a537c8ba-d2eb-43a4-83c0-c7c21b02170e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac", "name": "network-vif-deleted", "tag": "13893116-6587-44a1-831d-dd77042e4663"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:05.338754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6bed369a-de82-4834-a68f-70d414cebf26 req-a537c8ba-d2eb-43a4-83c0-c7c21b02170e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.340201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6bed369a-de82-4834-a68f-70d414cebf26 req-a537c8ba-d2eb-43a4-83c0-c7c21b02170e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.340711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6bed369a-de82-4834-a68f-70d414cebf26 req-a537c8ba-d2eb-43a4-83c0-c7c21b02170e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.373808 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6bed369a-de82-4834-a68f-70d414cebf26 req-a537c8ba-d2eb-43a4-83c0-c7c21b02170e service nova] Creating event network-vif-deleted:13893116-6587-44a1-831d-dd77042e4663 for instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac on n-h2-854663-10 Oct 27 10:25:05.394644 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6bed369a-de82-4834-a68f-70d414cebf26 req-a537c8ba-d2eb-43a4-83c0-c7c21b02170e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112211 Oct 27 10:25:05.401660 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2093/3989] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:05.414896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:05.415614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:05.434500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.440285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.442376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.444964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.449995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.454072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.828169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:05.848841 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-900244df-a121-4811-b3cd-8d4a7282a732 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1523 microversion: 2.1 time: 0.604711 Oct 27 10:25:05.861670 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1897/3990] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:05 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1523 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:05.868154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:05.868679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:05.885462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.886376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.888894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.890018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.892418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.893340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.905816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:05.914694 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eee5ddbc-1b6b-40e5-a4c9-1b93df36a458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1668 microversion: 2.1 time: 0.511238 Oct 27 10:25:05.915280 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2094/3991] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:05 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1668 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:05.939158 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 HTTP/1.1 Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '199e563d-e099-4187-96ea-cc1dc2694fd2'} Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:05.942441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-308be482-7ab8-402e-966a-aaa01e8f7034 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 404 len: 111 microversion: 2.1 time: 0.092253 Oct 27 10:25:05.947596 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1898/3992] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:05 2022] DELETE /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:05.957245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:05.958406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: 199e563d-e099-4187-96ea-cc1dc2694fd2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:05.966219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.967039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.967785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.968592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.969218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.969718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.985932 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 HTTP/1.1 Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '199e563d-e099-4187-96ea-cc1dc2694fd2'} Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.987994 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:05.993458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:05.993458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:05.993458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:05.993458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:05.993458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. Oct 27 10:25:05.993458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:05.993458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance 199e563d-e099-4187-96ea-cc1dc2694fd2 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:05.993458 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03c1e611-fff7-411a-8687-cb371d50f352 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2" status: 404 len: 111 microversion: 2.1 time: 0.040589 Oct 27 10:25:05.993458 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2095/3993] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:05 2022] GET /compute/v2.1/servers/199e563d-e099-4187-96ea-cc1dc2694fd2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:05.999299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:05.999809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa02ab73-79d7-4883-ae1a-c7f94b837b1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '.version_select at 0x7f6d5ad78c10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:06.000298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:06.006605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.007106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.007670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.008601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.008886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.009441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.026034 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-aa02ab73-79d7-4883-ae1a-c7f94b837b1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Image not found. Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa02ab73-79d7-4883-ae1a-c7f94b837b1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 HTTP/1.1 Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: exception: Image not found. Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'a7bcf6a3-5589-481a-8987-3ecec9c13c22'} Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a7bcf6a3-5589-481a-8987-3ecec9c13c22 to delete Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7bcf6a3-5589-481a-8987-3ecec9c13c22 could not be found. Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.028506 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 10:25:06.033995 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.036963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa02ab73-79d7-4883-ae1a-c7f94b837b1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Image not found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:06.037897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa02ab73-79d7-4883-ae1a-c7f94b837b1a tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22" status: 404 len: 62 microversion: 2.1 time: 0.042609 Oct 27 10:25:06.038960 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1899/3994] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:05 2022] DELETE /compute/v2.1/images/a7bcf6a3-5589-481a-8987-3ecec9c13c22 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:25:06.047974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:06.048728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:06.057304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.058225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.058610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.059693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.060309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.061165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.101153 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 HTTP/1.1 Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'aab1bd26-6fbe-4246-890f-533cf3d0a359'} Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:06.104134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:06.110791 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa8015c7-2163-4d51-91b3-0aa543026e79 tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 404 len: 111 microversion: 2.1 time: 0.062813 Oct 27 10:25:06.111898 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1900/3995] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:06 2022] DELETE /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:25:06.116482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:06.117129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] [instance: aab1bd26-6fbe-4246-890f-533cf3d0a359] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:06.123787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.124714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.125142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.125842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.126289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.126711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.146279 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] HTTP exception thrown: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Request method failure captured: Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 HTTP/1.1 Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsKFq8DC_YOkFgOtebBXlJ2bEC4Ru27wwAEubByRVyJLEwFtuHcruH_ZkcqdOaqt4OFYC4eIMTTd7kmSgaj4oUROfWHVWxiW7XtgIYyQDFJtu7411oHiIc7UFr_iCpb3E7W-mRi75l9cHc3h0PSiUvnTXFmFN9ezfRSs5-XmpkHXOo Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0848cca168854db48e34e9d939e97600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0848cca168854db48e34e9d939e97600", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0848cca168854db48e34e9d939e97600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ImagesTestJSON-311750119 Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0848cca168854db48e34e9d939e97600 Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ImagesTestJSON-311750119 Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 8074ee4104864f7b8010104133bd2fef Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ImagesTestJSON-311750119-project Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'aab1bd26-6fbe-4246-890f-533cf3d0a359'} Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.148841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:06.154173 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:06.154173 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:06.154173 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:06.154173 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:06.154173 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. Oct 27 10:25:06.154173 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:06.155978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] Returning 404 to user: Instance aab1bd26-6fbe-4246-890f-533cf3d0a359 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:06.157650 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41fec8bd-4692-48ad-a020-fcb2506a735b tempest-ImagesTestJSON-311750119 tempest-ImagesTestJSON-311750119-project] 10.222.0.76 "GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359" status: 404 len: 111 microversion: 2.1 time: 0.045299 Oct 27 10:25:06.162697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1901/3996] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:06 2022] GET /compute/v2.1/servers/aab1bd26-6fbe-4246-890f-533cf3d0a359 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:06.198541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:06.199155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:06.210406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.211202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.212856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.213811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.217656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.218818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.260364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:06.270584 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5055833-056c-4ea8-8aaf-4ffb43881a43 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.275248 Oct 27 10:25:06.275256 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2096/3997] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:05 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:06.322382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.323169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.326041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.333706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lazy-loading 'fault' on Instance uuid f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:25:06.431256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc08f1ad238424896dcefb0fa0b20c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9067a31bfee345fca080e7621aa60015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:06.449389 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-295ba73d-9bfc-48b4-9295-1b52fca92f8f tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 200 len: 1312 microversion: 2.1 time: 0.250586 Oct 27 10:25:06.451631 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1902/3998] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:06 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:06.874510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:06.875041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:06.883988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.885786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.887933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.889092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.890683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.891208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.939705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:06.940291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:06.951010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.951505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.951948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.952653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:06.953134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:06.953563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:07.805160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:07.806752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:07.825448 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e3b335e-a857-4991-9604-00d8716fd0f7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1668 microversion: 2.1 time: 0.890118 Oct 27 10:25:07.841655 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4967a99-d327-402e-baef-5ce1519df809 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1500 microversion: 2.1 time: 0.952805 Oct 27 10:25:07.841655 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2097/3999] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:06 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1500 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:07.842097 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1903/4000] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:06 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1668 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:07.842097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:07.842297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:07.842384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] [instance: f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:07.842496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:07.846433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:07.850502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:07.851771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:07.855503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:07.856205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:07.856338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:07.856774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:07.856937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:07.857542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:07.857701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:07.858106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:07.858534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:07.881782 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] HTTP exception thrown: Instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac could not be found. Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Request method failure captured: Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac HTTP/1.1 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlsu-3_w5LGZIvZif4TTAP6HRONgNGme2C9gImyb4W0g9Upsi7Y2bHorvYIAfIK1OJaF4pOA8nmy8Y4T0BPo3Z6b72CJIADNwIlaiQrBL1QEHegWtPyuQbLI5lnUkUsZwbu1MPjFEe-CeaqflWsbqJ87tWOxBka5KpPfYl0fSmtf6VA Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9067a31bfee345fca080e7621aa60015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9067a31bfee345fca080e7621aa60015", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9067a31bfee345fca080e7621aa60015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 9067a31bfee345fca080e7621aa60015 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-512757420 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5fc08f1ad238424896dcefb0fa0b20c5 Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-512757420-project Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac could not be found. Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac'} Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac could not be found. Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac could not be found. Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:07.889355 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:07.895467 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:07.895467 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:07.895467 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:07.895467 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:07.895467 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:07.895467 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:07.895467 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac could not be found. Oct 27 10:25:07.895467 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:07.898493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] Returning 404 to user: Instance f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:07.900367 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59be813b-3bf7-49d1-9ba8-395011e14b35 tempest-ServerRescueNegativeTestJSON-512757420 tempest-ServerRescueNegativeTestJSON-512757420-project] 10.222.0.76 "GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac" status: 404 len: 111 microversion: 2.1 time: 0.069667 Oct 27 10:25:07.903119 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1904/4001] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:07 2022] GET /compute/v2.1/servers/f3cde0a4-f4b3-4ce5-80c5-ffe8cebcb9ac => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:07.911752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:07.918149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:07.919483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:07.925446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:07.926129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:07.926725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:07.927623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:07.928274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:07.929451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:07.960747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:07.996725 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6bbc85ae-cece-43e3-bf51-ff51cbe875cd tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.090518 Oct 27 10:25:07.997553 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1905/4002] 10.222.0.76 () {58 vars in 1154 bytes} [Thu Oct 27 10:25:07 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:08.010045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a0bdd60-d921-43f9-b9fb-0ca3f5cf285f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:08.017471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a0bdd60-d921-43f9-b9fb-0ca3f5cf285f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:08.018206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a0bdd60-d921-43f9-b9fb-0ca3f5cf285f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:08.018940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a0bdd60-d921-43f9-b9fb-0ca3f5cf285f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:08.044920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a0bdd60-d921-43f9-b9fb-0ca3f5cf285f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Going to try to start instance {{(pid=120719) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 10:25:08.075246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:08.110521 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a0bdd60-d921-43f9-b9fb-0ca3f5cf285f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "POST /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c/action" status: 202 len: 0 microversion: 2.1 time: 0.104329 Oct 27 10:25:08.111890 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1906/4003] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:25:08 2022] POST /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:25:08.122200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:08.123541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:08.132905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:08.132905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:08.134551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:08.135594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:08.136360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:08.137151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:08.567232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:08.577396 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d025b4b-9d4a-4364-93cf-3c39be52cd2f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1511 microversion: 2.1 time: 0.747553 Oct 27 10:25:08.599133 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2098/4004] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:07 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1511 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:08.689797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:08.705617 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8ac55e8-e5a5-435e-805d-cb1e09133119 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1509 microversion: 2.1 time: 0.588457 Oct 27 10:25:08.707142 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1907/4005] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:08 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1509 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:08.854881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:08.869558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:08.886560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:08.887274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:08.887881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:08.888890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:08.889500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:08.890087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:09.405604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:09.421118 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd2d3ed6-946f-4f18-9e29-f65dc6ea2a5a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.573539 Oct 27 10:25:09.425547 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2099/4006] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:08 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:09.451170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73f852db-4457-44f8-8df5-e6abcb11e527 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:09.454385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73f852db-4457-44f8-8df5-e6abcb11e527 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:09.463385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f852db-4457-44f8-8df5-e6abcb11e527 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:09.464330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f852db-4457-44f8-8df5-e6abcb11e527 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:09.465174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f852db-4457-44f8-8df5-e6abcb11e527 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:09.466368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f852db-4457-44f8-8df5-e6abcb11e527 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:09.467111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f852db-4457-44f8-8df5-e6abcb11e527 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:09.467771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73f852db-4457-44f8-8df5-e6abcb11e527 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:09.525229 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73f852db-4457-44f8-8df5-e6abcb11e527 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 200 len: 321 microversion: 2.1 time: 0.077981 Oct 27 10:25:09.536206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:09.536714 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1908/4007] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:25:09 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 321 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:09.537242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:09.546286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:09.548353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:09.549878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:09.552940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:09.553958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:09.555121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:09.607952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:09.609105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:09.625332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:09.626390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:09.627037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:09.628106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:09.629229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:09.630321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:10.344617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:10.366476 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77fbfd85-27f4-4b74-a79b-f2f6c27d5969 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.833422 Oct 27 10:25:10.405490 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2100/4008] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:09 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:10.418312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:10.421344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:10.448821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:10.449520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:10.450543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:10.451359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:10.451920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:10.452434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:10.625815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:10.636608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-64dcb4e2-ee09-472e-bf1c-44a15fb461af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1488 microversion: 2.1 time: 1.033864 Oct 27 10:25:10.640442 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1909/4009] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:09 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1488 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:10.645969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:10.652418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:10.678881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:10.680976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:10.681731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:10.683078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:10.683755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:10.684343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:11.819405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:11.855781 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e919256c-21cd-445c-8ff1-80c6d7072e4f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 1.213360 Oct 27 10:25:11.864784 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1910/4010] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:10 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:11.878689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:11.881644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:11.888345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:11.903334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:11.903853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:11.904294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:11.908385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:11.908975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:11.911109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:11.957812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:25:11.991501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:12.002164 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ecd7828-e559-4da3-9ff8-729ee6de9150 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1509 microversion: 2.1 time: 1.594975 Oct 27 10:25:12.002764 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2101/4011] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:10 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1509 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:12.009635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:12.010283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:12.038472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:12.043330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:12.045877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:12.046927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:12.047637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:12.049303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:12.065570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:12.100266 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab5894a3-423d-4262-9860-fcd6dca3a2ac tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 204 len: 0 microversion: 2.1 time: 0.233403 Oct 27 10:25:12.105508 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1911/4012] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:11 2022] DELETE /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:12.113847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:12.115135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:12.124079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:12.166805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:12.168571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:12.169932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:12.173269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:12.173956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:12.630320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:12.635499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:12.650524 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e51b841c-f2db-4500-a6ec-094696a08e37 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1494 microversion: 2.1 time: 0.543031 Oct 27 10:25:12.651391 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1912/4013] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:12 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1494 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:12.663780 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa5ee0bd-a9c8-407f-90ae-6a1b9ca5da32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.656920 Oct 27 10:25:12.668825 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2102/4014] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:12 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:12.694082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:12.694702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:12.705255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:12.705895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:12.706155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:12.713164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:12.713723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:12.714172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:13.033418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:13.035534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:13.071246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:13.072125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:13.072573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:13.075011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:13.076411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:13.077016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:13.477876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:13.495854 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-04aeebed-93f6-47c3-85b7-2eb304d54f7f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.801704 Oct 27 10:25:13.496535 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1913/4015] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:12 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:13.677783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:13.684873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:13.686092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:13.689745 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1aa8b9cf-254a-4143-982e-8c6e9cebab2f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1513 microversion: 2.1 time: 0.663275 Oct 27 10:25:13.693408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:13.694411 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2103/4016] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:13 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1513 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:13.694620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:13.695307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:13.696551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:13.697199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:13.697813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:13.724892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-70897878", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9405a813-2b98-46c3-9126-2e0aba2c6166"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:13.873358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] validate_networks() for [('9405a813-2b98-46c3-9126-2e0aba2c6166', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:25:14.156052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:14.166325 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bf1b8efe-d045-48f9-bfef-dbd8621ebe21 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 200 len: 1494 microversion: 2.1 time: 0.496178 Oct 27 10:25:14.180757 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1914/4017] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:13 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 1494 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:14.192000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:14.218065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:14.218615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.compute.servers [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Removing options 'limit' from query {{(pid=120719) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 10:25:14.224627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:14.229564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:14.234624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:14.235170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:14.242526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:14.246203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:14.246729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:14.253043 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2dc9df81-44dd-4381-bc71-6404fbcde1e9 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.078490 Oct 27 10:25:14.253658 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1915/4018] 10.222.0.76 () {58 vars in 1140 bytes} [Thu Oct 27 10:25:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:25:14.774930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f44d382-7c93-41b5-b9d1-a4d9138cfd05 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Action: 'create', calling method: .version_select at 0x7f6d6375eca0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1035724819", "policies": ["affinity"]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:14.851113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6f44d382-7c93-41b5-b9d1-a4d9138cfd05 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:14.877269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6f44d382-7c93-41b5-b9d1-a4d9138cfd05 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:15.042871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6f44d382-7c93-41b5-b9d1-a4d9138cfd05 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:15.065399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6f44d382-7c93-41b5-b9d1-a4d9138cfd05 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:15.104719 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f44d382-7c93-41b5-b9d1-a4d9138cfd05 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.840095 Oct 27 10:25:15.117306 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1916/4019] 10.222.0.76 () {60 vars in 1174 bytes} [Thu Oct 27 10:25:14 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:15.124949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:15.125972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:15.144731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:15.145558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:15.146166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:15.147162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:15.147779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:15.148369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:15.726429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:15.744053 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8212bdaa-031d-4208-b373-d78393a9e86f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1513 microversion: 2.1 time: 0.621434 Oct 27 10:25:15.745060 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1917/4020] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:15 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1513 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:15.757639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-bdd50a25-389e-421c-9955-987bd861b7cf req-fb898d4d-d634-4ce4-b136-6de041fb38f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf71b7a0-da61-4a46-9825-c8fc74c7f3f0", "name": "network-vif-deleted", "tag": "24b7fa82-0d78-42e4-95bf-f27da4e3d81f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:15.795521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bdd50a25-389e-421c-9955-987bd861b7cf req-fb898d4d-d634-4ce4-b136-6de041fb38f8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:15.797012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bdd50a25-389e-421c-9955-987bd861b7cf req-fb898d4d-d634-4ce4-b136-6de041fb38f8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:15.797397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bdd50a25-389e-421c-9955-987bd861b7cf req-fb898d4d-d634-4ce4-b136-6de041fb38f8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:15.814195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:15.815130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:15.815838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:15.816491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:15.820011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:15.834851 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-bdd50a25-389e-421c-9955-987bd861b7cf req-fb898d4d-d634-4ce4-b136-6de041fb38f8 service nova] Creating event network-vif-deleted:24b7fa82-0d78-42e4-95bf-f27da4e3d81f for instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 on n-h2-854663-10 Oct 27 10:25:15.841307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:15.842177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:15.842857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:15.843815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:15.844720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:15.845457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:15.849666 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-bdd50a25-389e-421c-9955-987bd861b7cf req-fb898d4d-d634-4ce4-b136-6de041fb38f8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102239 Oct 27 10:25:15.852318 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1918/4021] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:15.872570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05254b52-fb8a-4c17-98d6-ed92c0bc3c83 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Action: 'create', calling method: .version_select at 0x7f6d637afee0>, body: {"server_group": {"name": "tempest-server-group-477398228", "policies": ["affinity"]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:15.882338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:15.890779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for user 1ebcbfbb11e84fe5bbfebd8a9ebea128 and project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:15.909888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-05254b52-fb8a-4c17-98d6-ed92c0bc3c83 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:15.918497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-05254b52-fb8a-4c17-98d6-ed92c0bc3c83 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:15.925218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:25:15.928401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:25:16.011162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-05254b52-fb8a-4c17-98d6-ed92c0bc3c83 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:16.017985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-05254b52-fb8a-4c17-98d6-ed92c0bc3c83 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:16.036833 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05254b52-fb8a-4c17-98d6-ed92c0bc3c83 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.182380 Oct 27 10:25:16.043827 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd934c40-d64d-4811-98f7-185aebd29f88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336404 Oct 27 10:25:16.043827 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2104/4022] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:25:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:25:16.044288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:16.045777 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1919/4023] 10.222.0.76 () {60 vars in 1173 bytes} [Thu Oct 27 10:25:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:16.049126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:16.065152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:16.080945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:16.107180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:16.107720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:16.108172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:16.108960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:16.116716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:16.121342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:16.140543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:16.141113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:16.141569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:16.142319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:16.142779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:16.149941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:16.162332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 HTTP/1.1 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'cf71b7a0-da61-4a46-9825-c8fc74c7f3f0'} Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:16.179221 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3591c625-034d-4ee0-b704-c820b9bf212f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 404 len: 111 microversion: 2.1 time: 0.142577 Oct 27 10:25:16.185575 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2105/4024] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:16 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:16.195943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7083386f-cbb3-4764-8458-caa6cad86e76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:16.196558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7083386f-cbb3-4764-8458-caa6cad86e76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:16.298675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7083386f-cbb3-4764-8458-caa6cad86e76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:16.314368 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7083386f-cbb3-4764-8458-caa6cad86e76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1213 microversion: 2.1 time: 0.131584 Oct 27 10:25:16.315176 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2106/4025] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:16 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1213 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:16.325142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92384989-4570-4a6a-a623-9d270d7ddc48 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Action: 'create', calling method: .version_select at 0x7f6d5a826b80>, body: {"server_group": {"name": "tempest-server-group-477398228", "policies": ["affinity"]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:16.379948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-92384989-4570-4a6a-a623-9d270d7ddc48 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:16.395796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-92384989-4570-4a6a-a623-9d270d7ddc48 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:16.529633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-92384989-4570-4a6a-a623-9d270d7ddc48 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:16.552163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-92384989-4570-4a6a-a623-9d270d7ddc48 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:16.559137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:16.573596 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5bf719dc-6d04-43a6-a7bb-2db187cfdf90 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f" status: 200 len: 1508 microversion: 2.1 time: 0.526444 Oct 27 10:25:16.590196 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1920/4026] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:16 2022] GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:16.609712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2141787101", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "aebae77c-7c09-4e55-b34c-9671e2410be6"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:16.627035 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92384989-4570-4a6a-a623-9d270d7ddc48 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.310385 Oct 27 10:25:16.627845 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2107/4027] 10.222.0.76 () {60 vars in 1173 bytes} [Thu Oct 27 10:25:16 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:16.636406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:16.640566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:16.659394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:16.661237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:16.663486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:16.666566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:16.669998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:16.670660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:16.737262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] validate_networks() for [('aebae77c-7c09-4e55-b34c-9671e2410be6', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:25:17.612094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:17.628911 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7768bf7d-9c29-44c0-80d0-6ce6e8dc2a09 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1511 microversion: 2.1 time: 0.999334 Oct 27 10:25:17.641525 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2108/4028] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:16 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1511 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:17.651289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8507850e-eaba-45fa-929a-a41e5cf2ef5f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:17.732849 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8507850e-eaba-45fa-929a-a41e5cf2ef5f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/ca68e6f0-4cde-455f-8659-de5c9a1d709d" status: 204 len: 0 microversion: 2.1 time: 0.089296 Oct 27 10:25:17.739488 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2109/4029] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:25:17 2022] DELETE /compute/v2.1/os-server-groups/ca68e6f0-4cde-455f-8659-de5c9a1d709d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:17.945609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:18.133092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-125939100", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": "none"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:18.288290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:18.288821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:18.289343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:18.289886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:18.290241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:18.312930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:18.313830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:18.315245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:18.316201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:18.316901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:18.317619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:18.337847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:18.349745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Getting quotas for project 5c5451608cc1445cb78d5612edafc49d. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:18.367843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Getting quotas for user fa67b54984fe478e8c0b9cc1a6d8f15a and project 5c5451608cc1445cb78d5612edafc49d. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:18.395376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:25:18.399339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 971ed1d1-acb4-4637-afc4-b003a38ddd9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:25:18.497085 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a538520-421a-497e-ad3c-22f8f4a75475 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.755974 Oct 27 10:25:18.498650 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2110/4030] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:25:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:25:18.510798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:18.512385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:18.537161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:18.548177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:18.548604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:18.549389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:18.549626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:18.550228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:18.554641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:18.557877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:18.559954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:18.562633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:18.563094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:18.573566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:18.574404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:18.576127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:18.578286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:18.579298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:18.581445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:18.633941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:18.654025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Getting quotas for user 83da5c7956454b278e9f9d6641a01711 and project a2512e456e704e10b0c34c7496e4f342. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:18.694662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:25:18.702017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:25:18.858950 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-064aaa43-6a04-4a2d-b932-cfa5824287bf tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.267450 Oct 27 10:25:18.859605 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1921/4031] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:25:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:25:18.890948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:18.894011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:18.903269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62ad3333-59ec-41ab-ba3c-702cd2352c50 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1283 microversion: 2.1 time: 0.401885 Oct 27 10:25:18.912701 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2111/4032] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:18 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1283 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:18.922227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7dd50f76-b3f6-4d5b-bc55-d97fed5ae959 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:18.929837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:18.932645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:18.978783 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7dd50f76-b3f6-4d5b-bc55-d97fed5ae959 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.072685 Oct 27 10:25:18.987394 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2112/4033] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:25:18 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:19.019623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:19.022150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:19.059525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:19.060032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:19.060471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:19.075857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:19.076346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:19.086591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:19.587165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:19.588235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:19.589035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:19.590192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:19.591705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:19.592449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:19.819483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:20.008975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a1768f0-5470-4d05-aad6-8351f6319898 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 344 microversion: 2.1 time: 1.136281 Oct 27 10:25:20.020821 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1922/4034] 10.222.0.76 () {58 vars in 1154 bytes} [Thu Oct 27 10:25:18 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 344 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:20.026127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:20.026727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 971ed1d1-acb4-4637-afc4-b003a38ddd9a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:20.033276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.033760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.040155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:20.042099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.044477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.045200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:20.308393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:20.322058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:20.323531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:20.324710 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-423c42d9-9b04-4da3-bcb7-465bb4c5a3b6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a" status: 200 len: 1273 microversion: 2.47 time: 0.302806 Oct 27 10:25:20.332069 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1923/4035] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:20 2022] GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:20.343869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:20.345866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:20.360076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.361051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.368214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:20.371939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.372806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.373481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:20.395144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:20.419925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:20.424080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:20.431478 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a560d7cb-ebc7-4d12-b094-ad3948a25832 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2950 microversion: 2.32 time: 1.439375 Oct 27 10:25:20.432815 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2113/4036] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:18 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2950 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:20.461456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8a9c457-3c31-4ad3-a649-454b5b00f969 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:20.538800 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8a9c457-3c31-4ad3-a649-454b5b00f969 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/80baf3df-294a-48b3-83d4-6b8a6c4b0bd9" status: 204 len: 0 microversion: 2.1 time: 0.103825 Oct 27 10:25:20.540881 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2114/4037] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:25:20 2022] DELETE /compute/v2.1/os-server-groups/80baf3df-294a-48b3-83d4-6b8a6c4b0bd9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:20.552387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:20.553300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:20.564989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.565771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.566627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:20.568623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.569650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.570370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:20.617815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:20.629162 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3a893330-c2de-4e41-8495-dc945c8270ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1211 microversion: 2.1 time: 0.295463 Oct 27 10:25:20.640831 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1924/4038] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:20 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1211 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:20.653085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:20.654893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:20.669991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.670479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.671277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:20.672588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.673798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.674352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:20.692933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:20.912464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:20.935640 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20fa5a31-5a6f-44b2-8eed-9da8df9dfcdc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1313 microversion: 2.1 time: 0.392911 Oct 27 10:25:20.953454 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2115/4039] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:20 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:20.965273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52f80642-32e1-423d-8add-4c98e9088e22 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:20.973033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52f80642-32e1-423d-8add-4c98e9088e22 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:20.984899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52f80642-32e1-423d-8add-4c98e9088e22 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.986002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52f80642-32e1-423d-8add-4c98e9088e22 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.986515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52f80642-32e1-423d-8add-4c98e9088e22 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:20.987308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52f80642-32e1-423d-8add-4c98e9088e22 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:20.991606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52f80642-32e1-423d-8add-4c98e9088e22 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:20.992075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52f80642-32e1-423d-8add-4c98e9088e22 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:21.268108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:21.313580 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d6c59e92-2342-49e1-9bc1-ebe69dc1caf8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1513 microversion: 2.1 time: 0.670794 Oct 27 10:25:21.346888 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1925/4040] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:20 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1513 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:21.365987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5bb1a677-ae57-4fad-b27f-d6a9ed59613b tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:21.407191 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5bb1a677-ae57-4fad-b27f-d6a9ed59613b tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.058651 Oct 27 10:25:21.408449 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1926/4041] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:25:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:21.426119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1664679386", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": "none"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:21.480762 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52f80642-32e1-423d-8add-4c98e9088e22 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.525659 Oct 27 10:25:21.482209 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2116/4042] 10.222.0.76 () {60 vars in 1316 bytes} [Thu Oct 27 10:25:20 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec/os-interface => generated 1831 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:21.487378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:21.487994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:21.497079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:21.497497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:21.499962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:21.500718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:21.501144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:21.506503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:21.506503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:21.506503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:21.507755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:21.508281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:21.508961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:21.509087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:21.521828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:21.523414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:21.524110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:21.525546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:21.527015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:21.527720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:21.558698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Getting quotas for project 5c5451608cc1445cb78d5612edafc49d. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:21.565270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Getting quotas for user fa67b54984fe478e8c0b9cc1a6d8f15a and project 5c5451608cc1445cb78d5612edafc49d. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:21.583426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:25:21.585680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:25:21.644813 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f752904e-c237-405f-8eb0-d6ebdcab1278 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.235125 Oct 27 10:25:21.646395 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1927/4043] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:25:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 237 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:25:21.653076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-74268459-7aa4-4c1f-8c1a-e37e9bad737f req-d86da710-1843-4fc0-9cba-da07fb03a8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a16e810-2ce6-4fa0-829e-1af369376408", "tag": "ab9f117e-7d8a-42ff-becc-c634bb030367"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:21.664751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-74268459-7aa4-4c1f-8c1a-e37e9bad737f req-d86da710-1843-4fc0-9cba-da07fb03a8f6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:21.665608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-74268459-7aa4-4c1f-8c1a-e37e9bad737f req-d86da710-1843-4fc0-9cba-da07fb03a8f6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:21.666301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-74268459-7aa4-4c1f-8c1a-e37e9bad737f req-d86da710-1843-4fc0-9cba-da07fb03a8f6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:21.686230 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-74268459-7aa4-4c1f-8c1a-e37e9bad737f req-d86da710-1843-4fc0-9cba-da07fb03a8f6 service nova] Creating event network-changed:ab9f117e-7d8a-42ff-becc-c634bb030367 for instance 7a16e810-2ce6-4fa0-829e-1af369376408 on n-h2-854663-10 Oct 27 10:25:21.695109 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-74268459-7aa4-4c1f-8c1a-e37e9bad737f req-d86da710-1843-4fc0-9cba-da07fb03a8f6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046250 Oct 27 10:25:21.698839 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1928/4044] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:21.706605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb7c2701-f3a7-4ff2-a5c6-7e6e1ddff151 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Action: 'create', calling method: .version_select at 0x7f6d637f4670>, body: {"server_group": {"name": "tempest-server-group-291074770", "policies": ["affinity"]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:21.732405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-eb7c2701-f3a7-4ff2-a5c6-7e6e1ddff151 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:21.743048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-eb7c2701-f3a7-4ff2-a5c6-7e6e1ddff151 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:21.780074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:21.792974 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d53b83e2-1d1f-4868-aea8-08944fe90429 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f" status: 200 len: 1508 microversion: 2.1 time: 0.309276 Oct 27 10:25:21.794705 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2117/4045] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:21 2022] GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:21.804062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-eb7c2701-f3a7-4ff2-a5c6-7e6e1ddff151 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:21.812787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-eb7c2701-f3a7-4ff2-a5c6-7e6e1ddff151 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:21.819463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:21.822896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:21.834989 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb7c2701-f3a7-4ff2-a5c6-7e6e1ddff151 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.134565 Oct 27 10:25:21.841472 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1929/4046] 10.222.0.76 () {60 vars in 1173 bytes} [Thu Oct 27 10:25:21 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:21.842729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d0a2a9f-a4f8-4b39-9773-defcb81be7af tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:21.845326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d0a2a9f-a4f8-4b39-9773-defcb81be7af tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:21.855259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:21.855905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:21.856803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:21.857692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:21.858268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:21.858552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:21.908643 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d0a2a9f-a4f8-4b39-9773-defcb81be7af tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "PUT /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 992 microversion: 2.47 time: 0.070736 Oct 27 10:25:21.925855 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1930/4047] 10.222.0.76 () {62 vars in 1297 bytes} [Thu Oct 27 10:25:21 2022] PUT /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 992 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:25:21.948914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:21.953679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:21.977460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:21.977964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:21.978409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:21.979274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:21.979783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:21.980299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:22.077627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:22.086963 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1b8fab2-b520-47fa-ac72-9ebbd0b13af2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1267 microversion: 2.1 time: 0.289575 Oct 27 10:25:22.087562 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2118/4048] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:21 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:22.094052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dfcff378-5b1a-460c-ad9c-b7ad90f38c72 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:22.159940 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dfcff378-5b1a-460c-ad9c-b7ad90f38c72 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/37b8a455-6efb-46d1-8a87-fc056070fd0b" status: 204 len: 0 microversion: 2.1 time: 0.069828 Oct 27 10:25:22.161783 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2119/4049] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:25:22 2022] DELETE /compute/v2.1/os-server-groups/37b8a455-6efb-46d1-8a87-fc056070fd0b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:22.169941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e31d03d-541a-44a5-b177-9395384987f2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:22.171890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e31d03d-541a-44a5-b177-9395384987f2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:22.278966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:22.288994 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b7b532c-3a99-4d3f-b2e9-d80449f50c72 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1511 microversion: 2.1 time: 0.361641 Oct 27 10:25:22.289936 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1931/4050] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:21 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:22.295159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:22.295899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:22.303468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:22.304950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:22.305660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:22.307008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:22.307664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:22.307865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e31d03d-541a-44a5-b177-9395384987f2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:22.308895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:22.326508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e31d03d-541a-44a5-b177-9395384987f2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:22.326508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e31d03d-541a-44a5-b177-9395384987f2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:22.326508 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e31d03d-541a-44a5-b177-9395384987f2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1278 microversion: 2.47 time: 0.161771 Oct 27 10:25:22.326508 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2120/4051] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:22 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:22.348814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0cc3fe1d-7a3e-4da3-b7ed-2a7df9b7ef9c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:22.378282 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0cc3fe1d-7a3e-4da3-b7ed-2a7df9b7ef9c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.051378 Oct 27 10:25:22.380553 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2121/4052] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:25:22 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:22.391363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:22.402269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:22.403070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:22.412331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:22.413315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:22.413846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:22.414692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:22.415325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:22.415843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:22.473012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:22.527888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:22.541780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:22.544379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:22.544872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:22.669130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:22.687067 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aab01f1b-239d-4459-aa64-d51796c4ac0b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1313 microversion: 2.1 time: 0.395366 Oct 27 10:25:22.688558 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1932/4053] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:22 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:22.695707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91ffe795-8ba7-4038-b870-25e5cf72934c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Action: 'create', calling method: .version_select at 0x7f6d638929d0>, body: {"server_group": {"name": "tempest-server-group-849870036", "policies": ["anti-affinity"]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:22.729164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-91ffe795-8ba7-4038-b870-25e5cf72934c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:22.737585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-91ffe795-8ba7-4038-b870-25e5cf72934c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:22.759982 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0c033b0-70bf-476a-8bd4-9fa1b10a39e5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.374686 Oct 27 10:25:22.762340 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2122/4054] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:25:22 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:22.790589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:22.797095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:22.798209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:22.819785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-91ffe795-8ba7-4038-b870-25e5cf72934c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:22.846539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-91ffe795-8ba7-4038-b870-25e5cf72934c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:22.862015 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91ffe795-8ba7-4038-b870-25e5cf72934c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.172085 Oct 27 10:25:22.862897 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1933/4055] 10.222.0.76 () {60 vars in 1173 bytes} [Thu Oct 27 10:25:22 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:22.874738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c18f8c8-898e-4f71-a050-bc2dc49c7361 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:22.908934 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c18f8c8-898e-4f71-a050-bc2dc49c7361 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/08c6717b-2cf4-4abc-82c9-c2963099bdf1" status: 204 len: 0 microversion: 2.1 time: 0.039081 Oct 27 10:25:22.910715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:22.910903 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1934/4056] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:25:22 2022] DELETE /compute/v2.1/os-server-groups/08c6717b-2cf4-4abc-82c9-c2963099bdf1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:22.911533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:22.911972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:22.912731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:22.913404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:22.914048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:22.919735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5cd0434f-1a33-414e-9f91-e6587dd634d8 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:22.931967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5cd0434f-1a33-414e-9f91-e6587dd634d8 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016938 Oct 27 10:25:22.932868 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1935/4057] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:25:22 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:23.056402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:23.113436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:23.113962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:23.126453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:23.126959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:23.131652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:23.132482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:23.132992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:23.133469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:23.142595 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f111cdb4-513b-47a9-b8dd-c1c2b73e4ecc tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1006 microversion: 2.1 time: 0.359273 Oct 27 10:25:23.144124 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2123/4058] 10.222.0.76 () {58 vars in 1150 bytes} [Thu Oct 27 10:25:22 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1006 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:23.164321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:23.171097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:23.172623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:23.179937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:23.180858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:23.181480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:23.182768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:23.183430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:23.184078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:23.290665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:23.307123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:23.309502 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93b05a2c-45ee-4090-9bde-bf0cdd2fdfd2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1267 microversion: 2.1 time: 0.200139 Oct 27 10:25:23.326088 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1936/4059] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:23 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:23.335463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1471433183", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "3c2b1f63-2ff7-4260-8382-be86c932de81"}]}, "os:scheduler_hints": {"group": "9b453cba-31ef-4cca-bf2f-0319f8f5750d"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:23.429930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] validate_networks() for [('3c2b1f63-2ff7-4260-8382-be86c932de81', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:25:23.495375 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b6b3894-84ae-4c55-a769-7734ce6afa14 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1006 microversion: 2.1 time: 0.335979 Oct 27 10:25:23.501313 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2124/4060] 10.222.0.76 () {58 vars in 1212 bytes} [Thu Oct 27 10:25:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1006 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:23.512344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:23.512999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:23.529331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:23.530078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:23.532458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:23.535182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:23.538051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:23.538723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:23.778230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:23.793320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:23.795627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:23.797671 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d85ed7c8-42d9-408a-9f2e-40e7777a26c0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1330 microversion: 2.47 time: 0.295257 Oct 27 10:25:23.799161 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2125/4061] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:23 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1330 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:23.806849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:23.814755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:23.815772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:23.823205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:23.824126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:23.824839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:23.825616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:23.826116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:23.826734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:23.927519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:23.995858 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9dd6998d-406e-4c9b-827e-89ff36c38a4c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1006 microversion: 2.1 time: 0.194987 Oct 27 10:25:23.996829 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2126/4062] 10.222.0.76 () {58 vars in 1196 bytes} [Thu Oct 27 10:25:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1006 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:24.182691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4eacc3b-52ce-44c4-ad27-d166ab1643e6 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Calling method '.version_select at 0x7f6d6383f790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:24.196435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eacc3b-52ce-44c4-ad27-d166ab1643e6 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.197401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eacc3b-52ce-44c4-ad27-d166ab1643e6 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.197539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eacc3b-52ce-44c4-ad27-d166ab1643e6 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.198376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eacc3b-52ce-44c4-ad27-d166ab1643e6 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.199132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eacc3b-52ce-44c4-ad27-d166ab1643e6 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.199706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4eacc3b-52ce-44c4-ad27-d166ab1643e6 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.227311 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4eacc3b-52ce-44c4-ad27-d166ab1643e6 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] 10.222.0.76 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.228332 Oct 27 10:25:24.227993 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2127/4063] 10.222.0.76 () {58 vars in 1122 bytes} [Thu Oct 27 10:25:23 2022] GET /compute/v2.1/limits => generated 511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:24.245064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:24.245064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:24.251761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.252545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.253268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.254324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.255373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.256545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.262605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:24.600681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:24.606473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:24.607894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:24.608616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:24.609524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:24.609699 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21ea5254-c10a-4274-9743-ce8bba18e5d2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1313 microversion: 2.1 time: 0.380617 Oct 27 10:25:24.610698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:24.613609 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2128/4064] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:24 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:24.620435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:24.625867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:24.626819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'name': '1464701169', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:24.643780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.644258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.645037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.646138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.647365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.648222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.650918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.651754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.653008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.653669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.654135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.654810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.679673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:24.692843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:24.700754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:24.717335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:25:24.719691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:25:24.757161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:24.800418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:24.810300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:24.828583 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e06c2b75-b432-4e85-aea8-87260d81690c tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?name=1464701169" status: 200 len: 346 microversion: 2.1 time: 0.212076 Oct 27 10:25:24.836824 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2129/4065] 10.222.0.76 () {58 vars in 1156 bytes} [Thu Oct 27 10:25:24 2022] GET /compute/v2.1/servers?name=1464701169 => generated 346 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:24.848283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17a71aa0-8b74-47a3-a613-0a982152d964 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1632643270", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:24.858432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:24.865120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Getting quotas for user 5286d64ef2e84d169837637fa0c3ebe0 and project 2667ac7667cc4f5bbe393742006746da. Resources: {'server_group_members'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:24.906772 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c81f7b4b-4bdb-4026-9879-6621bb043b99 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.572244 Oct 27 10:25:24.906772 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1937/4066] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:25:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:25:24.906772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:24.906772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:24.913319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.914013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.914450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.915325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:24.916340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:24.916959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:24.965426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-17a71aa0-8b74-47a3-a613-0a982152d964 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:25:25.276340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:25.288948 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fec022cd-5bf5-40ac-9a15-2d6af78f5ac5 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1315 microversion: 2.1 time: 0.386882 Oct 27 10:25:25.321364 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1938/4067] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:24 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:25.343868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:25.344853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:25.368575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:25.369092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:25.369528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:25.377027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:25.378951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:25.379658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:25.499089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-17a71aa0-8b74-47a3-a613-0a982152d964 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Getting quotas for project c808e99f493c41db9013547e7b2824d7. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:25.504733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-17a71aa0-8b74-47a3-a613-0a982152d964 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Getting quotas for user 16549ecfe776449faf16a7ed0a2e56dc and project c808e99f493c41db9013547e7b2824d7. Resources: dict_keys(['metadata_items']) {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:25.520130 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-17a71aa0-8b74-47a3-a613-0a982152d964 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17a71aa0-8b74-47a3-a613-0a982152d964 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Request method failure captured: Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 1752 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyTQ-bDY6QRir-L0yYscwi-qR9oojctU0W1g3tkIfohDWSyhEOLABRbRIYE96s81W4WTTmSD65-VM8at1ZESG9quuV55LO0rnXFzCtxvjAHJQDIJrKnnsRRCRILImJf9NGNyn-DVh_o3AA-2606zswcpyF21wnq2EO1zZBkE279p7o Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c808e99f493c41db9013547e7b2824d7 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1940314843 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c808e99f493c41db9013547e7b2824d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c808e99f493c41db9013547e7b2824d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c808e99f493c41db9013547e7b2824d7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c808e99f493c41db9013547e7b2824d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1940314843 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c808e99f493c41db9013547e7b2824d7 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1940314843 Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 16549ecfe776449faf16a7ed0a2e56dc Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1632643270", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:25.522213 n-d-854663-10 devstack@n-api.service[120720]: exception: Maximum number of metadata items exceeds 128 Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1632643270', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:25:25.525120 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17a71aa0-8b74-47a3-a613-0a982152d964 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17a71aa0-8b74-47a3-a613-0a982152d964 tempest-AbsoluteLimitsNegativeTestJSON-1940314843 tempest-AbsoluteLimitsNegativeTestJSON-1940314843-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.682968 Oct 27 10:25:25.528776 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2130/4068] 10.222.0.76 () {60 vars in 1148 bytes} [Thu Oct 27 10:25:24 2022] POST /compute/v2.1/servers => generated 87 bytes in 687 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:25:25.531625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:25.540646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:25.540646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:25.546503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:25.546973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:25.547548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:25.548273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:25.548885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:25.549312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:25.559697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:25.580709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:25.582736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:25.583996 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46c27664-ec0d-4cdb-9c56-b8935bb47a26 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1336 microversion: 2.47 time: 0.260290 Oct 27 10:25:25.584569 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1939/4069] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:25 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1336 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:25.621769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c381103-6686-4a81-8d70-e068e25c5557 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:25.622499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c381103-6686-4a81-8d70-e068e25c5557 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:25.706918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:25.774385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c381103-6686-4a81-8d70-e068e25c5557 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:25.785616 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c381103-6686-4a81-8d70-e068e25c5557 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1213 microversion: 2.1 time: 0.181492 Oct 27 10:25:25.786209 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1940/4070] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:25 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1213 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:25.795714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:25.798620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:25.803053 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a62d4958-470b-48c7-9484-3327bc51e029 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1006 microversion: 2.1 time: 0.277581 Oct 27 10:25:25.804103 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2131/4071] 10.222.0.76 () {58 vars in 1154 bytes} [Thu Oct 27 10:25:25 2022] GET /compute/v2.1/servers?name=-instance => generated 1006 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:25.815716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:25.816210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:25.816639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:25.817382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:25.817824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:25.818246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:25.833355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:25.843470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:25.844165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-146470116', 'deleted': False, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:25.857550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:25.858059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:25.858532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:25.859281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:25.859840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:25.860277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:25.975333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:26.069205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f223de77-55c9-4d08-ade5-b3bfba0634d7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-146470116" status: 200 len: 346 microversion: 2.1 time: 0.255117 Oct 27 10:25:26.077933 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2132/4072] 10.222.0.76 () {58 vars in 1228 bytes} [Thu Oct 27 10:25:25 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-146470116 => generated 346 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:26.083420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:26.085426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:26.093991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:26.094477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:26.094910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:26.095612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:26.096066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:26.096601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:26.100419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:26.111235 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4fe88a63-58ed-4cd4-a6e8-bd5b1b5dcac2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1313 microversion: 2.1 time: 0.323792 Oct 27 10:25:26.112766 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1941/4073] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:25 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:26.174628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:25:26.316143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:26.317398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:26.330766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:26.332353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:26.333628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:26.335893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:26.337837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:26.339156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:26.365189 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03de3dc8-ba30-48d8-a12d-e11e45f55125 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 204 len: 0 microversion: 2.1 time: 0.282716 Oct 27 10:25:26.367134 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2133/4074] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:26 2022] DELETE /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:26.401851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:26.406266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:26.423255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:26.426559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:26.427206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:26.428109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:26.431190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:26.432553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:27.308066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:27.328317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:27.344437 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f579cd15-2d01-4c61-9bc8-6c94b640b423 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1517 microversion: 2.1 time: 0.971820 Oct 27 10:25:27.347586 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ffb322de-2da4-4455-b89a-e60545a009ae tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1315 microversion: 2.1 time: 1.035147 Oct 27 10:25:27.349540 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1942/4075] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:26 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1315 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:27.379224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:27.380244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:27.388039 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2134/4076] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:26 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1517 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:27.394042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:27.395853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:27.399930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:27.401034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:27.401417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:27.402204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:27.402683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:27.403119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:27.409630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:27.410396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:27.411188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:27.412150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:27.413008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:27.413672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:27.598601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:27.602342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:27.613518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:27.613736 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c3d9142-93c4-4e0d-9aed-91e4deb247cb tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1283 microversion: 2.1 time: 0.223697 Oct 27 10:25:27.614363 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2135/4077] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:27 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1283 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:27.618977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:27.626358 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5fcf5dc-47ae-4503-a96c-6d3e1829acf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1357 microversion: 2.47 time: 0.269772 Oct 27 10:25:27.627037 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1943/4078] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:27 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:27.636542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:27.648461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:27.664435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:27.664944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:27.665369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:27.666061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:27.666561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:27.666952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:27.892933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:27.904045 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a0286996-eb2a-47de-8b36-46264ce17f1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1313 microversion: 2.1 time: 0.283850 Oct 27 10:25:27.905521 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2136/4079] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:27 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:27.914477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:27.922232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:27.929067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:27.929666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:27.930195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:27.931919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:27.932838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:27.933420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:27.972302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a21111bd-fad3-4b0b-9a89-d6a86aa76e50 req-e3bf7f4a-f324-4faa-8af3-59dffe2e3090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc68d83e-09db-424b-aaec-8bdbb4765ce9", "tag": "7178df06-87f7-4d8b-a6c0-546f6dbfe388"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:27.989708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a21111bd-fad3-4b0b-9a89-d6a86aa76e50 req-e3bf7f4a-f324-4faa-8af3-59dffe2e3090 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:27.990454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a21111bd-fad3-4b0b-9a89-d6a86aa76e50 req-e3bf7f4a-f324-4faa-8af3-59dffe2e3090 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:27.993185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a21111bd-fad3-4b0b-9a89-d6a86aa76e50 req-e3bf7f4a-f324-4faa-8af3-59dffe2e3090 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:28.029203 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a21111bd-fad3-4b0b-9a89-d6a86aa76e50 req-e3bf7f4a-f324-4faa-8af3-59dffe2e3090 service nova] Creating event network-changed:7178df06-87f7-4d8b-a6c0-546f6dbfe388 for instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 on n-h1-854663-10 Oct 27 10:25:28.044965 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a21111bd-fad3-4b0b-9a89-d6a86aa76e50 req-e3bf7f4a-f324-4faa-8af3-59dffe2e3090 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.416630 Oct 27 10:25:28.046803 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1944/4080] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:28.069426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:28.070165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:28.070892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:28.071524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:28.072153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:28.196792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:28.208768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:28.217203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:28.217697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:28.218132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:28.218836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:28.219270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:28.219687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:28.280350 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-abbf5ea2-0c33-4feb-b435-c4f50f5f454c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "POST /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb/action" status: 202 len: 1079 microversion: 2.47 time: 0.370677 Oct 27 10:25:28.283953 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2137/4081] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:25:27 2022] POST /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb/action => generated 1079 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 10:25:28.302467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:28.304078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:28.316782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:28.321016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:28.321520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:28.322261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:28.322723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:28.323263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:28.569855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:28.582244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:28.584248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:28.585690 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f0d3e6c0-06f6-4f3d-89a3-1b42be8571d4 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.287590 Oct 27 10:25:28.586734 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1945/4082] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:28 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:25:28.603734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:28.604642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:28.627819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:28.628713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:28.629405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:28.638006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:28.641152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:28.641920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:28.740321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:28.744361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:28.757967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:28.760733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:28.762366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:28.764124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:28.766126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:28.768134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:28.944066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:28.958212 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ade6f7fe-38b3-4041-b5d7-de9f1efb5de5 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1517 microversion: 2.1 time: 0.370219 Oct 27 10:25:28.959210 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1946/4083] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:28 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1517 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:28.969047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1969eece-a163-480f-9f1f-985c89d44b5c req-8ca81b95-538c-46d2-8421-ba7776f29417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a16e810-2ce6-4fa0-829e-1af369376408", "name": "network-vif-plugged", "status": "completed", "tag": "ab9f117e-7d8a-42ff-becc-c634bb030367"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:28.999083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:29.007290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1969eece-a163-480f-9f1f-985c89d44b5c req-8ca81b95-538c-46d2-8421-ba7776f29417 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.008335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1969eece-a163-480f-9f1f-985c89d44b5c req-8ca81b95-538c-46d2-8421-ba7776f29417 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:29.009069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1969eece-a163-480f-9f1f-985c89d44b5c req-8ca81b95-538c-46d2-8421-ba7776f29417 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:29.010203 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9269f833-7e0c-4b69-af61-841bb7e80e22 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1315 microversion: 2.1 time: 0.642469 Oct 27 10:25:29.011065 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2138/4084] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:28 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:29.043665 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1969eece-a163-480f-9f1f-985c89d44b5c req-8ca81b95-538c-46d2-8421-ba7776f29417 service nova] Creating event network-vif-plugged:ab9f117e-7d8a-42ff-becc-c634bb030367 for instance 7a16e810-2ce6-4fa0-829e-1af369376408 on n-h2-854663-10 Oct 27 10:25:29.053403 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1969eece-a163-480f-9f1f-985c89d44b5c req-8ca81b95-538c-46d2-8421-ba7776f29417 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092045 Oct 27 10:25:29.054642 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1947/4085] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:29.055333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:29.058911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:29.062873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:29.063839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:29.073449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.074135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:29.075005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:29.075929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.077078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.077436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:29.078377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:29.079913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:29.080371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:29.081309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.084196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:29.084721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:29.388592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:29.401765 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-143b3c8b-b527-467d-a1ef-61ae97ef7f9a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1313 microversion: 2.1 time: 0.345548 Oct 27 10:25:29.402627 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1948/4086] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:29 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:29.411602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c4924974-1a48-4174-925c-78f26a8c4e31 req-92ff711e-2611-44b7-81b8-ba4a5b4bab5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4d5987-7e66-4029-a235-894334151d30", "name": "network-vif-deleted", "tag": "728f35fa-6941-4935-814d-4337c8eca41b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:29.436798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c4924974-1a48-4174-925c-78f26a8c4e31 req-92ff711e-2611-44b7-81b8-ba4a5b4bab5c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.437586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c4924974-1a48-4174-925c-78f26a8c4e31 req-92ff711e-2611-44b7-81b8-ba4a5b4bab5c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:29.439464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c4924974-1a48-4174-925c-78f26a8c4e31 req-92ff711e-2611-44b7-81b8-ba4a5b4bab5c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:29.456396 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c4924974-1a48-4174-925c-78f26a8c4e31 req-92ff711e-2611-44b7-81b8-ba4a5b4bab5c service nova] Creating event network-vif-deleted:728f35fa-6941-4935-814d-4337c8eca41b for instance 3e4d5987-7e66-4029-a235-894334151d30 on n-h1-854663-10 Oct 27 10:25:29.476620 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c4924974-1a48-4174-925c-78f26a8c4e31 req-92ff711e-2611-44b7-81b8-ba4a5b4bab5c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072569 Oct 27 10:25:29.477327 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1949/4087] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:29.510982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:29.520524 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e2e8129-8498-4f64-95f7-c79cd25423c6 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1313 microversion: 2.1 time: 0.506371 Oct 27 10:25:29.526345 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2139/4088] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:29 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:29.616025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:29.616914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:29.632631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.634571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:29.635156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:29.637359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.638522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:29.640363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:29.771226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:29.780628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:29.782676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:29.784101 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13b44c07-3fd6-4731-82c5-0d52db9ad90a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.173426 Oct 27 10:25:29.785109 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1950/4089] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:29 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:29.981542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:29.982143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:29.993236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.993715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:29.994153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:29.994951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:29.995407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.006470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:30.038133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:30.038962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:30.047070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:30.047841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.048562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:30.049347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lazy-loading 'fault' on Instance uuid 3e4d5987-7e66-4029-a235-894334151d30 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:25:30.051079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:30.051750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.052182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:30.052966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:30.058281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.058969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:30.108638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:30.113097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:30.121328 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d5d9bf2-6f21-438d-a28d-11e4faaccbef tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 200 len: 1309 microversion: 2.1 time: 0.143655 Oct 27 10:25:30.122442 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2140/4090] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:29 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 1309 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:30.425586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:30.426209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:30.441458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:30.442338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.443547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:30.447567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:30.448830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.449632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:30.730938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:30.739649 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-510fc7b8-2f76-445b-ba61-e406817c13aa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1315 microversion: 2.1 time: 0.706477 Oct 27 10:25:30.755812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1951/4091] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:30 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:30.761480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:30.762299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:30.770303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:30.771230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.772136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:30.773719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:30.774425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.775089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:30.792912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:30.802341 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59395cfd-7bc7-4e28-b196-13ac3fbf4440 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1313 microversion: 2.1 time: 0.381737 Oct 27 10:25:30.819501 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2141/4092] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:30 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:30.832434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:30.832989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:30.840189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:30.840727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.841906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:30.842790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:30.843407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:30.843998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.056493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:31.069854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:31.071291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:31.073085 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f97722b-5268-48ac-aaa3-c766530149aa tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.247062 Oct 27 10:25:31.073668 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2142/4093] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:30 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:31.145628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:31.146350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 3e4d5987-7e66-4029-a235-894334151d30] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:31.156642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.157778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.158773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.159835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.160586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.161291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.179379 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] HTTP exception thrown: Instance 3e4d5987-7e66-4029-a235-894334151d30 could not be found. Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Request method failure captured: Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 HTTP/1.1 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlxFpmdKf-7x1BgJfm-IHylwkBsCGlrVPiSH69IXZCp447gFlp_yqnYknD8ZnsjiTpqPqiURhQ58Y4rO0Z2jnGOmslp6seuyhQmH0venZAk66gb0FeKiWpfeJyzjdpCjlHy2ov18JO_KCPgnPBrIgyjMWK1XOJlCXnbNA4yjfmyi_ew Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d18b9a2f9c34475eb3ef1dd2cbeaa320 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ListServerFiltersTestJSON-30790981 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d18b9a2f9c34475eb3ef1dd2cbeaa320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d18b9a2f9c34475eb3ef1dd2cbeaa320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d18b9a2f9c34475eb3ef1dd2cbeaa320", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d18b9a2f9c34475eb3ef1dd2cbeaa320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ListServerFiltersTestJSON-30790981 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d18b9a2f9c34475eb3ef1dd2cbeaa320 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-30790981 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ListServerFiltersTestJSON-30790981-project Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 42cda02f04334e57aa66529ca56d9a75 Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ListServerFiltersTestJSON-30790981-project Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 3e4d5987-7e66-4029-a235-894334151d30 could not be found. Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '3e4d5987-7e66-4029-a235-894334151d30'} Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4d5987-7e66-4029-a235-894334151d30 could not be found. Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4d5987-7e66-4029-a235-894334151d30 could not be found. Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:31.181187 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4d5987-7e66-4029-a235-894334151d30 could not be found. Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Returning 404 to user: Instance 3e4d5987-7e66-4029-a235-894334151d30 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f8a87c8-fa63-4ae8-ac14-baf7a493e52f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30" status: 404 len: 111 microversion: 2.1 time: 0.041354 Oct 27 10:25:31.189732 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2143/4094] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:31 2022] GET /compute/v2.1/servers/3e4d5987-7e66-4029-a235-894334151d30 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:25:31.198615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:31.199129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:31.210376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:31.214444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.214870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.215313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.218802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.219309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.219761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.222558 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c13b3f7-2f2d-4840-a9b5-196b2ee209d5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1313 microversion: 2.1 time: 0.465096 Oct 27 10:25:31.245159 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1952/4095] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:30 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:31.265037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:25:31.362280 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a6485a7-02c3-4e7b-bd66-a91f912bfa29 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f" status: 204 len: 0 microversion: 2.1 time: 0.169497 Oct 27 10:25:31.363551 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2144/4096] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:31 2022] DELETE /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:31.372560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:31.373227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:31.382432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.384204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.385021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.386728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.387690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.388837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.396558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:31.571735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0858325a-27af-410c-b739-a6f40d93eaa8 req-c2e0e5d4-86e6-4db6-9bdc-f61365bee7be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f92da9-0dfb-444a-b25b-5e1ba88b6818", "tag": "d80dc18d-36fe-4932-9abb-a6e788c957c8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:31.584039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0858325a-27af-410c-b739-a6f40d93eaa8 req-c2e0e5d4-86e6-4db6-9bdc-f61365bee7be service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.584411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0858325a-27af-410c-b739-a6f40d93eaa8 req-c2e0e5d4-86e6-4db6-9bdc-f61365bee7be service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.584942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0858325a-27af-410c-b739-a6f40d93eaa8 req-c2e0e5d4-86e6-4db6-9bdc-f61365bee7be service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.598491 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0858325a-27af-410c-b739-a6f40d93eaa8 req-c2e0e5d4-86e6-4db6-9bdc-f61365bee7be service nova] Creating event network-changed:d80dc18d-36fe-4932-9abb-a6e788c957c8 for instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 on n-h2-854663-10 Oct 27 10:25:31.602999 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0858325a-27af-410c-b739-a6f40d93eaa8 req-c2e0e5d4-86e6-4db6-9bdc-f61365bee7be service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035336 Oct 27 10:25:31.603582 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2145/4097] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:25:31.607678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:31.622884 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1465a626-1a0b-4721-bafb-304f85c95ac1 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f" status: 200 len: 1514 microversion: 2.1 time: 0.254992 Oct 27 10:25:31.623935 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1953/4098] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:31 2022] GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:31.764843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:31.765978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:31.773865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.775731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.776491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.778148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.778855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.779578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.831460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:31.832765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:31.839911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.840933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.841652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:31.842931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:31.843618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:31.844272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.081516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:32.091283 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-753aa154-deb8-486e-8b88-0b6b8262303f tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1315 microversion: 2.1 time: 0.331713 Oct 27 10:25:32.092253 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2146/4099] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:31 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:32.099929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:32.100796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:32.108111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:32.108884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:32.109319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.110243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:32.110868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:32.111294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.151505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:32.159839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c71513b-e908-4e41-8306-66a7be6d4c9f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1499 microversion: 2.1 time: 0.332799 Oct 27 10:25:32.160433 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1954/4100] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:31 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1499 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:32.184966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b46fc43-b5fb-4f1a-8eea-42d75567d336 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:32.192754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b46fc43-b5fb-4f1a-8eea-42d75567d336 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:32.193501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b46fc43-b5fb-4f1a-8eea-42d75567d336 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:32.194176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b46fc43-b5fb-4f1a-8eea-42d75567d336 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.198330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:32.210551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:32.212530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:32.215244 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6665fc31-3c8a-4b2a-bf48-e0f9fdd2fb9f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.118563 Oct 27 10:25:32.216003 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2147/4101] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:32 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:32.249164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:32.249814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:32.251727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b46fc43-b5fb-4f1a-8eea-42d75567d336 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Going to try to stop instance {{(pid=120719) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:25:32.261064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:32.261573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:32.266977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.268161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:32.268826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:32.269265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.327589 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b46fc43-b5fb-4f1a-8eea-42d75567d336 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408/action" status: 202 len: 0 microversion: 2.1 time: 0.146512 Oct 27 10:25:32.328597 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1955/4102] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:25:32 2022] POST /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:25:32.342585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:32.343631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:32.352079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:32.352900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:32.353556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.354629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:32.355404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:32.355919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.594416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:32.606228 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-319e4f6f-8c6c-48f6-a7de-3f9185e818ca tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1313 microversion: 2.1 time: 0.362420 Oct 27 10:25:32.606806 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2148/4103] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:32 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:32.629880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:32.638479 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb97fbb4-b765-43bf-b42a-742cc4dbbc03 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.301354 Oct 27 10:25:32.639118 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1956/4104] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:32 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:32.649580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:32.650905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:32.659720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:32.660212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:32.660646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.661405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:32.661863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:32.662280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:32.867898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:32.876264 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9dfc8eef-4173-4f9c-b173-a0a566aba55f tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f" status: 200 len: 1514 microversion: 2.1 time: 0.231036 Oct 27 10:25:32.889088 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2149/4105] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:32 2022] GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:33.116169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:33.117192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:33.124926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.125587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.126137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.126963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.127742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.128371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.244290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:33.245710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:33.252266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.253587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.254214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.255734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.256359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.257102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.287632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:33.296378 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c65d1f87-4426-48d6-997a-9d71eee948ed tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1315 microversion: 2.1 time: 0.184496 Oct 27 10:25:33.296993 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1957/4106] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:33 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:33.353641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:33.362964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:33.364390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:33.365614 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8abc49c0-efb9-4c58-8f23-b9e58586586a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.126890 Oct 27 10:25:33.366165 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2150/4107] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:33 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:25:33.630425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:33.631048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:33.639684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.640194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.640926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.641850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.642345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.642773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.663155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:33.664378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:33.681531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.682730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.683595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.684715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.685378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.686175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.893474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:33.895421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:33.904299 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5463786-3358-4366-b98d-b40b66d93691 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1313 microversion: 2.1 time: 0.278494 Oct 27 10:25:33.905034 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1958/4108] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:33 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:33.910742 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1631b49-b4b7-4732-a682-a5b4dccb9ae9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.251573 Oct 27 10:25:33.911534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-455e3f11-319d-45fa-a34a-85775a9a2481 req-a299dc8d-9ccd-4d84-8bf7-0e30d0bf03f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc68d83e-09db-424b-aaec-8bdbb4765ce9", "name": "network-vif-plugged", "status": "completed", "tag": "7178df06-87f7-4d8b-a6c0-546f6dbfe388"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:33.913788 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2151/4109] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:33 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:33.929498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-455e3f11-319d-45fa-a34a-85775a9a2481 req-a299dc8d-9ccd-4d84-8bf7-0e30d0bf03f4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.932553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-455e3f11-319d-45fa-a34a-85775a9a2481 req-a299dc8d-9ccd-4d84-8bf7-0e30d0bf03f4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.933430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:33.933665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-455e3f11-319d-45fa-a34a-85775a9a2481 req-a299dc8d-9ccd-4d84-8bf7-0e30d0bf03f4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.934940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:33.944333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.945103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.945700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.946860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:33.947581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:33.948747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:33.951336 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-455e3f11-319d-45fa-a34a-85775a9a2481 req-a299dc8d-9ccd-4d84-8bf7-0e30d0bf03f4 service nova] Creating event network-vif-plugged:7178df06-87f7-4d8b-a6c0-546f6dbfe388 for instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 on n-h1-854663-10 Oct 27 10:25:33.961494 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-455e3f11-319d-45fa-a34a-85775a9a2481 req-a299dc8d-9ccd-4d84-8bf7-0e30d0bf03f4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054950 Oct 27 10:25:33.962416 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1959/4110] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:34.147366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:34.157318 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0706cf80-960d-46bf-badb-45bf82847815 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f" status: 200 len: 1514 microversion: 2.1 time: 0.242285 Oct 27 10:25:34.159008 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2152/4111] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:33 2022] GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:34.322963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:34.324374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:34.331586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:34.332190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:34.332780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:34.333736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:34.334249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:34.334745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:34.394582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:34.395898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:34.408281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:34.409736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:34.410375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:34.411316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:34.411939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:34.412549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:34.500990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:34.509523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:34.511309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:34.512754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f78f6d9-6cd2-41bc-81d4-5761f0a3fd65 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.122479 Oct 27 10:25:34.513814 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2153/4112] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:34 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:34.539354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:34.548897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-071b1207-65d1-4f9a-969c-7ede96fe88d2 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1315 microversion: 2.1 time: 0.230910 Oct 27 10:25:34.550252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1960/4113] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:34 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:34.933090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:34.933712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:34.941117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:34.941863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:34.942695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:34.943289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:34.944185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:34.944835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:34.946454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:34.948235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:34.949223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:34.958219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:34.958863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:34.959521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:34.960405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:34.961105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:34.961618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:35.226501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:35.245471 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5d4c5ded-08aa-4cb4-b830-0c2cdd6adaa7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.305589 Oct 27 10:25:35.249624 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1961/4114] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:34 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:35.263381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c2caa970-1dd8-4aa8-b986-ab12562ce6f6 req-8c0ab9a0-9a91-4720-af56-0d4fca768981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a26b4e0-7122-4ddf-8cde-c15d3720517f", "name": "network-vif-deleted", "tag": "b5a1020c-5882-4d04-832e-25d851f5d24f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:35.295491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c2caa970-1dd8-4aa8-b986-ab12562ce6f6 req-8c0ab9a0-9a91-4720-af56-0d4fca768981 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:35.298416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:35.298848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c2caa970-1dd8-4aa8-b986-ab12562ce6f6 req-8c0ab9a0-9a91-4720-af56-0d4fca768981 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:35.299605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c2caa970-1dd8-4aa8-b986-ab12562ce6f6 req-8c0ab9a0-9a91-4720-af56-0d4fca768981 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:35.310802 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bbab1fc-9b13-42bb-9134-708f2bbeb3bd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1313 microversion: 2.1 time: 0.384464 Oct 27 10:25:35.316788 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2154/4115] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:34 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:35.331202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:35.331851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:35.335327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c2caa970-1dd8-4aa8-b986-ab12562ce6f6 req-8c0ab9a0-9a91-4720-af56-0d4fca768981 service nova] Creating event network-vif-deleted:b5a1020c-5882-4d04-832e-25d851f5d24f for instance 1a26b4e0-7122-4ddf-8cde-c15d3720517f on n-h2-854663-10 Oct 27 10:25:35.342589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:35.343349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:35.344024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:35.345020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:35.345659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:35.346545 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c2caa970-1dd8-4aa8-b986-ab12562ce6f6 req-8c0ab9a0-9a91-4720-af56-0d4fca768981 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094422 Oct 27 10:25:35.347965 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1962/4116] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:35.349441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:35.408777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:35.409377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:35.409818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:35.410544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lazy-loading 'fault' on Instance uuid 1a26b4e0-7122-4ddf-8cde-c15d3720517f {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:25:35.481004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:35.490389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33bb0d91-1710-4ddf-8e22-45f3121fde80 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f" status: 200 len: 1307 microversion: 2.1 time: 0.171962 Oct 27 10:25:35.492246 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2155/4117] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:35 2022] GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:35.542987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:35.543701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:35.560368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:35.560896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:35.561337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:35.562058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:35.562513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:35.562939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:35.572999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:35.573679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:35.580944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=32 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:35.583149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:35.583816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:35.584257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:35.585801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:35.586278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:35.586706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:35.713040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:35.727182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:35.732188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:35.733962 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-935e2bc8-2075-4745-9303-d22ecc3fc9b9 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.196056 Oct 27 10:25:35.749437 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1963/4118] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:35 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:25:35.886653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:35.891588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:35.900555 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8ee4557-c529-4138-bb61-548b5d16d621 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1315 microversion: 2.1 time: 0.331620 Oct 27 10:25:35.902245 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2156/4119] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:35 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:36.030375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=60 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:36.137756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-647b3a81-27e2-4ed4-b233-eb6f4c49e82f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: .version_select at 0x7f6d5ab53dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-704636127", "description": "tempest-description-1726978817"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:36.276795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:36.277582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:36.279919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=20 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:36.287059 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-647b3a81-27e2-4ed4-b233-eb6f4c49e82f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.262041 Oct 27 10:25:36.287909 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1964/4120] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:25:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:36.293868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:36.294377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:36.294792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:36.295496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:36.295955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:36.302115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b5740f14-cf90-4027-9131-ae4439ee3b1a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: .version_select at 0x7f6d5ab53820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-502332086", "description": "tempest-description-565881672"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:36.305310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:36.859793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:36.869479 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46c0dd8c-c5e5-4e42-8989-1e60dd9b9f44 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.597762 Oct 27 10:25:36.870359 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2157/4121] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:36 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:36.890662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:36.891269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:36.897682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:36.898391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:36.898988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:36.899865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:36.900479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:36.901086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:36.930885 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b5740f14-cf90-4027-9131-ae4439ee3b1a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.633307 Oct 27 10:25:36.931832 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1965/4122] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:25:36 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:36.943896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:36.945019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: 1a26b4e0-7122-4ddf-8cde-c15d3720517f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:36.957002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:36.957656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:36.958382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:36.960606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:36.961426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:36.964091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:36.988423 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] HTTP exception thrown: Instance 1a26b4e0-7122-4ddf-8cde-c15d3720517f could not be found. Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Request method failure captured: Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f HTTP/1.1 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlxFpmdKf-7x1BgJfm-IHylwkBsCGlrVPiSH69IXZCp447gFlp_yqnYknD8ZnsjiTpqPqiURhQ58Y4rO0Z2jnGOmslp6seuyhQmH0venZAk66gb0FeKiWpfeJyzjdpCjlHy2ov18JO_KCPgnPBrIgyjMWK1XOJlCXnbNA4yjfmyi_ew Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d18b9a2f9c34475eb3ef1dd2cbeaa320 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ListServerFiltersTestJSON-30790981 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d18b9a2f9c34475eb3ef1dd2cbeaa320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d18b9a2f9c34475eb3ef1dd2cbeaa320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d18b9a2f9c34475eb3ef1dd2cbeaa320", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d18b9a2f9c34475eb3ef1dd2cbeaa320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ListServerFiltersTestJSON-30790981 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d18b9a2f9c34475eb3ef1dd2cbeaa320 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-30790981 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ListServerFiltersTestJSON-30790981-project Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 42cda02f04334e57aa66529ca56d9a75 Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ListServerFiltersTestJSON-30790981-project Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 1a26b4e0-7122-4ddf-8cde-c15d3720517f could not be found. Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '1a26b4e0-7122-4ddf-8cde-c15d3720517f'} Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a26b4e0-7122-4ddf-8cde-c15d3720517f could not be found. Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a26b4e0-7122-4ddf-8cde-c15d3720517f could not be found. Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:36.991204 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:36.997441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:36.997441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:36.997441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:36.997441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:36.997441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:36.997441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a26b4e0-7122-4ddf-8cde-c15d3720517f could not be found. Oct 27 10:25:36.997441 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:37.000270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Returning 404 to user: Instance 1a26b4e0-7122-4ddf-8cde-c15d3720517f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:37.002371 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cebdb1fc-d70b-4f8e-b300-b80b34f421bb tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f" status: 404 len: 111 microversion: 2.1 time: 0.068212 Oct 27 10:25:37.006049 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1966/4123] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:36 2022] GET /compute/v2.1/servers/1a26b4e0-7122-4ddf-8cde-c15d3720517f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:37.012475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:37.013514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:37.020084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.020260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.020588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.021439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.021890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.022310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.123581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:37.136110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:37.137603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:37.138834 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c892b00-d68c-45fd-a07d-d34068f43db2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.130710 Oct 27 10:25:37.139405 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1967/4124] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:37 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:37.145958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:37.146339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:37.146461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:37.152720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.153495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.154147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.155030 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f44ba7b-ab85-4b5c-a086-da7fab77d3dd tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1313 microversion: 2.1 time: 0.269152 Oct 27 10:25:37.155182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.155489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.156478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.179323 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2158/4125] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:36 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:37.185195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-548479300", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "78d6ccf4-fcb7-4aa3-acdb-ca1493958b56"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:37.246600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] validate_networks() for [('78d6ccf4-fcb7-4aa3-acdb-ca1493958b56', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:25:37.371543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:37.392212 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22ba871e-2cde-46b4-9e70-4864a8125dd9 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1501 microversion: 2.1 time: 0.251550 Oct 27 10:25:37.392867 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1968/4126] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:37 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:37.398227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:37.398962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:37.406380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.406877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.407958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.408709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.409177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.409627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.440118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:25:37.518967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:37.529426 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-645cd7e6-ad61-4f13-9220-7865f1b18fb4 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "DELETE /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 204 len: 0 microversion: 2.1 time: 0.134950 Oct 27 10:25:37.530043 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1969/4127] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:37 2022] DELETE /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:37.538833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:37.539469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:37.546034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.546540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.546981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.547692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.548152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.548578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.574117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lazy-loading 'flavor' on Instance uuid bc68d83e-09db-424b-aaec-8bdbb4765ce9 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:25:37.595748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:37.650903 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31a896cc-2b9d-46ea-83fe-95805dd1ac93 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "POST /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9/action" status: 202 len: 0 microversion: 2.1 time: 0.116471 Oct 27 10:25:37.652229 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1970/4128] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:25:37 2022] POST /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:25:37.660546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:37.661780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:37.669429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.670216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.671002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.671988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.672649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.673618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.731149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:37.731579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:37.732286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:37.732739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:37.733162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:37.743782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.744427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.744929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.745997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.746509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.746937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.766601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Getting quotas for project c507a1f574f442e7a2bed77fd6128e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:37.772792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Getting quotas for user 56b0e71b200045128271a5b441a5b796 and project c507a1f574f442e7a2bed77fd6128e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:37.787395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:25:37.790028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:25:37.832041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:37.842274 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-274e5acb-5deb-428e-8cc2-d006687b49c7 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1519 microversion: 2.1 time: 0.187164 Oct 27 10:25:37.842782 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83137a82-0a57-4b04-a063-3c3fedb0cd18 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661327 Oct 27 10:25:37.842972 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1971/4129] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:37 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:37.844409 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2159/4130] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:25:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:25:37.855656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-708e0b44-7732-4c26-99a3-e4de07a50a10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:37.856957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-708e0b44-7732-4c26-99a3-e4de07a50a10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:37.865147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:37.866312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:37.873070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.873804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.874354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.875146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.875862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.876189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.920830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-708e0b44-7732-4c26-99a3-e4de07a50a10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:37.934716 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-708e0b44-7732-4c26-99a3-e4de07a50a10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1215 microversion: 2.1 time: 0.083247 Oct 27 10:25:37.944695 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2160/4131] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:37 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:37.944695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:37.944695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:37.951068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.951583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.952422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:37.953250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:37.953734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:37.954243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:38.082981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:38.096387 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aadd31f9-34c8-4426-84b0-dede4dc4bf84 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1509 microversion: 2.1 time: 0.242263 Oct 27 10:25:38.098632 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1972/4132] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:37 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:38.148761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:38.158732 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2efd4567-e7ae-4393-9fd9-c32bf87ac47c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.221808 Oct 27 10:25:38.177723 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2161/4133] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:37 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:38.183134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:38.183527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:38.186769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:38.187789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:38.194316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:38.194818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:38.195258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:38.195992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:38.196390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:38.196542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:38.197006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:38.197673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:38.198454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:38.199671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:38.200375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:38.201338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:38.310826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:38.319972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:38.327588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:38.329084 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9578c706-7294-4233-9402-27b4e52e553e tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.146763 Oct 27 10:25:38.332250 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2162/4134] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:38 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:38.449497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f3066953-2f16-43ca-a522-7035b5539028 req-c4ff1ff5-78fa-4154-bcab-974d80c71638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f92da9-0dfb-444a-b25b-5e1ba88b6818", "name": "network-vif-plugged", "status": "completed", "tag": "d80dc18d-36fe-4932-9abb-a6e788c957c8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:38.464684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:38.483486 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b287f22-3d3f-4872-8fe9-d5e0c24709be tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1313 microversion: 2.1 time: 0.304853 Oct 27 10:25:38.484694 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1973/4135] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:38 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:38.486416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f3066953-2f16-43ca-a522-7035b5539028 req-c4ff1ff5-78fa-4154-bcab-974d80c71638 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:38.486896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f3066953-2f16-43ca-a522-7035b5539028 req-c4ff1ff5-78fa-4154-bcab-974d80c71638 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:38.487329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f3066953-2f16-43ca-a522-7035b5539028 req-c4ff1ff5-78fa-4154-bcab-974d80c71638 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:38.500977 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f3066953-2f16-43ca-a522-7035b5539028 req-c4ff1ff5-78fa-4154-bcab-974d80c71638 service nova] Creating event network-vif-plugged:d80dc18d-36fe-4932-9abb-a6e788c957c8 for instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 on n-h2-854663-10 Oct 27 10:25:38.511447 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f3066953-2f16-43ca-a522-7035b5539028 req-c4ff1ff5-78fa-4154-bcab-974d80c71638 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065347 Oct 27 10:25:38.512076 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2163/4136] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:38.872285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:38.873541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:38.881135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:38.881688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:38.882378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:38.883115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:38.883563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:38.883979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:38.964000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:38.964932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:38.972793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:38.973149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:38.973834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:38.974837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:38.975392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:38.976118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:39.088870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:39.098127 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d96faffc-c5d3-4004-8eb0-feb8465d5c5b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1219 microversion: 2.1 time: 0.139024 Oct 27 10:25:39.099291 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2164/4137] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:38 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:39.103227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:39.114374 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88a908a6-86e4-4f4f-9c57-19edd7cfbb8b tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1519 microversion: 2.1 time: 0.245315 Oct 27 10:25:39.115955 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1974/4138] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:38 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:39.125805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:39.126423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:39.137728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:39.138524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:39.139241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:39.139994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:39.140506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:39.140979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:39.186932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:39.187567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:39.197655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:39.198321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:39.199505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:39.200514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:39.201096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:39.201678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:39.484077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:39.494826 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7ffd4e7f-cb37-4271-9a81-951da2641bbe tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.312363 Oct 27 10:25:39.518755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:39.523564 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1975/4139] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:39 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:39.530688 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53c02fcb-0477-4baa-8af0-6f62e26658ef tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1509 microversion: 2.1 time: 0.412110 Oct 27 10:25:39.535408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:39.536342 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2165/4140] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:39 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:39.541525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:39.544753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:39.546984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:39.554492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:39.557165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:39.557799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:39.559499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:39.561524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:39.561893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:39.563230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:39.563788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:39.564548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:39.565022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:39.565440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:39.567871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:39.779024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:39.791845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:39.796579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:39.797839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d8245e2-3019-4a5c-a793-e234e8c0ce87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.270032 Oct 27 10:25:39.801531 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1976/4141] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:39 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:39.815438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:39.827527 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-153a0b71-ca76-42aa-9a1e-ee59e2d1d89f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1313 microversion: 2.1 time: 0.289798 Oct 27 10:25:39.829687 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2166/4142] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:39 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:40.004298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-90550021-918a-4ab7-bb68-6c347fb616d6 req-8fce468e-b2e9-43bf-a8da-6dbb5738f6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc187b6-d1ef-46d1-aead-aefd533b174c", "name": "network-vif-deleted", "tag": "4a7906e3-0bae-4891-942c-be7dc72f9b38"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:40.016445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-90550021-918a-4ab7-bb68-6c347fb616d6 req-8fce468e-b2e9-43bf-a8da-6dbb5738f6c8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.017015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-90550021-918a-4ab7-bb68-6c347fb616d6 req-8fce468e-b2e9-43bf-a8da-6dbb5738f6c8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.017447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-90550021-918a-4ab7-bb68-6c347fb616d6 req-8fce468e-b2e9-43bf-a8da-6dbb5738f6c8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.034753 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-90550021-918a-4ab7-bb68-6c347fb616d6 req-8fce468e-b2e9-43bf-a8da-6dbb5738f6c8 service nova] Creating event network-vif-deleted:4a7906e3-0bae-4891-942c-be7dc72f9b38 for instance dcc187b6-d1ef-46d1-aead-aefd533b174c on n-h1-854663-10 Oct 27 10:25:40.042580 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-90550021-918a-4ab7-bb68-6c347fb616d6 req-8fce468e-b2e9-43bf-a8da-6dbb5738f6c8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042989 Oct 27 10:25:40.043840 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1977/4143] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:40.127959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:40.128603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:40.137884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.138851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.139460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.140028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:40.140858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:40.141415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.154626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.155991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.159705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.160321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.160816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.161555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.162002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.162423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.262336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:40.271769 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4bbcfe57-1984-48e5-b24b-54e324864f7b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1275 microversion: 2.1 time: 0.150134 Oct 27 10:25:40.272974 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2167/4144] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:40 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:40.273104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.273677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.274146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.274613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lazy-loading 'fault' on Instance uuid dcc187b6-d1ef-46d1-aead-aefd533b174c {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:25:40.330643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cda02f04334e57aa66529ca56d9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b9a2f9c34475eb3ef1dd2cbeaa320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:40.342933 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-432303e8-821b-4162-9358-9458437d2fa3 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 200 len: 1311 microversion: 2.1 time: 0.207275 Oct 27 10:25:40.344020 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1978/4145] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:40 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 1311 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:40.525363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:40.525995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:40.532922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.533416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.533848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.534555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.534999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.535412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.566257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:40.567334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:40.573783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.574609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.576085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.580178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.580178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.580178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.733621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:40.752416 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7af9e61-95ff-44c3-98d7-4552f698814c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.230469 Oct 27 10:25:40.753940 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2168/4146] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:40 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:40.763865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:40.773905 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-172c8acc-dd4c-4290-9bb1-cbe429c0e6dc tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1492 microversion: 2.1 time: 0.211464 Oct 27 10:25:40.789240 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1979/4147] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:40 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1492 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:40.801879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:40.802575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:40.809951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.811174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.811795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.813108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.813729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.814369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.827365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:40.828176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:40.834952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.835525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.836056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.837224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.837847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.839093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.858866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:25:40.942552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:40.952465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:40.954708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:40.956339 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb42b9d5-0973-4ed5-8d0f-7f3ae0ccccf7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.134788 Oct 27 10:25:40.957659 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1980/4148] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:40 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:25:40.962777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:40.963404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:40.970341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.970842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.971587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:40.972310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:40.972846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:40.973389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.001669 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-caaaf2a6-5eb2-4068-9e0e-0b5acfb34701 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 204 len: 0 microversion: 2.1 time: 0.206895 Oct 27 10:25:41.005912 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2169/4149] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:40 2022] DELETE /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:41.020860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:41.021692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:41.030558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.031053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.031717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.032649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.033332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.033987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.201972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:41.212304 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9621bfea-2f78-4a81-afcf-44afc4ea3103 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1498 microversion: 2.1 time: 0.253713 Oct 27 10:25:41.213255 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1981/4150] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:40 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1498 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:41.233621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:41.236114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59dfb015-1b10-4bbc-ba74-e594b5b884c5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:41.242571 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a444c3e9-ea40-4e12-9326-0c8dd9d574fa tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1498 microversion: 2.1 time: 0.234845 Oct 27 10:25:41.243163 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2170/4151] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:41 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1498 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:41.250193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.compute.server_groups [None req-59dfb015-1b10-4bbc-ba74-e594b5b884c5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Querying cell 9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) for 1 instances {{(pid=120719) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 10:25:41.251178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59dfb015-1b10-4bbc-ba74-e594b5b884c5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.251825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59dfb015-1b10-4bbc-ba74-e594b5b884c5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.252250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59dfb015-1b10-4bbc-ba74-e594b5b884c5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.284107 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59dfb015-1b10-4bbc-ba74-e594b5b884c5 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups/9b453cba-31ef-4cca-bf2f-0319f8f5750d" status: 200 len: 222 microversion: 2.1 time: 0.052114 Oct 27 10:25:41.284927 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1982/4152] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:25:41 2022] GET /compute/v2.1/os-server-groups/9b453cba-31ef-4cca-bf2f-0319f8f5750d => generated 222 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:25:41.296626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:41.297214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:41.297762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:41.298326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:41.300471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:41.304325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.304841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.305275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.305866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.306022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.306356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.306507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.306787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.306939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.308143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.308871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.309460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.335132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:25:41.414768 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-113f9304-1700-4c65-97d6-5e495c4b56a2 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 204 len: 0 microversion: 2.1 time: 0.122551 Oct 27 10:25:41.415336 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2171/4153] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:41 2022] DELETE /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:41.426149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:41.427163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] [instance: dcc187b6-d1ef-46d1-aead-aefd533b174c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:41.433731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.434212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.434640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.435329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.435784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.436182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.449985 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] HTTP exception thrown: Instance dcc187b6-d1ef-46d1-aead-aefd533b174c could not be found. Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Request method failure captured: Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c HTTP/1.1 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlxFpmdKf-7x1BgJfm-IHylwkBsCGlrVPiSH69IXZCp447gFlp_yqnYknD8ZnsjiTpqPqiURhQ58Y4rO0Z2jnGOmslp6seuyhQmH0venZAk66gb0FeKiWpfeJyzjdpCjlHy2ov18JO_KCPgnPBrIgyjMWK1XOJlCXnbNA4yjfmyi_ew Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d18b9a2f9c34475eb3ef1dd2cbeaa320 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ListServerFiltersTestJSON-30790981 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d18b9a2f9c34475eb3ef1dd2cbeaa320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d18b9a2f9c34475eb3ef1dd2cbeaa320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d18b9a2f9c34475eb3ef1dd2cbeaa320", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d18b9a2f9c34475eb3ef1dd2cbeaa320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ListServerFiltersTestJSON-30790981 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d18b9a2f9c34475eb3ef1dd2cbeaa320 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-30790981 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ListServerFiltersTestJSON-30790981-project Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 42cda02f04334e57aa66529ca56d9a75 Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ListServerFiltersTestJSON-30790981-project Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance dcc187b6-d1ef-46d1-aead-aefd533b174c could not be found. Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'dcc187b6-d1ef-46d1-aead-aefd533b174c'} Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc187b6-d1ef-46d1-aead-aefd533b174c could not be found. Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc187b6-d1ef-46d1-aead-aefd533b174c could not be found. Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:41.451597 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc187b6-d1ef-46d1-aead-aefd533b174c could not be found. Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] Returning 404 to user: Instance dcc187b6-d1ef-46d1-aead-aefd533b174c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea87dbf6-d07c-4539-ab22-b3b7d861f3b8 tempest-ListServerFiltersTestJSON-30790981 tempest-ListServerFiltersTestJSON-30790981-project] 10.222.0.76 "GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c" status: 404 len: 111 microversion: 2.1 time: 0.031406 Oct 27 10:25:41.457189 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2172/4154] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:41 2022] GET /compute/v2.1/servers/dcc187b6-d1ef-46d1-aead-aefd533b174c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:41.458283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:41.461524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:41.461937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:41.464247 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-89999cfc-2118-4929-8058-a239bacc8488 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.170134 Oct 27 10:25:41.476008 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1983/4155] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:41 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:41.476310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.476310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.476310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.476310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.476310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.476310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.476310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:41.683439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:41.691495 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b87557f-f987-4d30-9b7a-e5b510629c2f tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1504 microversion: 2.1 time: 0.233807 Oct 27 10:25:41.692062 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2173/4156] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:41 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:41.776616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:41.777396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:41.783616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.784101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.784533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.785397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.785846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.786266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.984294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:41.985268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:41.992954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.993696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.994201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:41.994963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:41.995522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:41.996005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:42.071469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:42.079796 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-577305db-2a13-49b4-bcd0-f749edf47302 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.307807 Oct 27 10:25:42.080702 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1984/4157] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:41 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:42.107315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:42.116859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:42.118383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:42.119806 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6aaa7bc8-5de8-4d63-b2e8-c7023ef2abff tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.140180 Oct 27 10:25:42.120476 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2174/4158] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:41 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:42.266510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:42.267124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:42.274265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:42.274806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:42.275260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:42.276026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:42.276546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:42.277033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:42.492429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:42.494160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:42.501724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:42.502212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:42.502644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:42.503322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:42.504348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:42.504972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:42.526035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:42.534197 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77e6ed90-41fd-44f4-9866-17e3d371354c tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1498 microversion: 2.1 time: 0.271714 Oct 27 10:25:42.534763 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1985/4159] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:42 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1498 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:42.714576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:42.715288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:42.724345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:42.728206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:42.729068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:42.731123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:42.732735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:42.733750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:42.791980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:42.808413 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d84e5da1-a783-452e-a768-96ecb9601194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.317809 Oct 27 10:25:42.809504 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2175/4160] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:42 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:43.104054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:43.105808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:43.113138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.113620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.114328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.115030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.115530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.116140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.135000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:43.149101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:43.152965 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10f2b942-bbd1-4530-834e-991889ebc72d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1504 microversion: 2.1 time: 0.442589 Oct 27 10:25:43.153915 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1986/4161] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:42 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:43.160222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:43.161323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:43.170173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.170995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.171570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.172411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.172999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.173689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.295546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:43.318169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:43.327546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:43.329538 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e24fdcd-afcf-44d3-85d3-fc0d15844e14 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.174261 Oct 27 10:25:43.336731 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1987/4162] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:43 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:43.442829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:43.458820 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a61fef7-066f-458d-b303-0db50e577d74 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.358891 Oct 27 10:25:43.459711 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2176/4163] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:43 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:43.560124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:43.561059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:43.570534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.571568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.572361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.573364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.574090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.574708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.621937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4c293588-5f52-4928-844a-0e182567acd1 req-4780cb21-2988-41c5-a783-8611ef41d782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc68d83e-09db-424b-aaec-8bdbb4765ce9", "name": "network-vif-deleted", "tag": "7178df06-87f7-4d8b-a6c0-546f6dbfe388"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:43.646974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c293588-5f52-4928-844a-0e182567acd1 req-4780cb21-2988-41c5-a783-8611ef41d782 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.647836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c293588-5f52-4928-844a-0e182567acd1 req-4780cb21-2988-41c5-a783-8611ef41d782 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.649207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c293588-5f52-4928-844a-0e182567acd1 req-4780cb21-2988-41c5-a783-8611ef41d782 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.690600 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4c293588-5f52-4928-844a-0e182567acd1 req-4780cb21-2988-41c5-a783-8611ef41d782 service nova] Creating event network-vif-deleted:7178df06-87f7-4d8b-a6c0-546f6dbfe388 for instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 on n-h1-854663-10 Oct 27 10:25:43.705840 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4c293588-5f52-4928-844a-0e182567acd1 req-4780cb21-2988-41c5-a783-8611ef41d782 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081697 Oct 27 10:25:43.716807 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2177/4164] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:25:43.760250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da5c7956454b278e9f9d6641a01711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2512e456e704e10b0c34c7496e4f342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:43.770105 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c943ee04-98f4-4c92-9261-b9f3d63db541 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 200 len: 1456 microversion: 2.1 time: 0.214285 Oct 27 10:25:43.771288 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1988/4165] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:43 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 1456 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:43.837944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:43.839165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:43.851402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.851913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.853393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.855005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.855743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.856589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.869783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-7a3ce935-9f1e-4098-9e75-d2b0ee803e59 req-2836d16e-21bb-4219-a8b0-9f41b79b81ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f92da9-0dfb-444a-b25b-5e1ba88b6818", "name": "network-vif-deleted", "tag": "d80dc18d-36fe-4932-9abb-a6e788c957c8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:43.913046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7a3ce935-9f1e-4098-9e75-d2b0ee803e59 req-2836d16e-21bb-4219-a8b0-9f41b79b81ad service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:43.913647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7a3ce935-9f1e-4098-9e75-d2b0ee803e59 req-2836d16e-21bb-4219-a8b0-9f41b79b81ad service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:43.915494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7a3ce935-9f1e-4098-9e75-d2b0ee803e59 req-2836d16e-21bb-4219-a8b0-9f41b79b81ad service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:43.943820 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-7a3ce935-9f1e-4098-9e75-d2b0ee803e59 req-2836d16e-21bb-4219-a8b0-9f41b79b81ad service nova] Creating event network-vif-deleted:d80dc18d-36fe-4932-9abb-a6e788c957c8 for instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 on n-h2-854663-10 Oct 27 10:25:43.960558 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-7a3ce935-9f1e-4098-9e75-d2b0ee803e59 req-2836d16e-21bb-4219-a8b0-9f41b79b81ad service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097411 Oct 27 10:25:43.963478 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1989/4166] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:44.162812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:44.172522 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-717000a8-bdea-46ab-a1fa-21c1deac7599 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.340229 Oct 27 10:25:44.173330 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2178/4167] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:43 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:44.178796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:44.179966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:44.188269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.188796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.189241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.190005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.190459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.190891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.228737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.229237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.229903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.230911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lazy-loading 'fault' on Instance uuid 27f92da9-0dfb-444a-b25b-5e1ba88b6818 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:25:44.285172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5286d64ef2e84d169837637fa0c3ebe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2667ac7667cc4f5bbe393742006746da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:44.294322 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-541b93e2-31ca-4193-8412-e81685b2c83d tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 200 len: 1303 microversion: 2.1 time: 0.120375 Oct 27 10:25:44.295088 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1990/4168] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:44 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:44.356262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:44.357463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:44.364365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.365216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.365747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.366854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.367648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.368145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.469846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:44.487065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:44.488588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:44.489409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:44.491018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:44.494979 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3fec4400-62c5-43aa-9d6c-0ec45cc939ca tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.143037 Oct 27 10:25:44.495814 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2179/4169] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:44 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:44.505570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.506142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.506647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.511024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.511763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.512287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.690070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:44.702161 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-53fae2fa-6cb9-4eab-87d5-0fcf04baf3ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.218776 Oct 27 10:25:44.703417 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1991/4170] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:44 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:44.795206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:44.795814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:44.802464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.803170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.803782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.804828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.805470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.805885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.820378 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 HTTP/1.1 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'bc68d83e-09db-424b-aaec-8bdbb4765ce9'} Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.822095 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39a01337-0373-4962-9b3e-f8291b94eb33 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 404 len: 111 microversion: 2.1 time: 0.032471 Oct 27 10:25:44.829034 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1992/4171] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:44 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:44.836900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:44.837400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:44.844566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.845287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.845749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.846489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.846947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.847380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.862655 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 HTTP/1.1 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'bc68d83e-09db-424b-aaec-8bdbb4765ce9'} Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:44.864210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e30f2291-639e-458d-beaf-db66fdbd5adb tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 404 len: 111 microversion: 2.1 time: 0.032580 Oct 27 10:25:44.869818 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1993/4172] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:44 2022] DELETE /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:44.873966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:44.874573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: bc68d83e-09db-424b-aaec-8bdbb4765ce9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:44.880387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.880901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.881331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.885147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.885753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.886244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.887110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1727438716", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": "none"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:44.903512 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 HTTP/1.1 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'bc68d83e-09db-424b-aaec-8bdbb4765ce9'} Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.905110 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance bc68d83e-09db-424b-aaec-8bdbb4765ce9 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a215afcb-526f-4a8c-b3b7-09519f490193 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9" status: 404 len: 111 microversion: 2.1 time: 0.036388 Oct 27 10:25:44.910375 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1994/4173] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:44 2022] GET /compute/v2.1/servers/bc68d83e-09db-424b-aaec-8bdbb4765ce9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:25:44.915162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:44.915679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:44.922227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.922706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.924519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.925257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.925717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.926148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.940949 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 HTTP/1.1 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'cf71b7a0-da61-4a46-9825-c8fc74c7f3f0'} Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:44.942527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be54c0e9-eb7c-4b0c-a51b-c333420bac79 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 404 len: 111 microversion: 2.1 time: 0.032560 Oct 27 10:25:44.951029 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1995/4174] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:44 2022] DELETE /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:44.952268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:44.952268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:44.952268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:44.952268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:44.952268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:44.952972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:44.953519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: cf71b7a0-da61-4a46-9825-c8fc74c7f3f0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:44.955996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.956482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.956962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.957685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.958138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.958562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.960019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.960501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.960973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.961657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.962106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.962525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.975938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Getting quotas for project e4c3e5dfd9ea4f18a2aeb9af958fa45e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:44.976543 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 HTTP/1.1 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'cf71b7a0-da61-4a46-9825-c8fc74c7f3f0'} Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:44.978144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fabd2eba-7f93-403d-ada4-92d514da1c54 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0" status: 404 len: 111 microversion: 2.1 time: 0.030609 Oct 27 10:25:44.983584 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1996/4175] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:44 2022] GET /compute/v2.1/servers/cf71b7a0-da61-4a46-9825-c8fc74c7f3f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:44.984436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Getting quotas for user ad7c92b4fb5841ba9272634b95ee5fb3 and project e4c3e5dfd9ea4f18a2aeb9af958fa45e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:44.988433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:44.989041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:44.995093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.995585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.996022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.996487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:25:44.996734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:44.997198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:44.997623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:44.998819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:25:45.011300 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a HTTP/1.1 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '6046b640-0df2-4ff7-9a74-88ddb8572b5a'} Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:45.012989 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9568036d-c3c7-4d8b-9f95-2ca2e3905ae7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 404 len: 111 microversion: 2.1 time: 0.029667 Oct 27 10:25:45.018228 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1997/4176] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:44 2022] DELETE /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.023216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.023832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 6046b640-0df2-4ff7-9a74-88ddb8572b5a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.031072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.031559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.032001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.032775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.033210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.033633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.045384 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cde225d2-c577-48d9-b90a-64093fcd86b7 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.306655 Oct 27 10:25:45.046293 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2180/4177] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 10:25:45.049100 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a HTTP/1.1 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '6046b640-0df2-4ff7-9a74-88ddb8572b5a'} Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.050739 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 6046b640-0df2-4ff7-9a74-88ddb8572b5a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b91bfd5-2bf9-4030-9408-66cd66deacce tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a" status: 404 len: 111 microversion: 2.1 time: 0.032879 Oct 27 10:25:45.057373 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1998/4178] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/servers/6046b640-0df2-4ff7-9a74-88ddb8572b5a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.058742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffa2ab21-54e5-4ab9-8e7b-c75d2681ba13 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.059846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffa2ab21-54e5-4ab9-8e7b-c75d2681ba13 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.063428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.063579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.070699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.071225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.071615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.072315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.072808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.073270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.089288 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 HTTP/1.1 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'b3c25d08-f113-4663-8a4f-e0dd23e0bb37'} Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:45.091078 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e029ed6-5f1e-486a-8b3e-0175c33a14f0 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 404 len: 111 microversion: 2.1 time: 0.034099 Oct 27 10:25:45.098142 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1999/4179] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:45 2022] DELETE /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.103398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.103398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: b3c25d08-f113-4663-8a4f-e0dd23e0bb37] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.107806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.108296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.108759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.109465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.110304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.110304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.123393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffa2ab21-54e5-4ab9-8e7b-c75d2681ba13 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:45.125533 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 HTTP/1.1 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'b3c25d08-f113-4663-8a4f-e0dd23e0bb37'} Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.127101 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.132638 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.132638 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.132638 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.132638 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.132638 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.132638 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. Oct 27 10:25:45.132638 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.132638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance b3c25d08-f113-4663-8a4f-e0dd23e0bb37 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.132638 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-259b08e8-f8d4-4f62-89c6-ef54c43368af tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37" status: 404 len: 111 microversion: 2.1 time: 0.031538 Oct 27 10:25:45.133488 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2000/4180] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/servers/b3c25d08-f113-4663-8a4f-e0dd23e0bb37 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.133610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffa2ab21-54e5-4ab9-8e7b-c75d2681ba13 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:45.135868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffa2ab21-54e5-4ab9-8e7b-c75d2681ba13 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:45.137434 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffa2ab21-54e5-4ab9-8e7b-c75d2681ba13 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 200 len: 1281 microversion: 2.47 time: 0.083464 Oct 27 10:25:45.137667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ee55139-c21a-4b90-b935-1de1d3734d44 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.148816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ee55139-c21a-4b90-b935-1de1d3734d44 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 302d09c5-4dc8-4b9f-a215-9af59ca4d95e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.149256 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2181/4181] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-3ee55139-c21a-4b90-b935-1de1d3734d44 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ee55139-c21a-4b90-b935-1de1d3734d44 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e HTTP/1.1 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '302d09c5-4dc8-4b9f-a215-9af59ca4d95e'} Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:45.149375 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ee55139-c21a-4b90-b935-1de1d3734d44 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ee55139-c21a-4b90-b935-1de1d3734d44 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e" status: 404 len: 111 microversion: 2.1 time: 0.013156 Oct 27 10:25:45.155206 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2001/4182] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:45 2022] DELETE /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.160022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3cc4fce1-d1b0-4481-a803-3133fa2fbb1e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.160652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3cc4fce1-d1b0-4481-a803-3133fa2fbb1e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 302d09c5-4dc8-4b9f-a215-9af59ca4d95e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.166648 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3cc4fce1-d1b0-4481-a803-3133fa2fbb1e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3cc4fce1-d1b0-4481-a803-3133fa2fbb1e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e HTTP/1.1 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '302d09c5-4dc8-4b9f-a215-9af59ca4d95e'} Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.168552 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.175151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.175151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.175151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.175151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. Oct 27 10:25:45.175151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.175151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3cc4fce1-d1b0-4481-a803-3133fa2fbb1e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 302d09c5-4dc8-4b9f-a215-9af59ca4d95e could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.175151 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3cc4fce1-d1b0-4481-a803-3133fa2fbb1e tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e" status: 404 len: 111 microversion: 2.1 time: 0.014770 Oct 27 10:25:45.175151 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2182/4183] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/servers/302d09c5-4dc8-4b9f-a215-9af59ca4d95e => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.196004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.196699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.205130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.205644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.206083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.206797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.207248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.207859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.323887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.324795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.336227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.337203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.337841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.338580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.339105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.340194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.355869 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] HTTP exception thrown: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Request method failure captured: Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 HTTP/1.1 Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyJYwizZ1fDl9qlhK_8qxTGexvAi_CXMFLOOmDzuVQHIxGscjFyXr5_IWSWLuOC70AtAvIn-PKMgANNhS2DIDVkbuqERgFtQLpTWKjXTrGRYSXG1igmGUtxamTE5zBmh6X6OVn0LYZ8AM3in5fGz3GC2QYW79fxIlI5mC1p7rOW-n8 Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2667ac7667cc4f5bbe393742006746da", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5286d64ef2e84d169837637fa0c3ebe0 Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '27f92da9-0dfb-444a-b25b-5e1ba88b6818'} Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.357634 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.363246 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.363246 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.363246 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.363246 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.363246 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.363246 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.363246 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.364776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Returning 404 to user: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.365815 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da41b0fc-4933-4c2c-90af-7515a63efebf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 404 len: 111 microversion: 2.1 time: 0.051431 Oct 27 10:25:45.367198 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2183/4184] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:25:45.381374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b80d5aba-c7ca-4914-a150-91a01d0bffd9 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.408867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_groups [None req-b80d5aba-c7ca-4914-a150-91a01d0bffd9 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Querying cell 9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) for 1 instances {{(pid=120720) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 10:25:45.409780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80d5aba-c7ca-4914-a150-91a01d0bffd9 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.410838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80d5aba-c7ca-4914-a150-91a01d0bffd9 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.411506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80d5aba-c7ca-4914-a150-91a01d0bffd9 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.413176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:45.424350 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b80d5aba-c7ca-4914-a150-91a01d0bffd9 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.050600 Oct 27 10:25:45.424514 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92db9716-9589-48b5-9bd9-d63f67abdad1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.232601 Oct 27 10:25:45.425048 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2002/4185] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:45.425425 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2184/4186] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:45.445008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bb4552f3-c46d-409b-ab04-af25afecf801 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.459237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.compute.server_groups [None req-bb4552f3-c46d-409b-ab04-af25afecf801 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Querying cell 9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) for 1 instances {{(pid=120719) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 10:25:45.460200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb4552f3-c46d-409b-ab04-af25afecf801 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.460535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb4552f3-c46d-409b-ab04-af25afecf801 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.460997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb4552f3-c46d-409b-ab04-af25afecf801 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.473323 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bb4552f3-c46d-409b-ab04-af25afecf801 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups/9b453cba-31ef-4cca-bf2f-0319f8f5750d" status: 200 len: 184 microversion: 2.1 time: 0.032294 Oct 27 10:25:45.473904 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2003/4187] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/os-server-groups/9b453cba-31ef-4cca-bf2f-0319f8f5750d => generated 184 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:45.487551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.488254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.495616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.496126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.496621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.497359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.498112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.498555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.513792 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] HTTP exception thrown: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Request method failure captured: Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 HTTP/1.1 Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyJYwizZ1fDl9qlhK_8qxTGexvAi_CXMFLOOmDzuVQHIxGscjFyXr5_IWSWLuOC70AtAvIn-PKMgANNhS2DIDVkbuqERgFtQLpTWKjXTrGRYSXG1igmGUtxamTE5zBmh6X6OVn0LYZ8AM3in5fGz3GC2QYW79fxIlI5mC1p7rOW-n8 Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2667ac7667cc4f5bbe393742006746da", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5286d64ef2e84d169837637fa0c3ebe0 Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '27f92da9-0dfb-444a-b25b-5e1ba88b6818'} Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:45.515468 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Returning 404 to user: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-176e157c-0e9d-4f7f-b7dd-d0759981b339 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 404 len: 111 microversion: 2.1 time: 0.033918 Oct 27 10:25:45.524383 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2185/4188] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:45 2022] DELETE /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.526471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.527035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] [instance: 27f92da9-0dfb-444a-b25b-5e1ba88b6818] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.535700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.536544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.537213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.537642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.538639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.539702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.540403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.541269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.543541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.544024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.544454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.545212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.545659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.546075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.570341 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] HTTP exception thrown: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Request method failure captured: Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 HTTP/1.1 Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyJYwizZ1fDl9qlhK_8qxTGexvAi_CXMFLOOmDzuVQHIxGscjFyXr5_IWSWLuOC70AtAvIn-PKMgANNhS2DIDVkbuqERgFtQLpTWKjXTrGRYSXG1igmGUtxamTE5zBmh6X6OVn0LYZ8AM3in5fGz3GC2QYW79fxIlI5mC1p7rOW-n8 Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2667ac7667cc4f5bbe393742006746da", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5286d64ef2e84d169837637fa0c3ebe0 Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '27f92da9-0dfb-444a-b25b-5e1ba88b6818'} Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.573361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.579187 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.579187 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.579187 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.579187 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.579187 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.579187 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. Oct 27 10:25:45.579187 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.579187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Returning 404 to user: Instance 27f92da9-0dfb-444a-b25b-5e1ba88b6818 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.581474 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58280a56-992b-4bb0-8ef4-df4cf2da57e0 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818" status: 404 len: 111 microversion: 2.1 time: 0.058499 Oct 27 10:25:45.585865 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2004/4189] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/servers/27f92da9-0dfb-444a-b25b-5e1ba88b6818 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.591418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be1c4258-a789-4ba0-958c-47787d7d520c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.598919 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-be1c4258-a789-4ba0-958c-47787d7d520c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] HTTP exception thrown: Instance group 08c6717b-2cf4-4abc-82c9-c2963099bdf1 could not be found. Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be1c4258-a789-4ba0-958c-47787d7d520c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Request method failure captured: Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-server-groups/08c6717b-2cf4-4abc-82c9-c2963099bdf1 HTTP/1.1 Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyJYwizZ1fDl9qlhK_8qxTGexvAi_CXMFLOOmDzuVQHIxGscjFyXr5_IWSWLuOC70AtAvIn-PKMgANNhS2DIDVkbuqERgFtQLpTWKjXTrGRYSXG1igmGUtxamTE5zBmh6X6OVn0LYZ8AM3in5fGz3GC2QYW79fxIlI5mC1p7rOW-n8 Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2667ac7667cc4f5bbe393742006746da", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5286d64ef2e84d169837637fa0c3ebe0 Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance group 08c6717b-2cf4-4abc-82c9-c2963099bdf1 could not be found. Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '08c6717b-2cf4-4abc-82c9-c2963099bdf1'} Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 08c6717b-2cf4-4abc-82c9-c2963099bdf1 could not be found. Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 08c6717b-2cf4-4abc-82c9-c2963099bdf1 could not be found. Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.609795 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.615324 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.615324 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.615324 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.615324 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.615324 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 08c6717b-2cf4-4abc-82c9-c2963099bdf1 could not be found. Oct 27 10:25:45.615324 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.615324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be1c4258-a789-4ba0-958c-47787d7d520c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Returning 404 to user: Instance group 08c6717b-2cf4-4abc-82c9-c2963099bdf1 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.615324 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be1c4258-a789-4ba0-958c-47787d7d520c tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/08c6717b-2cf4-4abc-82c9-c2963099bdf1" status: 404 len: 117 microversion: 2.1 time: 0.025364 Oct 27 10:25:45.616040 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2005/4190] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:25:45 2022] DELETE /compute/v2.1/os-server-groups/08c6717b-2cf4-4abc-82c9-c2963099bdf1 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.621601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-877bafdd-c4cc-4c79-97f8-d7df3bc2cfc4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.624083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:45.629475 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-877bafdd-c4cc-4c79-97f8-d7df3bc2cfc4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] HTTP exception thrown: Instance group 37b8a455-6efb-46d1-8a87-fc056070fd0b could not be found. Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-877bafdd-c4cc-4c79-97f8-d7df3bc2cfc4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Request method failure captured: Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-server-groups/37b8a455-6efb-46d1-8a87-fc056070fd0b HTTP/1.1 Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyJYwizZ1fDl9qlhK_8qxTGexvAi_CXMFLOOmDzuVQHIxGscjFyXr5_IWSWLuOC70AtAvIn-PKMgANNhS2DIDVkbuqERgFtQLpTWKjXTrGRYSXG1igmGUtxamTE5zBmh6X6OVn0LYZ8AM3in5fGz3GC2QYW79fxIlI5mC1p7rOW-n8 Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2667ac7667cc4f5bbe393742006746da", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5286d64ef2e84d169837637fa0c3ebe0 Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance group 37b8a455-6efb-46d1-8a87-fc056070fd0b could not be found. Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '37b8a455-6efb-46d1-8a87-fc056070fd0b'} Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 37b8a455-6efb-46d1-8a87-fc056070fd0b could not be found. Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 37b8a455-6efb-46d1-8a87-fc056070fd0b could not be found. Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.632403 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.637991 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.637991 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.637991 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.637991 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.637991 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 37b8a455-6efb-46d1-8a87-fc056070fd0b could not be found. Oct 27 10:25:45.637991 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.637991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-877bafdd-c4cc-4c79-97f8-d7df3bc2cfc4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Returning 404 to user: Instance group 37b8a455-6efb-46d1-8a87-fc056070fd0b could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.638619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:45.638745 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-877bafdd-c4cc-4c79-97f8-d7df3bc2cfc4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/37b8a455-6efb-46d1-8a87-fc056070fd0b" status: 404 len: 117 microversion: 2.1 time: 0.017015 Oct 27 10:25:45.638745 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2006/4191] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:25:45 2022] DELETE /compute/v2.1/os-server-groups/37b8a455-6efb-46d1-8a87-fc056070fd0b => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.638959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:45.638959 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f003b3e5-aa60-453d-a8fe-c7cc2046f7e8 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.104208 Oct 27 10:25:45.638959 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2186/4192] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:45.646146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-729e946d-477b-47fa-9843-d900da27d821 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.652951 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-729e946d-477b-47fa-9843-d900da27d821 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] HTTP exception thrown: Instance group 80baf3df-294a-48b3-83d4-6b8a6c4b0bd9 could not be found. Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-729e946d-477b-47fa-9843-d900da27d821 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Request method failure captured: Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-server-groups/80baf3df-294a-48b3-83d4-6b8a6c4b0bd9 HTTP/1.1 Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyJYwizZ1fDl9qlhK_8qxTGexvAi_CXMFLOOmDzuVQHIxGscjFyXr5_IWSWLuOC70AtAvIn-PKMgANNhS2DIDVkbuqERgFtQLpTWKjXTrGRYSXG1igmGUtxamTE5zBmh6X6OVn0LYZ8AM3in5fGz3GC2QYW79fxIlI5mC1p7rOW-n8 Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2667ac7667cc4f5bbe393742006746da", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5286d64ef2e84d169837637fa0c3ebe0 Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance group 80baf3df-294a-48b3-83d4-6b8a6c4b0bd9 could not be found. Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '80baf3df-294a-48b3-83d4-6b8a6c4b0bd9'} Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 80baf3df-294a-48b3-83d4-6b8a6c4b0bd9 could not be found. Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 80baf3df-294a-48b3-83d4-6b8a6c4b0bd9 could not be found. Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.654613 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.659859 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.659859 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.659859 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.659859 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.659859 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 80baf3df-294a-48b3-83d4-6b8a6c4b0bd9 could not be found. Oct 27 10:25:45.659859 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.659859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-729e946d-477b-47fa-9843-d900da27d821 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Returning 404 to user: Instance group 80baf3df-294a-48b3-83d4-6b8a6c4b0bd9 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.659859 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-729e946d-477b-47fa-9843-d900da27d821 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/80baf3df-294a-48b3-83d4-6b8a6c4b0bd9" status: 404 len: 117 microversion: 2.1 time: 0.013901 Oct 27 10:25:45.659859 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2007/4193] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:25:45 2022] DELETE /compute/v2.1/os-server-groups/80baf3df-294a-48b3-83d4-6b8a6c4b0bd9 => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:25:45.665382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0ade006-e4ed-4c21-856f-8cbe161118f4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.671984 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-b0ade006-e4ed-4c21-856f-8cbe161118f4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] HTTP exception thrown: Instance group ca68e6f0-4cde-455f-8659-de5c9a1d709d could not be found. Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0ade006-e4ed-4c21-856f-8cbe161118f4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Request method failure captured: Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-server-groups/ca68e6f0-4cde-455f-8659-de5c9a1d709d HTTP/1.1 Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyJYwizZ1fDl9qlhK_8qxTGexvAi_CXMFLOOmDzuVQHIxGscjFyXr5_IWSWLuOC70AtAvIn-PKMgANNhS2DIDVkbuqERgFtQLpTWKjXTrGRYSXG1igmGUtxamTE5zBmh6X6OVn0LYZ8AM3in5fGz3GC2QYW79fxIlI5mC1p7rOW-n8 Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2667ac7667cc4f5bbe393742006746da", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2667ac7667cc4f5bbe393742006746da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2667ac7667cc4f5bbe393742006746da Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerGroupTestJSON-1444317867 Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5286d64ef2e84d169837637fa0c3ebe0 Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerGroupTestJSON-1444317867-project Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance group ca68e6f0-4cde-455f-8659-de5c9a1d709d could not be found. Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ca68e6f0-4cde-455f-8659-de5c9a1d709d'} Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ca68e6f0-4cde-455f-8659-de5c9a1d709d could not be found. Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ca68e6f0-4cde-455f-8659-de5c9a1d709d could not be found. Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.674012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:45.679795 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:45.679795 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:45.679795 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:45.679795 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:45.679795 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ca68e6f0-4cde-455f-8659-de5c9a1d709d could not be found. Oct 27 10:25:45.679795 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:45.679795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0ade006-e4ed-4c21-856f-8cbe161118f4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Returning 404 to user: Instance group ca68e6f0-4cde-455f-8659-de5c9a1d709d could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:45.679795 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0ade006-e4ed-4c21-856f-8cbe161118f4 tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/ca68e6f0-4cde-455f-8659-de5c9a1d709d" status: 404 len: 117 microversion: 2.1 time: 0.014306 Oct 27 10:25:45.679795 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2187/4194] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:25:45 2022] DELETE /compute/v2.1/os-server-groups/ca68e6f0-4cde-455f-8659-de5c9a1d709d => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:45.684232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3e357c2-0a61-4338-87ee-e501d155efcf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.713937 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f3e357c2-0a61-4338-87ee-e501d155efcf tempest-ServerGroupTestJSON-1444317867 tempest-ServerGroupTestJSON-1444317867-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/9b453cba-31ef-4cca-bf2f-0319f8f5750d" status: 204 len: 0 microversion: 2.1 time: 0.033460 Oct 27 10:25:45.714648 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2008/4195] 10.222.0.76 () {58 vars in 1266 bytes} [Thu Oct 27 10:25:45 2022] DELETE /compute/v2.1/os-server-groups/9b453cba-31ef-4cca-bf2f-0319f8f5750d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:25:45.726348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:45.727249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:45.734183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.734664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.735090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.735783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:45.736236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:45.736655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:45.875662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:45.884123 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d25a5945-de5c-45a7-a024-648fff72aa86 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.161699 Oct 27 10:25:45.896953 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2188/4196] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:45 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:46.002034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5c2b3b73-6903-469f-a283-24ded407634c req-3221d842-c580-474b-8d72-6d6825184394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc11663-1696-4b94-88a3-a060d97d88c6", "tag": "a4ad2cf6-9b4f-43a4-9348-b783d772e6fe"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:46.017150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5c2b3b73-6903-469f-a283-24ded407634c req-3221d842-c580-474b-8d72-6d6825184394 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:46.018121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5c2b3b73-6903-469f-a283-24ded407634c req-3221d842-c580-474b-8d72-6d6825184394 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:46.018766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5c2b3b73-6903-469f-a283-24ded407634c req-3221d842-c580-474b-8d72-6d6825184394 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:46.034047 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5c2b3b73-6903-469f-a283-24ded407634c req-3221d842-c580-474b-8d72-6d6825184394 service nova] Creating event network-changed:a4ad2cf6-9b4f-43a4-9348-b783d772e6fe for instance dbc11663-1696-4b94-88a3-a060d97d88c6 on n-h1-854663-10 Oct 27 10:25:46.040355 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5c2b3b73-6903-469f-a283-24ded407634c req-3221d842-c580-474b-8d72-6d6825184394 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042356 Oct 27 10:25:46.041243 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2009/4197] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:46.165164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:46.166114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:46.172984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:46.173756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:46.175090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:46.175877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:46.176367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:46.177026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:46.269254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:46.278567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:46.280036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:46.281447 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5efce0e-b94f-464a-a154-1556fb13e1ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 200 len: 1333 microversion: 2.47 time: 0.121845 Oct 27 10:25:46.282068 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2189/4198] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:46 2022] GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 1333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:46.449020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:46.449956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:46.457315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:46.457933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:46.458629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:46.459401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:46.459922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:46.460558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:46.626204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:46.636863 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d6ad9a0d-6f3c-45a9-a3ed-97047f897624 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.192146 Oct 27 10:25:46.638064 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2010/4199] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:46 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:46.662965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:46.663808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:46.671473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:46.672069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:46.672784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:46.673681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:46.674229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:46.674752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:46.771341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:46.782308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:46.783888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:46.785394 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7139fe58-316b-45d0-beb8-7030aabacaf0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.126733 Oct 27 10:25:46.786803 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2190/4200] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:46 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:46.911619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:46.912236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:46.914619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:46.921617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:46.922414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:46.922855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:46.923567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:46.924017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:46.924440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:47.102949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:47.114993 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-098cf95e-df43-4313-83d5-fb58f8b40adf tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.207175 Oct 27 10:25:47.115941 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2011/4201] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:46 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:47.310578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:47.312475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:47.322407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:47.323210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:47.323893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:47.325024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:47.325646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:47.326376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:47.423068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:47.435535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:47.437466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:47.439156 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a431a1cf-4250-4bc9-8202-be5cc9fe5d3d tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 200 len: 1339 microversion: 2.47 time: 0.135115 Oct 27 10:25:47.454119 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2191/4202] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:47 2022] GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 1339 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:47.665083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:47.665775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:47.692834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:47.702559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:47.704091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:47.708789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:47.711689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:47.712564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:47.815799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:47.817188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:47.838261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:47.842974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:47.843803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:47.846400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:47.847968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:47.850042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.062139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:48.075508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:48.077320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:48.081222 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6e7754a-1160-49a0-8337-9eb7688f6d5f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.272590 Oct 27 10:25:48.092816 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2192/4203] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:47 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:25:48.140002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:48.145431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:48.152910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.157998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.158760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.159825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.160494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.161199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.169600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:48.180353 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c243c7b-e798-4205-817c-e2aa3fdbfde6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.521718 Oct 27 10:25:48.181347 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2012/4204] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:47 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:48.470670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:48.473585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:48.474234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:48.482923 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-add947ab-2e6d-4d71-b446-3fb4737550ca tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.348655 Oct 27 10:25:48.483669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.484187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.484692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.486262 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2193/4205] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:48 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:48.487532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.488078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.488510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.516010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:48.516675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:48.524491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.525442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.526147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.527247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.528253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.529517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.556376 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 HTTP/1.1 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '67c1dd7f-094e-451b-bbd1-0aceb7873a96'} Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:48.558300 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.564032 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.567933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:48.568926 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e15706f5-3bd7-4472-b2bc-3ffe0085fc77 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 404 len: 111 microversion: 2.1 time: 0.059125 Oct 27 10:25:48.569576 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2194/4206] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:48 2022] DELETE /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:48.578515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:48.579440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 67c1dd7f-094e-451b-bbd1-0aceb7873a96] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:48.587789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.588366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.589156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.590058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.591187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.591728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.610602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 HTTP/1.1 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '67c1dd7f-094e-451b-bbd1-0aceb7873a96'} Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:48.612062 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 67c1dd7f-094e-451b-bbd1-0aceb7873a96 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77858481-0fc8-42e7-a3ab-c503685621a7 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96" status: 404 len: 111 microversion: 2.1 time: 0.039793 Oct 27 10:25:48.617628 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2195/4207] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:48 2022] GET /compute/v2.1/servers/67c1dd7f-094e-451b-bbd1-0aceb7873a96 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:25:48.625711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:48.626565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:48.628195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:48.634500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.635228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.635914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.636991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.637701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.638362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.644052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:48.645743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:48.647392 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bda9797-a918-4f01-88a1-f6a45805ebd0 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 200 len: 1339 microversion: 2.47 time: 0.182571 Oct 27 10:25:48.656695 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2013/4208] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:48 2022] GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 1339 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:48.680996 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 HTTP/1.1 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '9b660b14-6253-4e7c-8bea-f252101ae635'} Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:48.687788 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.692378 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.696167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:48.697351 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cbfad0f5-2cf3-4155-9dbc-daaa87c819da tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 404 len: 111 microversion: 2.1 time: 0.075549 Oct 27 10:25:48.698712 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2196/4209] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:25:48 2022] DELETE /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:48.706911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:48.707689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] [instance: 9b660b14-6253-4e7c-8bea-f252101ae635] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:48.723246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.724297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.724795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.725688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:48.726153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:48.726580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:48.750599 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] HTTP exception thrown: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Request method failure captured: Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 HTTP/1.1 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWltrQD94_FTGg8oKdrpAG9OGr5cmJaljQGjTIJ1eiSMzgLtofVuu0PllknEP210B-Y0Q3AbvlV_FLg5sF-SU_1Si0RIUmCuASNbfpJXdZpCxWj1E_gy_lAsDCuNl3NPcK65WImIap1xxPw9mvG8oWWRbCx3ndviJrZ2gYz-O5dyXpHo Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2512e456e704e10b0c34c7496e4f342", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2512e456e704e10b0c34c7496e4f342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2512e456e704e10b0c34c7496e4f342 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1500243468 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 83da5c7956454b278e9f9d6641a01711 Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1500243468-project Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '9b660b14-6253-4e7c-8bea-f252101ae635'} Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:48.752771 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] Returning 404 to user: Instance 9b660b14-6253-4e7c-8bea-f252101ae635 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3804c12-0e52-4c15-96c0-b0d32261fad3 tempest-DeleteServersTestJSON-1500243468 tempest-DeleteServersTestJSON-1500243468-project] 10.222.0.76 "GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635" status: 404 len: 111 microversion: 2.1 time: 0.051957 Oct 27 10:25:48.757474 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2014/4210] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:48 2022] GET /compute/v2.1/servers/9b660b14-6253-4e7c-8bea-f252101ae635 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:49.111621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:49.112518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:49.126552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:49.127094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:49.127743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:49.128638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:49.134867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:49.135754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:49.205592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:49.206225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:49.221469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:49.221999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:49.222452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:49.223196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:49.223669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:49.224106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:49.483474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:49.496945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:49.498446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:49.499787 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f9e98cc-9a91-47c1-a764-a811d0288b87 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.392103 Oct 27 10:25:49.516687 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2197/4211] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:49 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:49.516687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:49.516687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:49.536336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:49.537293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:49.537890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:49.538805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:49.539487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:49.541243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:49.546403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:49.866070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:49.874218 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d50a7c4b-9314-4bee-8514-25d2e63a6ab5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.368826 Oct 27 10:25:49.897796 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2198/4212] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:49 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:49.899860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:49.910158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:49.914438 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-19e87220-3ba1-449d-95c8-8eb114bcd290 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.712532 Oct 27 10:25:49.915193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:49.917510 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2015/4213] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:49 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:49.924937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:49.925633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:49.926262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:49.927138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:49.927877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:49.928455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:50.077493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:50.087010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:50.088450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:50.090591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c3f95a1-23aa-46ab-a54c-527821cd5b0a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 200 len: 1360 microversion: 2.47 time: 0.190750 Oct 27 10:25:50.091374 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2199/4214] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:49 2022] GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 1360 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:50.121263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0afca93c-c2c2-4fc2-b5c8-2460cf5ab661 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-196735023"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:50.123822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0afca93c-c2c2-4fc2-b5c8-2460cf5ab661 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:50.141219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afca93c-c2c2-4fc2-b5c8-2460cf5ab661 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:50.141750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afca93c-c2c2-4fc2-b5c8-2460cf5ab661 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:50.142191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afca93c-c2c2-4fc2-b5c8-2460cf5ab661 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:50.142993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afca93c-c2c2-4fc2-b5c8-2460cf5ab661 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:50.143489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afca93c-c2c2-4fc2-b5c8-2460cf5ab661 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:50.143920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afca93c-c2c2-4fc2-b5c8-2460cf5ab661 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:50.506846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:50.535433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:50.536415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:50.558419 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0afca93c-c2c2-4fc2-b5c8-2460cf5ab661 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "POST /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3/action" status: 202 len: 52 microversion: 2.47 time: 0.441310 Oct 27 10:25:50.559627 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2016/4215] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:25:50 2022] POST /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3/action => generated 52 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 27 10:25:50.565700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:50.566193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:50.566627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:50.570738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:50.574213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:50.575283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:50.577757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:50.579920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:50.594045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:50.611954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:50.614338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:50.617412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:50.618764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:50.619558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:50.687645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:25:50.832955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:50.850579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:50.852427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:50.856591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a74060c3-50a3-4860-9106-419929f90ca6 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.326169 Oct 27 10:25:50.862129 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2200/4216] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:50 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:50.904368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:50.923050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:50.948521 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5ae72e9-803c-4cef-acad-91c446e1c9ca tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "DELETE /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 204 len: 0 microversion: 2.47 time: 0.379502 Oct 27 10:25:50.949480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:50.950374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:50.951010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:50.952004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:50.952715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:50.953822 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2017/4217] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:25:50 2022] DELETE /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:25:50.954176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:50.969155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:50.976616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:50.997660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:51.000625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:51.001174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:51.006878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:51.007437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:51.011201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:51.337770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:51.352811 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb9dd760-f995-4ce2-b158-990fa3ee6499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.452686 Oct 27 10:25:51.353446 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2201/4218] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:50 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:51.358731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:51.360603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:51.368622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:51.369813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:51.370444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:51.371577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:51.372197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:51.372821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:51.484439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:51.500842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:51.506159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:51.509206 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44825d01-f5eb-4173-b6cb-a4cfbeecfcaa tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 200 len: 1366 microversion: 2.47 time: 0.154424 Oct 27 10:25:51.510048 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2202/4219] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:51 2022] GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:51.541577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:51.550682 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea7369e4-5a81-4887-9885-95f33b0e7cc1 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.595368 Oct 27 10:25:51.551279 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2018/4220] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:50 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:51.878630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4787c521-d49c-4381-8a94-b31f573a6357 req-ae8a4747-8074-4af8-9468-5de603b8711c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc11663-1696-4b94-88a3-a060d97d88c6", "name": "network-vif-plugged", "status": "completed", "tag": "a4ad2cf6-9b4f-43a4-9348-b783d772e6fe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:51.890104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:51.890790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:51.906014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:51.909019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:51.909797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:51.912133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:51.912922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:51.914542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:51.915859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4787c521-d49c-4381-8a94-b31f573a6357 req-ae8a4747-8074-4af8-9468-5de603b8711c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:51.916259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4787c521-d49c-4381-8a94-b31f573a6357 req-ae8a4747-8074-4af8-9468-5de603b8711c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:51.917429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4787c521-d49c-4381-8a94-b31f573a6357 req-ae8a4747-8074-4af8-9468-5de603b8711c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:51.946978 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4787c521-d49c-4381-8a94-b31f573a6357 req-ae8a4747-8074-4af8-9468-5de603b8711c service nova] Creating event network-vif-plugged:a4ad2cf6-9b4f-43a4-9348-b783d772e6fe for instance dbc11663-1696-4b94-88a3-a060d97d88c6 on n-h1-854663-10 Oct 27 10:25:51.960696 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4787c521-d49c-4381-8a94-b31f573a6357 req-ae8a4747-8074-4af8-9468-5de603b8711c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086864 Oct 27 10:25:51.962384 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2203/4221] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:52.047852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:52.069647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:52.071381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:52.074587 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aea5498d-cf1a-4254-a9a9-b5f43b82c22c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.188768 Oct 27 10:25:52.077678 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2019/4222] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:51 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:52.386871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:52.387844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:52.395407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:52.395930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:52.396345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:52.397088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:52.398586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:52.400240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:52.539986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:52.540749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:52.553267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:52.556428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:52.557016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:52.559843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:52.560442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:52.561241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:52.610239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:52.622296 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f387a5a-3772-43d3-a732-29a0273089d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.247314 Oct 27 10:25:52.623114 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2204/4223] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:52 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:52.631057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:52.632940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:52.643501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:52.644099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:52.645164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:52.646723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:52.647269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:52.647792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:52.676253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:52.691279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:52.693985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:52.695488 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d75e520-1615-4ed8-95df-b5f4063abf75 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 200 len: 1366 microversion: 2.47 time: 0.161653 Oct 27 10:25:52.696281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2020/4224] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:52 2022] GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:25:52.877576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:52.888184 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f476400c-0875-46e0-be43-a90add836e15 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.262258 Oct 27 10:25:52.894264 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2205/4225] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:52 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:53.103816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:53.104771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:53.114704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:53.115720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:53.116546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:53.117485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:53.118164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:53.119168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:53.208047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:53.216801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:53.218262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:53.219453 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31fb1a84-5e50-4547-adc0-6ff01efc68a2 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.120509 Oct 27 10:25:53.220019 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2021/4226] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:53 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:53.649412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:53.650495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:53.661238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:53.661845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:53.662584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:53.663605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:53.668015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:53.668921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:53.842755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1528002935", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": "none"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:53.885626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:53.902325 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-976db63a-ff54-4dc5-a12e-07c59afda507 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.257403 Oct 27 10:25:53.902829 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2022/4227] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:53 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:53.933807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:53.934392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:53.935276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:53.935886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:53.936395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:53.939018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:53.939965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:53.950153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:53.951151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:53.951840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:53.952458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:53.953007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:53.953493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:53.954184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:53.954554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:53.955131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:53.955262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:53.955696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:53.956121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:53.981059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Getting quotas for project 5a80a963c4574afba0a4097c1d9278b1. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:25:53.987174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:53.988830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Getting quotas for user df866f38d8964445b84457e3dffc2750 and project 5a80a963c4574afba0a4097c1d9278b1. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:25:54.013667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:25:54.018631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:25:54.050573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:54.051261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:54.051932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:54.052574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lazy-loading 'fault' on Instance uuid 31fcbcfa-3546-443a-b219-3d04376a8eb3 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:25:54.110227 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec7c3652-21c1-4c6c-8a48-4d5a162c1c8b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.473634 Oct 27 10:25:54.118154 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2206/4228] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:25:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:25:54.123722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:54.124730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:54.135281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:54.136046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:54.136875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:54.138672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:54.139314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:54.139922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:54.153223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.162238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.169964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7c92b4fb5841ba9272634b95ee5fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3e5dfd9ea4f18a2aeb9af958fa45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.174557 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-492f4de1-2f42-4d1b-9b4c-f47e453d18a8 tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 200 len: 1371 microversion: 2.47 time: 0.247495 Oct 27 10:25:54.175292 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2023/4229] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:53 2022] GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:54.214708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-99954f10-7789-454c-89c2-1ea9220b3940 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:54.222345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-99954f10-7789-454c-89c2-1ea9220b3940 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:54.367420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-99954f10-7789-454c-89c2-1ea9220b3940 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.377916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-99954f10-7789-454c-89c2-1ea9220b3940 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.384536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-99954f10-7789-454c-89c2-1ea9220b3940 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.386341 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-99954f10-7789-454c-89c2-1ea9220b3940 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1278 microversion: 2.57 time: 0.207905 Oct 27 10:25:54.391811 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2024/4230] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:54 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:54.411679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:54.412399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:54.422341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:54.422823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:54.423263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:54.429744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:54.430281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:54.430727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:54.496292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.505747 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69a01884-ef7f-440e-989b-0949da66a02e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1315 microversion: 2.1 time: 0.385879 Oct 27 10:25:54.506900 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2207/4231] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:54 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:54.570653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.585381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.587720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:54.591414 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e46e7af-444e-482c-9ace-d07144d22d76 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1366 microversion: 2.47 time: 0.197069 Oct 27 10:25:54.594077 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2025/4232] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:54 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:54.930253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:54.930996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:54.943215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:54.943949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:54.944167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:54.945402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:54.945867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:54.946443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.192575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:55.203262 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d05c2ce-9978-463c-b298-e0e496d833fd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.277519 Oct 27 10:25:55.204146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:55.205336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] [instance: 31fcbcfa-3546-443a-b219-3d04376a8eb3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:55.206483 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2208/4233] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:54 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:55.236026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.238635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.239154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.239862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.243384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.243860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.263790 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] HTTP exception thrown: Instance 31fcbcfa-3546-443a-b219-3d04376a8eb3 could not be found. Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Request method failure captured: Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 HTTP/1.1 Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyoEbh_AZ3Lo31AdFIJzJ4Exe9P43As3FEeSI-HUkA1QwnVR5lkss-K2EvbjQxJ1AKskzHpa4DY_QssUsF_M-0zulLyLI1MXFz_VaHIIKblYHOvOl2Kymka-imFVpcRHuqY0J602Ifaqj4Y_4tEjwX9N-CyQYzoHuLIUB0R74dMSMM Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: e4c3e5dfd9ea4f18a2aeb9af958fa45e Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersAaction247Test-2074100385 Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e4c3e5dfd9ea4f18a2aeb9af958fa45e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e4c3e5dfd9ea4f18a2aeb9af958fa45e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e4c3e5dfd9ea4f18a2aeb9af958fa45e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e4c3e5dfd9ea4f18a2aeb9af958fa45e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersAaction247Test-2074100385 Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: e4c3e5dfd9ea4f18a2aeb9af958fa45e Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersAaction247Test-2074100385 Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersAaction247Test-2074100385-project Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: ad7c92b4fb5841ba9272634b95ee5fb3 Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersAaction247Test-2074100385-project Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 31fcbcfa-3546-443a-b219-3d04376a8eb3 could not be found. Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '31fcbcfa-3546-443a-b219-3d04376a8eb3'} Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31fcbcfa-3546-443a-b219-3d04376a8eb3 could not be found. Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31fcbcfa-3546-443a-b219-3d04376a8eb3 could not be found. Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:55.265679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31fcbcfa-3546-443a-b219-3d04376a8eb3 could not be found. Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] Returning 404 to user: Instance 31fcbcfa-3546-443a-b219-3d04376a8eb3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b7ebd581-9e0a-4e44-87e5-6203c8cfdb7a tempest-ServersAaction247Test-2074100385 tempest-ServersAaction247Test-2074100385-project] 10.222.0.76 "GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3" status: 404 len: 111 microversion: 2.47 time: 0.067078 Oct 27 10:25:55.268882 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2026/4234] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:55 2022] GET /compute/v2.1/servers/31fcbcfa-3546-443a-b219-3d04376a8eb3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:25:55.422175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:55.422800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:55.430063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.430603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.431298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.432253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.433199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.433888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.522924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:55.530571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:55.531585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:55.533251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:55.535396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:55.536800 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a16eb9ac-e40b-4067-96d9-1cd9340d8812 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1330 microversion: 2.57 time: 0.119514 Oct 27 10:25:55.537546 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2209/4235] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:55 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1330 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:55.546282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.546944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.547692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.548636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.549242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.549802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.622585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:55.623201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:55.630678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.631594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.632446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.633865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.634577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.635203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.745854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:55.757688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ae1e3d9-7bf3-42c2-95df-433e30ad2d10 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1502 microversion: 2.1 time: 0.232493 Oct 27 10:25:55.762821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:55.770933 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2027/4236] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:55 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:55.778324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:55.778324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:55.778324 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6bf62add-f423-4deb-a4e8-99240474db2d tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1372 microversion: 2.47 time: 0.156533 Oct 27 10:25:55.778324 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2210/4237] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:55 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:25:55.786486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-704636127"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:55.787351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:55.801033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.801800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.802391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.803102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:55.803549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:55.804297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:55.971858 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.network.security_group_api [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Adding security group e5357036-8ed7-4922-b002-99dfec86d0bb to port a4ad2cf6-9b4f-43a4-9348-b783d772e6fe Oct 27 10:25:56.232882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:56.234454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:56.245172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:56.245917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:56.246622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:56.247749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:56.248500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:56.249130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:56.543541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:56.554555 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d30e6879-ba0d-4a21-b78f-bfe3498dfe26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.325467 Oct 27 10:25:56.566111 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2211/4238] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:56 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:56.581860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:56.582667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:56.590158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:56.590919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:56.591529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:56.592491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:56.593267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:56.593907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:56.603439 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30935a04-aec0-4a63-8c87-b6d8a6ca7052 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6/action" status: 202 len: 0 microversion: 2.1 time: 0.819491 Oct 27 10:25:56.606281 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2028/4239] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:25:55 2022] POST /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6/action => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:25:56.614387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-502332086"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:56.615417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:56.634274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:56.636491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:56.639912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:56.641611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:56.643064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:56.644227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:56.828848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:56.853783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:56.859367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:56.864507 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b676ced1-e3a8-4966-9c1b-f5a35a1aa237 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1336 microversion: 2.57 time: 0.295229 Oct 27 10:25:56.865881 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2212/4240] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:56 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1336 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:56.871357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f57b1705-a8ce-49d4-ae2a-013a3f92721e req-f400806d-8fa3-48ef-91c7-2a98bb6893e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc11663-1696-4b94-88a3-a060d97d88c6", "tag": "a4ad2cf6-9b4f-43a4-9348-b783d772e6fe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:56.883735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f57b1705-a8ce-49d4-ae2a-013a3f92721e req-f400806d-8fa3-48ef-91c7-2a98bb6893e2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:56.889492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f57b1705-a8ce-49d4-ae2a-013a3f92721e req-f400806d-8fa3-48ef-91c7-2a98bb6893e2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:56.893875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f57b1705-a8ce-49d4-ae2a-013a3f92721e req-f400806d-8fa3-48ef-91c7-2a98bb6893e2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:56.933235 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f57b1705-a8ce-49d4-ae2a-013a3f92721e req-f400806d-8fa3-48ef-91c7-2a98bb6893e2 service nova] Creating event network-changed:a4ad2cf6-9b4f-43a4-9348-b783d772e6fe for instance dbc11663-1696-4b94-88a3-a060d97d88c6 on n-h1-854663-10 Oct 27 10:25:56.947977 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f57b1705-a8ce-49d4-ae2a-013a3f92721e req-f400806d-8fa3-48ef-91c7-2a98bb6893e2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080369 Oct 27 10:25:56.960477 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2213/4241] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:56.974506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:56.976237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:56.994326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:56.995847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:56.998191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:56.999154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:57.001624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:57.002463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:57.010684 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.network.security_group_api [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Adding security group 0e2d2412-70da-4392-b2bf-99751adfe6d3 to port a4ad2cf6-9b4f-43a4-9348-b783d772e6fe Oct 27 10:25:57.729025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:57.742201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:57.744162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:57.747376 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08f45e62-98be-41ff-899b-b8c66911962a tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1372 microversion: 2.47 time: 0.782789 Oct 27 10:25:57.755003 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2214/4242] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:56 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1372 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:57.766614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:57.767304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:57.778703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:57.779560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:57.780744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:57.781684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:57.782146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:57.782576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:57.817288 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e7e0df1f-2d0f-4af1-b4e7-84a35196ad3f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6/action" status: 202 len: 0 microversion: 2.1 time: 1.206760 Oct 27 10:25:57.822591 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2029/4243] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:25:56 2022] POST /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6/action => generated 0 bytes in 1213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:25:57.833872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10f43c85-b507-4e11-aa5e-acc4223bd17d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:57.835609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-10f43c85-b507-4e11-aa5e-acc4223bd17d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:57.861059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f43c85-b507-4e11-aa5e-acc4223bd17d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:57.862455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f43c85-b507-4e11-aa5e-acc4223bd17d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:57.866189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f43c85-b507-4e11-aa5e-acc4223bd17d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:57.867204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f43c85-b507-4e11-aa5e-acc4223bd17d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:57.870468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f43c85-b507-4e11-aa5e-acc4223bd17d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:57.871618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10f43c85-b507-4e11-aa5e-acc4223bd17d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:58.201636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:58.224410 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a6ff6c5-d6f4-4f90-be34-074fec45c435 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1509 microversion: 2.1 time: 0.459319 Oct 27 10:25:58.224610 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2215/4244] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:57 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1509 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:58.238840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:58.239936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:58.258077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:58.262775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:58.264996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:58.267748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:58.270011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:58.271674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:58.365651 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10f43c85-b507-4e11-aa5e-acc4223bd17d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.537721 Oct 27 10:25:58.366607 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2030/4245] 10.222.0.76 () {58 vars in 1293 bytes} [Thu Oct 27 10:25:57 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6/os-security-groups => generated 1156 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:58.385678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e778397e-fb51-4bb7-a440-ec033985572e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: .version_select at 0x7f6d5b2dc310>, body: {"security_group": {"name": " tempest-securitygroup -1147528495 ", "description": "tempest-description-993878418"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:58.444277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:58.449298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:58.463000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:58.464853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:58.466096 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-874fc42f-ad79-4ef3-ad44-7e2daa08a9ec tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1357 microversion: 2.57 time: 0.238960 Oct 27 10:25:58.469054 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2216/4246] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:58 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:58.505631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:58.514792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:58.539764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:58.541273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:58.544937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:58.546301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:58.546959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:58.550197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:58.657997 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e778397e-fb51-4bb7-a440-ec033985572e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.277172 Oct 27 10:25:58.660266 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2031/4247] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:25:58 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:58.674411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a81e7d39-ac51-47c1-b61f-43d5b44e8696 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b2d5160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:58.746255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:25:58.746715 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a81e7d39-ac51-47c1-b61f-43d5b44e8696 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a" status: 200 len: 223 microversion: 2.1 time: 0.075920 Oct 27 10:25:58.747346 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2032/4248] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:25:58 2022] GET /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a => generated 223 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:58.747606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:25:58.748161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:25:58.748714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:25:58.749018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:25:58.761315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f28413bc-bb73-4784-80af-48875e1a2b19 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b2a5ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:58.877429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:58.884738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:58.885535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:58.886142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:58.887021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:58.887651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:58.888304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:58.926748 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65150251-aac0-4e65-9819-9ba8bf3d84a3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "POST /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd/action" status: 202 len: 1138 microversion: 2.57 time: 0.434512 Oct 27 10:25:58.927500 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2217/4249] 10.222.0.76 () {62 vars in 1320 bytes} [Thu Oct 27 10:25:58 2022] POST /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd/action => generated 1138 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 10:25:58.933122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:58.933945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:58.941537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:58.942417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:58.942997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:58.943835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:58.944874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:58.945463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.165228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.175897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.182026 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f28413bc-bb73-4784-80af-48875e1a2b19 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a" status: 202 len: 0 microversion: 2.1 time: 0.425928 Oct 27 10:25:59.184422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.186601 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2033/4250] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:25:58 2022] DELETE /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:25:59.192015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:59.192741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:59.194024 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b9f3891-dfb4-4ca6-860c-0f728be9c82c tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1357 microversion: 2.47 time: 0.265311 Oct 27 10:25:59.199139 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2218/4251] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:58 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:59.208537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.208696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b27e742b-fb4a-4769-8550-332dfc052061 req-54473d23-a1c9-4fa7-b177-a1632b23395c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc11663-1696-4b94-88a3-a060d97d88c6", "tag": "a4ad2cf6-9b4f-43a4-9348-b783d772e6fe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:59.209397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.210088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.210984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.211681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.212238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.236369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b27e742b-fb4a-4769-8550-332dfc052061 req-54473d23-a1c9-4fa7-b177-a1632b23395c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.236883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b27e742b-fb4a-4769-8550-332dfc052061 req-54473d23-a1c9-4fa7-b177-a1632b23395c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.237312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b27e742b-fb4a-4769-8550-332dfc052061 req-54473d23-a1c9-4fa7-b177-a1632b23395c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.264389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b27e742b-fb4a-4769-8550-332dfc052061 req-54473d23-a1c9-4fa7-b177-a1632b23395c service nova] Creating event network-changed:a4ad2cf6-9b4f-43a4-9348-b783d772e6fe for instance dbc11663-1696-4b94-88a3-a060d97d88c6 on n-h1-854663-10 Oct 27 10:25:59.272135 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b27e742b-fb4a-4769-8550-332dfc052061 req-54473d23-a1c9-4fa7-b177-a1632b23395c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071284 Oct 27 10:25:59.273559 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2219/4252] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:59.283505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d817fbb-86d1-4c6f-bd1e-321e3c6e8cbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5bf9cc10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:59.383392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.395840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-2d817fbb-86d1-4c6f-bd1e-321e3c6e8cbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:25:59.396792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.security_group_api [None req-2d817fbb-86d1-4c6f-bd1e-321e3c6e8cbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a not found {{(pid=120720) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:25:59.397715 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-2d817fbb-86d1-4c6f-bd1e-321e3c6e8cbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:25:59.397715 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-a816648c-fb59-4da1-abfa-9c14e3d36c28'] Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d817fbb-86d1-4c6f-bd1e-321e3c6e8cbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a HTTP/1.1 Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-a816648c-fb59-4da1-abfa-9c14e3d36c28'] Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a'} Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:25:59.400584 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a816648c-fb59-4da1-abfa-9c14e3d36c28'] Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a816648c-fb59-4da1-abfa-9c14e3d36c28'] Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a816648c-fb59-4da1-abfa-9c14e3d36c28'] Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a816648c-fb59-4da1-abfa-9c14e3d36c28'] Oct 27 10:25:59.404699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:25:59.408489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.409181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d817fbb-86d1-4c6f-bd1e-321e3c6e8cbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:25:59.409181 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-a816648c-fb59-4da1-abfa-9c14e3d36c28'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:25:59.410219 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d817fbb-86d1-4c6f-bd1e-321e3c6e8cbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a" status: 404 len: 194 microversion: 2.1 time: 0.135318 Oct 27 10:25:59.410798 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2220/4253] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:25:59 2022] GET /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:25:59.411100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.423486 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a9bd0cc1-7dee-493a-bfbb-4257565ecd81 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.226562 Oct 27 10:25:59.424483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:59.444001 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2034/4254] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:25:59 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:59.444221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.444221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Searching by: {'deleted': False, 'project_id': '5c5451608cc1445cb78d5612edafc49d'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:25:59.447187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:59.447812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:59.456558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.457124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.459668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.460589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.461207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.462714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.464076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.465370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.465958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.466816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.467331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.467891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.636825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:25:59.670117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.682967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ea3558f-63e1-45ac-9496-5fccc79a5f92 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1486 microversion: 2.1 time: 0.247111 Oct 27 10:25:59.697010 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2035/4255] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:59 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1486 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:59.708848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff6e190b-ca9a-43b0-b80c-90eb4e3c2394 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: .version_select at 0x7f6d63892b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-654007939", "description": "tempest-description-1865758436"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:59.762635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.771324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.771814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.772383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.785326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.787001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:59.836054 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6be1c393-0beb-4e32-8beb-dc17c2eec91f tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.424073 Oct 27 10:25:59.837228 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2221/4256] 10.222.0.76 () {60 vars in 1187 bytes} [Thu Oct 27 10:25:59 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:25:59.842748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09b33361-a0b3-4221-ad11-aecc87452295 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:59.845741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09b33361-a0b3-4221-ad11-aecc87452295 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:59.867968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b33361-a0b3-4221-ad11-aecc87452295 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.871994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b33361-a0b3-4221-ad11-aecc87452295 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.875522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b33361-a0b3-4221-ad11-aecc87452295 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.877861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b33361-a0b3-4221-ad11-aecc87452295 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:59.879845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b33361-a0b3-4221-ad11-aecc87452295 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:59.881945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b33361-a0b3-4221-ad11-aecc87452295 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:59.979083 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09b33361-a0b3-4221-ad11-aecc87452295 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 200 len: 151 microversion: 2.1 time: 0.140334 Oct 27 10:25:59.984600 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2222/4257] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:25:59 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 151 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:59.991255 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff6e190b-ca9a-43b0-b80c-90eb4e3c2394 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.292025 Oct 27 10:25:59.991951 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2036/4258] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:25:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:25:59.993305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:59.996299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:00.007365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:00.007985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:00.016196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.017090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.018573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:00.023070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.024445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.025161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.025288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.026501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:00.028536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:00.031803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.033306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.035829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:00.075317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:26:00.082683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:00.216869 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94234ebe-eeeb-4cb5-b98c-4591415c55ef tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "DELETE /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 204 len: 0 microversion: 2.47 time: 0.228940 Oct 27 10:26:00.219058 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2223/4259] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:25:59 2022] DELETE /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:26:00.227643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8695e193-0ce3-4b78-a3c8-1fc9c490e7e3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: .version_select at 0x7f6d5b7fc310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1390171938", "description": "tempest-description-234660250"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:00.399808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:00.426008 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-917b7653-fb0c-478f-b520-b1fd3003727f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.422936 Oct 27 10:26:00.429964 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2037/4260] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:00 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:00.438457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:00.439832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:00.454560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.455460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.456266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:00.457372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.458138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.459439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:00.589855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:00.610264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:00.612638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:00.614585 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-29c169bf-dff9-4b84-a31e-869c0f80a930 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1363 microversion: 2.47 time: 0.183204 Oct 27 10:26:00.615573 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2038/4261] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:00 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:00.623347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:00.624352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:00.639725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.640798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.643189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:00.643952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.643952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.644875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:00.779094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:00.787793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:00.789314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:00.790683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7be19e41-8757-499e-a985-39b5e3a1a5dc tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.173931 Oct 27 10:26:00.791552 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2039/4262] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:00 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:00.801105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:00.801737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:00.803263 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8695e193-0ce3-4b78-a3c8-1fc9c490e7e3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.582834 Oct 27 10:26:00.812354 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2224/4263] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:26:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:00.818956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce027d48-f2d3-4713-b393-da4e064a56e3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: .version_select at 0x7f6d5bafd8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-763017159", "description": "tempest-description-276177405"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:00.820304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.820841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.821339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:00.822193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:00.822429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:00.823726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:01.142209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:01.150191 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f0f66537-34ed-4e1f-9426-320688dc5124 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.353067 Oct 27 10:26:01.153133 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2040/4264] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:00 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:01.180537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:01.193683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:01.201122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:01.201709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:01.202222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:01.203418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:01.203976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:01.204594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:01.409695 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce027d48-f2d3-4713-b393-da4e064a56e3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.593179 Oct 27 10:26:01.410891 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2225/4265] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:26:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:01.437742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74239384-6854-4fc7-9931-1c51877c3194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b7fc310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:01.593185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:01.608227 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5eb01e00-dd9e-49f2-b7ff-849ec09148d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.430466 Oct 27 10:26:01.621877 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2041/4266] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:01 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:01.634117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:01.635062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:01.643590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:01.644394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:01.645622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:01.646663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:01.647305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:01.647983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:02.008688 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74239384-6854-4fc7-9931-1c51877c3194 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.587926 Oct 27 10:26:02.009723 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2226/4267] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:26:01 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:02.015273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:02.016059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:02.030338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:02.043225 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7bf662a5-8452-48a4-b468-21f4aca8e26f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.413255 Oct 27 10:26:02.059567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:02.059567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:02.059567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:02.059567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:02.059567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:02.059567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:02.060076 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2042/4268] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:01 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:02.060076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:02.060076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:02.088910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:02.088910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:02.088910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:02.088910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:02.088910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:02.088910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:02.237341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:02.254223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:02.260929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:02.264828 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aab8f454-f5ed-4199-a5ea-3bb26b1f10d0 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 200 len: 1363 microversion: 2.47 time: 0.253677 Oct 27 10:26:02.285822 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2227/4269] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:02 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:02.309103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1170dd9-2d26-44ba-a6ed-ae7c86882962 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b4a5550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:02.326426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:02.339016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:02.340489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:02.341750 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f0b1e07-de45-4f69-b4c3-0d3ac7524d5b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.289625 Oct 27 10:26:02.342332 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2043/4270] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:02 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:02.353765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-108454391", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9405a813-2b98-46c3-9126-2e0aba2c6166"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:02.485511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] validate_networks() for [('9405a813-2b98-46c3-9126-2e0aba2c6166', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:26:02.840250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1170dd9-2d26-44ba-a6ed-ae7c86882962 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/1535f694-379b-47d3-a4d7-bf15e024c0f0" status: 202 len: 0 microversion: 2.1 time: 0.553175 Oct 27 10:26:02.841128 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2228/4271] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:02 2022] DELETE /compute/v2.1/os-security-groups/1535f694-379b-47d3-a4d7-bf15e024c0f0 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:02.849443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9fc64800-37cb-4d85-9666-52ffd680bd12 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5ba5ff70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:02.952580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-9fc64800-37cb-4d85-9666-52ffd680bd12 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:02.953252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.security_group_api [None req-9fc64800-37cb-4d85-9666-52ffd680bd12 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 not found {{(pid=120720) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:26:02.953784 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9fc64800-37cb-4d85-9666-52ffd680bd12 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:02.953784 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-53a7d065-739d-4690-9fbd-c854957d80b5'] Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9fc64800-37cb-4d85-9666-52ffd680bd12 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-security-groups/1535f694-379b-47d3-a4d7-bf15e024c0f0 HTTP/1.1 Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-53a7d065-739d-4690-9fbd-c854957d80b5'] Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1535f694-379b-47d3-a4d7-bf15e024c0f0'} Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:02.956998 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53a7d065-739d-4690-9fbd-c854957d80b5'] Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53a7d065-739d-4690-9fbd-c854957d80b5'] Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53a7d065-739d-4690-9fbd-c854957d80b5'] Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53a7d065-739d-4690-9fbd-c854957d80b5'] Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9fc64800-37cb-4d85-9666-52ffd680bd12 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-53a7d065-739d-4690-9fbd-c854957d80b5'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9fc64800-37cb-4d85-9666-52ffd680bd12 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups/1535f694-379b-47d3-a4d7-bf15e024c0f0" status: 404 len: 194 microversion: 2.1 time: 0.113631 Oct 27 10:26:02.961115 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2229/4272] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:26:02 2022] GET /compute/v2.1/os-security-groups/1535f694-379b-47d3-a4d7-bf15e024c0f0 => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:02.969634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8ee187b-eec2-4780-a8d8-58544ac73f45 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b5d4040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:03.353077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:26:03.356728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:26:03.357391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:26:03.358084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:26:03.358769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:26:03.376909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.377988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.378741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:03.380187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.381087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.382196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:03.404531 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8ee187b-eec2-4780-a8d8-58544ac73f45 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/4449f272-6f56-4a68-89d2-0e3d5c2605bf" status: 202 len: 0 microversion: 2.1 time: 0.440656 Oct 27 10:26:03.408347 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2230/4273] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:02 2022] DELETE /compute/v2.1/os-security-groups/4449f272-6f56-4a68-89d2-0e3d5c2605bf => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:03.414156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:03.415259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 918da693-3762-46e1-b856-0e84d454e0bb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:03.433453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.434363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.434589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:03.435375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.436071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.436553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:03.444278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:03.453427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for user 1ebcbfbb11e84fe5bbfebd8a9ebea128 and project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:03.454668 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] HTTP exception thrown: Instance 918da693-3762-46e1-b856-0e84d454e0bb could not be found. Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Request method failure captured: Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb HTTP/1.1 Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyMGquyH5LZHqoQ_nFBdH6PuHq4OGVVVFlkOQu7vNVW-ldPk5aMSnAB8YuYwBTWOaX2dHbjjIbqCQMuJdVA1Ci8yKPCrWHNkFbkEkVhGsiYexekQcmQtjYqhoWz1Rby2hr4X09xIrVKlkYeH_60ib-dQUNzAsrgm1Eruvqa0GwzlCY Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 5c5451608cc1445cb78d5612edafc49d Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerShowV247Test-503892662 Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5c5451608cc1445cb78d5612edafc49d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5c5451608cc1445cb78d5612edafc49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5c5451608cc1445cb78d5612edafc49d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5c5451608cc1445cb78d5612edafc49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerShowV247Test-503892662 Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 5c5451608cc1445cb78d5612edafc49d Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerShowV247Test-503892662 Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerShowV247Test-503892662-project Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: fa67b54984fe478e8c0b9cc1a6d8f15a Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerShowV247Test-503892662-project Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 918da693-3762-46e1-b856-0e84d454e0bb could not be found. Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '918da693-3762-46e1-b856-0e84d454e0bb'} Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 918da693-3762-46e1-b856-0e84d454e0bb could not be found. Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 918da693-3762-46e1-b856-0e84d454e0bb could not be found. Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:03.457459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 918da693-3762-46e1-b856-0e84d454e0bb could not be found. Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Returning 404 to user: Instance 918da693-3762-46e1-b856-0e84d454e0bb could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c57747e8-a742-4b00-b42f-089540fdebf3 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb" status: 404 len: 111 microversion: 2.47 time: 0.048922 Oct 27 10:26:03.461708 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2231/4274] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:03 2022] GET /compute/v2.1/servers/918da693-3762-46e1-b856-0e84d454e0bb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:26:03.469353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:26:03.469687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:03.470139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:03.472357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:26:03.477443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.477939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.478381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:03.479126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.479631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.480069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:03.527158 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2815b690-afa6-493e-a2c5-d9336cfddc65 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183578 Oct 27 10:26:03.528203 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2044/4275] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:26:03.533264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76fbcfb9-2c13-4b61-b768-6ee0aeb0929b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d6380faf0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:03.590042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG neutronclient.v2_0.client [None req-76fbcfb9-2c13-4b61-b768-6ee0aeb0929b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist", "detail": ""}} {{(pid=120719) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:03.590814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:03.591607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.security_group_api [None req-76fbcfb9-2c13-4b61-b768-6ee0aeb0929b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf not found {{(pid=120719) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:26:03.592151 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-76fbcfb9-2c13-4b61-b768-6ee0aeb0929b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:03.592151 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-24e56c2b-3ec8-4b51-9ef7-f914780f978b'] Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76fbcfb9-2c13-4b61-b768-6ee0aeb0929b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-security-groups/4449f272-6f56-4a68-89d2-0e3d5c2605bf HTTP/1.1 Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: exception: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-24e56c2b-3ec8-4b51-9ef7-f914780f978b'] Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '4449f272-6f56-4a68-89d2-0e3d5c2605bf'} Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:03.594012 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24e56c2b-3ec8-4b51-9ef7-f914780f978b'] Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24e56c2b-3ec8-4b51-9ef7-f914780f978b'] Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24e56c2b-3ec8-4b51-9ef7-f914780f978b'] Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24e56c2b-3ec8-4b51-9ef7-f914780f978b'] Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76fbcfb9-2c13-4b61-b768-6ee0aeb0929b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-24e56c2b-3ec8-4b51-9ef7-f914780f978b'] {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76fbcfb9-2c13-4b61-b768-6ee0aeb0929b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups/4449f272-6f56-4a68-89d2-0e3d5c2605bf" status: 404 len: 194 microversion: 2.1 time: 0.067082 Oct 27 10:26:03.597617 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2045/4276] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:26:03 2022] GET /compute/v2.1/os-security-groups/4449f272-6f56-4a68-89d2-0e3d5c2605bf => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:03.608120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:03.608512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:03.609052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 971ed1d1-acb4-4637-afc4-b003a38ddd9a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:03.610815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:03.612166 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9b7d7b9-a625-41dd-9300-8c87e35a1878 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.147048 Oct 27 10:26:03.613479 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2232/4277] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:03 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:03.618652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9fb97bb-060f-49a3-a96f-7ad38d596b62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:03.619406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e9fb97bb-060f-49a3-a96f-7ad38d596b62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:03.641728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.642456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.643096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:03.644122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.645106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.645754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:03.698935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e9fb97bb-060f-49a3-a96f-7ad38d596b62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:03.706995 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9fb97bb-060f-49a3-a96f-7ad38d596b62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1214 microversion: 2.1 time: 0.092302 Oct 27 10:26:03.708331 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2233/4278] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:03 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:03.709196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 971ed1d1-acb4-4637-afc4-b003a38ddd9a] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:26:03.714150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-206e401f-0032-4781-85de-a6aa9f694c94 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b7533a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:03.889539 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-332f5d59-5f92-4089-aa48-077b0f93a194 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "DELETE /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a" status: 204 len: 0 microversion: 2.47 time: 0.291289 Oct 27 10:26:03.890306 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2046/4279] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:26:03 2022] DELETE /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:26:03.899185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:03.900148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 971ed1d1-acb4-4637-afc4-b003a38ddd9a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:03.917237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.917974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.918677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:03.919683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:03.920348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:03.921418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:04.475733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:04.489558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:04.491259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:04.495097 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b584d700-6558-4c3a-b30d-2774201b2062 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a" status: 200 len: 1362 microversion: 2.47 time: 0.600305 Oct 27 10:26:04.521210 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2047/4280] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:03 2022] GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a => generated 1362 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:04.589574 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-206e401f-0032-4781-85de-a6aa9f694c94 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/228b0496-a6e7-4b3e-b569-9bd278902dde" status: 202 len: 0 microversion: 2.1 time: 0.879485 Oct 27 10:26:04.590742 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2234/4281] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:03 2022] DELETE /compute/v2.1/os-security-groups/228b0496-a6e7-4b3e-b569-9bd278902dde => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:04.602757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e61b3bd-af5e-46fe-ba79-38d0782a0814 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b2a5d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:04.643242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:04.648519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:04.683216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:04.684368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:04.685359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:04.692325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:04.693038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:04.695644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:04.711170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG neutronclient.v2_0.client [None req-8e61b3bd-af5e-46fe-ba79-38d0782a0814 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist", "detail": ""}} {{(pid=120719) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:04.711770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.security_group_api [None req-8e61b3bd-af5e-46fe-ba79-38d0782a0814 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group 228b0496-a6e7-4b3e-b569-9bd278902dde not found {{(pid=120719) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:26:04.712482 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-8e61b3bd-af5e-46fe-ba79-38d0782a0814 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:04.712482 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-ce77a395-8094-48ec-bc6a-bd910f608f04'] Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e61b3bd-af5e-46fe-ba79-38d0782a0814 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-security-groups/228b0496-a6e7-4b3e-b569-9bd278902dde HTTP/1.1 Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: exception: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-ce77a395-8094-48ec-bc6a-bd910f608f04'] Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '228b0496-a6e7-4b3e-b569-9bd278902dde'} Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:04.716838 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce77a395-8094-48ec-bc6a-bd910f608f04'] Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce77a395-8094-48ec-bc6a-bd910f608f04'] Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce77a395-8094-48ec-bc6a-bd910f608f04'] Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce77a395-8094-48ec-bc6a-bd910f608f04'] Oct 27 10:26:04.720090 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:04.725699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e61b3bd-af5e-46fe-ba79-38d0782a0814 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:04.725699 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-ce77a395-8094-48ec-bc6a-bd910f608f04'] {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:04.727362 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e61b3bd-af5e-46fe-ba79-38d0782a0814 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups/228b0496-a6e7-4b3e-b569-9bd278902dde" status: 404 len: 194 microversion: 2.1 time: 0.131548 Oct 27 10:26:04.728160 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2048/4282] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:26:04 2022] GET /compute/v2.1/os-security-groups/228b0496-a6e7-4b3e-b569-9bd278902dde => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:04.740280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:04.746036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:04.769062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:04.771088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:04.775313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:04.778276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:04.778848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:04.779517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:04.898150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:04.915098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:04.919838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:04.921140 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c2d77a4-fee7-4726-911a-7d6102caae03 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.283718 Oct 27 10:26:04.926239 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2235/4283] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:04 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:04.940642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec95e802-6b99-4a6f-833c-0b3e26753fc0 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b753040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:05.066301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:05.083452 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e975d00-bdaf-432f-bedc-bcded9691988 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1210 microversion: 2.1 time: 0.351207 Oct 27 10:26:05.084555 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2049/4284] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:04 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1210 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:05.528822 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec95e802-6b99-4a6f-833c-0b3e26753fc0 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.601101 Oct 27 10:26:05.529602 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2236/4285] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:26:04 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:05.547003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:05.548317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 971ed1d1-acb4-4637-afc4-b003a38ddd9a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:05.550157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-048cbfbd-4b09-43d3-8c43-7280c652bfdf tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: .version_select at 0x7f6d5b4a5d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-467777321", "description": "tempest-description-102068070"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:05.558736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:05.559587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:05.560504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:05.562903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:05.563857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:05.564548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:05.846609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:05.863376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:05.873652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:05.878655 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d907963d-8a47-4e52-ab28-1dd74214ca45 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a" status: 200 len: 1362 microversion: 2.47 time: 0.350956 Oct 27 10:26:05.881730 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2050/4286] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:05 2022] GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:05.955773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:05.956883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:05.971006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:05.978068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:05.978861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:05.984591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:05.986372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:05.988558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:06.266620 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-048cbfbd-4b09-43d3-8c43-7280c652bfdf tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.720581 Oct 27 10:26:06.269172 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2237/4287] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:26:05 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:06.294425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:06.295354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:06.302533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:06.322829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:06.329331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:06.331181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:06.333174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:06.336056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:06.337268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:06.338730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:06.339187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:06.340636 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c117d83-bd56-46ae-b9c2-5be1dcc7c1e7 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.391759 Oct 27 10:26:06.346433 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2051/4288] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:05 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:06.355524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00d0dd2e-0b0e-4485-bd41-d376b97b7b3d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: .version_select at 0x7f6d5b474820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-615233395", "description": "tempest-description-994414608"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:06.522545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:06.537031 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a56b60b7-841b-445c-97c5-3b93f3940172 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1272 microversion: 2.1 time: 0.265282 Oct 27 10:26:06.539658 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2238/4289] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:06 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:06.853732 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00d0dd2e-0b0e-4485-bd41-d376b97b7b3d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.505864 Oct 27 10:26:06.854576 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2052/4290] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:26:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:06.908862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:06.910464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 971ed1d1-acb4-4637-afc4-b003a38ddd9a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:06.934318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:06.934998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:06.935465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:06.936228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:06.936735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:06.937173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:07.032816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:07.038303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:07.039037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:07.039678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lazy-loading 'fault' on Instance uuid 971ed1d1-acb4-4637-afc4-b003a38ddd9a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:26:07.195827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:07.208224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:07.216995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa67b54984fe478e8c0b9cc1a6d8f15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5451608cc1445cb78d5612edafc49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:07.220013 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fee02e8e-2668-40e4-8888-b4e5b9ebfff7 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a" status: 200 len: 1367 microversion: 2.47 time: 0.315125 Oct 27 10:26:07.225969 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2239/4291] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:06 2022] GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:07.377507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:07.378404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:07.381843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:07.422835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:07.423650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:07.427950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:07.429620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:07.431460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:07.435179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:07.506758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1057223535", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "78d6ccf4-fcb7-4aa3-acdb-ca1493958b56"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:07.614847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] validate_networks() for [('78d6ccf4-fcb7-4aa3-acdb-ca1493958b56', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:26:07.830923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:07.849447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:07.860818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:07.864798 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1a9d5c4-3652-49d2-9584-7f0a1cfa20fb tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.490413 Oct 27 10:26:07.866365 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2053/4292] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:07 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:07.887565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:07.888370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:07.919589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:07.925327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:07.926204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:07.927152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:07.927934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:07.928770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:08.133478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:08.158580 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d089963c-ad83-4279-bcb1-f4d4c340d7e6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1272 microversion: 2.1 time: 0.290523 Oct 27 10:26:08.177441 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2054/4293] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:07 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1272 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:08.256561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:08.257472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] [instance: 971ed1d1-acb4-4637-afc4-b003a38ddd9a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:08.264933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:08.268355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:08.271078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:08.272020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:08.275090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:08.275796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:08.314532 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] HTTP exception thrown: Instance 971ed1d1-acb4-4637-afc4-b003a38ddd9a could not be found. Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Request method failure captured: Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a HTTP/1.1 Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyMGquyH5LZHqoQ_nFBdH6PuHq4OGVVVFlkOQu7vNVW-ldPk5aMSnAB8YuYwBTWOaX2dHbjjIbqCQMuJdVA1Ci8yKPCrWHNkFbkEkVhGsiYexekQcmQtjYqhoWz1Rby2hr4X09xIrVKlkYeH_60ib-dQUNzAsrgm1Eruvqa0GwzlCY Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 5c5451608cc1445cb78d5612edafc49d Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerShowV247Test-503892662 Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5c5451608cc1445cb78d5612edafc49d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5c5451608cc1445cb78d5612edafc49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5c5451608cc1445cb78d5612edafc49d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5c5451608cc1445cb78d5612edafc49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerShowV247Test-503892662 Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 5c5451608cc1445cb78d5612edafc49d Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerShowV247Test-503892662 Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerShowV247Test-503892662-project Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: fa67b54984fe478e8c0b9cc1a6d8f15a Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerShowV247Test-503892662-project Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 971ed1d1-acb4-4637-afc4-b003a38ddd9a could not be found. Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '971ed1d1-acb4-4637-afc4-b003a38ddd9a'} Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971ed1d1-acb4-4637-afc4-b003a38ddd9a could not be found. Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971ed1d1-acb4-4637-afc4-b003a38ddd9a could not be found. Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:08.316122 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971ed1d1-acb4-4637-afc4-b003a38ddd9a could not be found. Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] Returning 404 to user: Instance 971ed1d1-acb4-4637-afc4-b003a38ddd9a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e2b83ca-a77f-4f09-92ba-f6f858bcc6e1 tempest-ServerShowV247Test-503892662 tempest-ServerShowV247Test-503892662-project] 10.222.0.76 "GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a" status: 404 len: 111 microversion: 2.47 time: 0.066055 Oct 27 10:26:08.323609 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2055/4294] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:08 2022] GET /compute/v2.1/servers/971ed1d1-acb4-4637-afc4-b003a38ddd9a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:26:08.763187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:26:08.763708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:26:08.763844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:26:08.764444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:26:08.765087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:26:08.781298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=27 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:08.788812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:08.804437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:08.804928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:08.805768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:08.806236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:08.806669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:08.849922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:08.881131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Getting quotas for project c507a1f574f442e7a2bed77fd6128e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:08.893180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Getting quotas for user 56b0e71b200045128271a5b441a5b796 and project c507a1f574f442e7a2bed77fd6128e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:08.893383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:08.894049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:08.909695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:08.910397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:08.910845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:08.919569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:08.920118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:08.920563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:08.948923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:26:08.956947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:26:09.101650 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-755286c7-c87a-4512-a0d7-ad59a02e1a7f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.598822 Oct 27 10:26:09.110976 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2240/4295] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:26:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:26:09.152466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb54b587-3652-4014-bde5-87115ffad5d9 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:09.169797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb54b587-3652-4014-bde5-87115ffad5d9 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:09.313838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:09.316125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:09.324779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:09.333256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:09.340955 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-edb1cc06-8f37-4b9d-93e2-21de6d339783 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.451349 Oct 27 10:26:09.341614 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2056/4296] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:08 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:09.347005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:09.358705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:09.381231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:09.381824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:09.382271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:09.383006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:09.383665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:09.384310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:09.531641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb54b587-3652-4014-bde5-87115ffad5d9 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:09.548409 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb54b587-3652-4014-bde5-87115ffad5d9 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1216 microversion: 2.1 time: 0.435915 Oct 27 10:26:09.576985 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2241/4297] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:09 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1216 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:10.155338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:10.167535 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7f0d14e-37f9-4a88-accf-e2fb34fd0de3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.824496 Oct 27 10:26:10.204748 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2057/4298] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:09 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:10.372087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:10.373493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:10.391266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:10.392193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:10.396300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:10.400519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:10.401860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:10.402298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:10.589373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:10.590259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:10.606403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:10.611665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:10.612341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:10.616438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:10.618165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:10.622328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:10.647060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:10.656695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:10.658084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:10.659297 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f69860a-2395-4930-b1f4-6af1e15bad9c tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.291722 Oct 27 10:26:10.659877 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2242/4299] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:10 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:10.876629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:10.890882 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17f0bd35-68fe-4bde-aaf9-538b141c0069 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1268 microversion: 2.1 time: 0.301530 Oct 27 10:26:10.911472 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2058/4300] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:10 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1268 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:11.193079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:11.193539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:11.204333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:11.204890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:11.205332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:11.206048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:11.206660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:11.207152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:11.231415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:11.472941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:11.483686 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b4ac944-779c-42c9-aa64-d82b095d4e72 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.295604 Oct 27 10:26:11.503538 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2243/4301] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:11 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:11.690975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:11.693144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:11.706598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:11.707093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:11.707533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:11.708247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:11.716007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:11.716989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:11.899595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:11.917948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:11.918576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:11.923055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:11.925419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:11.929436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:11.929882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:11.930079 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0aec6357-a263-43d9-a6e4-6f3d5f2e2029 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.239709 Oct 27 10:26:11.930627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:11.931499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:11.932104 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2059/4302] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:11 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:11.945433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:11.946225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:12.099596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:12.107995 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a6b15e7-ff35-45dc-8fec-f36339cb0720 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1274 microversion: 2.1 time: 0.193959 Oct 27 10:26:12.126711 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2244/4303] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:11 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:12.509897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:12.511017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:12.521205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:12.522858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:12.523355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:12.524060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:12.524527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:12.527133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:12.786971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-181799217", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": "none"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:12.905108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:26:12.906741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:26:12.909472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:26:12.910131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:26:12.910759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:26:12.916836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:12.925853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:12.928264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:12.929488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:12.935558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:12.937882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:12.938621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:12.939107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:12.958798 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2358d96b-b651-4efa-a0ed-5f84ac6a3d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.451755 Oct 27 10:26:12.959712 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2060/4304] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:12 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:12.967437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:12.970574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Getting quotas for project 53b53d589e73434e9e998f8349d608f9. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:12.973627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:12.979033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Getting quotas for user ad72fb9645db4ee4b59db67e96316b98 and project 53b53d589e73434e9e998f8349d608f9. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:12.984520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:12.985401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:12.986075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:12.987107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:12.988309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:12.988976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:12.993471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:26:12.995959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:26:13.055225 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7331798-2b51-42cf-89bc-c777ccddd82f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.474346 Oct 27 10:26:13.057414 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2245/4305] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 10:26:13.069010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-991210cb-1bb9-408d-aa78-dce16affcadc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:13.069915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-991210cb-1bb9-408d-aa78-dce16affcadc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:13.121720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:13.131420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:13.134717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:13.137172 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c9531dd-4c39-4756-9c91-43491d66bbd0 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.175355 Oct 27 10:26:13.138032 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2061/4306] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:12 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:13.143169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:13.144028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:13.154338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:13.154474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-991210cb-1bb9-408d-aa78-dce16affcadc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:13.157284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:13.158403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:13.161044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:13.161531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:13.161968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:13.163447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-991210cb-1bb9-408d-aa78-dce16affcadc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:13.164929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-991210cb-1bb9-408d-aa78-dce16affcadc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:13.166313 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-991210cb-1bb9-408d-aa78-dce16affcadc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1277 microversion: 2.54 time: 0.101554 Oct 27 10:26:13.167451 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2246/4307] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:13 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:13.250394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:13.260929 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1fb8f741-f85b-4ee6-aa10-ac7edae7df5d tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1274 microversion: 2.1 time: 0.120419 Oct 27 10:26:13.266280 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2062/4308] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:13 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1274 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:13.994603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:13.996382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:14.011884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:14.020914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:14.023008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:14.024744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:14.025494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:14.030368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:14.166033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:14.167636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:14.169882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:14.170789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:14.196305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:14.204547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:14.205402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:14.206819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:14.207620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:14.208352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:14.336126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:14.361103 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa2a4911-5e8c-4d49-85b5-3c7395cc0f68 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.373960 Oct 27 10:26:14.367923 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2247/4309] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:13 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:14.381767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:14.395285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:14.423182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:14.436240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:14.439859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:14.443359 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86bd2740-c10d-4479-ba92-c8d7f43da2b3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.281251 Oct 27 10:26:14.450339 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2063/4310] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:14 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:14.450705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:14.464688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:14.464688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:14.464688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:14.464688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:14.464688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:14.465195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:14.465195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:14.478698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:14.478698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:14.478698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:14.483700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:14.485297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:14.487700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:14.605839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:14.645826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:14.648913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:14.650303 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c2e144f-6025-409b-b67c-e8909373687e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1329 microversion: 2.54 time: 0.281055 Oct 27 10:26:14.651434 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2248/4311] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:14 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1329 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:14.664476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:14.680030 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-604d3900-f574-4860-b0a0-fef83cbcff4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1274 microversion: 2.1 time: 0.228189 Oct 27 10:26:14.681360 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2064/4312] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:14 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:15.395518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:15.404181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:15.429663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:15.430431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:15.431126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:15.432206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:15.432944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:15.433615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:15.484800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:15.486496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:15.496949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:15.498165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:15.498843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:15.499867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:15.500564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:15.501257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:15.634125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:15.644232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:15.648533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:15.656711 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-119c7e5c-b9a3-4578-a7d4-3ed4ae28109f tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.178034 Oct 27 10:26:15.657972 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2065/4313] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:15 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:15.681436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:15.682254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:15.689999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:15.691103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:15.691740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:15.693422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:15.694167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:15.694794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:15.757967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:15.773651 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8133e705-1141-4a3f-b2a1-2b9d0a6f03d6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.382619 Oct 27 10:26:15.775943 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2249/4314] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:15 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:15.784570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:15.793240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:15.797654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:15.798182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:15.806270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:15.810184 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae1fe593-e45a-40d7-a8a5-850275f42f87 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1335 microversion: 2.54 time: 0.134695 Oct 27 10:26:15.812408 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2066/4315] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:15 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1335 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:15.833532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:15.836149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:15.836920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:15.838420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:15.839526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:15.840677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:16.098343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:16.123319 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d57184fa-ecff-42ec-aefc-0a1e49da3c26 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 0.334463 Oct 27 10:26:16.128510 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2250/4316] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:15 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:16.323385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-84bce79e-2ad4-4406-96ff-b0fe83981667 req-b058b6e2-a83b-4128-8dbe-e273b6817636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42645020-6574-4ccd-a940-5488825620c9", "tag": "5ea362d9-27fd-4b51-908c-273002fca9d8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:16.366579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-84bce79e-2ad4-4406-96ff-b0fe83981667 req-b058b6e2-a83b-4128-8dbe-e273b6817636 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:16.369216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-84bce79e-2ad4-4406-96ff-b0fe83981667 req-b058b6e2-a83b-4128-8dbe-e273b6817636 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:16.369969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-84bce79e-2ad4-4406-96ff-b0fe83981667 req-b058b6e2-a83b-4128-8dbe-e273b6817636 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:16.419099 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-84bce79e-2ad4-4406-96ff-b0fe83981667 req-b058b6e2-a83b-4128-8dbe-e273b6817636 service nova] Creating event network-changed:5ea362d9-27fd-4b51-908c-273002fca9d8 for instance 42645020-6574-4ccd-a940-5488825620c9 on n-h2-854663-10 Oct 27 10:26:16.428176 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-84bce79e-2ad4-4406-96ff-b0fe83981667 req-b058b6e2-a83b-4128-8dbe-e273b6817636 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118274 Oct 27 10:26:16.429510 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2251/4317] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:26:16.452601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea52cfab-90a8-4913-bf27-4a4bfca39567 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Action: 'create', calling method: .version_select at 0x7f6d5b310160>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:16.507983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ea52cfab-90a8-4913-bf27-4a4bfca39567 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Getting quotas for project e1794e4b3e334546bc6e4c56546f4b74. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:16.518876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ea52cfab-90a8-4913-bf27-4a4bfca39567 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Getting quotas for user 32e63322af1549f6bb4d4d5dc28d1ce3 and project e1794e4b3e334546bc6e4c56546f4b74. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:16.623120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ea52cfab-90a8-4913-bf27-4a4bfca39567 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Getting quotas for project e1794e4b3e334546bc6e4c56546f4b74. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:16.634150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ea52cfab-90a8-4913-bf27-4a4bfca39567 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Getting quotas for user 32e63322af1549f6bb4d4d5dc28d1ce3 and project e1794e4b3e334546bc6e4c56546f4b74. Resources: {'server_groups'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:16.657067 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea52cfab-90a8-4913-bf27-4a4bfca39567 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] 10.222.0.76 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.492289 Oct 27 10:26:16.658509 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2067/4318] 10.222.0.76 () {62 vars in 1214 bytes} [Thu Oct 27 10:26:16 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:26:16.671017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f806dc8-16f5-49b8-9a5d-fc34ac8aeebc tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:16.687152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:16.688351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:16.696474 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f806dc8-16f5-49b8-9a5d-fc34ac8aeebc tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.030533 Oct 27 10:26:16.700475 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2252/4319] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 27 10:26:16 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:26:16.700959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:16.701604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:16.702214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:16.703155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:16.703748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:16.704313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:16.710994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7919cea6-0cfe-4c1f-91ac-cb50d7232552 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:16.735895 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7919cea6-0cfe-4c1f-91ac-cb50d7232552 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] 10.222.0.76 "GET /compute/v2.1/os-server-groups/cc80581b-a665-4031-aad0-2733f2635ea7" status: 200 len: 235 microversion: 2.64 time: 0.028665 Oct 27 10:26:16.741940 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2253/4320] 10.222.0.76 () {60 vars in 1304 bytes} [Thu Oct 27 10:26:16 2022] GET /compute/v2.1/os-server-groups/cc80581b-a665-4031-aad0-2733f2635ea7 => generated 235 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:26:16.752765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0802679-2931-4690-8807-de50dce530d2 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:16.823556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:16.834929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:16.835661 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0802679-2931-4690-8807-de50dce530d2 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/cc80581b-a665-4031-aad0-2733f2635ea7" status: 204 len: 0 microversion: 2.64 time: 0.086934 Oct 27 10:26:16.836577 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2254/4321] 10.222.0.76 () {60 vars in 1307 bytes} [Thu Oct 27 10:26:16 2022] DELETE /compute/v2.1/os-server-groups/cc80581b-a665-4031-aad0-2733f2635ea7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 10:26:16.836749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:16.838175 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-672a4ce2-fe2e-4efc-b932-7c00eefd8105 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.155306 Oct 27 10:26:16.844889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:16.845639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:16.854194 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2068/4322] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:16 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:16.865554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:16.866702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:16.869792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:16.871619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:16.872725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:16.873647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:16.874383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:16.875397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:16.890652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:16.891580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:16.892599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:16.895425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:16.896072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:16.898692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:17.115417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:17.123874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:17.134544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:17.137538 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24da47f0-d455-40ef-835f-2783b91321b7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.299594 Oct 27 10:26:17.138616 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2255/4323] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:16 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:17.152212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:17.155498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd070322-d629-4945-9456-10efb2cd1fb2 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:17.158608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59221dea-2043-4ad9-a3ed-bc9957c1792e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1335 microversion: 2.54 time: 0.303015 Oct 27 10:26:17.173066 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2069/4324] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:16 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1335 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:17.173651 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-fd070322-d629-4945-9456-10efb2cd1fb2 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] HTTP exception thrown: Instance group cc80581b-a665-4031-aad0-2733f2635ea7 could not be found. Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd070322-d629-4945-9456-10efb2cd1fb2 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Request method failure captured: Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-server-groups/cc80581b-a665-4031-aad0-2733f2635ea7 HTTP/1.1 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzHgFpbJMUEIYl16hTEmFuFm6ifa13BQgfWoCjnnBJn0x__AEghf-rnvNjb-o_Rc6SCGWTUB659uemieeDZ9xcH5kqracA1yoUWV2hkDqaJaVQXuelNC8kRoVHgqQfS9EMFkmrR8tdILEe2ulD1fGx_EGC7xgtRRJ-ScNXcVBrrZjQ Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.64 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: e1794e4b3e334546bc6e4c56546f4b74 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerGroup264TestJSON-1203650986 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e1794e4b3e334546bc6e4c56546f4b74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e1794e4b3e334546bc6e4c56546f4b74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e1794e4b3e334546bc6e4c56546f4b74", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e1794e4b3e334546bc6e4c56546f4b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerGroup264TestJSON-1203650986 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: e1794e4b3e334546bc6e4c56546f4b74 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1203650986 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerGroup264TestJSON-1203650986-project Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 32e63322af1549f6bb4d4d5dc28d1ce3 Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerGroup264TestJSON-1203650986-project Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance group cc80581b-a665-4031-aad0-2733f2635ea7 could not be found. Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'cc80581b-a665-4031-aad0-2733f2635ea7'} Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cc80581b-a665-4031-aad0-2733f2635ea7 could not be found. Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cc80581b-a665-4031-aad0-2733f2635ea7 could not be found. Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:17.178596 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:17.182654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:17.182654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:17.182654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:17.182654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:17.182654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cc80581b-a665-4031-aad0-2733f2635ea7 could not be found. Oct 27 10:26:17.182654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:17.182654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd070322-d629-4945-9456-10efb2cd1fb2 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] Returning 404 to user: Instance group cc80581b-a665-4031-aad0-2733f2635ea7 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:17.182654 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd070322-d629-4945-9456-10efb2cd1fb2 tempest-ServerGroup264TestJSON-1203650986 tempest-ServerGroup264TestJSON-1203650986-project] 10.222.0.76 "DELETE /compute/v2.1/os-server-groups/cc80581b-a665-4031-aad0-2733f2635ea7" status: 404 len: 117 microversion: 2.64 time: 0.042397 Oct 27 10:26:17.187555 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2256/4325] 10.222.0.76 () {60 vars in 1307 bytes} [Thu Oct 27 10:26:17 2022] DELETE /compute/v2.1/os-server-groups/cc80581b-a665-4031-aad0-2733f2635ea7 => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:26:17.188618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:17.189242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:17.196594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:17.197117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:17.197962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:17.198287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:17.198744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:17.199402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:17.869037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:17.870378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:17.887034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:17.889113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:17.889763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:17.890674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:17.893908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:17.894652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:18.336260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:18.350639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:18.352436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:18.354256 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c147f7a-186f-49fb-84de-c39f64ee1800 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.489563 Oct 27 10:26:18.360723 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2257/4326] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:17 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:18.377086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:18.378050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:18.394968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:18.395808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:18.402217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:18.405225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:18.407341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:18.407929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:18.759217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:18.774756 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0f95215-6b38-4ff2-a71a-974c7fbe1e32 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 1.600193 Oct 27 10:26:18.776426 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2070/4327] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:17 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:18.791350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:18.792968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:18.809153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:18.809889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:18.810554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:18.812405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:18.816119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:18.817255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.035871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:19.049627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:19.051146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:19.061980 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc443ae4-f140-45ea-bf68-735ff2d1846d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1356 microversion: 2.54 time: 0.280346 Oct 27 10:26:19.063024 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2071/4328] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:18 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1356 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:19.097966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ea15b81-c0e5-4715-8841-f04413e95d47 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Action: 'create', calling method: .version_select at 0x7f6d5b474ca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1226216439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlW4o8jKkuUWQ0I0MZZ4esgEha98Qi0Sw+iHjvw5rRdBFtlQifTyXWHXDDcE5yUCpbbkYxHM/Hs2QAd0zYzwzUB/zW14663vdGn2FmXQzoGtaHTF/xbitYGaK31eJ3cDw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:19.164029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-2ea15b81-c0e5-4715-8841-f04413e95d47 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Getting quotas for project 53b53d589e73434e9e998f8349d608f9. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:19.194009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-2ea15b81-c0e5-4715-8841-f04413e95d47 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Getting quotas for user ad72fb9645db4ee4b59db67e96316b98 and project 53b53d589e73434e9e998f8349d608f9. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:19.274462 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ea15b81-c0e5-4715-8841-f04413e95d47 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.181367 Oct 27 10:26:19.276966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2072/4329] 10.222.0.76 () {62 vars in 1200 bytes} [Thu Oct 27 10:26:19 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 10:26:19.297284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1226216439", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:19.318767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:19.343086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.347321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.347825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.352551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.353145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.353618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.367939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:19.383475 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58708b4b-a3b7-49ac-ac9e-3f8e8bcc80e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 1.020829 Oct 27 10:26:19.384961 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2258/4330] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:18 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:19.411688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:19.412573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:19.431493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.432461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.433125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.434118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.436118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.437016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.557229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:26:19.561522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:26:19.562237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:26:19.562907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:26:19.563467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:26:19.676680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:19.696457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:19.700873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:19.704238 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-787f0120-8f85-4729-abcb-7409763c46ad tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.316952 Oct 27 10:26:19.706001 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2259/4331] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:19 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:19.720738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:19.751323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:19.770563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.771940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.772410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.773217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.778855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.779395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.804644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:19.813376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:19.829672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.831594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.832050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.833976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.834444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.849948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.928046 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac94e396-5846-43eb-8754-c58c70a53e3c tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "POST /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354/action" status: 202 len: 1139 microversion: 2.54 time: 0.639539 Oct 27 10:26:19.937548 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2073/4332] 10.222.0.76 () {62 vars in 1320 bytes} [Thu Oct 27 10:26:19 2022] POST /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354/action => generated 1139 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 10:26:19.964048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:19.965066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:19.981188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.983689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.985824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:19.989402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:19.989965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:19.990418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:20.136018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:20.153871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:20.155862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:20.157629 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2629abe-7d76-475a-9d70-b28559d8246a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.198687 Oct 27 10:26:20.158958 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2074/4333] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:19 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:20.292495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:20.302579 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b244a951-20b3-4d6a-a3d0-646168603c43 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 0.503875 Oct 27 10:26:20.323843 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2260/4334] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:19 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:20.427168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:20.430500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:20.446796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:20.448211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:20.448818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:20.449902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:20.450469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:20.450995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:20.605496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1c0c8e44-4a65-4bf5-89b2-785cc7f810e0 req-7eddd12d-7d01-4bb6-9d59-7bcde0ca763f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d8d9de-e792-43cd-b099-6c16baa73765", "tag": "4e38778c-5c98-4efc-aec7-534c4a9f194a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:20.628429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1c0c8e44-4a65-4bf5-89b2-785cc7f810e0 req-7eddd12d-7d01-4bb6-9d59-7bcde0ca763f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:20.629180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1c0c8e44-4a65-4bf5-89b2-785cc7f810e0 req-7eddd12d-7d01-4bb6-9d59-7bcde0ca763f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:20.630735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1c0c8e44-4a65-4bf5-89b2-785cc7f810e0 req-7eddd12d-7d01-4bb6-9d59-7bcde0ca763f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:20.649550 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1c0c8e44-4a65-4bf5-89b2-785cc7f810e0 req-7eddd12d-7d01-4bb6-9d59-7bcde0ca763f service nova] Creating event network-changed:4e38778c-5c98-4efc-aec7-534c4a9f194a for instance d1d8d9de-e792-43cd-b099-6c16baa73765 on n-h2-854663-10 Oct 27 10:26:20.658597 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1c0c8e44-4a65-4bf5-89b2-785cc7f810e0 req-7eddd12d-7d01-4bb6-9d59-7bcde0ca763f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055796 Oct 27 10:26:20.660431 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2261/4335] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:20.740343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:20.741071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:20.757608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:20.758269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:20.758906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:20.760143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:20.760701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:20.761321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:20.838871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:20.855014 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-66274278-6472-47bb-b83b-574f6d3f6e30 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.447159 Oct 27 10:26:20.871680 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2075/4336] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:20 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:20.918363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:20.935212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:20.938006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:20.939644 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e1fe077-2cf3-4790-8e09-77345b2a8871 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.204596 Oct 27 10:26:20.941423 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2262/4337] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:20 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:21.188958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:21.189597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:21.205800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:21.206530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:21.207242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:21.208115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:21.208756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:21.209359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:21.309794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:21.329843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:21.331528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:21.333068 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8d09026-4d30-47d5-89e3-67c2f4b4ae9a tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.148974 Oct 27 10:26:21.334093 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2076/4338] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:21 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:21.337808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:21.338468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:21.351992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:21.352624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:21.353165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:21.354327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:21.355015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:21.355698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:21.615133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:21.627043 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f257e82-a979-4e6e-8da2-c7c10913ae79 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 0.294280 Oct 27 10:26:21.627838 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2263/4339] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:21 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:21.879413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:21.880623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:21.889168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:21.889937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:21.890538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:21.891443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:21.892737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:21.893317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:21.968481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:21.969375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:21.983420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:21.984463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:21.985748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:21.986729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:21.987395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:21.988062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:22.151789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:22.165381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:22.166910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:22.168310 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5fdbc6c7-5f68-4f87-9238-d199c745f365 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.204280 Oct 27 10:26:22.172344 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2264/4340] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:21 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:22.270757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:22.282379 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-79ce8c14-d570-4890-a504-59ac0b681d15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.407245 Oct 27 10:26:22.282991 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2077/4341] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:21 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:22.360982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:22.361958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:22.376503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:22.377153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:22.377689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:22.386043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:22.386743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:22.387296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:22.569946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:22.582651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:22.590915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:22.592462 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6477df19-8c45-433c-b69a-151ef113e320 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.235585 Oct 27 10:26:22.597183 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2265/4342] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:22 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:22.655067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:22.657248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:22.665624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:22.671362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:22.671958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:22.672590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:22.674324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:22.674755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:23.050275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:23.074385 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4bc619c-ebbb-49d4-bfed-939247ee7846 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 0.423089 Oct 27 10:26:23.075024 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2078/4343] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:22 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:23.200689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:23.202075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:23.204321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:23.206487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=15 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:23.223066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:23.223797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:23.225251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:23.226881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:23.228058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:23.228728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:23.306795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:23.307490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:23.318898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:23.322296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:23.323067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:23.324110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:23.329751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:23.330224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:23.392197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:23.413461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:23.425026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:23.428942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:23.430557 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4ad6575-ce7b-4b06-a113-fed8402cdb97 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.234307 Oct 27 10:26:23.431133 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2266/4344] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:23 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:23.554723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:23.566963 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12dbe3ec-425c-4a44-9764-5590a952768b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.264434 Oct 27 10:26:23.568515 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2079/4345] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:23 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:23.629702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:23.630715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:23.639467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:23.640204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:23.640901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:23.641881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:23.647603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:23.648512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:23.750558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:23.760298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:23.761839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:23.763127 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce971ada-ded9-448d-97de-438d4f9345e2 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.139790 Oct 27 10:26:23.763936 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2267/4346] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:23 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:24.099244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:24.100039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:24.109571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:24.110314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:24.134749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:24.144078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:24.144906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:24.145352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:24.458808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:24.460360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:24.473027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:24.477800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:24.478900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:24.482013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:24.494415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:24.497358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:24.986016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:24.998953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:25.000532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:25.010217 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-576a1fe8-6168-4b27-98b5-6becf537e620 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.556365 Oct 27 10:26:25.011385 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2268/4347] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:24 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:25.016631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:25.021561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:25.042946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:25.043659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:25.044110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:25.044873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:25.045483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:25.045835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:25.201221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:25.209816 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c889d8f0-f872-4aef-9293-30b7751d0781 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 1.114572 Oct 27 10:26:25.213934 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2080/4348] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:24 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:25.219159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:25.233615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:25.240701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:25.242056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:25.242715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:25.243863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:25.244578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:25.253808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:25.432498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:25.442710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:25.454707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:25.456291 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-410263a0-8cf4-4932-a820-d1157dbdb744 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.241032 Oct 27 10:26:25.457168 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2081/4349] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:25 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:25.464735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6fca97c4-7da4-48fa-bdde-f7ef1cd4fb26 req-dd65afdd-58dd-4645-a3ec-a61141cd3dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42645020-6574-4ccd-a940-5488825620c9", "name": "network-vif-plugged", "status": "completed", "tag": "5ea362d9-27fd-4b51-908c-273002fca9d8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:25.482579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:25.486918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6fca97c4-7da4-48fa-bdde-f7ef1cd4fb26 req-dd65afdd-58dd-4645-a3ec-a61141cd3dbd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:25.487396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6fca97c4-7da4-48fa-bdde-f7ef1cd4fb26 req-dd65afdd-58dd-4645-a3ec-a61141cd3dbd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:25.487821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6fca97c4-7da4-48fa-bdde-f7ef1cd4fb26 req-dd65afdd-58dd-4645-a3ec-a61141cd3dbd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:25.511151 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6fca97c4-7da4-48fa-bdde-f7ef1cd4fb26 req-dd65afdd-58dd-4645-a3ec-a61141cd3dbd service nova] Creating event network-vif-plugged:5ea362d9-27fd-4b51-908c-273002fca9d8 for instance 42645020-6574-4ccd-a940-5488825620c9 on n-h2-854663-10 Oct 27 10:26:25.526696 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6fca97c4-7da4-48fa-bdde-f7ef1cd4fb26 req-dd65afdd-58dd-4645-a3ec-a61141cd3dbd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067852 Oct 27 10:26:25.527669 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2082/4350] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:25.576427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:25.598039 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48d88281-b128-4de7-af88-7f46d021941a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.585087 Oct 27 10:26:25.598974 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2269/4351] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:25 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:26.040870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:26.041701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:26.048095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.048586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.059534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:26.060300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.060809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.061489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:26.163380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:26.175792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:26.177451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:26.182096 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d928a4a-2b9e-485f-a2c5-b2bf74f53f88 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.145928 Oct 27 10:26:26.184070 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2083/4352] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:26 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:26.235671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:26.236564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:26.250685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.251471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.252072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:26.254607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.255309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.255748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:26.487617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:26.488340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:26.504319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.504860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.505299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:26.506019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.506469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.507255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:26.549171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:26.561441 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bdf3670f-8837-4bef-bf0c-21cefb153a02 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 0.329735 Oct 27 10:26:26.563967 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2270/4353] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:26 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:26.602838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:26.615801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:26.617936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:26.620170 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-84eb057e-92d8-4bfa-bdf2-91dc37d87b60 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.136440 Oct 27 10:26:26.623661 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2084/4354] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:26 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:26.630207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:26.630831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:26.640636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.645539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.650012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:26.652295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.652859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.653326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:27.066459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:27.090574 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f1c79a1-8d7d-4796-93a9-a5dde14035a4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1314 microversion: 2.1 time: 0.464993 Oct 27 10:26:27.093188 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2271/4355] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:26 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:27.217162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:27.217821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:27.240358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:27.254102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:27.255860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:27.258945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:27.262368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:27.263910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:27.442617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:27.455030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:27.459538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:27.461236 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b604e78c-745e-4454-85b4-7fd42c1bc8de tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.255322 Oct 27 10:26:27.462602 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2085/4356] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:27 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:27.588227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:27.588968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:27.598631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:27.599511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:27.600322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:27.601526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:27.602332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:27.603006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:27.654138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:27.654749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:27.667389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:27.672760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:27.673821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:27.674567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:27.675020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:27.675434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:27.775090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:27.787524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:27.790355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:27.796534 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6fd2f1d8-e84b-436e-a558-cebbc97c3600 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.143078 Oct 27 10:26:27.820554 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2086/4357] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:27 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:27.914934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:27.930203 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da5585d1-a8e5-43ba-b80c-9c19d5b69111 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 0.344981 Oct 27 10:26:27.930861 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2272/4358] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:27 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:28.116776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:28.117873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:28.129234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.130455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.131661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.137549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.138492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.139137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.368521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:28.393179 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5d411ec-50e8-4016-9d61-a7b47788d624 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1500 microversion: 2.1 time: 0.280542 Oct 27 10:26:28.393845 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2087/4359] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:28 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1500 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:28.422182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ce6a92e-ea27-457a-bf6c-ab074f36e999 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:28.425741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ce6a92e-ea27-457a-bf6c-ab074f36e999 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:28.435019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ce6a92e-ea27-457a-bf6c-ab074f36e999 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.436106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ce6a92e-ea27-457a-bf6c-ab074f36e999 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.436790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ce6a92e-ea27-457a-bf6c-ab074f36e999 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.437848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ce6a92e-ea27-457a-bf6c-ab074f36e999 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.438509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ce6a92e-ea27-457a-bf6c-ab074f36e999 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.439153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ce6a92e-ea27-457a-bf6c-ab074f36e999 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.489728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:28.490405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:28.522009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.522487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.522930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.524070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.524958 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ce6a92e-ea27-457a-bf6c-ab074f36e999 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 14 microversion: 2.1 time: 0.108118 Oct 27 10:26:28.525832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.526235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.526373 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2273/4360] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:28 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:26:28.647498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:28.657814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:28.660500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:28.675399 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-85c0b623-b01c-4ca7-8aef-e6e033c7c1c3 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.178405 Oct 27 10:26:28.676496 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2088/4361] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:28 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:28.725453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-78269412-8bbc-46c3-8126-35bda28c2c50 req-4067497d-346f-4bb5-a563-74ead3e97004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d8d9de-e792-43cd-b099-6c16baa73765", "name": "network-vif-plugged", "status": "completed", "tag": "4e38778c-5c98-4efc-aec7-534c4a9f194a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:28.752187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-78269412-8bbc-46c3-8126-35bda28c2c50 req-4067497d-346f-4bb5-a563-74ead3e97004 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.752549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-78269412-8bbc-46c3-8126-35bda28c2c50 req-4067497d-346f-4bb5-a563-74ead3e97004 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.753042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-78269412-8bbc-46c3-8126-35bda28c2c50 req-4067497d-346f-4bb5-a563-74ead3e97004 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.788921 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-78269412-8bbc-46c3-8126-35bda28c2c50 req-4067497d-346f-4bb5-a563-74ead3e97004 service nova] Creating event network-vif-plugged:4e38778c-5c98-4efc-aec7-534c4a9f194a for instance d1d8d9de-e792-43cd-b099-6c16baa73765 on n-h2-854663-10 Oct 27 10:26:28.800808 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-78269412-8bbc-46c3-8126-35bda28c2c50 req-4067497d-346f-4bb5-a563-74ead3e97004 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080439 Oct 27 10:26:28.806846 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2274/4362] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:28.836967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:28.837800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:28.869349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.870849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.874056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.876246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.876761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.877208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.957170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:28.957886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:28.978523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.979177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.979639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.980363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.980841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.981317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:29.051718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:29.070561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:29.072163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:29.073588 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-abbfd181-4932-464b-8afc-49efdf64be8e tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.241883 Oct 27 10:26:29.074177 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2089/4363] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:28 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:29.278470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:29.299288 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1e550df-00b6-4bc1-b8a8-d9e45d200ea2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 0.336257 Oct 27 10:26:29.302180 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2275/4364] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:28 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:29.542406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21c4ff50-e8d0-4599-b479-abc57d5ee0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:29.547413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21c4ff50-e8d0-4599-b479-abc57d5ee0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:29.557237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:29.560495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21c4ff50-e8d0-4599-b479-abc57d5ee0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:29.562052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21c4ff50-e8d0-4599-b479-abc57d5ee0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:29.562864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21c4ff50-e8d0-4599-b479-abc57d5ee0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:29.564182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21c4ff50-e8d0-4599-b479-abc57d5ee0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:29.565086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21c4ff50-e8d0-4599-b479-abc57d5ee0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:29.565924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21c4ff50-e8d0-4599-b479-abc57d5ee0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:29.592136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:29.705286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:29.706183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:29.714273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:29.725448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:29.726136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:29.727046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:29.727742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:29.728304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:29.883990 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21c4ff50-e8d0-4599-b479-abc57d5ee0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 14 microversion: 2.1 time: 0.349634 Oct 27 10:26:29.886677 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2090/4365] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:29 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 14 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:26:29.924723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:29.936379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:29.941407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:29.944066 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cfcb67dc-a7e8-42d4-b765-ecd260af1838 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1366 microversion: 2.57 time: 0.242759 Oct 27 10:26:29.946560 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2276/4366] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:29 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:30.109882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:30.110740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:30.118413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:30.119461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:30.120228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:30.121222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:30.121877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:30.122505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:30.253253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:30.269843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:30.272867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:30.274567 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1d25475-aa91-4d49-bb24-dab84fee8255 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.170646 Oct 27 10:26:30.292544 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2091/4367] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:30 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:30.323564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:30.324170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:30.335756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:30.336251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:30.336695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:30.345460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:30.346102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:30.346615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:30.899957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88481097-0f54-48b7-a51e-f76009a70565 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:30.905663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-88481097-0f54-48b7-a51e-f76009a70565 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:30.926601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88481097-0f54-48b7-a51e-f76009a70565 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:30.927826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88481097-0f54-48b7-a51e-f76009a70565 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:30.929875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88481097-0f54-48b7-a51e-f76009a70565 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:30.932864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88481097-0f54-48b7-a51e-f76009a70565 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:30.934463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88481097-0f54-48b7-a51e-f76009a70565 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:30.935349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88481097-0f54-48b7-a51e-f76009a70565 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:31.015748 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88481097-0f54-48b7-a51e-f76009a70565 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 14 microversion: 2.1 time: 0.119625 Oct 27 10:26:31.017751 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2092/4368] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:30 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:26:31.027996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:31.028748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:31.040945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:31.041498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:31.042558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:31.043749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:31.044357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:31.044961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:31.131322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:31.147579 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d908228b-b125-4dde-aed0-fed81f1d1630 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1316 microversion: 2.1 time: 0.827662 Oct 27 10:26:31.162179 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2277/4369] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:30 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1316 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:31.286049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:31.299407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:31.301582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:31.303738 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c0cbff4-d904-4979-bd55-0645b9b00df5 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1372 microversion: 2.57 time: 0.283609 Oct 27 10:26:31.305301 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2093/4370] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:31 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1372 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:31.306181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:31.307005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:31.318095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:31.318909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:31.319553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:31.320494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:31.325742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:31.327314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:31.516884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:31.548189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:31.550533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:31.552257 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6c72244-301b-48b4-8633-cdf68e2097c8 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.250241 Oct 27 10:26:31.553767 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2278/4371] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:31 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:32.049413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3a91eb74-c2d2-4552-8933-740e44b81789 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:32.052828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3a91eb74-c2d2-4552-8933-740e44b81789 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:32.070206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a91eb74-c2d2-4552-8933-740e44b81789 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.071696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a91eb74-c2d2-4552-8933-740e44b81789 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.072316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a91eb74-c2d2-4552-8933-740e44b81789 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.073266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a91eb74-c2d2-4552-8933-740e44b81789 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.073857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a91eb74-c2d2-4552-8933-740e44b81789 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.074420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a91eb74-c2d2-4552-8933-740e44b81789 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.163933 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3a91eb74-c2d2-4552-8933-740e44b81789 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 14 microversion: 2.1 time: 0.136587 Oct 27 10:26:32.170209 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2094/4372] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:32 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:26:32.176171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:32.176880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:32.191117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.192023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.192705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.194130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.195396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.199176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.339197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:32.339926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:32.352203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.357683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.358595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.359743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.362081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.362685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.494910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:32.507719 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10ddab3f-eb46-4d7e-9ad5-1d9cd6b4cfa2 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1504 microversion: 2.1 time: 0.336060 Oct 27 10:26:32.508336 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2279/4373] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:32 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:32.533645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-467777321"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:32.534237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:32.543495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.544001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.545207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.547442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.548078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.549530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.573593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:32.583238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:32.590701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:32.591964 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7910487c-a4d0-4f51-8d88-734c66050c52 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1372 microversion: 2.57 time: 0.260822 Oct 27 10:26:32.620702 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2095/4374] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:32 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:32.620702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:32.620702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:32.626810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.626810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.626810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.627107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:32.628974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:32.629662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:32.849331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:32.867451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:32.881392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:32.882731 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91ccaae1-8037-42f5-9767-096d108f1ffd tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.275537 Oct 27 10:26:32.889645 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2096/4375] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:32 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:33.090144 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Adding security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 to port 4e38778c-5c98-4efc-aec7-534c4a9f194a Oct 27 10:26:33.180193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-737d7415-f1d1-4eb9-9187-4724d9fd4f7e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:33.183399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-737d7415-f1d1-4eb9-9187-4724d9fd4f7e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:33.213078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737d7415-f1d1-4eb9-9187-4724d9fd4f7e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:33.215065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737d7415-f1d1-4eb9-9187-4724d9fd4f7e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:33.219717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737d7415-f1d1-4eb9-9187-4724d9fd4f7e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:33.223071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737d7415-f1d1-4eb9-9187-4724d9fd4f7e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:33.223747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737d7415-f1d1-4eb9-9187-4724d9fd4f7e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:33.225304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-737d7415-f1d1-4eb9-9187-4724d9fd4f7e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:33.358925 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-737d7415-f1d1-4eb9-9187-4724d9fd4f7e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 14 microversion: 2.1 time: 0.182108 Oct 27 10:26:33.360194 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2097/4376] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:33 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:26:33.636508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:33.637388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:33.662967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:33.664100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:33.664830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:33.665850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:33.666746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:33.667338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:33.934009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:33.952250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:33.964133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:33.972130 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5921bd6f-5798-426a-a707-05d0673caf7b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1357 microversion: 2.57 time: 0.339694 Oct 27 10:26:33.975507 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2098/4377] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:33 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1357 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:33.989849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:33.995197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:34.015087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.019291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.021073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.022758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.023394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.023885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.227413 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0158015-94a5-48ca-87ea-73723118e3ab tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765/action" status: 202 len: 0 microversion: 2.1 time: 1.698870 Oct 27 10:26:34.232543 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2280/4378] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:32 2022] POST /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765/action => generated 0 bytes in 1702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:34.237119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:34.238300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:34.261327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.262198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.263015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.263856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.269299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.269923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.340987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:26:34.498909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:34.531564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:34.540492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:34.559507 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-69ae165e-7b23-4f4c-a2e0-1774275a08ae tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.581666 Oct 27 10:26:34.560928 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2099/4379] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:33 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:34.585699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-11e960d6-514b-4ae9-a22d-d4aa29a75ae4 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5acbf160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:34.625392 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eefec1f5-480e-48da-b3da-bf2a00874519 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "DELETE /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 204 len: 0 microversion: 2.57 time: 0.391452 Oct 27 10:26:34.637609 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2281/4380] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:26:34 2022] DELETE /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:26:34.649975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4bf8755-2421-411d-b5a7-e545eac3bc31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:34.657381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4bf8755-2421-411d-b5a7-e545eac3bc31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:34.674888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:34.679886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4bf8755-2421-411d-b5a7-e545eac3bc31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.680406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4bf8755-2421-411d-b5a7-e545eac3bc31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.680879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4bf8755-2421-411d-b5a7-e545eac3bc31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.683681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4bf8755-2421-411d-b5a7-e545eac3bc31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.684177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4bf8755-2421-411d-b5a7-e545eac3bc31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.688637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4bf8755-2421-411d-b5a7-e545eac3bc31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.796205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4bf8755-2421-411d-b5a7-e545eac3bc31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 14 microversion: 2.1 time: 0.158198 Oct 27 10:26:34.797025 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2282/4381] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:34 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:26:34.806485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-eada1712-fe54-4c22-9f8b-037b7d01df0e req-582c5356-1568-47bd-90ac-677587787aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d8d9de-e792-43cd-b099-6c16baa73765", "tag": "4e38778c-5c98-4efc-aec7-534c4a9f194a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:34.828328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eada1712-fe54-4c22-9f8b-037b7d01df0e req-582c5356-1568-47bd-90ac-677587787aa6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.828842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eada1712-fe54-4c22-9f8b-037b7d01df0e req-582c5356-1568-47bd-90ac-677587787aa6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.829270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eada1712-fe54-4c22-9f8b-037b7d01df0e req-582c5356-1568-47bd-90ac-677587787aa6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.866706 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-eada1712-fe54-4c22-9f8b-037b7d01df0e req-582c5356-1568-47bd-90ac-677587787aa6 service nova] Creating event network-changed:4e38778c-5c98-4efc-aec7-534c4a9f194a for instance d1d8d9de-e792-43cd-b099-6c16baa73765 on n-h2-854663-10 Oct 27 10:26:34.880594 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-eada1712-fe54-4c22-9f8b-037b7d01df0e req-582c5356-1568-47bd-90ac-677587787aa6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082142 Oct 27 10:26:34.882430 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2283/4382] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:34.910346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:34.911085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:34.931630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.933038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.933494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.935293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.936534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.937959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.007557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:35.043079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG neutronclient.v2_0.client [None req-11e960d6-514b-4ae9-a22d-d4aa29a75ae4 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 266913ca-0353-4fbc-bd02-c4d24dc261c0 in use.", "detail": ""}} {{(pid=120719) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:35.044574 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-11e960d6-514b-4ae9-a22d-d4aa29a75ae4 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security Group 266913ca-0353-4fbc-bd02-c4d24dc261c0 in use. Oct 27 10:26:35.044574 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-dd940c69-2b90-4709-9d8d-ad89483ffd2d'] Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-11e960d6-514b-4ae9-a22d-d4aa29a75ae4 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-security-groups/266913ca-0353-4fbc-bd02-c4d24dc261c0 HTTP/1.1 Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: exception: Security Group 266913ca-0353-4fbc-bd02-c4d24dc261c0 in use. Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-dd940c69-2b90-4709-9d8d-ad89483ffd2d'] Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '266913ca-0353-4fbc-bd02-c4d24dc261c0'} Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:35.046835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 266913ca-0353-4fbc-bd02-c4d24dc261c0 in use. Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd940c69-2b90-4709-9d8d-ad89483ffd2d'] Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 266913ca-0353-4fbc-bd02-c4d24dc261c0 in use. Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd940c69-2b90-4709-9d8d-ad89483ffd2d'] Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 266913ca-0353-4fbc-bd02-c4d24dc261c0 in use. Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd940c69-2b90-4709-9d8d-ad89483ffd2d'] Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 266913ca-0353-4fbc-bd02-c4d24dc261c0 in use. Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd940c69-2b90-4709-9d8d-ad89483ffd2d'] Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-11e960d6-514b-4ae9-a22d-d4aa29a75ae4 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 400 to user: Security Group 266913ca-0353-4fbc-bd02-c4d24dc261c0 in use. Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-dd940c69-2b90-4709-9d8d-ad89483ffd2d'] {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-11e960d6-514b-4ae9-a22d-d4aa29a75ae4 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/266913ca-0353-4fbc-bd02-c4d24dc261c0" status: 400 len: 185 microversion: 2.1 time: 0.483369 Oct 27 10:26:35.051017 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2100/4383] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:34 2022] DELETE /compute/v2.1/os-security-groups/266913ca-0353-4fbc-bd02-c4d24dc261c0 => generated 185 bytes in 484 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:26:35.063572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bd8ecc8-742f-4fca-a6e1-b2e67a71999b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:35.072181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1bd8ecc8-742f-4fca-a6e1-b2e67a71999b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:35.081474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bd8ecc8-742f-4fca-a6e1-b2e67a71999b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.081988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bd8ecc8-742f-4fca-a6e1-b2e67a71999b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.082682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bd8ecc8-742f-4fca-a6e1-b2e67a71999b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.083794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bd8ecc8-742f-4fca-a6e1-b2e67a71999b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.084646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bd8ecc8-742f-4fca-a6e1-b2e67a71999b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.085233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bd8ecc8-742f-4fca-a6e1-b2e67a71999b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.228951 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bd8ecc8-742f-4fca-a6e1-b2e67a71999b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765/action" status: 202 len: 0 microversion: 2.1 time: 0.172203 Oct 27 10:26:35.247139 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2101/4384] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:35 2022] POST /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:26:35.289407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:35.298293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:35.322957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.325978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.328182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.331302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.338936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.357420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.402840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:35.431375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:35.449470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:35.458725 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96fb3cbe-13ba-4376-9864-d3eb56dd6903 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1363 microversion: 2.57 time: 0.572682 Oct 27 10:26:35.461519 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2284/4385] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:34 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1363 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:35.593031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:35.593905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:35.606577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.607304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.607888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.613643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.614382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.614969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.838293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:35.874586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:35.877797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:35.880612 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-816db3a8-d376-412a-b1cc-8ca08ce751b4 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.291712 Oct 27 10:26:35.881876 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2285/4386] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:35 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:35.888072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c2723b9e-c38e-4e09-af3e-d58afa015ded tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:35.893642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c2723b9e-c38e-4e09-af3e-d58afa015ded tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:35.906960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:35.926535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2723b9e-c38e-4e09-af3e-d58afa015ded tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.928905 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-de87614a-f332-462e-9946-24c7c422ac3b tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1574 microversion: 2.1 time: 0.672342 Oct 27 10:26:35.929948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2723b9e-c38e-4e09-af3e-d58afa015ded tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.930922 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2102/4387] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:35 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1574 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:35.931551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2723b9e-c38e-4e09-af3e-d58afa015ded tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.932405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2723b9e-c38e-4e09-af3e-d58afa015ded tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.934442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2723b9e-c38e-4e09-af3e-d58afa015ded tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.935737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2723b9e-c38e-4e09-af3e-d58afa015ded tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:36.017486 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c2723b9e-c38e-4e09-af3e-d58afa015ded tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 14 microversion: 2.1 time: 0.133744 Oct 27 10:26:36.021034 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2286/4388] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:35 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:26:36.489619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:36.490392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:36.508074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:36.508884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:36.509585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:36.511648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:36.512855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:36.514697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:36.608455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:36.620985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:36.624175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:36.646660 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ad40407-96b6-4e78-bab8-4912bfd5b560 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1363 microversion: 2.57 time: 0.141462 Oct 27 10:26:36.648395 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2103/4389] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:36 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:36.925942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:36.927321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:36.939090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:36.940428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:36.944807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:36.949577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:36.949851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:36.950258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:36.955450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:36.956970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:36.969518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:36.975020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:36.978713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:36.981468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:36.982352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:36.983806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:37.077241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:37.103689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:37.106028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:37.108912 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c716a2a8-a0b1-42ac-8d93-fdd27df8fd86 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.199773 Oct 27 10:26:37.110920 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2287/4390] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:36 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:37.118544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81aa9841-fa52-47ec-b21e-bf1f253d5665 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:37.122782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81aa9841-fa52-47ec-b21e-bf1f253d5665 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:37.145651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81aa9841-fa52-47ec-b21e-bf1f253d5665 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:37.157297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81aa9841-fa52-47ec-b21e-bf1f253d5665 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:37.158647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81aa9841-fa52-47ec-b21e-bf1f253d5665 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:37.159673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81aa9841-fa52-47ec-b21e-bf1f253d5665 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:37.162912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81aa9841-fa52-47ec-b21e-bf1f253d5665 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:37.163731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81aa9841-fa52-47ec-b21e-bf1f253d5665 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:37.267276 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81aa9841-fa52-47ec-b21e-bf1f253d5665 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 14 microversion: 2.1 time: 0.154104 Oct 27 10:26:37.276436 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2288/4391] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:37 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:26:37.408371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:37.441313 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c6a4f8d-10b5-4718-8ca1-063822db3f4a tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1574 microversion: 2.1 time: 0.489765 Oct 27 10:26:37.451917 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2104/4392] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:36 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1574 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:37.682387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:37.689046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:37.706769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:37.707631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:37.708281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:37.709770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:37.711850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:37.713286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:37.798670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:37.805744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:37.806433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:37.807084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lazy-loading 'fault' on Instance uuid eb665476-9159-4c2d-8fdf-02047bd838fd {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:26:37.898931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:37.913194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:37.916993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df866f38d8964445b84457e3dffc2750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a80a963c4574afba0a4097c1d9278b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:37.921202 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a73ce53-a461-4e3a-973c-5b457cacaa34 tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 200 len: 1368 microversion: 2.57 time: 0.247366 Oct 27 10:26:37.923055 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2289/4393] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:37 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:38.140885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:38.142167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:38.155719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:38.156205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:38.156635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:38.157372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:38.158824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:38.160184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:38.285362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb1f7fad-3b7e-4c18-94d9-c1e7178b2679 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:38.288472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb1f7fad-3b7e-4c18-94d9-c1e7178b2679 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:38.303092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb1f7fad-3b7e-4c18-94d9-c1e7178b2679 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:38.303590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb1f7fad-3b7e-4c18-94d9-c1e7178b2679 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:38.304022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb1f7fad-3b7e-4c18-94d9-c1e7178b2679 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:38.311816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb1f7fad-3b7e-4c18-94d9-c1e7178b2679 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:38.312586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb1f7fad-3b7e-4c18-94d9-c1e7178b2679 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:38.313296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb1f7fad-3b7e-4c18-94d9-c1e7178b2679 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:38.348322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:38.367108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:38.371199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:38.373465 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ec85a81-97b3-4279-be94-6bb861018dcc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.237095 Oct 27 10:26:38.374633 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2105/4394] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:38 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:38.411262 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb1f7fad-3b7e-4c18-94d9-c1e7178b2679 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 14 microversion: 2.1 time: 0.124530 Oct 27 10:26:38.413935 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2290/4395] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:38 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 10:26:38.467361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:38.467994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:38.476329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:38.477348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:38.478638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:38.480147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:38.481629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:38.482127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:38.733528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:38.754787 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-405a8943-dbb4-4518-b44e-7b9cd68e087e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1572 microversion: 2.1 time: 0.291980 Oct 27 10:26:38.757054 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2106/4396] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:38 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1572 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:38.781741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-615233395"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:38.782666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:38.791023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:38.791799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:38.792487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:38.793883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:38.794519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:38.795117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:39.035162 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Adding security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 to port 4e38778c-5c98-4efc-aec7-534c4a9f194a Oct 27 10:26:39.182800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1948671842", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:39.278085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] validate_networks() for [('4e40c3bf-78c6-49ec-85b4-816b286fa1de', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:26:39.868876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-859ed244-9602-45ec-bc28-3174f991d652 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765/action" status: 202 len: 0 microversion: 2.1 time: 1.091810 Oct 27 10:26:39.870650 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2291/4397] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:38 2022] POST /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765/action => generated 0 bytes in 1095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:39.876314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:39.877552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] [instance: eb665476-9159-4c2d-8fdf-02047bd838fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:39.884607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:39.886044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:39.886694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:39.887889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:39.888545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:39.889193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:39.918375 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] HTTP exception thrown: Instance eb665476-9159-4c2d-8fdf-02047bd838fd could not be found. Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Request method failure captured: Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd HTTP/1.1 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyx6q_gwzaFgHuWW7ZIv8V7FLn1lZMr1bw1Xp_8szh-1eGVxfsPLvH9EY9b-JIe0Foi9j3r-DwJshsIsd9Z8g2HtU5bS9b4uZbl7r01SaEbWAybjQ3pUduyrxwd6u3yo_WTQYDAT_55IkGhntHU5EhNa7tuH13Del54PPcaWb-bPUA Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.57 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 5a80a963c4574afba0a4097c1d9278b1 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerShowV257Test-1306384239 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a80a963c4574afba0a4097c1d9278b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5a80a963c4574afba0a4097c1d9278b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5a80a963c4574afba0a4097c1d9278b1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a80a963c4574afba0a4097c1d9278b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerShowV257Test-1306384239 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 5a80a963c4574afba0a4097c1d9278b1 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerShowV257Test-1306384239 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerShowV257Test-1306384239-project Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: df866f38d8964445b84457e3dffc2750 Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerShowV257Test-1306384239-project Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance eb665476-9159-4c2d-8fdf-02047bd838fd could not be found. Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'eb665476-9159-4c2d-8fdf-02047bd838fd'} Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb665476-9159-4c2d-8fdf-02047bd838fd could not be found. Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb665476-9159-4c2d-8fdf-02047bd838fd could not be found. Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:39.922172 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb665476-9159-4c2d-8fdf-02047bd838fd could not be found. Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] Returning 404 to user: Instance eb665476-9159-4c2d-8fdf-02047bd838fd could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6fa308bb-369d-4242-9689-67154298e84b tempest-ServerShowV257Test-1306384239 tempest-ServerShowV257Test-1306384239-project] 10.222.0.76 "GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd" status: 404 len: 111 microversion: 2.57 time: 0.052814 Oct 27 10:26:39.926458 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2292/4398] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:39 2022] GET /compute/v2.1/servers/eb665476-9159-4c2d-8fdf-02047bd838fd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:26:39.949046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:39.949715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:39.951257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:26:39.951949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:26:39.952645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:26:39.953301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:26:39.953937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:26:39.965498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:39.966766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:39.967204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:39.967926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:39.969396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:39.971800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:39.975713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:39.976472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:39.978553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:39.979665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:39.981094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:39.985432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.023725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Getting quotas for project d8bfafdd15ce4d76ba83efe7d2f6d8cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:40.038470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Getting quotas for user 2252caef8d76405a8db702970ab03fb2 and project d8bfafdd15ce4d76ba83efe7d2f6d8cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:40.081174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:26:40.084042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:26:40.090837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:40.101740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:40.103290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:40.104987 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eeb109ee-9c69-406b-9705-c05829ed99be tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.177046 Oct 27 10:26:40.105956 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2293/4399] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:39 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:40.111602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b579b891-a9b8-416e-a0f1-73396a4beeeb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:40.114831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b579b891-a9b8-416e-a0f1-73396a4beeeb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:40.123572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b579b891-a9b8-416e-a0f1-73396a4beeeb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.124066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b579b891-a9b8-416e-a0f1-73396a4beeeb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.124506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b579b891-a9b8-416e-a0f1-73396a4beeeb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.125277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b579b891-a9b8-416e-a0f1-73396a4beeeb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.125897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b579b891-a9b8-416e-a0f1-73396a4beeeb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.126473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b579b891-a9b8-416e-a0f1-73396a4beeeb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.196194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b579b891-a9b8-416e-a0f1-73396a4beeeb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action" status: 200 len: 8206 microversion: 2.1 time: 0.088808 Oct 27 10:26:40.203983 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2294/4400] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:40 2022] POST /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9/action => generated 8206 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:40.211119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84197c72-9abf-464f-9107-a60931d41264 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d63999ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:40.219857 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1aa343ca-1f0d-4376-a22a-7a8c0ffffa0c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349564 Oct 27 10:26:40.224260 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2107/4401] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:26:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:26:40.251541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a017ca8b-9853-4aa1-8756-76e6bd064693 req-2c0159d6-4588-4774-9a68-8fddb7b9936d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d8d9de-e792-43cd-b099-6c16baa73765", "tag": "4e38778c-5c98-4efc-aec7-534c4a9f194a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:40.275894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a017ca8b-9853-4aa1-8756-76e6bd064693 req-2c0159d6-4588-4774-9a68-8fddb7b9936d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.276625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a017ca8b-9853-4aa1-8756-76e6bd064693 req-2c0159d6-4588-4774-9a68-8fddb7b9936d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.277277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a017ca8b-9853-4aa1-8756-76e6bd064693 req-2c0159d6-4588-4774-9a68-8fddb7b9936d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.293600 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a017ca8b-9853-4aa1-8756-76e6bd064693 req-2c0159d6-4588-4774-9a68-8fddb7b9936d service nova] Creating event network-changed:4e38778c-5c98-4efc-aec7-534c4a9f194a for instance d1d8d9de-e792-43cd-b099-6c16baa73765 on n-h2-854663-10 Oct 27 10:26:40.300462 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a017ca8b-9853-4aa1-8756-76e6bd064693 req-2c0159d6-4588-4774-9a68-8fddb7b9936d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074193 Oct 27 10:26:40.302130 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2108/4402] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:40.312075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:40.313123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:40.320723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.322409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.323578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.324574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.325249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.325985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.366063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-84197c72-9abf-464f-9107-a60931d41264 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 in use.", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:40.369041 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-84197c72-9abf-464f-9107-a60931d41264 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security Group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 in use. Oct 27 10:26:40.369041 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-9e588d85-9788-412b-8d00-804334e49490'] Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84197c72-9abf-464f-9107-a60931d41264 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-security-groups/350bb531-a4a1-4d7f-a44e-45b94d0cf752 HTTP/1.1 Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: exception: Security Group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 in use. Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-9e588d85-9788-412b-8d00-804334e49490'] Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '350bb531-a4a1-4d7f-a44e-45b94d0cf752'} Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:40.371744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 in use. Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e588d85-9788-412b-8d00-804334e49490'] Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 in use. Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e588d85-9788-412b-8d00-804334e49490'] Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 in use. Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e588d85-9788-412b-8d00-804334e49490'] Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 in use. Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e588d85-9788-412b-8d00-804334e49490'] Oct 27 10:26:40.375227 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:40.379337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84197c72-9abf-464f-9107-a60931d41264 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 400 to user: Security Group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 in use. Oct 27 10:26:40.379337 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-9e588d85-9788-412b-8d00-804334e49490'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:40.381704 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-84197c72-9abf-464f-9107-a60931d41264 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/350bb531-a4a1-4d7f-a44e-45b94d0cf752" status: 400 len: 185 microversion: 2.1 time: 0.174936 Oct 27 10:26:40.383063 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2295/4403] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:40 2022] DELETE /compute/v2.1/os-security-groups/350bb531-a4a1-4d7f-a44e-45b94d0cf752 => generated 185 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:26:40.391914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f0e2926-ff90-4c10-9caa-3f928eb02f4c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:40.393071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f0e2926-ff90-4c10-9caa-3f928eb02f4c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:40.510109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8f0e2926-ff90-4c10-9caa-3f928eb02f4c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:40.518265 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f0e2926-ff90-4c10-9caa-3f928eb02f4c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1217 microversion: 2.1 time: 0.133719 Oct 27 10:26:40.521649 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2296/4404] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:40 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:40.536652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:40.541757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:40.561490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.565509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.566513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.570584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.571303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.573220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.624451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:26:40.742762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:40.745819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:40.759811 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52f21128-60b1-4992-acf8-0270af4c07f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.454930 Oct 27 10:26:40.761762 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2109/4405] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:40 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:40.794764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:40.797034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:40.811842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.812639 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2538741c-6caa-495d-ad11-2dc7a8d975ac tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 204 len: 0 microversion: 2.1 time: 0.287705 Oct 27 10:26:40.813408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.814090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.814707 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2297/4406] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:26:40 2022] DELETE /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:26:40.815668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.816180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.816744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.834153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:40.851590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:40.882355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.883039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.883284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:40.892282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:40.892792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:40.893227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:41.276636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:41.290720 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a85b0280-5f24-4449-a76f-1d4636cf027d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.507099 Oct 27 10:26:41.291483 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2110/4407] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:40 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:41.302766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:41.303386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:41.331647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:41.333899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:41.334842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:41.338037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:41.342930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:41.343646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:41.465457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:41.478000 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b476dd4f-2dc9-45e8-bb71-7b752ad9f5c3 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1646 microversion: 2.1 time: 0.656153 Oct 27 10:26:41.478951 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2298/4408] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:40 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1646 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:41.487160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:41.492098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:41.507541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:41.509084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:41.510212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:41.512341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:41.514238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:41.515058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:41.571567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:41.590277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:41.593860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:41.597564 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e4cf603-e7ea-4802-93dc-d785cb51fd75 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.304951 Oct 27 10:26:41.604932 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2111/4409] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:41 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:41.611320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:41.612204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:41.623405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:41.629717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:41.630481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:41.631535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:41.632056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:41.632590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:41.823403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:41.843710 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fda1d266-8038-472f-877c-7e438e934d2a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1269 microversion: 2.1 time: 0.237379 Oct 27 10:26:41.844523 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2112/4410] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:41 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:42.500576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:42.505386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:42.506757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:42.536476 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2db7aa81-0f0d-44fb-850e-68f94993b4d8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 1.053281 Oct 27 10:26:42.538693 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2299/4411] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:41 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:42.573962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:42.573962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:42.573962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:42.573962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:42.573962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:42.573962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:42.574770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:42.574770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:42.576792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:42.577476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:42.578072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:42.579980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:42.580915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:42.581757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:43.151467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:43.168462 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-878b17c9-35a7-4373-954b-3192454cec15 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.603333 Oct 27 10:26:43.182647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2300/4412] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:42 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:43.185020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:43.196629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:43.198249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:43.204974 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d6a70408-7420-420e-b93e-0ea8be3b5926 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1646 microversion: 2.1 time: 0.705058 Oct 27 10:26:43.208942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:43.209636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:43.210246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:43.211193 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2113/4413] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:42 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1646 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:43.223979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:43.226863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:43.227531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:43.227995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:43.230783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:43.258068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:43.258565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:43.259009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:43.259801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:43.260258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:43.271840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:43.411257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:43.425988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:43.427499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:43.440041 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a2af01a-9c0d-494e-bbdc-aa1161ddad2d tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.238499 Oct 27 10:26:43.441539 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2301/4414] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:43 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:43.448734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:43.451394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:43.470671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:43.471185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:43.471636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:43.472363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:43.477501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:43.477958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:43.482609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:43.503751 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e2e4f18b-1bba-48e1-b598-280ffddcf5fa tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1275 microversion: 2.1 time: 0.288793 Oct 27 10:26:43.514084 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2114/4415] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:43 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1275 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:43.584594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:43.622061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Locking {{(pid=120720) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 27 10:26:43.757624 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af23fb81-1eaa-471b-9610-92b63727e10b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.314483 Oct 27 10:26:43.760598 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2302/4416] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:43 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:43.768928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:43.770049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:43.783300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:43.784104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:43.786961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:43.787907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:43.790329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:43.790870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.107762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:44.120690 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c82faa74-8b22-4ff7-8999-63c56032e668 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.355523 Oct 27 10:26:44.121979 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2115/4417] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:43 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:44.145187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1485bb63-1581-4704-b0ab-bc3a4466cc2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:44.159549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1485bb63-1581-4704-b0ab-bc3a4466cc2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.165585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1485bb63-1581-4704-b0ab-bc3a4466cc2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.168059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1485bb63-1581-4704-b0ab-bc3a4466cc2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.234827 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1485bb63-1581-4704-b0ab-bc3a4466cc2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] HTTP exception thrown: Instance 12306d2d-5e05-4a81-b323-1fc83906167e is locked Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1485bb63-1581-4704-b0ab-bc3a4466cc2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Request method failure captured: Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action HTTP/1.1 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 15 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlvFjvwCvJWajeEXqgzH-z_DFVkhQLebs9WsHxyKvtwa_JOeb71FsuVl2sDDbQKYE0FBFhO7HmuuecVkwQXAih8Jai9-pgze9OrG_VlxirEFv8mOsE5s7mk2MO7WGTUbVJb9ZHmIrthFWebesL1PNYS_R9HmcU_APCswB1BtPswgOz0 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eb2b0a77cbdc4d1bb17b8761358b04b9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 1ebcbfbb11e84fe5bbfebd8a9ebea128 Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: {"os-stop": {}} Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 12306d2d-5e05-4a81-b323-1fc83906167e is locked Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '12306d2d-5e05-4a81-b323-1fc83906167e', 'body': {'os-stop': {}}} Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 12306d2d-5e05-4a81-b323-1fc83906167e is locked Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 12306d2d-5e05-4a81-b323-1fc83906167e is locked Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12306d2d-5e05-4a81-b323-1fc83906167e is locked Oct 27 10:26:44.236970 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:44.240869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:44.242679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:44.247242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1485bb63-1581-4704-b0ab-bc3a4466cc2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Returning 409 to user: Instance 12306d2d-5e05-4a81-b323-1fc83906167e is locked {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:44.248300 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1485bb63-1581-4704-b0ab-bc3a4466cc2e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 409 len: 107 microversion: 2.1 time: 0.108105 Oct 27 10:26:44.249133 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2303/4418] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:44 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 107 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:26:44.258219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.258400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:44.258820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:44.267153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.269425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.272321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.276141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.276971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.287402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.287995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.288334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.289082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.289527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.289996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.407633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Unlocking {{(pid=120720) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 27 10:26:44.507362 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f67a73aa-4cda-4e81-9bc2-f3c3bcd0ab1d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.252928 Oct 27 10:26:44.508311 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2304/4419] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:44 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:44.528331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:44.532368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:44.552378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.554487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.554963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.555734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.556187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.575454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.687947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:44.702906 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34074c32-fe59-492f-a36b-ab13e77c3964 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1468 microversion: 2.1 time: 0.467551 Oct 27 10:26:44.717497 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2116/4420] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:44 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:44.730497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bb87e33b-793a-45ed-9334-f391c0dc5907 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:44.739905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb87e33b-793a-45ed-9334-f391c0dc5907 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.740976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb87e33b-793a-45ed-9334-f391c0dc5907 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.741620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb87e33b-793a-45ed-9334-f391c0dc5907 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.775963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bb87e33b-793a-45ed-9334-f391c0dc5907 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Going to try to stop instance {{(pid=120719) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:26:44.862679 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bb87e33b-793a-45ed-9334-f391c0dc5907 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.142388 Oct 27 10:26:44.868446 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2117/4421] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:44 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:44.877085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:44.896499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:44.898194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:44.899532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:44.901500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:44.906487 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e548190-e48f-4923-aef9-ed32c633e6c3 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.395401 Oct 27 10:26:44.910383 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2305/4422] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:44 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:44.919902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.920747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.928122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5069f9ed-19f0-4a75-b1c6-c21ad49f144f req-e8c9f72c-0778-4a33-92cb-6b58445d7a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d8d9de-e792-43cd-b099-6c16baa73765", "name": "network-vif-deleted", "tag": "4e38778c-5c98-4efc-aec7-534c4a9f194a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:44.928992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.930948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.936917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.938396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:44.967564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5069f9ed-19f0-4a75-b1c6-c21ad49f144f req-e8c9f72c-0778-4a33-92cb-6b58445d7a75 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:44.969797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5069f9ed-19f0-4a75-b1c6-c21ad49f144f req-e8c9f72c-0778-4a33-92cb-6b58445d7a75 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:44.970958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5069f9ed-19f0-4a75-b1c6-c21ad49f144f req-e8c9f72c-0778-4a33-92cb-6b58445d7a75 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:45.019326 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5069f9ed-19f0-4a75-b1c6-c21ad49f144f req-e8c9f72c-0778-4a33-92cb-6b58445d7a75 service nova] Creating event network-vif-deleted:4e38778c-5c98-4efc-aec7-534c4a9f194a for instance d1d8d9de-e792-43cd-b099-6c16baa73765 on n-h2-854663-10 Oct 27 10:26:45.029286 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5069f9ed-19f0-4a75-b1c6-c21ad49f144f req-e8c9f72c-0778-4a33-92cb-6b58445d7a75 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115486 Oct 27 10:26:45.031406 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2306/4423] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:45.041337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:45.043580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:45.051699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:45.052336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:45.052907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:45.053996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:45.055159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:45.055765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:45.214693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:45.223060 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43e40d3e-303f-456b-8c78-3986653b8324 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1275 microversion: 2.1 time: 0.351900 Oct 27 10:26:45.223642 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2118/4424] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:44 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1275 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:45.423725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:45.437980 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28d7acaa-757f-4425-b0d6-94045044ea31 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.403991 Oct 27 10:26:45.438574 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2307/4425] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:45 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:45.730158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:45.734629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:45.742666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:45.745378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:45.745822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:45.748230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:45.749751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:45.751026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:45.812939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:45.815923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:45.816639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:45.819198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lazy-loading 'fault' on Instance uuid d1d8d9de-e792-43cd-b099-6c16baa73765 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:26:45.935383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:45.950664 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0221f74a-baa3-4c8d-9dbf-b333ee362247 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 200 len: 1306 microversion: 2.1 time: 0.224994 Oct 27 10:26:45.952010 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2308/4426] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:45 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 1306 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:45.974067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:45.975192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:45.984365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:45.984493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc68bc51-155a-47fe-acf9-7ccf67253e0b tempest-ComputeTenantNetworksTest-2035595320 tempest-ComputeTenantNetworksTest-2035595320-project] Calling method '.version_select at 0x7f6d5b4ee5e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:45.985982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:45.987262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:45.988147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:45.988925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:45.989520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:46.144407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:46.156861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:46.158575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:46.159772 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6bbaa16b-a706-44a8-b6d6-b4530c332c13 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.206550 Oct 27 10:26:46.162917 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2309/4427] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:45 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:46.252412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:46.253549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:46.263192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:46.263882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:46.264872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:46.266095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:46.266918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:46.267347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:46.290319 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc68bc51-155a-47fe-acf9-7ccf67253e0b tempest-ComputeTenantNetworksTest-2035595320 tempest-ComputeTenantNetworksTest-2035595320-project] 10.222.0.76 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.888477 Oct 27 10:26:46.291171 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2119/4428] 10.222.0.76 () {58 vars in 1158 bytes} [Thu Oct 27 10:26:45 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:26:46.306684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d9d95fb-aea4-4e20-b9b9-b9c224f71c99 tempest-ComputeTenantNetworksTest-2035595320 tempest-ComputeTenantNetworksTest-2035595320-project] Calling method '.version_select at 0x7f6d5acbf430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:46.510224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d9d95fb-aea4-4e20-b9b9-b9c224f71c99 tempest-ComputeTenantNetworksTest-2035595320 tempest-ComputeTenantNetworksTest-2035595320-project] 10.222.0.76 "GET /compute/v2.1/os-tenant-networks/1b1d79a0-327d-4725-b276-4a1ad98f77e4" status: 200 len: 140 microversion: 2.1 time: 0.211406 Oct 27 10:26:46.518922 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2120/4429] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:26:46 2022] GET /compute/v2.1/os-tenant-networks/1b1d79a0-327d-4725-b276-4a1ad98f77e4 => generated 140 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:26:46.524111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:46.526928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:46.536955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:46.537749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:46.538405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:46.539861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:46.540529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:46.541681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:46.614606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:46.624787 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5df155f8-f7d8-4890-b0e6-b890b9ae275c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1317 microversion: 2.1 time: 0.381484 Oct 27 10:26:46.641598 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2310/4430] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:46 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:46.795095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:46.808509 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82d46ee8-2f20-45b9-a7d7-3ab0f3ff1d9e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.288079 Oct 27 10:26:46.809526 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2121/4431] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:46 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:46.975847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:46.977144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:46.984797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:46.985531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:46.986096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:46.987094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:46.987685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:46.988240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:47.009480 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 HTTP/1.1 Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'd1d8d9de-e792-43cd-b099-6c16baa73765'} Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:47.011728 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:47.015682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:47.015682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:47.015682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:47.015682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:47.015682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:47.015682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:47.015682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:47.017249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:47.018559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08ec92f5-99d2-4bf1-a3d1-a1a122829411 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 404 len: 111 microversion: 2.1 time: 0.047083 Oct 27 10:26:47.019603 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2311/4432] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:46 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:47.029688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eaca91ca-ba09-4874-a8fe-18062d04ca51 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b2eb550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:47.091935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4ff564e2-9ce4-4a6b-9097-20364cead84e req-83a7e0ac-38b8-41cc-a959-64216e2bb541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f1a184-24f6-43f3-8477-e15a2694f8df", "tag": "d3e32e88-f305-4079-a874-e75520cad0d1"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:47.118175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4ff564e2-9ce4-4a6b-9097-20364cead84e req-83a7e0ac-38b8-41cc-a959-64216e2bb541 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:47.119032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4ff564e2-9ce4-4a6b-9097-20364cead84e req-83a7e0ac-38b8-41cc-a959-64216e2bb541 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:47.120241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4ff564e2-9ce4-4a6b-9097-20364cead84e req-83a7e0ac-38b8-41cc-a959-64216e2bb541 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:47.158660 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4ff564e2-9ce4-4a6b-9097-20364cead84e req-83a7e0ac-38b8-41cc-a959-64216e2bb541 service nova] Creating event network-changed:d3e32e88-f305-4079-a874-e75520cad0d1 for instance 80f1a184-24f6-43f3-8477-e15a2694f8df on n-h1-854663-10 Oct 27 10:26:47.164951 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4ff564e2-9ce4-4a6b-9097-20364cead84e req-83a7e0ac-38b8-41cc-a959-64216e2bb541 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076225 Oct 27 10:26:47.171296 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2312/4433] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:26:47.192570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:47.194530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:47.210595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:47.211335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:47.211778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:47.212503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:47.213287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:47.217925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:47.354382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:47.371352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:47.377040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:47.380564 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ae4cf29-8509-4ee5-b6b2-34ec5bc39ff5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.197466 Oct 27 10:26:47.382808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2313/4434] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:47 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:47.415572 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eaca91ca-ba09-4874-a8fe-18062d04ca51 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/266913ca-0353-4fbc-bd02-c4d24dc261c0" status: 202 len: 0 microversion: 2.1 time: 0.391356 Oct 27 10:26:47.416691 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2122/4435] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:47 2022] DELETE /compute/v2.1/os-security-groups/266913ca-0353-4fbc-bd02-c4d24dc261c0 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:47.426667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e822cc7-6031-4696-9c61-09ca54377c98 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5bab1550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:47.649983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:47.650825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:47.664529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:47.665129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:47.665832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:47.666700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:47.667299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:47.668151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:47.817503 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e822cc7-6031-4696-9c61-09ca54377c98 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/350bb531-a4a1-4d7f-a44e-45b94d0cf752" status: 202 len: 0 microversion: 2.1 time: 0.395967 Oct 27 10:26:47.818104 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2314/4436] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:47 2022] DELETE /compute/v2.1/os-security-groups/350bb531-a4a1-4d7f-a44e-45b94d0cf752 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:47.836806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:47.837839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:47.854534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:47.855191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:47.856000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:47.858407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:47.859013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:47.861187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:47.911280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:47.926910 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e8fb37d-2d26-4cf4-82ca-c95af619cb0e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1317 microversion: 2.1 time: 0.279191 Oct 27 10:26:47.929960 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2123/4437] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:47 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:47.938808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-11dc667b-16ce-4d49-904d-01f4264329f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'create', calling method: .version_select at 0x7f6d5acbfc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-907166257", "description": "tempest-description-1148188488"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:48.124588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:48.133281 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2bc83ccc-9c36-484e-9802-c5cf0526984a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.304253 Oct 27 10:26:48.133734 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2315/4438] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:47 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:48.229845 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-11dc667b-16ce-4d49-904d-01f4264329f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.298274 Oct 27 10:26:48.238932 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2124/4439] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:26:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:48.246263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5848f14-e9f3-4d3e-a664-a522087b59cf tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Action: 'update', calling method: .version_select at 0x7f6d5a9eb4c0>, body: {"security_group": {"name": "tempest-sg-hth-738610722", "description": "tempest-description-hth-1680476173"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:48.412564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:48.412564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:48.420940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:48.421370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:48.421803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:48.422510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:48.422953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:48.423375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:48.508319 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5848f14-e9f3-4d3e-a664-a522087b59cf tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "PUT /compute/v2.1/os-security-groups/35f8fb14-d026-4b88-8f8e-2792c3682c73" status: 200 len: 217 microversion: 2.1 time: 0.266473 Oct 27 10:26:48.516862 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2316/4440] 10.222.0.76 () {60 vars in 1290 bytes} [Thu Oct 27 10:26:48 2022] PUT /compute/v2.1/os-security-groups/35f8fb14-d026-4b88-8f8e-2792c3682c73 => generated 217 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:48.523766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-885d6fdb-6121-4d6c-a5fc-c723de94c316 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d63967b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:48.559217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:48.569402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:48.573471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:48.576851 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e3e16d25-0cd1-4f69-9f78-61b2bd34714f tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.169494 Oct 27 10:26:48.589654 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2125/4441] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:48 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:48.685899 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-885d6fdb-6121-4d6c-a5fc-c723de94c316 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/os-security-groups/35f8fb14-d026-4b88-8f8e-2792c3682c73" status: 200 len: 217 microversion: 2.1 time: 0.167647 Oct 27 10:26:48.687042 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2317/4442] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:26:48 2022] GET /compute/v2.1/os-security-groups/35f8fb14-d026-4b88-8f8e-2792c3682c73 => generated 217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:26:48.703087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fbf7fbd7-a4e0-4368-9c0e-cf0291911f21 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d637f7790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:48.952500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:48.953455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:48.969512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:48.970387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:48.971051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:48.972011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:48.972707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:48.973350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.022597 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fbf7fbd7-a4e0-4368-9c0e-cf0291911f21 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/35f8fb14-d026-4b88-8f8e-2792c3682c73" status: 202 len: 0 microversion: 2.1 time: 0.323726 Oct 27 10:26:49.023393 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2126/4443] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:48 2022] DELETE /compute/v2.1/os-security-groups/35f8fb14-d026-4b88-8f8e-2792c3682c73 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:49.031633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.032173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:49.055394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.060858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.062892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.066951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.071180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.072276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.099920 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 HTTP/1.1 Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd1d8d9de-e792-43cd-b099-6c16baa73765'} Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:26:49.104528 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.107865 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.110892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:49.111927 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82796532-215e-4942-94a0-2ca41ad46747 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 404 len: 111 microversion: 2.1 time: 0.084377 Oct 27 10:26:49.113914 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2127/4444] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:26:49 2022] DELETE /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:26:49.129290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.131173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: d1d8d9de-e792-43cd-b099-6c16baa73765] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:49.149779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.150978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.151758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.152625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.153388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.153960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.191883 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 HTTP/1.1 Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd1d8d9de-e792-43cd-b099-6c16baa73765'} Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.193390 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.197210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.197210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.197210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.197210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:49.197210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:49.197210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. Oct 27 10:26:49.197210 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.200151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Instance d1d8d9de-e792-43cd-b099-6c16baa73765 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:49.201408 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5c755ce-191f-4f87-a012-6b3e879cc9a5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765" status: 404 len: 111 microversion: 2.1 time: 0.081125 Oct 27 10:26:49.202387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:49.203392 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2128/4445] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:49 2022] GET /compute/v2.1/servers/d1d8d9de-e792-43cd-b099-6c16baa73765 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:26:49.212299 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0659e96e-78f1-43fd-a6dc-3e5ca51e9665 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1317 microversion: 2.1 time: 0.263710 Oct 27 10:26:49.214194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.215410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:49.226008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.226806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.227425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.228411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.229084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.229759 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2318/4446] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:48 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:49.232260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.240022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a8dc108-256b-459c-ac97-eae7ca1646c6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b72b4c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.278248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-2a8dc108-256b-459c-ac97-eae7ca1646c6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 does not exist", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:49.278854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.security_group_api [None req-2a8dc108-256b-459c-ac97-eae7ca1646c6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 not found {{(pid=120720) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:26:49.279378 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-2a8dc108-256b-459c-ac97-eae7ca1646c6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 does not exist Oct 27 10:26:49.279378 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-b31d390e-c6c8-4384-8c9d-13e4e778ad8b'] Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a8dc108-256b-459c-ac97-eae7ca1646c6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-security-groups/350bb531-a4a1-4d7f-a44e-45b94d0cf752 HTTP/1.1 Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 does not exist Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-b31d390e-c6c8-4384-8c9d-13e4e778ad8b'] Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '350bb531-a4a1-4d7f-a44e-45b94d0cf752'} Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:49.281658 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 does not exist Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b31d390e-c6c8-4384-8c9d-13e4e778ad8b'] Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 does not exist Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b31d390e-c6c8-4384-8c9d-13e4e778ad8b'] Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 does not exist Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b31d390e-c6c8-4384-8c9d-13e4e778ad8b'] Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 does not exist Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b31d390e-c6c8-4384-8c9d-13e4e778ad8b'] Oct 27 10:26:49.284960 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.288695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a8dc108-256b-459c-ac97-eae7ca1646c6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group 350bb531-a4a1-4d7f-a44e-45b94d0cf752 does not exist Oct 27 10:26:49.288695 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-b31d390e-c6c8-4384-8c9d-13e4e778ad8b'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:49.289805 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a8dc108-256b-459c-ac97-eae7ca1646c6 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/350bb531-a4a1-4d7f-a44e-45b94d0cf752" status: 404 len: 194 microversion: 2.1 time: 0.059086 Oct 27 10:26:49.290524 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2319/4447] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:49 2022] DELETE /compute/v2.1/os-security-groups/350bb531-a4a1-4d7f-a44e-45b94d0cf752 => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:49.298780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43191211-e16b-4356-ab15-a3accf664c5f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5ae29c10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.369668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-43191211-e16b-4356-ab15-a3accf664c5f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 does not exist", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:49.371534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.security_group_api [None req-43191211-e16b-4356-ab15-a3accf664c5f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 not found {{(pid=120720) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:26:49.372449 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-43191211-e16b-4356-ab15-a3accf664c5f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 does not exist Oct 27 10:26:49.372449 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-ed8c7697-5ba0-4b42-a102-4bbb7cfa95ba'] Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43191211-e16b-4356-ab15-a3accf664c5f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-security-groups/266913ca-0353-4fbc-bd02-c4d24dc261c0 HTTP/1.1 Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 does not exist Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-ed8c7697-5ba0-4b42-a102-4bbb7cfa95ba'] Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '266913ca-0353-4fbc-bd02-c4d24dc261c0'} Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:49.374838 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 does not exist Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8c7697-5ba0-4b42-a102-4bbb7cfa95ba'] Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 does not exist Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8c7697-5ba0-4b42-a102-4bbb7cfa95ba'] Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 does not exist Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8c7697-5ba0-4b42-a102-4bbb7cfa95ba'] Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 does not exist Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8c7697-5ba0-4b42-a102-4bbb7cfa95ba'] Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43191211-e16b-4356-ab15-a3accf664c5f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group 266913ca-0353-4fbc-bd02-c4d24dc261c0 does not exist Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-ed8c7697-5ba0-4b42-a102-4bbb7cfa95ba'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43191211-e16b-4356-ab15-a3accf664c5f tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/266913ca-0353-4fbc-bd02-c4d24dc261c0" status: 404 len: 194 microversion: 2.1 time: 0.081367 Oct 27 10:26:49.378153 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2320/4448] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:49 2022] DELETE /compute/v2.1/os-security-groups/266913ca-0353-4fbc-bd02-c4d24dc261c0 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:26:49.385636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d927ba69-f930-4430-9238-ac2ef5eae48e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5be35ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.497318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:49.505099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-d927ba69-f930-4430-9238-ac2ef5eae48e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:49.505924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.security_group_api [None req-d927ba69-f930-4430-9238-ac2ef5eae48e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group 228b0496-a6e7-4b3e-b569-9bd278902dde not found {{(pid=120720) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:26:49.506612 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-d927ba69-f930-4430-9238-ac2ef5eae48e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:49.506612 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-46592ab9-5411-4109-a30f-65b7b9ed0faf'] Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d927ba69-f930-4430-9238-ac2ef5eae48e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-security-groups/228b0496-a6e7-4b3e-b569-9bd278902dde HTTP/1.1 Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-46592ab9-5411-4109-a30f-65b7b9ed0faf'] Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '228b0496-a6e7-4b3e-b569-9bd278902dde'} Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:49.508645 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46592ab9-5411-4109-a30f-65b7b9ed0faf'] Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46592ab9-5411-4109-a30f-65b7b9ed0faf'] Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46592ab9-5411-4109-a30f-65b7b9ed0faf'] Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46592ab9-5411-4109-a30f-65b7b9ed0faf'] Oct 27 10:26:49.512031 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.514744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d927ba69-f930-4430-9238-ac2ef5eae48e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group 228b0496-a6e7-4b3e-b569-9bd278902dde does not exist Oct 27 10:26:49.514744 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-46592ab9-5411-4109-a30f-65b7b9ed0faf'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:49.515803 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d927ba69-f930-4430-9238-ac2ef5eae48e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/228b0496-a6e7-4b3e-b569-9bd278902dde" status: 404 len: 194 microversion: 2.1 time: 0.134106 Oct 27 10:26:49.520033 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2321/4449] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:49 2022] DELETE /compute/v2.1/os-security-groups/228b0496-a6e7-4b3e-b569-9bd278902dde => generated 194 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:26:49.521865 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a55fe1fd-3f18-455b-9884-e35adf2d1314 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.313469 Oct 27 10:26:49.544435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdc8cae5-61f6-4bd9-b6ba-289dabd3458e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b72b4c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.544910 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2129/4450] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:49 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:49.572353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG neutronclient.v2_0.client [None req-fdc8cae5-61f6-4bd9-b6ba-289dabd3458e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist", "detail": ""}} {{(pid=120720) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:49.573284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.security_group_api [None req-fdc8cae5-61f6-4bd9-b6ba-289dabd3458e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf not found {{(pid=120720) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:26:49.574461 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-fdc8cae5-61f6-4bd9-b6ba-289dabd3458e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:49.574461 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-2be0dcc4-e0a0-4b4a-b683-74f9e1346527'] Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdc8cae5-61f6-4bd9-b6ba-289dabd3458e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-security-groups/4449f272-6f56-4a68-89d2-0e3d5c2605bf HTTP/1.1 Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: exception: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-2be0dcc4-e0a0-4b4a-b683-74f9e1346527'] Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '4449f272-6f56-4a68-89d2-0e3d5c2605bf'} Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:49.576308 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be0dcc4-e0a0-4b4a-b683-74f9e1346527'] Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be0dcc4-e0a0-4b4a-b683-74f9e1346527'] Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be0dcc4-e0a0-4b4a-b683-74f9e1346527'] Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be0dcc4-e0a0-4b4a-b683-74f9e1346527'] Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdc8cae5-61f6-4bd9-b6ba-289dabd3458e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group 4449f272-6f56-4a68-89d2-0e3d5c2605bf does not exist Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: Neutron server returns request_ids: ['req-2be0dcc4-e0a0-4b4a-b683-74f9e1346527'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdc8cae5-61f6-4bd9-b6ba-289dabd3458e tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/4449f272-6f56-4a68-89d2-0e3d5c2605bf" status: 404 len: 194 microversion: 2.1 time: 0.038438 Oct 27 10:26:49.582914 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2322/4451] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:49 2022] DELETE /compute/v2.1/os-security-groups/4449f272-6f56-4a68-89d2-0e3d5c2605bf => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:49.586818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a25b9d9-8847-43d3-9245-37552bb52856 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5a94e1f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.613495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG neutronclient.v2_0.client [None req-2a25b9d9-8847-43d3-9245-37552bb52856 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist", "detail": ""}} {{(pid=120719) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:49.614115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.security_group_api [None req-2a25b9d9-8847-43d3-9245-37552bb52856 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 not found {{(pid=120719) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:26:49.614646 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2a25b9d9-8847-43d3-9245-37552bb52856 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:49.614646 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-6bad3bc6-f0c7-4504-9199-f2cbb53ad585'] Oct 27 10:26:49.616453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.617327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a25b9d9-8847-43d3-9245-37552bb52856 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-security-groups/1535f694-379b-47d3-a4d7-bf15e024c0f0 HTTP/1.1 Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: exception: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-6bad3bc6-f0c7-4504-9199-f2cbb53ad585'] Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '1535f694-379b-47d3-a4d7-bf15e024c0f0'} Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:49.618996 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bad3bc6-f0c7-4504-9199-f2cbb53ad585'] Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bad3bc6-f0c7-4504-9199-f2cbb53ad585'] Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bad3bc6-f0c7-4504-9199-f2cbb53ad585'] Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bad3bc6-f0c7-4504-9199-f2cbb53ad585'] Oct 27 10:26:49.623521 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.630046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a25b9d9-8847-43d3-9245-37552bb52856 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group 1535f694-379b-47d3-a4d7-bf15e024c0f0 does not exist Oct 27 10:26:49.630046 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-6bad3bc6-f0c7-4504-9199-f2cbb53ad585'] {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:49.630356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.630496 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a25b9d9-8847-43d3-9245-37552bb52856 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/1535f694-379b-47d3-a4d7-bf15e024c0f0" status: 404 len: 194 microversion: 2.1 time: 0.046759 Oct 27 10:26:49.630496 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2130/4452] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:49 2022] DELETE /compute/v2.1/os-security-groups/1535f694-379b-47d3-a4d7-bf15e024c0f0 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:49.631831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.632285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.635059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.635782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.636431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.640705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e64da01-0882-45f0-9ae8-bb4c2d0566eb tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5a969160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.671094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG neutronclient.v2_0.client [None req-8e64da01-0882-45f0-9ae8-bb4c2d0566eb tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist", "detail": ""}} {{(pid=120719) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 10:26:49.671701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.security_group_api [None req-8e64da01-0882-45f0-9ae8-bb4c2d0566eb tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Neutron security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a not found {{(pid=120719) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 10:26:49.672224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-8e64da01-0882-45f0-9ae8-bb4c2d0566eb tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:26:49.672224 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-55ba0c62-6456-41fb-a7e7-3c91616dcf97'] Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e64da01-0882-45f0-9ae8-bb4c2d0566eb tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a HTTP/1.1 Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: exception: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-55ba0c62-6456-41fb-a7e7-3c91616dcf97'] Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a'} Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 10:26:49.674077 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55ba0c62-6456-41fb-a7e7-3c91616dcf97'] Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55ba0c62-6456-41fb-a7e7-3c91616dcf97'] Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55ba0c62-6456-41fb-a7e7-3c91616dcf97'] Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55ba0c62-6456-41fb-a7e7-3c91616dcf97'] Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e64da01-0882-45f0-9ae8-bb4c2d0566eb tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Security group ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a does not exist Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: Neutron server returns request_ids: ['req-55ba0c62-6456-41fb-a7e7-3c91616dcf97'] {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e64da01-0882-45f0-9ae8-bb4c2d0566eb tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a" status: 404 len: 194 microversion: 2.1 time: 0.041461 Oct 27 10:26:49.677500 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2131/4453] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:49 2022] DELETE /compute/v2.1/os-security-groups/ff7f4df2-1d4c-422a-a0ac-94f62d87ae0a => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:49.686337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.686843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:49.702293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.704407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.704889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.709074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.709544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.710279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.745658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:26:49.782517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:49.786272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:UPDATE=8,nova_cell1:INSERT=3,nova_cell1:SELECT=89 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:49.798338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:49.800645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:49.802265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:49.803612 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7805eb4e-b078-4f46-b1f0-0f403a6f4d58 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.193936 Oct 27 10:26:49.804539 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2323/4454] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:49 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:49.845729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:49.865538 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a55abb97-c828-4f9e-a806-6495e62939f8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 204 len: 0 microversion: 2.1 time: 0.183076 Oct 27 10:26:49.867705 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2132/4455] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:26:49 2022] DELETE /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:26:49.876123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:49.877001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:49.884106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.885006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.885442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:49.886183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:49.886974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:49.887524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:50.088778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:50.098468 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-302142bb-6b4c-46c9-be3d-90f17288bcbe tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1644 microversion: 2.1 time: 0.226271 Oct 27 10:26:50.099052 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2324/4456] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:49 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1644 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:50.244509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:50.245559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:50.251771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:50.256560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:50.276779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:50.276779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:50.276779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:50.283273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:50.284514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:50.284998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:50.545830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:50.546515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:50.549309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:50.557762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:50.558628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:50.559440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:50.560845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:50.560845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:50.561268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:50.581535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:50.593928 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71649ada-d6c5-48db-8c21-326fb324c137 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1317 microversion: 2.1 time: 0.355636 Oct 27 10:26:50.595255 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2133/4457] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:50 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:50.808762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:50.818517 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2103721-0143-4c19-813a-8b5c325b8590 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.276627 Oct 27 10:26:50.819435 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2325/4458] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:50 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:50.857278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:50.865199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:50.881840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:50.882339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:50.882776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:50.883492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:50.883949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:50.884427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:51.008817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:51.024260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:51.026358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:51.036106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-feb1d959-5bd3-49d4-b1f6-1f4e9e597fa6 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.199214 Oct 27 10:26:51.062426 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2134/4459] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:50 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:51.126850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:51.127783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:51.138993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:51.139715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:51.141770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:51.142714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:51.145772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:51.146445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:51.378885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:51.387870 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60215bcf-6370-403a-a3bd-53d8c61098f5 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1644 microversion: 2.1 time: 0.265685 Oct 27 10:26:51.388469 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2326/4460] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:51 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1644 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:51.622201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:51.623383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:51.635020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:51.635833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:51.636598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:51.637785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:51.638960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:51.639615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:51.851922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:51.853667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:51.869267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:51.871060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:51.874642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:51.875916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:51.876574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:51.879424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:51.895023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:51.907377 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b2bdf068-925d-4c7e-883a-982f08e01157 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1317 microversion: 2.1 time: 0.290666 Oct 27 10:26:51.908334 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2135/4461] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:51 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:52.067403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:52.068021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:52.080070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:52.080568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:52.081031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:52.081746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:52.082198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:52.082620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:52.204963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:52.214349 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4248c1f3-aeea-4a62-9561-4584880b57ee tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.367725 Oct 27 10:26:52.214944 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2327/4462] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:51 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:52.224246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:52.240209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:52.241968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:52.243237 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b6ce326-3ec9-4f3c-ae65-77936d23fb96 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1408 microversion: 2.54 time: 0.179845 Oct 27 10:26:52.244308 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2136/4463] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:52 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:52.413225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:52.414162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:52.425310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:52.429038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:52.430067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:52.431072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:52.432544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:52.445056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:52.931838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:52.933057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:52.941789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:52.942566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:52.943149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:52.944015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:52.944604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:52.945195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:53.248495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:53.265429 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c5d0974-8793-414b-9c47-90f1f0bc98da tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1644 microversion: 2.1 time: 0.853882 Oct 27 10:26:53.281534 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2328/4464] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:52 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1644 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:53.287229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:53.288323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:53.296301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:53.296892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:53.298024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:53.299443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:53.300652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:53.301459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:53.387747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:53.402617 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3049021-0df2-4df2-a478-a1b670d815e9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1317 microversion: 2.1 time: 0.475018 Oct 27 10:26:53.403527 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2137/4465] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:52 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:53.426223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:53.426871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:53.434331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:53.434765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:53.435208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:53.435917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:53.436368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:53.437002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:53.596963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:53.605874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:53.607694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:53.609166 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d9706e17-f258-47ea-a739-6d19d7acf277 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1414 microversion: 2.54 time: 0.191058 Oct 27 10:26:53.610009 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2138/4466] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:53 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1414 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:53.615358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-43243904-354a-413d-a33e-9ee9bb4f2d51 req-5c6a6ad4-f855-4176-8ea9-10920899fbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc11663-1696-4b94-88a3-a060d97d88c6", "name": "network-vif-deleted", "tag": "a4ad2cf6-9b4f-43a4-9348-b783d772e6fe"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:53.635608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-43243904-354a-413d-a33e-9ee9bb4f2d51 req-5c6a6ad4-f855-4176-8ea9-10920899fbd4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:53.637312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-43243904-354a-413d-a33e-9ee9bb4f2d51 req-5c6a6ad4-f855-4176-8ea9-10920899fbd4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:53.637927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-43243904-354a-413d-a33e-9ee9bb4f2d51 req-5c6a6ad4-f855-4176-8ea9-10920899fbd4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:53.657469 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-43243904-354a-413d-a33e-9ee9bb4f2d51 req-5c6a6ad4-f855-4176-8ea9-10920899fbd4 service nova] Creating event network-vif-deleted:a4ad2cf6-9b4f-43a4-9348-b783d772e6fe for instance dbc11663-1696-4b94-88a3-a060d97d88c6 on n-h1-854663-10 Oct 27 10:26:53.664719 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-43243904-354a-413d-a33e-9ee9bb4f2d51 req-5c6a6ad4-f855-4176-8ea9-10920899fbd4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053235 Oct 27 10:26:53.665562 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2139/4467] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:53.700058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:53.709565 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-64f05a92-f8a4-4d50-bda7-9701fa2fa272 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.426793 Oct 27 10:26:53.710697 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2329/4468] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:53 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:54.001945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1e489e53-80a6-49aa-bffa-f1b4f48db3af req-3a7ea831-5a9a-4913-9266-a51d749d6859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f1a184-24f6-43f3-8477-e15a2694f8df", "name": "network-vif-plugged", "status": "completed", "tag": "d3e32e88-f305-4079-a874-e75520cad0d1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:54.036770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1e489e53-80a6-49aa-bffa-f1b4f48db3af req-3a7ea831-5a9a-4913-9266-a51d749d6859 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.039611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1e489e53-80a6-49aa-bffa-f1b4f48db3af req-3a7ea831-5a9a-4913-9266-a51d749d6859 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.040116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1e489e53-80a6-49aa-bffa-f1b4f48db3af req-3a7ea831-5a9a-4913-9266-a51d749d6859 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.067178 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1e489e53-80a6-49aa-bffa-f1b4f48db3af req-3a7ea831-5a9a-4913-9266-a51d749d6859 service nova] Creating event network-vif-plugged:d3e32e88-f305-4079-a874-e75520cad0d1 for instance 80f1a184-24f6-43f3-8477-e15a2694f8df on n-h1-854663-10 Oct 27 10:26:54.074412 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1e489e53-80a6-49aa-bffa-f1b4f48db3af req-3a7ea831-5a9a-4913-9266-a51d749d6859 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082586 Oct 27 10:26:54.075456 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2140/4469] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 27 10:26:54.290333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:54.291301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:54.307282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.308039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.309547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.312691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.317182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.317923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.369065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.369842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.370507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.371168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lazy-loading 'fault' on Instance uuid dbc11663-1696-4b94-88a3-a060d97d88c6 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:26:54.430036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:54.431127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:54.437926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.438618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.439236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.439562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:54.440390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.441442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.442094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.455247 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdaa007d-8c92-4e2b-9716-33960cfc0192 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1305 microversion: 2.1 time: 0.169656 Oct 27 10:26:54.456172 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2330/4470] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:54 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1305 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:54.643016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:54.643966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:54.660954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.661635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.662144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.663440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.663908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.664451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.738571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:54.753435 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e509a3e-60c4-4cd6-92f5-e0abe310aad0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1317 microversion: 2.1 time: 0.328926 Oct 27 10:26:54.755347 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2141/4471] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:54 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:54.764120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:54.764963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:54.772941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.786459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.789378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.790314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.790827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.791849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.833202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:54.868437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:54.870829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:54.878426 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79bacde0-8251-4a06-a86c-1998ac5b0897 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1414 microversion: 2.54 time: 0.242815 Oct 27 10:26:54.882679 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2331/4472] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:54 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1414 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:55.085364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:55.097109 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac5ee518-a5a9-44ab-b5d8-33f4e1bd5412 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.340100 Oct 27 10:26:55.098395 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2142/4473] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:54 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:55.484919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:55.494356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:55.510153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:55.510972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:55.511538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:55.513539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:55.515360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:55.516943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:55.569760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:55.573225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:55.574043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:55.574878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:55.575706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lazy-loading 'fault' on Instance uuid dbc11663-1696-4b94-88a3-a060d97d88c6 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:26:55.656482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b0e71b200045128271a5b441a5b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507a1f574f442e7a2bed77fd6128e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:55.667948 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da3f2c57-1bbe-401b-b043-a6a90a0a8504 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 200 len: 1305 microversion: 2.1 time: 0.192678 Oct 27 10:26:55.668915 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2332/4474] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:55 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 1305 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:55.777078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:55.778073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:55.791498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:55.792305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:55.792966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:55.793905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:55.794550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:55.795168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:55.913164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:55.914157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:55.930567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:55.931344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:55.932049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:55.933395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:55.943558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:55.944349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.065628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:56.082110 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-994a9791-ede2-4d78-91dc-c2047b35bda8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1317 microversion: 2.1 time: 0.307524 Oct 27 10:26:56.082967 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2143/4475] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:55 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:56.124632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:56.127726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:56.132200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:56.141123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:56.145351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:56.147485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.148214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.148419 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72645b0a-dc4e-4d94-9f6a-b8b028b377f5 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1399 microversion: 2.54 time: 0.242143 Oct 27 10:26:56.149280 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2333/4476] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:55 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1399 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:56.150455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.152422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.153160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.155342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.174761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a04156ee-53a2-4ad5-b5b0-74529c0231fc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '.version_select at 0x7f6d5a9fea60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:56.218118 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a04156ee-53a2-4ad5-b5b0-74529c0231fc tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1226216439" status: 204 len: 0 microversion: 2.54 time: 0.047274 Oct 27 10:26:56.219173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2334/4477] 10.222.0.76 () {60 vars in 1319 bytes} [Thu Oct 27 10:26:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1226216439 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 10:26:56.234764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:56.235271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:56.248655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.249353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.249805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.252363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.252892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.253341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.325972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:26:56.445795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:56.464600 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cbe6ede5-6d6b-40a7-a688-fa028197f166 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1653 microversion: 2.1 time: 0.345175 Oct 27 10:26:56.467068 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2144/4478] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:56 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1653 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:56.499941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-beea3b09-e2cd-47b4-8fa3-0d5b8c4cbec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:56.517389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fe9c954-4cf3-449b-a0df-9d27b6842ee0 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 204 len: 0 microversion: 2.54 time: 0.287271 Oct 27 10:26:56.522996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beea3b09-e2cd-47b4-8fa3-0d5b8c4cbec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.523648 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2335/4479] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:26:56 2022] DELETE /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:26:56.529400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beea3b09-e2cd-47b4-8fa3-0d5b8c4cbec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.530122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-beea3b09-e2cd-47b4-8fa3-0d5b8c4cbec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.540919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:56.543504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:56.562547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.563389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.565057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.566638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.568859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.570561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.580829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-beea3b09-e2cd-47b4-8fa3-0d5b8c4cbec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Going to try to start instance {{(pid=120719) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 10:26:56.676513 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-beea3b09-e2cd-47b4-8fa3-0d5b8c4cbec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.187652 Oct 27 10:26:56.678054 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2145/4480] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:56 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:56.706958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:56.710867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:56.714375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:56.720988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.721624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.722467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.723562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.725113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.725113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.747974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:56.756311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:56.762045 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e40308a-869d-4636-80f1-f4449a5415f9 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1405 microversion: 2.54 time: 0.232974 Oct 27 10:26:56.763457 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2336/4481] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:56 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:56.783644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:56.784644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] [instance: dbc11663-1696-4b94-88a3-a060d97d88c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:56.808136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.811168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.813891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.814840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.816921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.817505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.862005 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] HTTP exception thrown: Instance dbc11663-1696-4b94-88a3-a060d97d88c6 could not be found. Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Request method failure captured: Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 HTTP/1.1 Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlyfqR_tbv6Ff-tkee1ysnyifORK_rzhq4qNUWG-76q295tzCzRmTRKLv5Nv1mudvsaKUkGFUrhBBhmWEeEA0lQ75ruNmgo33wubkiCY5WJziPXCBxp7Hjji-7FCiHyupVcTwVRS5zh4GOYHqavkcw-ilL8MPJg0G4VN2wTas-lLbYY Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c507a1f574f442e7a2bed77fd6128e9e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c507a1f574f442e7a2bed77fd6128e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: c507a1f574f442e7a2bed77fd6128e9e Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-264719079 Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 56b0e71b200045128271a5b441a5b796 Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-SecurityGroupsTestJSON-264719079-project Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance dbc11663-1696-4b94-88a3-a060d97d88c6 could not be found. Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'dbc11663-1696-4b94-88a3-a060d97d88c6'} Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc11663-1696-4b94-88a3-a060d97d88c6 could not be found. Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc11663-1696-4b94-88a3-a060d97d88c6 could not be found. Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:56.864276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:56.867744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:56.867744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:56.867744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:56.867744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:56.867744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:56.867744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc11663-1696-4b94-88a3-a060d97d88c6 could not be found. Oct 27 10:26:56.867744 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:26:56.871537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Returning 404 to user: Instance dbc11663-1696-4b94-88a3-a060d97d88c6 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:56.872811 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d28912b6-3da5-46d0-aca9-8193a65e4276 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6" status: 404 len: 111 microversion: 2.1 time: 0.107345 Oct 27 10:26:56.873829 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2337/4482] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:56 2022] GET /compute/v2.1/servers/dbc11663-1696-4b94-88a3-a060d97d88c6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:56.885435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26c6c083-1319-407a-907f-ba2cf99255ec tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5a9eb820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:57.028837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:57.042351 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8ab36fa-18ef-481a-a9ab-d90c1242f8d3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1662 microversion: 2.1 time: 0.344280 Oct 27 10:26:57.043471 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2146/4483] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:56 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1662 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:57.110583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:57.111471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:57.123178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:57.124119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:57.125027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:57.126107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:57.127569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:57.128266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:57.284771 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26c6c083-1319-407a-907f-ba2cf99255ec tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/0e2d2412-70da-4392-b2bf-99751adfe6d3" status: 202 len: 0 microversion: 2.1 time: 0.404606 Oct 27 10:26:57.285568 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2338/4484] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:56 2022] DELETE /compute/v2.1/os-security-groups/0e2d2412-70da-4392-b2bf-99751adfe6d3 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:57.294988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf589f84-78de-4c96-a965-fbfe8b6557b8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] Calling method '.version_select at 0x7f6d5b7b09d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:57.468535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:57.480735 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ebbd139-c748-460e-a448-39ef08575763 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.374869 Oct 27 10:26:57.493327 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2147/4485] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:57 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:57.640965 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf589f84-78de-4c96-a965-fbfe8b6557b8 tempest-SecurityGroupsTestJSON-264719079 tempest-SecurityGroupsTestJSON-264719079-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/e5357036-8ed7-4922-b002-99dfec86d0bb" status: 202 len: 0 microversion: 2.1 time: 0.351066 Oct 27 10:26:57.645255 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2339/4486] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:26:57 2022] DELETE /compute/v2.1/os-security-groups/e5357036-8ed7-4922-b002-99dfec86d0bb => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:26:57.647947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1152895060", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:57.718365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] validate_networks() for [('4e40c3bf-78c6-49ec-85b4-816b286fa1de', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:26:57.810037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:57.810662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:57.820150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:57.820644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:57.821104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:57.822098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:57.822327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:57.822758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:57.966216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:57.979128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:57.981028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:57.990488 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6de6531f-5548-4072-8949-5909c2ac3a80 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1405 microversion: 2.54 time: 0.184498 Oct 27 10:26:57.992272 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2340/4487] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:57 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:26:58.385699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:58.386326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:58.397659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:58.398439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:58.399063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:58.400023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:58.401989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:58.403267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:59.059118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:59.065192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:59.075659 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0416c04-e93b-426a-a8ad-e986b7ace1dd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1662 microversion: 2.1 time: 1.009073 Oct 27 10:26:59.092075 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2341/4488] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:58 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1662 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:59.099221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:59.100132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:59.115661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:59.116649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:59.118157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:59.119293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:59.123637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:59.124360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:59.218134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:59.220962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:59.222197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:59.223167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lazy-loading 'fault' on Instance uuid 4a9b34a6-72ce-40ab-b3b2-ed7351b38354 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:26:59.801760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:59.811971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:26:59.812538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:26:59.813118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:26:59.813516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:26:59.814714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:26:59.828303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:59.831007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad72fb9645db4ee4b59db67e96316b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b53d589e73434e9e998f8349d608f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:59.833075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:59.833562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:59.833994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:59.835000 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c23e19d-164b-485c-91b7-6bcd9ee13596 tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 200 len: 1410 microversion: 2.54 time: 0.740749 Oct 27 10:26:59.836381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:59.836889 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2342/4489] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:26:59 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 1410 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:26:59.838071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:59.838730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:59.865095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Getting quotas for project d8bfafdd15ce4d76ba83efe7d2f6d8cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:59.872335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Getting quotas for user 2252caef8d76405a8db702970ab03fb2 and project d8bfafdd15ce4d76ba83efe7d2f6d8cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:59.889302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:26:59.891714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:26:59.958171 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae733167-4c46-40ed-8b5c-1d3e108f2083 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.314480 Oct 27 10:26:59.959536 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2148/4490] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:26:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:26:59.970462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c432862-e09a-42da-82c0-e5f559962a97 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:59.971135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c432862-e09a-42da-82c0-e5f559962a97 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:00.060877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c432862-e09a-42da-82c0-e5f559962a97 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:00.069094 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c432862-e09a-42da-82c0-e5f559962a97 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1217 microversion: 2.1 time: 0.102537 Oct 27 10:27:00.069947 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2343/4491] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:59 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:00.100742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:00.101307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:00.120778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.121467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.121965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.130391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.132731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.133386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.356020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:00.358976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:00.368710 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83d5eb6e-5101-4003-94d5-905b99dd881f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.272796 Oct 27 10:27:00.370191 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2149/4492] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:00 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:00.404985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:00.406041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:00.418860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.419372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.419818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.421155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.421634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.422053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.842044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:00.863678 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a07fc715-f9e8-41ec-9f5b-2d0fe82fa6c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.474645 Oct 27 10:27:00.864273 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2344/4493] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:00 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:00.869390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:00.872297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] [instance: 4a9b34a6-72ce-40ab-b3b2-ed7351b38354] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:00.889259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:00.889806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:00.896696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.897403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.897707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.898314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.898436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.898974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.900807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.901580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.902096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.903512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.909378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.909831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.941027 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] HTTP exception thrown: Instance 4a9b34a6-72ce-40ab-b3b2-ed7351b38354 could not be found. Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Request method failure captured: Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 HTTP/1.1 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzEdzyXP3USzI-kvoglleRmBO5AxzR4WAUnvH8iE-14MscEPsDY0F09yI98d9hKAvVNhCDyV5zUH-DZdyUN9bV9kAbkuIpZ0Hp0qhdl2WBn7A8L4Ym8Q8G4YsELOcyTa9Y18sD1k11DQ4saXha0KXB0DkuQg6EGiNEw3ZZndOKEa64 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.54 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 53b53d589e73434e9e998f8349d608f9 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerShowV254Test-1096332109 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53b53d589e73434e9e998f8349d608f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53b53d589e73434e9e998f8349d608f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53b53d589e73434e9e998f8349d608f9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53b53d589e73434e9e998f8349d608f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerShowV254Test-1096332109 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 53b53d589e73434e9e998f8349d608f9 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerShowV254Test-1096332109 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerShowV254Test-1096332109-project Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: ad72fb9645db4ee4b59db67e96316b98 Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerShowV254Test-1096332109-project Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 4a9b34a6-72ce-40ab-b3b2-ed7351b38354 could not be found. Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '4a9b34a6-72ce-40ab-b3b2-ed7351b38354'} Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9b34a6-72ce-40ab-b3b2-ed7351b38354 could not be found. Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9b34a6-72ce-40ab-b3b2-ed7351b38354 could not be found. Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:00.943972 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:00.948930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:00.948930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:00.948930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:00.948930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:00.948930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:00.948930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9b34a6-72ce-40ab-b3b2-ed7351b38354 could not be found. Oct 27 10:27:00.948930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:00.951547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] Returning 404 to user: Instance 4a9b34a6-72ce-40ab-b3b2-ed7351b38354 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:00.953068 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6bcff7a-f3f1-4875-bc17-b2cd8da738ea tempest-ServerShowV254Test-1096332109 tempest-ServerShowV254Test-1096332109-project] 10.222.0.76 "GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354" status: 404 len: 111 microversion: 2.54 time: 0.091079 Oct 27 10:27:00.954805 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2150/4494] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:00 2022] GET /compute/v2.1/servers/4a9b34a6-72ce-40ab-b3b2-ed7351b38354 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:27:00.968747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Unlocking {{(pid=120720) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 27 10:27:01.075229 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ade67303-12a2-40fa-8f66-4e2d7f4eec3c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.191725 Oct 27 10:27:01.075976 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2345/4495] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:27:00 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:27:01.088979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:01.089612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:01.098669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:01.099533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:01.101666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:01.102166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:01.102952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:01.104536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:01.105448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:01.106265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:01.127609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:01.128561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:01.130386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:01.132433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:01.136989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:01.137644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:01.307584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:01.318569 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80fbc507-c62f-41e9-8b26-cf64469bdcff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1269 microversion: 2.1 time: 0.223783 Oct 27 10:27:01.320395 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2346/4496] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:01 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:01.756577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:01.777466 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-db93700f-613a-4925-9111-b5b833962101 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.690624 Oct 27 10:27:01.779779 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2151/4497] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:01 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:01.806975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:01.809083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:01.816535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:01.817366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:01.818558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:01.819597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:01.820352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:01.821141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:02.342992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:02.343866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:02.354817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:02.356706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:02.357250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:02.360396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:02.361039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:02.361545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:02.499088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:02.506951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:02.514959 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-29c3da62-9c41-4c92-8f0d-1259f6e44e95 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1275 microversion: 2.1 time: 0.175950 Oct 27 10:27:02.520177 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2152/4498] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:02 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:02.533177 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9fde73fa-c28c-4b59-af9a-3c3605f25d76 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.713540 Oct 27 10:27:02.533881 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2347/4499] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:01 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:02.562773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:02.564088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:02.570935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:02.571886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:02.572624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:02.573580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:02.574243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:02.574875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:02.896796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:02.910706 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8a93bea9-a47b-4d3b-b371-f4d057470493 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.351946 Oct 27 10:27:02.933584 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2153/4500] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:02 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:02.940974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9eccc1a-85f1-4c17-af30-3d2f1809b25c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:02.941791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f9eccc1a-85f1-4c17-af30-3d2f1809b25c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:02.950814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9eccc1a-85f1-4c17-af30-3d2f1809b25c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:02.954640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9eccc1a-85f1-4c17-af30-3d2f1809b25c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:02.955333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9eccc1a-85f1-4c17-af30-3d2f1809b25c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:02.956937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9eccc1a-85f1-4c17-af30-3d2f1809b25c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:02.957921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9eccc1a-85f1-4c17-af30-3d2f1809b25c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:02.958675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9eccc1a-85f1-4c17-af30-3d2f1809b25c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:03.064208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9eccc1a-85f1-4c17-af30-3d2f1809b25c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.127318 Oct 27 10:27:03.068112 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2348/4501] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:27:02 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:27:03.076256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:03.076972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:03.090102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:03.094824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:03.094824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:03.094824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:03.096526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:03.097007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:03.545726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:03.546440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:03.559673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:03.559929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:03.562800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:03.564548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:03.570559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:03.571409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:04.487786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:04.501626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1671 microversion: 2.1 time: 1.430141 Oct 27 10:27:04.502227 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2154/4502] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:03 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1671 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:04.505963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:04.507406 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1b60a32-3502-4d90-95b9-18c77852711c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001667 Oct 27 10:27:04.508700 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2155/4503] 10.222.0.76 () {56 vars in 886 bytes} [Thu Oct 27 10:27:04 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 10:27:04.728994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:04.746346 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1019ea57-b9cc-4238-8d8c-3f0be64317c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1317 microversion: 2.1 time: 1.199711 Oct 27 10:27:04.752236 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2349/4504] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:03 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1317 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:04.835617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b3f78f4a-651d-4337-8ed8-2ba0c345d8bc req-7de399ea-5231-49be-a13b-acc724563b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7616ad90-cb36-470d-967c-aca1f4bbd5e0", "tag": "d48dad60-9b00-45dc-826c-f68aeac79423"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:04.857507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b3f78f4a-651d-4337-8ed8-2ba0c345d8bc req-7de399ea-5231-49be-a13b-acc724563b8a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:04.858211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b3f78f4a-651d-4337-8ed8-2ba0c345d8bc req-7de399ea-5231-49be-a13b-acc724563b8a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:04.858810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b3f78f4a-651d-4337-8ed8-2ba0c345d8bc req-7de399ea-5231-49be-a13b-acc724563b8a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:04.885252 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b3f78f4a-651d-4337-8ed8-2ba0c345d8bc req-7de399ea-5231-49be-a13b-acc724563b8a service nova] Creating event network-changed:d48dad60-9b00-45dc-826c-f68aeac79423 for instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 on n-h1-854663-10 Oct 27 10:27:04.906635 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b3f78f4a-651d-4337-8ed8-2ba0c345d8bc req-7de399ea-5231-49be-a13b-acc724563b8a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074947 Oct 27 10:27:04.907520 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2156/4505] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:05.529384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:05.530004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:05.541641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:05.543132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:05.543879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:05.544796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:05.545356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:05.546904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:05.773858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:05.774911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:05.782850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:05.784224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:05.785316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:05.786279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:05.786951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:05.787597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:06.041500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:06.059660 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42d2a936-71d4-4b01-ae1c-47d73954c113 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1651 microversion: 2.1 time: 0.533416 Oct 27 10:27:06.061192 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2350/4506] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:05 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1651 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:06.091559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94bde2d9-2edb-4020-9c67-bca4fb76f921 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:06.092275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94bde2d9-2edb-4020-9c67-bca4fb76f921 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:06.102259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bde2d9-2edb-4020-9c67-bca4fb76f921 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:06.103308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bde2d9-2edb-4020-9c67-bca4fb76f921 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:06.104168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bde2d9-2edb-4020-9c67-bca4fb76f921 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:06.105187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bde2d9-2edb-4020-9c67-bca4fb76f921 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:06.106367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bde2d9-2edb-4020-9c67-bca4fb76f921 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:06.107472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bde2d9-2edb-4020-9c67-bca4fb76f921 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:06.202851 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94bde2d9-2edb-4020-9c67-bca4fb76f921 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.115732 Oct 27 10:27:06.203781 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2351/4507] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:27:06 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:27:06.213777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:06.215637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:06.225424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:06.226523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:06.227466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:06.229864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:06.230700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:06.231451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:06.244353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:06.260128 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8bc15163-0430-498a-aedc-3323c9db5500 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1317 microversion: 2.1 time: 0.491768 Oct 27 10:27:06.278782 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2157/4508] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:05 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:06.732926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:06.742844 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-142b4e4f-c4e5-48ef-87de-2172ca69d2b5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1658 microversion: 2.1 time: 0.534225 Oct 27 10:27:06.750174 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2352/4509] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:06 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1658 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:07.288175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:07.289619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:07.308115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:07.308619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:07.311452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:07.313972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:07.315105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:07.317825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:07.656071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:07.668027 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-68658e03-7136-42b5-bf85-cb645ef2cee9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1317 microversion: 2.1 time: 0.387444 Oct 27 10:27:07.670276 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2158/4510] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:07 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:07.778339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:07.779894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:07.791504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:07.792276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:07.794276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:07.795278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:07.796272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:07.797203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:08.093484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-99f07039-6ae1-4bf7-bdf3-202ef3f504be tempest-ExtensionsTest-1631980424 tempest-ExtensionsTest-1631980424-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:08.095868 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-99f07039-6ae1-4bf7-bdf3-202ef3f504be tempest-ExtensionsTest-1631980424 tempest-ExtensionsTest-1631980424-project] 10.222.0.76 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.280541 Oct 27 10:27:08.096848 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2159/4511] 10.222.0.76 () {58 vars in 1170 bytes} [Thu Oct 27 10:27:07 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:08.109955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9650b716-4f89-49e9-94a2-a6abd67124bb tempest-ExtensionsTest-1631980424 tempest-ExtensionsTest-1631980424-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:08.117758 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9650b716-4f89-49e9-94a2-a6abd67124bb tempest-ExtensionsTest-1631980424 tempest-ExtensionsTest-1631980424-project] 10.222.0.76 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.013034 Oct 27 10:27:08.119971 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2160/4512] 10.222.0.76 () {58 vars in 1134 bytes} [Thu Oct 27 10:27:08 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:27:08.130376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:08.157410 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ee538e6-ee80-4494-9855-15aec918efed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.381180 Oct 27 10:27:08.160344 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2353/4513] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:07 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:08.194339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:08.195362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:08.244516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:08.247392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:08.248064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:08.251430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:08.252105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:08.253345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:08.698320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:08.698950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:08.709354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:08.713597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:08.715028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:08.717519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:08.718257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:08.719000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:08.774253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:08.787795 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83d01425-aecc-4336-bfa0-51bb1a9a807a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.598354 Oct 27 10:27:08.789079 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2161/4514] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:08 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:08.814230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:08.814850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:08.826289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:08.827944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:08.828397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:08.829175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:08.829802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:08.830375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:09.673936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:09.677155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:09.693714 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f98da7b5-ac7e-475b-b6c5-2e105ad9299d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1317 microversion: 2.1 time: 0.999776 Oct 27 10:27:09.694325 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2354/4515] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:08 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1317 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:09.804013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:09.816096 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0ac2bfe-9509-407e-9da5-2a88df04612b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 1.005328 Oct 27 10:27:09.817449 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2162/4516] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:08 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:09.847469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:09.848443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:09.873507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:09.874046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:09.874500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:09.875259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:09.875821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:09.876955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:10.065203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:10.721435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:10.722213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:10.733649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:10.734753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:10.740424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:10.744552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:10.745225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:10.746101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:10.747690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:10.749393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:11.017470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:11.039234 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-686b213c-f317-4a71-b560-357449c00be8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 1.199902 Oct 27 10:27:11.040494 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2355/4517] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:09 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:11.070729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:11.072712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:11.107936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:11.108809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:11.109448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:11.110356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:11.111086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:11.111758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:11.186293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:11.221347 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-164a7cb7-ee56-47d7-91f8-7497df55250b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1317 microversion: 2.1 time: 0.501430 Oct 27 10:27:11.222761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2163/4518] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:10 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:11.476714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:11.495250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae7d56af-9e40-43f4-93c1-4f68fcb02fb3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.433019 Oct 27 10:27:11.497434 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2356/4519] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:11 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:11.519901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:11.520523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:11.527313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:11.527976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:11.528595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:11.529648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:11.530241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:11.530814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:11.810113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:11.829328 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-820b58d3-2f1e-4326-ab64-84f9681a428f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.313274 Oct 27 10:27:11.829929 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2164/4520] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:11 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:12.248838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:12.249467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:12.273553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:12.274300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:12.274852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:12.277164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:12.277949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:12.278568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:12.594344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:12.609778 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-542f92ad-835d-4d32-9f8d-13191d29422a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1317 microversion: 2.1 time: 0.365999 Oct 27 10:27:12.610403 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2357/4521] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:12 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:12.826746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-504ae7fb-2e75-4e51-8d8d-72211552da10 req-9bd3f6ed-14f9-4334-83f9-5e763743164d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7616ad90-cb36-470d-967c-aca1f4bbd5e0", "name": "network-vif-plugged", "status": "completed", "tag": "d48dad60-9b00-45dc-826c-f68aeac79423"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:12.841874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-504ae7fb-2e75-4e51-8d8d-72211552da10 req-9bd3f6ed-14f9-4334-83f9-5e763743164d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:12.843012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-504ae7fb-2e75-4e51-8d8d-72211552da10 req-9bd3f6ed-14f9-4334-83f9-5e763743164d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:12.843653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-504ae7fb-2e75-4e51-8d8d-72211552da10 req-9bd3f6ed-14f9-4334-83f9-5e763743164d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:12.874034 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-504ae7fb-2e75-4e51-8d8d-72211552da10 req-9bd3f6ed-14f9-4334-83f9-5e763743164d service nova] Creating event network-vif-plugged:d48dad60-9b00-45dc-826c-f68aeac79423 for instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 on n-h1-854663-10 Oct 27 10:27:12.882500 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-504ae7fb-2e75-4e51-8d8d-72211552da10 req-9bd3f6ed-14f9-4334-83f9-5e763743164d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059440 Oct 27 10:27:12.884053 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2165/4522] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:13.553316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b49d651-6abc-4924-a87c-20f9dd2b3c09 tempest-AZV2TestJSON-516993284 tempest-AZV2TestJSON-516993284-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:13.555859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b49d651-6abc-4924-a87c-20f9dd2b3c09 tempest-AZV2TestJSON-516993284 tempest-AZV2TestJSON-516993284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:13.556470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b49d651-6abc-4924-a87c-20f9dd2b3c09 tempest-AZV2TestJSON-516993284 tempest-AZV2TestJSON-516993284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:13.557258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b49d651-6abc-4924-a87c-20f9dd2b3c09 tempest-AZV2TestJSON-516993284 tempest-AZV2TestJSON-516993284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:13.561239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b49d651-6abc-4924-a87c-20f9dd2b3c09 tempest-AZV2TestJSON-516993284 tempest-AZV2TestJSON-516993284-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:13.562061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b49d651-6abc-4924-a87c-20f9dd2b3c09 tempest-AZV2TestJSON-516993284 tempest-AZV2TestJSON-516993284-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:13.562805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b49d651-6abc-4924-a87c-20f9dd2b3c09 tempest-AZV2TestJSON-516993284 tempest-AZV2TestJSON-516993284-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:13.633260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:13.634696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:13.646291 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b49d651-6abc-4924-a87c-20f9dd2b3c09 tempest-AZV2TestJSON-516993284 tempest-AZV2TestJSON-516993284-project] 10.222.0.76 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.441855 Oct 27 10:27:13.646953 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2358/4523] 10.222.0.76 () {58 vars in 1164 bytes} [Thu Oct 27 10:27:13 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:27:13.653841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:13.653841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:13.653841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:13.653841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:13.653841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:13.653841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:14.261231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:14.287224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6874111d-5192-47fc-91a4-4d1dfcc4d83a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1317 microversion: 2.1 time: 0.658444 Oct 27 10:27:14.288471 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2166/4524] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:13 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:14.315575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2af67291-1002-4e36-aa9c-e07535fb7651 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Action: 'create', calling method: .version_select at 0x7f6d5ae294c0>, body: {"keypair": {"name": "tempest-keypair-1001932277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrdGSTZ0eUJoHmuNS9yyrfOIGJkiBRJrxFw9ANeSF8PZax5NExxHoGqQACeG/tMuxCJZkPf78JkXN6C41A8M2XbfskHpsNo/q2a6MHeofqUNhxamGOwuJ2lQvJ5G32nVA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:14.356797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-2af67291-1002-4e36-aa9c-e07535fb7651 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Getting quotas for project 79f9cab7fe2840a590d692b91ff6de3a. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:27:14.372230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-2af67291-1002-4e36-aa9c-e07535fb7651 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Getting quotas for user 51871a8eed994b2785a872172d4bdc76 and project 79f9cab7fe2840a590d692b91ff6de3a. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:27:14.438091 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2af67291-1002-4e36-aa9c-e07535fb7651 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.126576 Oct 27 10:27:14.439823 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2359/4525] 10.222.0.76 () {62 vars in 1200 bytes} [Thu Oct 27 10:27:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 10:27:15.317675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:15.319010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:15.330098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:15.332547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:15.333344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:15.334634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:15.336395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:15.337599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:15.747961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:15.757043 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c35cd95-31db-4c04-8982-e30ed1534fbc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1505 microversion: 2.1 time: 0.446846 Oct 27 10:27:15.757628 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2167/4526] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:15 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:15.782234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:15.783328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:15.791722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:15.792835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:15.793846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:15.795944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:15.796621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:15.797287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:15.831716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:27:16.069776 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-535e1da0-781b-4493-a9c3-078fb220591d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 204 len: 0 microversion: 2.1 time: 0.291323 Oct 27 10:27:16.080558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:16.081238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:16.087195 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2360/4527] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:27:15 2022] DELETE /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:27:16.094020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:16.094517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:16.094959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:16.101112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:16.101698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:16.105220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:16.609929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:16.624426 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-967d4ee7-257a-43db-beed-929b560f1e0a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1511 microversion: 2.1 time: 0.547713 Oct 27 10:27:16.625516 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2168/4528] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:16 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1511 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:17.653506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:17.654812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:17.666552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:17.669459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:17.670080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:17.674287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:17.674956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:17.675570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:18.651396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:18.671142 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da778826-c46b-473d-81e8-2a4e5723003d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1511 microversion: 2.1 time: 1.023055 Oct 27 10:27:18.671782 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2361/4529] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:17 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1511 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:19.083114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1033269679", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "976103df-7b6f-4027-b0ef-7ce4c1d4cb38"}, {"port": "87e5ceb2-bb58-4ae5-852d-ee73be4cb0f3", "tag": "port-1"}, {"port": "ae4d4470-a4f9-491d-b4cb-91c4398b832b", "tag": "port-2"}, {"uuid": "3252fc57-30b7-43ec-bee1-90126819c8e8", "tag": "net-1"}, {"uuid": "3252fc57-30b7-43ec-bee1-90126819c8e8"}, {"uuid": "24e94747-c98d-4f28-8103-ca2dffa64a5c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "24e94747-c98d-4f28-8103-ca2dffa64a5c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5fb03d84-c7c3-43dc-aa80-86a23c61187d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c28493a4-9bc3-4568-b8be-d96249ed30be", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "92e5a870-c991-4a00-a6f8-430f3cb7c4f5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2109830830"}], "key_name": "tempest-keypair-1001932277", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:19.408420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8ad6af0f-c1ca-4474-8ed3-34259c1265ca req-18abc524-158e-4c54-a264-695a004ecd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7616ad90-cb36-470d-967c-aca1f4bbd5e0", "name": "network-vif-deleted", "tag": "d48dad60-9b00-45dc-826c-f68aeac79423"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:19.427978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ad6af0f-c1ca-4474-8ed3-34259c1265ca req-18abc524-158e-4c54-a264-695a004ecd4b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:19.428472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ad6af0f-c1ca-4474-8ed3-34259c1265ca req-18abc524-158e-4c54-a264-695a004ecd4b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:19.428949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ad6af0f-c1ca-4474-8ed3-34259c1265ca req-18abc524-158e-4c54-a264-695a004ecd4b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:19.468850 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8ad6af0f-c1ca-4474-8ed3-34259c1265ca req-18abc524-158e-4c54-a264-695a004ecd4b service nova] Creating event network-vif-deleted:d48dad60-9b00-45dc-826c-f68aeac79423 for instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 on n-h1-854663-10 Oct 27 10:27:19.485246 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8ad6af0f-c1ca-4474-8ed3-34259c1265ca req-18abc524-158e-4c54-a264-695a004ecd4b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082833 Oct 27 10:27:19.486488 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2362/4530] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:19.700506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:19.702018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:19.713880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:19.725825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:19.726663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:19.728247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:19.729323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:19.729996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:19.791181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:19.792066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:19.801932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:19.803066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lazy-loading 'fault' on Instance uuid 7616ad90-cb36-470d-967c-aca1f4bbd5e0 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:27:19.971102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:19.973227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] validate_networks() for [('976103df-7b6f-4027-b0ef-7ce4c1d4cb38', None, None, None, None, None), (None, None, '87e5ceb2-bb58-4ae5-852d-ee73be4cb0f3', None, None, None), (None, None, 'ae4d4470-a4f9-491d-b4cb-91c4398b832b', None, None, None), ('3252fc57-30b7-43ec-bee1-90126819c8e8', None, None, None, None, None), ('3252fc57-30b7-43ec-bee1-90126819c8e8', None, None, None, None, None), ('24e94747-c98d-4f28-8103-ca2dffa64a5c', '10.2.2.100', None, None, None, None), ('24e94747-c98d-4f28-8103-ca2dffa64a5c', '10.2.2.200', None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:27:19.979611 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82e6f3e7-0db8-4a73-a41d-d15f2807b677 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 200 len: 1307 microversion: 2.1 time: 0.283756 Oct 27 10:27:19.980219 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2363/4531] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:19 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:21.003383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:21.005041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:21.018054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:21.021919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:21.023578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:21.025507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:21.026360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:21.027013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:21.046535 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 HTTP/1.1 Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '7616ad90-cb36-470d-967c-aca1f4bbd5e0'} Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:21.049669 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.053329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:21.053329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:21.053329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:21.053329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:21.053329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:21.053329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:27:21.053329 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.056559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:21.062405 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1fc62036-bbe0-44b8-aafb-712fe382f4b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 404 len: 111 microversion: 2.1 time: 0.063610 Oct 27 10:27:21.068862 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2364/4532] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:20 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:27:21.074920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:21.083029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:21.096455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:21.097053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:21.102460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:21.103436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:21.103995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:21.104496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:21.605536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:21.615084 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-384ae873-5359-4921-9ce4-118ecb598094 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.544455 Oct 27 10:27:21.621229 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2365/4533] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:21 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:21.681000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:21.818742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5eb94eef-c694-44af-815c-ed4602bf82d3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5eb94eef-c694-44af-815c-ed4602bf82d3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 163 Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": 12345, "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 12345 Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:27:21.822900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 10:27:21.826432 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:21.828978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5eb94eef-c694-44af-815c-ed4602bf82d3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:21.830198 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5eb94eef-c694-44af-815c-ed4602bf82d3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.016191 Oct 27 10:27:21.831112 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2366/4534] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:21 2022] POST /compute/v2.1/servers => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:27:21.843220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:21.845491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:21.863358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:21.864568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:21.865258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:21.869409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:21.870136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:21.870825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:22.775946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:22.785530 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f50cab8d-e025-44f8-a960-8a2aa48934f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.950017 Oct 27 10:27:22.786664 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2367/4535] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:21 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:22.812977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:22.813630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:22.843424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:22.843929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:22.844370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:22.845328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:22.845791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:22.846219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:23.576413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:24.296874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:24.313823 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a751f20-5325-4121-99cf-0c91933df4f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 1.504833 Oct 27 10:27:24.315646 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2368/4536] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:22 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:24.553451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:25.299276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-579a56e9-b1f5-47bf-966c-e8849ed52ef5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'create', calling method: .version_select at 0x7f6d5a7c3a60>, body: {"keypair": {"name": "tempest-keypair-344567849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8A5py7cfgOFSYZQhHP3MF5fmbBjYkMfsDhNFUYLUZfPG+iMj4xSo1g9WDbAz2Adl6Dpfwq58z4EJ6Jh/mMZXeeLh6bW2xi5QLfaY8y0lDdSSxcZY41aiD7evdkp0G/Cg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:25.319933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:25.345554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-579a56e9-b1f5-47bf-966c-e8849ed52ef5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Getting quotas for project 2ac83c84f1234dea80c2b074896559c8. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:27:25.363455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-579a56e9-b1f5-47bf-966c-e8849ed52ef5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Getting quotas for user 742c83e928b64f588265112ea7f4c3c9 and project 2ac83c84f1234dea80c2b074896559c8. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:27:25.445901 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-579a56e9-b1f5-47bf-966c-e8849ed52ef5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.898311 Oct 27 10:27:25.447938 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2369/4537] 10.222.0.76 () {62 vars in 1200 bytes} [Thu Oct 27 10:27:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 901 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 27 10:27:26.623991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=85 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:26.720981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:26.722859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:26.747496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:26.750608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:26.755445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:26.756489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:26.759173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:26.760252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:26.808136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:27:26.966754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11633f81-e9ee-4b23-9823-bc67001b3822 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 204 len: 0 microversion: 2.32 time: 0.953815 Oct 27 10:27:26.967409 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2370/4538] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:27:26 2022] DELETE /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 0 bytes in 956 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 10:27:26.980742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:26.981661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:26.996898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:26.997450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:26.997897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:27.000298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:27.000833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:27.001617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:27.620719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:27.637451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:27.651950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:27.655654 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7b954a4-6d6a-4de4-96e3-2f51a403a938 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2956 microversion: 2.32 time: 0.683514 Oct 27 10:27:27.680938 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2371/4539] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:26 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2956 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:27:27.757106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07ded551-3391-4318-8ccc-19e32146ac71 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-268499312", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e0a7af75-efd8-4ef3-a7b4-ecaacef09853", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:27.866412 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-07ded551-3391-4318-8ccc-19e32146ac71 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Block Device e0a7af75-efd8-4ef3-a7b4-ecaacef09853 is not bootable. Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07ded551-3391-4318-8ccc-19e32146ac71 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 357 Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-268499312", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e0a7af75-efd8-4ef3-a7b4-ecaacef09853", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: exception: Block Device e0a7af75-efd8-4ef3-a7b4-ecaacef09853 is not bootable. Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-268499312', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e0a7af75-efd8-4ef3-a7b4-ecaacef09853'}], 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e0a7af75-efd8-4ef3-a7b4-ecaacef09853 is not bootable. Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:27.877127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e0a7af75-efd8-4ef3-a7b4-ecaacef09853 is not bootable. Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e0a7af75-efd8-4ef3-a7b4-ecaacef09853 is not bootable. Oct 27 10:27:27.881240 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:27.882588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07ded551-3391-4318-8ccc-19e32146ac71 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Block Device e0a7af75-efd8-4ef3-a7b4-ecaacef09853 is not bootable. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:27.883752 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-07ded551-3391-4318-8ccc-19e32146ac71 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.130671 Oct 27 10:27:27.884777 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2372/4540] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:27:27.894708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:27.895870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:27.912232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:27.915653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:27.916384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:27.917375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:27.922018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:27.924545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:28.401898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:27:28.402425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:27:28.402891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:27:28.403381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:27:28.403868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:27:28.434381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:28.435204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:28.435875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:28.436907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:28.437555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:28.438191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:28.465809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:28.474154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:28.482175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Getting quotas for project 79f9cab7fe2840a590d692b91ff6de3a. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:27:28.485802 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c3f84f0-b01c-411c-921a-1ee35c04ee54 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.596412 Oct 27 10:27:28.507808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2373/4541] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:27 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:28.520421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Getting quotas for user 51871a8eed994b2785a872172d4bdc76 and project 79f9cab7fe2840a590d692b91ff6de3a. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:27:28.526781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:28.527748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:28.534850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:28.535647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:28.536312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:28.537259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:28.537930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:28.538588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:28.830735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:27:28.833968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5fb03d84-c7c3-43dc-aa80-86a23c61187d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c28493a4-9bc3-4568-b8be-d96249ed30be',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92e5a870-c991-4a00-a6f8-430f3cb7c4f5',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:27:29.106102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:29.125792 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3106558-8eee-4005-9a91-123c63911f99 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.603338 Oct 27 10:27:29.130194 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2374/4542] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:28 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:29.168159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:29.170859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:29.192041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:29.193107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:29.195554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:29.197636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:29.199393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:29.200468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:29.695071 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe9bae19-8b63-46b1-a859-603dc3ac76e5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 10.616273 Oct 27 10:27:29.701060 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2169/4543] 10.222.0.76 () {62 vars in 1189 bytes} [Thu Oct 27 10:27:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 10623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:27:29.732467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f554ee40-2496-4820-a8cb-aa8dc1dfcb2e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:29.738763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f554ee40-2496-4820-a8cb-aa8dc1dfcb2e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:29.913076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f554ee40-2496-4820-a8cb-aa8dc1dfcb2e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:29.924088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f554ee40-2496-4820-a8cb-aa8dc1dfcb2e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:29.927745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f554ee40-2496-4820-a8cb-aa8dc1dfcb2e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:29.930817 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f554ee40-2496-4820-a8cb-aa8dc1dfcb2e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1286 microversion: 2.42 time: 0.226314 Oct 27 10:27:29.935068 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2170/4544] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:29 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1286 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:30.124024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:30.138773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:30.143308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:30.147049 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddad3866-186d-414d-b2ad-f00c340487fc tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2956 microversion: 2.32 time: 1.015464 Oct 27 10:27:30.149109 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2375/4545] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:29 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2956 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:30.965516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-14eb2570-6a37-4f62-bbc1-dfc7560aec3e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:30.967836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-14eb2570-6a37-4f62-bbc1-dfc7560aec3e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:31.181425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:31.182048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:31.199630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:31.200648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:31.201743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:31.202596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:31.203194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:31.203793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:31.279737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-14eb2570-6a37-4f62-bbc1-dfc7560aec3e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:31.290447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-14eb2570-6a37-4f62-bbc1-dfc7560aec3e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:31.294578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-14eb2570-6a37-4f62-bbc1-dfc7560aec3e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:31.297138 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-14eb2570-6a37-4f62-bbc1-dfc7560aec3e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1286 microversion: 2.42 time: 0.336864 Oct 27 10:27:31.303203 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2171/4546] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:30 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1286 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:31.810502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1758761721", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "caf9c7a3-96f4-4a9a-9b36-4095b49119e4"}], "security_groups": [{"name": "tempest-securitygroup--723860087"}], "key_name": "tempest-keypair-344567849", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:31.831919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:31.854889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:31.856354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:31.864981 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f34dad6-4604-45aa-8802-3237e7810849 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2956 microversion: 2.32 time: 0.686911 Oct 27 10:27:31.865688 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2376/4547] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:31 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2956 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:27:32.179598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] validate_networks() for [('caf9c7a3-96f4-4a9a-9b36-4095b49119e4', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:27:32.339258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:32.339958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:32.353215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:32.353875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:32.354332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:32.355053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:32.355602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:32.356039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:32.538682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:32.553730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:32.558109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:32.559506 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec9d612e-2614-4809-8535-9a29fc6552a3 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1576 microversion: 2.42 time: 0.230731 Oct 27 10:27:32.560313 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2377/4548] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:32 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:27:32.587742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff04e682-c403-4d1f-aa0c-f440987d1d20 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1425241984", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e360a591-87a4-48a1-b578-afd9703b636a", "destination_type": "local"}, {"source_type": "volume", "uuid": "1775ca78-7936-4494-8de0-c5fa3aa07a5e", "destination_type": "invalid"}], "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff04e682-c403-4d1f-aa0c-f440987d1d20 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 495 Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1425241984", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e360a591-87a4-48a1-b578-afd9703b636a", "destination_type": "local"}, {"source_type": "volume", "uuid": "1775ca78-7936-4494-8de0-c5fa3aa07a5e", "destination_type": "invalid"}], "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1425241984', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e360a591-87a4-48a1-b578-afd9703b636a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1775ca78-7936-4494-8de0-c5fa3aa07a5e', 'destination_type': 'invalid'}], 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:32.593594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 10:27:32.597103 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:32.603192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff04e682-c403-4d1f-aa0c-f440987d1d20 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:32.604518 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff04e682-c403-4d1f-aa0c-f440987d1d20 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.026449 Oct 27 10:27:32.608944 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2378/4549] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:32 2022] POST /compute/v2.1/servers => generated 155 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:27:32.616446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:32.617326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:32.629032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:32.629852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:32.630472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:32.631390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:32.632116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:32.633740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:33.277797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:33.292038 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce608a3d-3089-4cd2-a8b7-0399c5d48504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.681629 Oct 27 10:27:33.295444 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2379/4550] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:32 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:33.333540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:33.334559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:33.345831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:33.353509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:33.353973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:33.354733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:33.355458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:33.355893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:33.614829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:27:33.615355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:27:33.616362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:27:33.616836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:27:33.617255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:27:33.641013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:33.641962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:33.642655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:33.647792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:33.649750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:33.652160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:33.691661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Getting quotas for project 2ac83c84f1234dea80c2b074896559c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:27:33.699425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Getting quotas for user 742c83e928b64f588265112ea7f4c3c9 and project 2ac83c84f1234dea80c2b074896559c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:27:33.715800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:27:33.718601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:27:33.800830 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f79cec62-31bf-4d28-8603-da417d7bc9bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.997620 Oct 27 10:27:33.802343 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2172/4551] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:27:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:27:33.815832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:33.817544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:33.829477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:33.830802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:33.831401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:33.832307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:33.838805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:33.842156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:34.244993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:34.263436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:34.266648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:34.269761 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-06614a72-7075-48c8-9f05-3dc5cce1b3fa tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2935 microversion: 2.32 time: 0.961015 Oct 27 10:27:34.286137 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2380/4552] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:33 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2935 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:34.306911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:34.307925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:34.315098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:34.315908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:34.316519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:34.317481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:34.318356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:34.319069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:34.666009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:34.682481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:34.683983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:34.687184 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7f7c948-5a2c-4f62-8f2e-d6d0345f42f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1594 microversion: 2.42 time: 0.398808 Oct 27 10:27:34.687785 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2381/4553] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:34 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1594 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:34.706475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:34.721227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:34.739489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:34.739972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:34.740404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:34.741904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:34.741904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:34.742083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:34.818441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:34.832549 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-75306959-dedc-4027-8723-ea7cf7450a84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 1.026965 Oct 27 10:27:34.835150 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2173/4554] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:33 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:34.851067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-834cd8c2-e601-427c-9887-383ce44c609f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:34.860058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-834cd8c2-e601-427c-9887-383ce44c609f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:34.880591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-834cd8c2-e601-427c-9887-383ce44c609f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:34.884800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-834cd8c2-e601-427c-9887-383ce44c609f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:34.888250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-834cd8c2-e601-427c-9887-383ce44c609f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:34.890718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-834cd8c2-e601-427c-9887-383ce44c609f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:34.893153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-834cd8c2-e601-427c-9887-383ce44c609f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:34.895319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-834cd8c2-e601-427c-9887-383ce44c609f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:35.154969 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-834cd8c2-e601-427c-9887-383ce44c609f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.313479 Oct 27 10:27:35.158918 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2174/4555] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:27:34 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:27:35.178911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8b010701-ca74-4f53-b146-2f7a6e503d90 req-ca04ae20-7cc0-42ca-a231-683c358f56ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-unplugged", "status": "completed", "tag": "83bb0a57-9239-4158-bc07-2fedf58045e6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:35.231601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:35.234262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8b010701-ca74-4f53-b146-2f7a6e503d90 req-ca04ae20-7cc0-42ca-a231-683c358f56ea service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:35.239193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8b010701-ca74-4f53-b146-2f7a6e503d90 req-ca04ae20-7cc0-42ca-a231-683c358f56ea service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:35.241888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8b010701-ca74-4f53-b146-2f7a6e503d90 req-ca04ae20-7cc0-42ca-a231-683c358f56ea service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:35.244607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:35.246081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:35.247245 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8aeb1d5-b4f0-498f-a76d-b75ab332404c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1285 microversion: 2.20 time: 0.558513 Oct 27 10:27:35.247808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2382/4556] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:34 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1285 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:35.262120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5e550015-e400-47e1-8c94-b7a93d9331bc req-87ca58ce-86fe-47ad-82bf-1249eb2edd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-deleted", "tag": "933ec73d-9a1a-4d23-9d8c-110265b3b6e0"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:35.294600 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8b010701-ca74-4f53-b146-2f7a6e503d90 req-ca04ae20-7cc0-42ca-a231-683c358f56ea service nova] Creating event network-vif-unplugged:83bb0a57-9239-4158-bc07-2fedf58045e6 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:27:35.297519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5e550015-e400-47e1-8c94-b7a93d9331bc req-87ca58ce-86fe-47ad-82bf-1249eb2edd87 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:35.305501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5e550015-e400-47e1-8c94-b7a93d9331bc req-87ca58ce-86fe-47ad-82bf-1249eb2edd87 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:35.306304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5e550015-e400-47e1-8c94-b7a93d9331bc req-87ca58ce-86fe-47ad-82bf-1249eb2edd87 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:35.308465 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8b010701-ca74-4f53-b146-2f7a6e503d90 req-ca04ae20-7cc0-42ca-a231-683c358f56ea service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145652 Oct 27 10:27:35.312172 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2175/4557] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:35.356924 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5e550015-e400-47e1-8c94-b7a93d9331bc req-87ca58ce-86fe-47ad-82bf-1249eb2edd87 service nova] Creating event network-vif-deleted:933ec73d-9a1a-4d23-9d8c-110265b3b6e0 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:27:35.370660 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5e550015-e400-47e1-8c94-b7a93d9331bc req-87ca58ce-86fe-47ad-82bf-1249eb2edd87 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112391 Oct 27 10:27:35.371359 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2383/4558] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:35.388753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:35.392999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:35.412126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:35.414724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:35.427271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:35.428101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:35.429834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:35.432200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:35.435898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:36.064875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ba414b24-a000-4e85-85d7-24823182599b tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Action: 'create', calling method: .version_select at 0x7f6d5a87a700>, body: {"keypair": {"name": "tempest-keypair-84163679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSBgltVhkCuDaMI9z57TW/0vutgjwKKNcKoi21sZaNCtfB3IX01Nd8WhpO0IZY/umpTe8U+yMGBjMVzhVrb6REaMUjZT62FEQBKJU4tBK8We2JtkOC4/2w9sjcTb9LPDA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:36.148461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ba414b24-a000-4e85-85d7-24823182599b tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Getting quotas for project 7d1e58c4aebb4852a2b1877bf30cbb9f. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:27:36.176300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ba414b24-a000-4e85-85d7-24823182599b tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Getting quotas for user c2ba4cff95bf44a9892530e904020984 and project 7d1e58c4aebb4852a2b1877bf30cbb9f. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:27:36.275705 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ba414b24-a000-4e85-85d7-24823182599b tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.952262 Oct 27 10:27:36.277526 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2176/4559] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:27:35 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:36.305589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68df0484-e885-4bcf-a7c3-6cc570ea2fab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-9383430", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68df0484-e885-4bcf-a7c3-6cc570ea2fab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 489 Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-9383430", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-9383430', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:36.316781 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 10:27:36.320222 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:36.325687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68df0484-e885-4bcf-a7c3-6cc570ea2fab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:36.327492 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-68df0484-e885-4bcf-a7c3-6cc570ea2fab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.039139 Oct 27 10:27:36.328108 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2177/4560] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:36 2022] POST /compute/v2.1/servers => generated 624 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:27:36.349752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:36.350953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:36.385752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:36.386458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:36.386913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:36.390801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:36.391335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:36.394991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:37.128144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.151679 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a2502b0-4840-4a98-a2bc-a5ac1a776efd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1668 microversion: 2.1 time: 1.769522 Oct 27 10:27:37.152292 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2384/4561] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:35 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1668 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:37.195517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:37.196894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:37.204330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:37.209077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:37.209620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:37.217569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:37.218062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:37.218496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:37.440881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.460120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.462228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.466523 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-478ad932-1814-4706-a602-4f7d15734f5e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1594 microversion: 2.42 time: 0.287452 Oct 27 10:27:37.472843 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2385/4562] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:37 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1594 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:37.498135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:37.498677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:37.533469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:37.538382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:37.538861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:37.539789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:37.540265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:37.543572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:37.826194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.843631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.847091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.852884 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a41c3cd-33d1-4945-b537-09d6b0418d6e tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2706 microversion: 2.32 time: 1.518090 Oct 27 10:27:37.853578 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2178/4563] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:36 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2706 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:37.859827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.868541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:37.869204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:37.873142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.877487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:37.880603 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7ec8c3c-75a8-4a60-a453-7967b802b0b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1339 microversion: 2.20 time: 0.405468 Oct 27 10:27:37.887115 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2386/4564] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:37 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1339 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:37.902632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:37.903128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:37.903744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:37.908066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:37.908896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:37.909524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:37.917747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e5277bad-823c-4725-8aa7-5d794dfbefdc req-9ffabc60-8229-4672-b2d8-6c497c72a580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-unplugged", "status": "completed", "tag": "ea6b7f3d-eab2-4913-848a-baf2f2b76986"}, {"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-unplugged", "status": "completed", "tag": "ddc37743-d9c0-4cc7-9a0d-2fc905d04b07"}, {"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-unplugged", "status": "completed", "tag": "5e400934-2aff-4c7a-bc1e-a86b095a134a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:37.946542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e5277bad-823c-4725-8aa7-5d794dfbefdc req-9ffabc60-8229-4672-b2d8-6c497c72a580 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:37.950046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e5277bad-823c-4725-8aa7-5d794dfbefdc req-9ffabc60-8229-4672-b2d8-6c497c72a580 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:37.952814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e5277bad-823c-4725-8aa7-5d794dfbefdc req-9ffabc60-8229-4672-b2d8-6c497c72a580 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:37.972752 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e5277bad-823c-4725-8aa7-5d794dfbefdc req-9ffabc60-8229-4672-b2d8-6c497c72a580 service nova] Creating event network-vif-unplugged:ea6b7f3d-eab2-4913-848a-baf2f2b76986 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:27:37.973510 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e5277bad-823c-4725-8aa7-5d794dfbefdc req-9ffabc60-8229-4672-b2d8-6c497c72a580 service nova] Creating event network-vif-unplugged:ddc37743-d9c0-4cc7-9a0d-2fc905d04b07 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:27:37.974193 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e5277bad-823c-4725-8aa7-5d794dfbefdc req-9ffabc60-8229-4672-b2d8-6c497c72a580 service nova] Creating event network-vif-unplugged:5e400934-2aff-4c7a-bc1e-a86b095a134a for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:27:37.980982 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e5277bad-823c-4725-8aa7-5d794dfbefdc req-9ffabc60-8229-4672-b2d8-6c497c72a580 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.092227 Oct 27 10:27:37.982905 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2387/4565] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:38.182264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:38.183274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:38.198971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:38.199476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:38.199912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:38.200625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:38.201105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:38.201525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:38.261543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:38.276597 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7b9c3a6-b93f-4949-b92f-86664a579c4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.420603 Oct 27 10:27:38.276597 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2179/4566] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:37 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:38.299652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:38.300267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:38.312342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:38.312856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:38.313652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:38.314516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:38.315148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:38.318052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:39.215815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:39.233539 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e54d9b08-bcfa-46f5-8d23-be6b665e4e36 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1668 microversion: 2.1 time: 1.057291 Oct 27 10:27:39.234157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2388/4567] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:38 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1668 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:39.246221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:39.251644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:39.273990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:39.275930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:39.276580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:39.277760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:39.279244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:39.279858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:39.871704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:39.883710 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2d198fd0-d2b5-4a7c-823e-e7610ea4c33c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 1.587739 Oct 27 10:27:39.907891 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2180/4568] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:38 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:39.917159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:39.917874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:39.934207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:39.934724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:39.935406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:39.936274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:39.941848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:39.942506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:40.067974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:40.088452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:40.092013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:40.097878 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9422755-4285-4882-8f5c-419662a9c671 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1662 microversion: 2.42 time: 0.860197 Oct 27 10:27:40.098855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2389/4569] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:39 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1662 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:40.121170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:40.124426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:40.138916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:40.143505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:40.144414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:40.147287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:40.148263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:40.149867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:40.336938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:40.350004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:40.360472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:40.365495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:40.369809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:40.371006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:40.374256 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-36949db4-1cb8-4d50-9979-11e0ffbce99c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2706 microversion: 2.32 time: 0.464030 Oct 27 10:27:40.374727 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dcb4ca18-4511-4797-a9ef-91bf12c65e1c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1339 microversion: 2.20 time: 0.273497 Oct 27 10:27:40.376052 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2181/4570] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:39 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2706 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:40.377333 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2390/4571] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:40 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1339 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:40.388218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c10b078-05e9-429e-8c50-c2d78c0bdb70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c10b078-05e9-429e-8c50-c2d78c0bdb70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 416 Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:40.405914 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:27:40.408882 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:40.411911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8deec906-f2dd-4160-991f-90fd3a20e07c req-496264c8-96af-48c4-92a9-298058eb6164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-deleted", "tag": "ea6b7f3d-eab2-4913-848a-baf2f2b76986"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:40.419592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c10b078-05e9-429e-8c50-c2d78c0bdb70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:40.421111 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c10b078-05e9-429e-8c50-c2d78c0bdb70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.039763 Oct 27 10:27:40.424877 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2391/4572] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:40 2022] POST /compute/v2.1/servers => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:27:40.438473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:40.444915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:40.447653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8deec906-f2dd-4160-991f-90fd3a20e07c req-496264c8-96af-48c4-92a9-298058eb6164 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:40.448147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8deec906-f2dd-4160-991f-90fd3a20e07c req-496264c8-96af-48c4-92a9-298058eb6164 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:40.448605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8deec906-f2dd-4160-991f-90fd3a20e07c req-496264c8-96af-48c4-92a9-298058eb6164 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:40.460943 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8deec906-f2dd-4160-991f-90fd3a20e07c req-496264c8-96af-48c4-92a9-298058eb6164 service nova] Creating event network-vif-deleted:ea6b7f3d-eab2-4913-848a-baf2f2b76986 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:27:40.461520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:40.462021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:40.462460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:40.467570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:40.470624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:40.472181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:40.478615 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8deec906-f2dd-4160-991f-90fd3a20e07c req-496264c8-96af-48c4-92a9-298058eb6164 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101169 Oct 27 10:27:40.479234 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2182/4573] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:40.484708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:40.485418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:40.502229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:40.502722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:40.503174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:40.503956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:40.504411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:40.504869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:41.219763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:41.229762 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f74bbe8c-6c73-4d54-a43b-7753a9a06826 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.749295 Oct 27 10:27:41.249761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2183/4574] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:40 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:41.264484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:41.265244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:41.273479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:41.277271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:41.278618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:41.279577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:41.281820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:41.283444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:41.398960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:41.421736 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c290fb64-8463-4f95-b1ae-caaa5121451e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.993076 Oct 27 10:27:41.423024 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2392/4575] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:40 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:41.434039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:41.449686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:41.460852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:41.461831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:41.462521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:41.463498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:41.467323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:41.468295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:41.580445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:41.605779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:41.611791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:41.615883 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-518fe84b-aa57-464c-ab3c-60e2b75b2d30 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1709 microversion: 2.42 time: 0.361904 Oct 27 10:27:41.629568 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2184/4576] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:41 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1709 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:41.629568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:41.629568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:41.652963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:41.653470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:41.662731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:41.663627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:41.669301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:41.669882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:41.924943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:41.935867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:41.958113 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4926cee-8b94-49b4-a3bd-c00049bb2ac9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.526621 Oct 27 10:27:41.960057 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2393/4577] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:41 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:41.968285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:41.969275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:41.972544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:41.978595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:41.979479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:41.980430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:41.981834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:41.982801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:41.984229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:41.997013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:42.003611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:42.007230 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-18dc5a6b-f52e-4e5f-a641-1b6bfe777864 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1406 microversion: 2.20 time: 0.385424 Oct 27 10:27:42.010765 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2185/4578] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:41 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:42.055634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb07d643-a19d-4528-9c8c-9abc922b1d7a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-106900892", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": -1, "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:42.077389 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fb07d643-a19d-4528-9c8c-9abc922b1d7a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Flavor -1 could not be found. Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb07d643-a19d-4528-9c8c-9abc922b1d7a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 205 Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-106900892", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": -1, "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: exception: Flavor -1 could not be found. Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-106900892', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': -1, 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:42.079531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 27 10:27:42.083669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:42.086020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb07d643-a19d-4528-9c8c-9abc922b1d7a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:42.087314 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb07d643-a19d-4528-9c8c-9abc922b1d7a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.036119 Oct 27 10:27:42.088070 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2186/4579] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:42 2022] POST /compute/v2.1/servers => generated 73 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 27 10:27:42.096639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:42.099223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:42.107191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:42.107933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:42.108529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:42.109459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:42.110062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:42.111861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:42.458570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:42.461201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:42.471581 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8ffef07-ed8b-4a60-8821-3a0c38298727 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.379110 Oct 27 10:27:42.488687 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2187/4580] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:42 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:42.489080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:42.489080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:42.489080 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e76d5407-2730-4768-b458-f03dbcf71a95 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2372 microversion: 2.32 time: 0.517918 Oct 27 10:27:42.489080 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2394/4581] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:41 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2372 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:42.555784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:42.557347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:42.567193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:42.568420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:42.569148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:42.571785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:42.572781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:42.573486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:42.649012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:42.649832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:42.667972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:42.668388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:42.668942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:42.670635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:42.671107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:42.671550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.192644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:43.205342 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-baf75d09-0813-4e0c-aa87-db81afb991ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.669490 Oct 27 10:27:43.206234 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2395/4582] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:42 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:43.213942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b6b8970e-a065-42c9-a57f-1b6367c08591 req-ee7195e1-14d2-4ba6-a831-e4c60a989aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-deleted", "tag": "ddc37743-d9c0-4cc7-9a0d-2fc905d04b07"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:43.230507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b6b8970e-a065-42c9-a57f-1b6367c08591 req-ee7195e1-14d2-4ba6-a831-e4c60a989aa1 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.231374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b6b8970e-a065-42c9-a57f-1b6367c08591 req-ee7195e1-14d2-4ba6-a831-e4c60a989aa1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.232061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b6b8970e-a065-42c9-a57f-1b6367c08591 req-ee7195e1-14d2-4ba6-a831-e4c60a989aa1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.254336 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b6b8970e-a065-42c9-a57f-1b6367c08591 req-ee7195e1-14d2-4ba6-a831-e4c60a989aa1 service nova] Creating event network-vif-deleted:ddc37743-d9c0-4cc7-9a0d-2fc905d04b07 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:27:43.266569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:43.288837 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b6b8970e-a065-42c9-a57f-1b6367c08591 req-ee7195e1-14d2-4ba6-a831-e4c60a989aa1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055069 Oct 27 10:27:43.292523 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2396/4583] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:43.303546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:43.311880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:43.322180 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4103f74b-944d-4dcc-b9bf-03e18e9378f2 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1756 microversion: 2.42 time: 0.671993 Oct 27 10:27:43.323340 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2188/4584] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:42 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1756 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:27:43.323887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:43.324915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:43.345041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.345539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.346013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.346728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.347236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.347608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.401655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88793ffd-ffd8-4916-bd3a-deb082194d3f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-26718499", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88793ffd-ffd8-4916-bd3a-deb082194d3f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 171 Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-26718499", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-26718499', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi -1 Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:27:43.413740 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 10:27:43.418008 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:43.421388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88793ffd-ffd8-4916-bd3a-deb082194d3f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:43.422423 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88793ffd-ffd8-4916-bd3a-deb082194d3f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.026463 Oct 27 10:27:43.424389 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2189/4585] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:43 2022] POST /compute/v2.1/servers => generated 145 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:27:43.434886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:43.435952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:43.444361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.445130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.445789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.446670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.447278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.447854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.684229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:43.807817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:43.823751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:43.827867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:43.831089 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-151db4cc-0a79-422c-b7ca-424974b14953 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1406 microversion: 2.20 time: 0.532554 Oct 27 10:27:43.833597 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2397/4586] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:43 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:43.841196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:43.842242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:43.851046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.851408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:43.852000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.853016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.854202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.855209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.855786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.861720 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2391c97-00ee-41eb-9b00-c56ab066f3d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.432736 Oct 27 10:27:43.862612 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2190/4587] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:43 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:43.894804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:43.895804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:43.907237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.908098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.908764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.909641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.910231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.912853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:44.306436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:44.319797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:44.322186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:44.323798 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e6200102-14cf-4767-98f9-b0f0f436a6b4 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 2211 microversion: 2.32 time: 0.488450 Oct 27 10:27:44.324921 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2398/4588] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:43 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 2211 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:44.343563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:44.352156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:44.353386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:44.358243 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed5c6540-cb05-4951-81d2-4512d4ee0fbd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.467496 Oct 27 10:27:44.363540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:44.364373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:44.365229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:44.365397 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2191/4589] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:43 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:44.366244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:44.367135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:44.367979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:44.470865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0155eae8-2658-4b5e-a824-128edc38f2d6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-254561596", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:44.476113 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0155eae8-2658-4b5e-a824-128edc38f2d6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0155eae8-2658-4b5e-a824-128edc38f2d6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 215 Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-254561596", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-254561596', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:44.478637 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:44.482679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:44.482679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:44.482679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:44.482679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:44.482679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:44.482679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:44.482679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 10:27:44.482679 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:44.483870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0155eae8-2658-4b5e-a824-128edc38f2d6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:44.484887 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0155eae8-2658-4b5e-a824-128edc38f2d6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.018034 Oct 27 10:27:44.485920 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2192/4590] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:44 2022] POST /compute/v2.1/servers => generated 123 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:27:44.496151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:44.500355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:44.517319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:44.519789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:44.520737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:44.526174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:44.534335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:44.535078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:44.964494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:44.988224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:45.007903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:45.011191 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d956c5c-ce71-44e4-a008-c2e67c3cd8ac tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1803 microversion: 2.42 time: 0.662250 Oct 27 10:27:45.012568 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2399/4591] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:44 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1803 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:27:45.047272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:45.051550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:45.066006 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5cd30afa-be8c-43f1-858f-78b49ebc632a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.572222 Oct 27 10:27:45.066817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:45.072623 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2193/4592] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:44 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:45.083877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:45.090421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:45.091331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:45.092471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:45.094163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:45.095024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:45.101679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:45.102749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:45.120608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:45.121534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:45.122241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:45.124812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:45.128297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:45.129478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:45.201561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:45.959779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:45.978144 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b5c142c-b626-4e7b-ba9b-5c2251c0e8c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.881291 Oct 27 10:27:45.983288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:45.992348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:45.992631 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2194/4593] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:45 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:45.997772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9ede2120-949d-4ae8-b060-09702567f32d req-a4a2af65-ec98-4d5f-8e23-4518a1848d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-deleted", "tag": "83bb0a57-9239-4158-bc07-2fedf58045e6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:45.999892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:46.001306 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4536b31c-b31a-4d20-8367-80f13af810eb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1406 microversion: 2.20 time: 0.968938 Oct 27 10:27:46.019252 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2400/4594] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:45 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1406 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:46.046770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:46.054738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:46.063497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9ede2120-949d-4ae8-b060-09702567f32d req-a4a2af65-ec98-4d5f-8e23-4518a1848d68 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:46.070530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9ede2120-949d-4ae8-b060-09702567f32d req-a4a2af65-ec98-4d5f-8e23-4518a1848d68 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:46.073960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9ede2120-949d-4ae8-b060-09702567f32d req-a4a2af65-ec98-4d5f-8e23-4518a1848d68 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:46.081803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:46.086606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:46.093024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:46.093557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:46.100797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:46.101479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:46.115007 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9ede2120-949d-4ae8-b060-09702567f32d req-a4a2af65-ec98-4d5f-8e23-4518a1848d68 service nova] Creating event network-vif-deleted:83bb0a57-9239-4158-bc07-2fedf58045e6 for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:27:46.121160 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9ede2120-949d-4ae8-b060-09702567f32d req-a4a2af65-ec98-4d5f-8e23-4518a1848d68 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126904 Oct 27 10:27:46.121836 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2195/4595] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:46.130211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1062326350", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b73ac066-bd53-4096-95ed-fcf7e64a93a0"}], "security_groups": [{"name": "tempest-securitygroup--1698428402"}], "key_name": "tempest-keypair-84163679", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:46.219173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=20 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:46.325795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:46.346806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:46.348619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:46.350269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fed076c8-9e89-4a16-aa62-c1168026a39b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.328165 Oct 27 10:27:46.353205 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2401/4596] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:46 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:46.359932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] validate_networks() for [('b73ac066-bd53-4096-95ed-fcf7e64a93a0', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:27:46.366353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:46.366982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:46.380080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:46.380500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:46.382560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:46.383737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:46.385616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:46.386224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:46.692410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:46.710409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:46.715823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:46.717480 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-966d78b6-19b1-4cee-80b7-55e8a890b1e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1803 microversion: 2.42 time: 0.363292 Oct 27 10:27:46.718602 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2402/4597] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:46 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1803 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:46.724766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f6b19a2-414d-467c-b29f-a65aff79637e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1700495613", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "key_name": "tempest-key-858578283", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:46.846518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-6f6b19a2-414d-467c-b29f-a65aff79637e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] validate_networks() for [('4e40c3bf-78c6-49ec-85b4-816b286fa1de', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:27:47.476498 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6f6b19a2-414d-467c-b29f-a65aff79637e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Invalid key_name provided. Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f6b19a2-414d-467c-b29f-a65aff79637e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 246 Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1700495613", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "key_name": "tempest-key-858578283", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid key_name provided. Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1700495613', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'key_name': 'tempest-key-858578283', 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-858578283 not found for user 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:47.482170 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 27 10:27:47.486186 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:27:47.492772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f6b19a2-414d-467c-b29f-a65aff79637e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid key_name provided. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:47.493967 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f6b19a2-414d-467c-b29f-a65aff79637e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.773930 Oct 27 10:27:47.497753 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2403/4598] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:46 2022] POST /compute/v2.1/servers => generated 70 bytes in 778 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:27:47.527195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:47.528101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:47.538356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:47.539216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:47.539958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:47.541039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:47.541736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:47.543038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:47.744302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Getting quotas for project 7d1e58c4aebb4852a2b1877bf30cbb9f. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:27:47.751765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Getting quotas for user c2ba4cff95bf44a9892530e904020984 and project 7d1e58c4aebb4852a2b1877bf30cbb9f. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:27:47.756853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:47.772139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:27:47.773710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:27:47.774538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:27:47.775369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:27:47.776113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:27:47.792648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:47.793435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:47.794046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:47.795018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:47.806249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:47.807207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:47.838249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Getting quotas for project 7d1e58c4aebb4852a2b1877bf30cbb9f. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:27:47.846835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Getting quotas for user c2ba4cff95bf44a9892530e904020984 and project 7d1e58c4aebb4852a2b1877bf30cbb9f. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:27:47.863764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:27:47.868163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:27:47.925198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:47.935000 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-32312c00-a8d3-4d7d-b78c-f4a404fbc730 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.811727 Oct 27 10:27:47.942733 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2196/4599] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:27:47.949125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:47.949954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:47.957347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:47.958282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:47.958930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:47.959539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:47.960453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:47.961082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:47.961760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:47.964333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:47.966209 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cc6a7b3c-2565-45f6-a60f-3f9597b581fe tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1406 microversion: 2.20 time: 0.443678 Oct 27 10:27:47.987668 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2404/4600] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:47 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:47.997667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:47.998473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:48.006570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:48.013933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:48.014478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:48.015294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:48.015838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:48.016325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:48.094584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:48.107607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:48.109294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:48.111146 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-36be8145-515d-446c-8501-d7b2e7d622a6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.166727 Oct 27 10:27:48.112490 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2197/4601] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:47 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:48.117887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:48.118836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:48.131068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:48.131861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:48.132285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:48.133547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:48.134385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:48.134959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:48.584833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:48.597443 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54896017-31c5-4b5f-9e89-a2748ca19f62 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.608111 Oct 27 10:27:48.613374 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2405/4602] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:47 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:48.629576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:48.630968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:48.641925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:48.643342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:48.644185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:48.645512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:48.646425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:48.647157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:48.782113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:48.805258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:48.807000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:48.808220 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d2b18d73-5e48-4d0a-9b8b-2941de3456df tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1850 microversion: 2.42 time: 0.694347 Oct 27 10:27:48.808804 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2198/4603] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:48 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1850 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:48.832734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-63cf4fc7-94ee-40ab-954e-48ec7455acd7 req-7fc3a2f4-a5ac-4a31-8d9b-24b750b474cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39", "tag": "f4bf9ba7-53c2-4a70-9da2-6e9514c10258"}, {"server_uuid": "8940a824-ca7a-4b64-a49f-e6a1ad2104ec", "name": "network-vif-deleted", "tag": "5e400934-2aff-4c7a-bc1e-a86b095a134a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:48.844918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-63cf4fc7-94ee-40ab-954e-48ec7455acd7 req-7fc3a2f4-a5ac-4a31-8d9b-24b750b474cb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:48.845661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-63cf4fc7-94ee-40ab-954e-48ec7455acd7 req-7fc3a2f4-a5ac-4a31-8d9b-24b750b474cb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:48.846269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-63cf4fc7-94ee-40ab-954e-48ec7455acd7 req-7fc3a2f4-a5ac-4a31-8d9b-24b750b474cb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:48.861717 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-63cf4fc7-94ee-40ab-954e-48ec7455acd7 req-7fc3a2f4-a5ac-4a31-8d9b-24b750b474cb service nova] Creating event network-changed:f4bf9ba7-53c2-4a70-9da2-6e9514c10258 for instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 on n-h2-854663-10 Oct 27 10:27:48.862502 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-63cf4fc7-94ee-40ab-954e-48ec7455acd7 req-7fc3a2f4-a5ac-4a31-8d9b-24b750b474cb service nova] Creating event network-vif-deleted:5e400934-2aff-4c7a-bc1e-a86b095a134a for instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec on n-h1-854663-10 Oct 27 10:27:48.880750 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-63cf4fc7-94ee-40ab-954e-48ec7455acd7 req-7fc3a2f4-a5ac-4a31-8d9b-24b750b474cb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.060436 Oct 27 10:27:48.882130 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2199/4604] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:48.889854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:48.891279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:48.901945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:48.902604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:48.903280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:48.904431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:48.905105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:48.905668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:49.099188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:49.129752 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa1d5dfa-ba24-4c9c-a5a0-09d598e904fa tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1280 microversion: 2.1 time: 0.514636 Oct 27 10:27:49.130906 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2406/4605] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:48 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1280 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:49.153007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:49.154786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:49.180225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:49.185222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:49.188308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:49.189465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:49.193238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:49.194432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:49.532260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:49.545542 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-90eb3e83-0196-462a-96fd-924dacf55beb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.661979 Oct 27 10:27:49.553772 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2200/4606] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:48 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:49.559699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:49.560694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:49.587171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:49.603859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:49.607225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:49.613516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:49.614463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:49.614463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:49.616164 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c979b1d-5a82-49cc-8958-95b0673ff618 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1406 microversion: 2.20 time: 0.483649 Oct 27 10:27:49.616908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:49.618453 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2407/4607] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:49 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1406 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:49.620624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:49.625518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:49.816860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:49.838129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:49.838947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:49.854699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:49.858841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:49.860568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:49.861766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:49.863473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:49.866345 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15a70e49-91b8-427a-8d80-0f9b977d6871 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.310648 Oct 27 10:27:49.866947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:49.869705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:49.870489 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2201/4608] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:49 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:49.871238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:49.891752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f5afb88-61af-46ca-afcc-afb1a3a33fea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1396326313", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:50.289122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.security_group_api [None req-5f5afb88-61af-46ca-afcc-afb1a3a33fea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Neutron security group does_not_exist not found {{(pid=120719) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 27 10:27:50.289796 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5f5afb88-61af-46ca-afcc-afb1a3a33fea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f5afb88-61af-46ca-afcc-afb1a3a33fea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 258 Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1396326313", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1396326313', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 27 10:27:50.305400 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 27 10:27:50.309083 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:50.318229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f5afb88-61af-46ca-afcc-afb1a3a33fea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:50.319184 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f5afb88-61af-46ca-afcc-afb1a3a33fea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.445884 Oct 27 10:27:50.325619 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2202/4609] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:27:49 2022] POST /compute/v2.1/servers => generated 106 bytes in 453 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:27:50.332639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:50.333656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:50.348531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:50.349551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:50.350208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:50.351291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:50.352189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:50.352958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:50.509366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:50.520517 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b85ae6aa-ade1-4af3-b1a0-efa948e366a4 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1334 microversion: 2.1 time: 0.193290 Oct 27 10:27:50.521999 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2203/4610] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:50 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1334 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:50.527993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:50.528883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:50.536388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:50.537139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:50.537744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:50.538588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:50.540391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:50.541593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:50.591498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:50.606288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:50.616073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:50.626332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a596aad-d3da-467f-8c98-fdf1544639c6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1850 microversion: 2.42 time: 0.794357 Oct 27 10:27:50.635627 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2408/4611] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:49 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1850 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:27:50.649589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-aa0ec78f-2d46-4e34-bcda-5d303ed35d8d req-c89850b4-1ca3-4915-b316-548d28618935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "tag": "2489d5fc-eae3-43ec-b706-bb225acfc6a5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:50.671263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-aa0ec78f-2d46-4e34-bcda-5d303ed35d8d req-c89850b4-1ca3-4915-b316-548d28618935 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:50.681781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-aa0ec78f-2d46-4e34-bcda-5d303ed35d8d req-c89850b4-1ca3-4915-b316-548d28618935 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:50.682426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-aa0ec78f-2d46-4e34-bcda-5d303ed35d8d req-c89850b4-1ca3-4915-b316-548d28618935 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:50.704680 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-aa0ec78f-2d46-4e34-bcda-5d303ed35d8d req-c89850b4-1ca3-4915-b316-548d28618935 service nova] Creating event network-changed:2489d5fc-eae3-43ec-b706-bb225acfc6a5 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:27:50.710354 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-aa0ec78f-2d46-4e34-bcda-5d303ed35d8d req-c89850b4-1ca3-4915-b316-548d28618935 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073132 Oct 27 10:27:50.711217 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2409/4612] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:50.718060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:50.719101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:50.728435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:50.729176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:50.729715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:50.730559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:50.731106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:50.731877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:51.034231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:51.044242 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-070c6fc4-70a1-4219-9118-483c7f982474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.520845 Oct 27 10:27:51.065967 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2204/4613] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:50 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:51.072366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:51.073386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:51.081074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:51.081707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:51.082300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:51.083375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:51.083971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:51.084576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:51.201358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:51.212022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:51.226642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:51.228578 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c0a17b2-0141-4544-b9d1-a2e04370140b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.160993 Oct 27 10:27:51.229901 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2205/4614] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:51 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:51.234798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:51.235634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:51.254818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:51.255585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:51.262533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:51.263638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:51.264718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:51.265844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:51.824858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:51.839620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:51.841096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:51.842899 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c3be8834-80d1-4a91-8761-846ca0391198 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1406 microversion: 2.20 time: 1.130361 Oct 27 10:27:51.857133 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2410/4615] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:50 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1406 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:51.866614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a4b28287-7af2-49c7-a529-6de5a4328ca0 req-c47719b1-54b7-4074-8e3d-0c460c957bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39", "name": "network-vif-plugged", "status": "completed", "tag": "f4bf9ba7-53c2-4a70-9da2-6e9514c10258"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:51.877885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a4b28287-7af2-49c7-a529-6de5a4328ca0 req-c47719b1-54b7-4074-8e3d-0c460c957bbb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:51.878886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a4b28287-7af2-49c7-a529-6de5a4328ca0 req-c47719b1-54b7-4074-8e3d-0c460c957bbb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:51.879665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a4b28287-7af2-49c7-a529-6de5a4328ca0 req-c47719b1-54b7-4074-8e3d-0c460c957bbb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:51.892956 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a4b28287-7af2-49c7-a529-6de5a4328ca0 req-c47719b1-54b7-4074-8e3d-0c460c957bbb service nova] Creating event network-vif-plugged:f4bf9ba7-53c2-4a70-9da2-6e9514c10258 for instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 on n-h2-854663-10 Oct 27 10:27:51.901304 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a4b28287-7af2-49c7-a529-6de5a4328ca0 req-c47719b1-54b7-4074-8e3d-0c460c957bbb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039891 Oct 27 10:27:51.906840 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2411/4616] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:51.913581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:51.914836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:51.920057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:51.925182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:51.926776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:51.927627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:51.928690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:51.930276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:51.931049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.062241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:52.065478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:52.076587 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f4542da-49c9-4109-9022-06aab9f029bd tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1334 microversion: 2.1 time: 0.167673 Oct 27 10:27:52.080170 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cdd2ae16-1d36-4961-9488-3f8e570338a8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.848870 Oct 27 10:27:52.080772 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2412/4617] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:51 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1334 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:52.082209 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2206/4618] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:51 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:52.098043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:52.100946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:52.107420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a7f1c73-d0cc-4dba-bcff-5521b47eb614 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:52.108412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a7f1c73-d0cc-4dba-bcff-5521b47eb614 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: c40cdb7b-d2e9-404a-bc1e-27afbb039c65] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:52.109277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.109956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.111182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.112406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.113659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.114618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.117750 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9a7f1c73-d0cc-4dba-bcff-5521b47eb614 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance c40cdb7b-d2e9-404a-bc1e-27afbb039c65 could not be found. Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a7f1c73-d0cc-4dba-bcff-5521b47eb614 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/c40cdb7b-d2e9-404a-bc1e-27afbb039c65 HTTP/1.1 Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance c40cdb7b-d2e9-404a-bc1e-27afbb039c65 could not be found. Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'c40cdb7b-d2e9-404a-bc1e-27afbb039c65'} Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40cdb7b-d2e9-404a-bc1e-27afbb039c65 could not be found. Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40cdb7b-d2e9-404a-bc1e-27afbb039c65 could not be found. Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:52.119388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:52.123866 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:52.123866 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:52.123866 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:52.123866 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:52.123866 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:52.123866 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:52.123866 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40cdb7b-d2e9-404a-bc1e-27afbb039c65 could not be found. Oct 27 10:27:52.123866 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:52.125126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a7f1c73-d0cc-4dba-bcff-5521b47eb614 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance c40cdb7b-d2e9-404a-bc1e-27afbb039c65 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:52.126162 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a7f1c73-d0cc-4dba-bcff-5521b47eb614 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c40cdb7b-d2e9-404a-bc1e-27afbb039c65" status: 404 len: 111 microversion: 2.1 time: 0.022797 Oct 27 10:27:52.126932 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2207/4619] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:27:52 2022] DELETE /compute/v2.1/servers/c40cdb7b-d2e9-404a-bc1e-27afbb039c65 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:27:52.135277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:52.135891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:52.142362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:52.143600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.144290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.144985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.145973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.146683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.147338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.525584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:52.527558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:52.560904 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d837fab5-78c9-4784-b112-6ec3da01e442 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.429442 Oct 27 10:27:52.562166 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2208/4620] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:52 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:52.569337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:52.571044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:52.590243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:52.592065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:52.593484 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8410d470-43b1-4b84-9279-cca3c3a39e78 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1871 microversion: 2.42 time: 0.509717 Oct 27 10:27:52.605085 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2413/4621] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:52 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1871 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:52.605288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.605288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.605288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.605288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.605288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.605288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.617282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:52.617282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:52.622069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.622957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.623085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.623789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.624235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.624696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.777959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:52.794330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:52.796593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:52.799076 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ddfa8971-ad01-4f9b-bc5a-166d6e7903b9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.235577 Oct 27 10:27:52.813418 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2209/4622] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:52 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:52.828046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-da9c7e81-b4d5-4b62-aaba-1c9295ddfb61 req-e1312a55-eb3d-44ea-866e-9de718fb1991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "tag": "87e5ceb2-bb58-4ae5-852d-ee73be4cb0f3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:52.849587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-da9c7e81-b4d5-4b62-aaba-1c9295ddfb61 req-e1312a55-eb3d-44ea-866e-9de718fb1991 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.850209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-da9c7e81-b4d5-4b62-aaba-1c9295ddfb61 req-e1312a55-eb3d-44ea-866e-9de718fb1991 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.850660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-da9c7e81-b4d5-4b62-aaba-1c9295ddfb61 req-e1312a55-eb3d-44ea-866e-9de718fb1991 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.889588 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-da9c7e81-b4d5-4b62-aaba-1c9295ddfb61 req-e1312a55-eb3d-44ea-866e-9de718fb1991 service nova] Creating event network-changed:87e5ceb2-bb58-4ae5-852d-ee73be4cb0f3 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:27:52.895252 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-da9c7e81-b4d5-4b62-aaba-1c9295ddfb61 req-e1312a55-eb3d-44ea-866e-9de718fb1991 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082836 Oct 27 10:27:52.898856 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2210/4623] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:52.919206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:52.921207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:52.944108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.946465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.953519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:52.954385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:52.954919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:52.955518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:53.138957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:53.153455 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3aaf0095-88ae-4467-a873-1f51bb6d7101 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.557840 Oct 27 10:27:53.154069 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2414/4624] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:52 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:53.178439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:53.179752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:53.187665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:53.188482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:53.189146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:53.190677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:53.191360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:53.192113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:53.477937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:53.506770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:53.510722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:53.515205 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab45729e-cec7-422b-9b29-4a17a69fdb0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1406 microversion: 2.20 time: 0.614977 Oct 27 10:27:53.516990 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2211/4625] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:52 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1406 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:53.521706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e746216c-c468-4f19-bba4-327940a8a097 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:53.524990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e746216c-c468-4f19-bba4-327940a8a097 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 10:27:53.526245 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e746216c-c468-4f19-bba4-327940a8a097 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e746216c-c468-4f19-bba4-327940a8a097 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 9223372036854775808 could not be found. Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '9223372036854775808'} Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:53.528089 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:53.531756 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:53.531756 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:53.531756 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:53.531756 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 27 10:27:53.531756 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:53.531756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e746216c-c468-4f19-bba4-327940a8a097 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:53.531756 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e746216c-c468-4f19-bba4-327940a8a097 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.011458 Oct 27 10:27:53.531756 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2212/4626] 10.222.0.76 () {58 vars in 1188 bytes} [Thu Oct 27 10:27:53 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:27:53.543719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:53.544738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:53.553433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:53.554437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:53.555039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:53.555946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:53.556743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:53.557290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:53.776231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:53.786150 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3cb9954-2e66-46ce-8f39-78a6e815bf50 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1402 microversion: 2.1 time: 0.614781 Oct 27 10:27:53.790798 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2415/4627] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:53 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1402 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:53.799450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:53.815261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:53.835291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:53.836103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:53.836920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:53.837852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:53.838644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:53.839349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.061242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.077504 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-44e08cce-511e-44c4-becd-5fafc7089923 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.539603 Oct 27 10:27:54.078423 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2213/4628] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:53 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:54.090539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:54.093742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:54.121346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.121869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.122524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.123436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.124052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.124636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.295975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.314288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.315885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.322151 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b373b58e-1f84-4665-9d22-73e1e7922d92 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1871 microversion: 2.42 time: 0.529493 Oct 27 10:27:54.322898 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2416/4629] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:53 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1871 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:54.331377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:54.336816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:54.355416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.356032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.356539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.357570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.360247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.360942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.363057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.376168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.378392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.379959 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0040936-81fd-4e39-b336-d21f4baf1258 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.298216 Oct 27 10:27:54.381409 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2214/4630] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:54 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:54.541357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:54.542023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:54.552980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.556342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.556967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.557970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.559367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.560538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.800074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.817775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.823361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.832412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:54.832980 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4aa57252-728d-4110-b990-f262567d052c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.505222 Oct 27 10:27:54.834410 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2417/4631] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:54 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:54.842319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:54.843970 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c1248fa-2fbd-4b24-abf8-35d7e5274dd7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1597 microversion: 2.20 time: 0.308038 Oct 27 10:27:54.845137 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2215/4632] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:54 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1597 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:54.848786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:54.859978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a68cbe0-e5ee-452e-9096-f900031d1c7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:54.862954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a68cbe0-e5ee-452e-9096-f900031d1c7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Failed to fetch instance by id -1 {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 10:27:54.866314 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-7a68cbe0-e5ee-452e-9096-f900031d1c7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance -1 could not be found. Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a68cbe0-e5ee-452e-9096-f900031d1c7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance -1 could not be found. Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '-1'} Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:54.871211 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:54.874872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:54.874872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:54.874872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 27 10:27:54.874872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:54.885744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a68cbe0-e5ee-452e-9096-f900031d1c7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:54.887823 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a68cbe0-e5ee-452e-9096-f900031d1c7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.034850 Oct 27 10:27:54.887996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.889032 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2216/4633] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:27:54 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 10:27:54.889762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.890802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.893191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.894068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.896462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d36051ec-3b3c-4ff8-9c5a-af6334661aae tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:54.897378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d36051ec-3b3c-4ff8-9c5a-af6334661aae tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:54.897501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.913445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36051ec-3b3c-4ff8-9c5a-af6334661aae tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.914322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36051ec-3b3c-4ff8-9c5a-af6334661aae tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.915243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36051ec-3b3c-4ff8-9c5a-af6334661aae tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.916227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36051ec-3b3c-4ff8-9c5a-af6334661aae tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:54.922470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36051ec-3b3c-4ff8-9c5a-af6334661aae tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:54.923742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36051ec-3b3c-4ff8-9c5a-af6334661aae tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:54.958604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:55.145485 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d36051ec-3b3c-4ff8-9c5a-af6334661aae tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.255266 Oct 27 10:27:55.146090 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2217/4634] 10.222.0.76 () {60 vars in 1316 bytes} [Thu Oct 27 10:27:54 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:27:55.151009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:55.152323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:55.167439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:55.168325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:55.170163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:55.172419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:55.172967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:55.173434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:55.195748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:55.211360 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7ff6198-2573-425c-ba97-af98618feb79 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1402 microversion: 2.1 time: 0.372642 Oct 27 10:27:55.212122 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2418/4635] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:54 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1402 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:55.353911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:55.354680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:55.364816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:55.365460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:55.371270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:55.372178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:55.372800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:55.373349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:55.716414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:55.727896 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed9a71b8-2df5-4821-8140-278e600c07a9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.580714 Oct 27 10:27:55.741917 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2218/4636] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:55 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:55.754370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:55.755193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:55.761804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:55.762497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:55.763276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:55.764165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:55.764813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:55.765432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:56.006660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:56.018797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:56.021486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:56.023893 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-732720a8-5267-4a07-88c2-2d5cc410a350 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.280030 Oct 27 10:27:56.025093 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2219/4637] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:55 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:56.033826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-72e05b2d-6c88-464e-aebe-a70c176d8a25 req-1e2ff54a-6026-4c68-a806-fc35862dfc69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee938790-68f8-4a2d-bc35-37b63962be81", "tag": "2d25df33-e375-46be-b517-352b07423210"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:56.049792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-72e05b2d-6c88-464e-aebe-a70c176d8a25 req-1e2ff54a-6026-4c68-a806-fc35862dfc69 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:56.050488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-72e05b2d-6c88-464e-aebe-a70c176d8a25 req-1e2ff54a-6026-4c68-a806-fc35862dfc69 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:56.051479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-72e05b2d-6c88-464e-aebe-a70c176d8a25 req-1e2ff54a-6026-4c68-a806-fc35862dfc69 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:56.075471 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-72e05b2d-6c88-464e-aebe-a70c176d8a25 req-1e2ff54a-6026-4c68-a806-fc35862dfc69 service nova] Creating event network-changed:2d25df33-e375-46be-b517-352b07423210 for instance ee938790-68f8-4a2d-bc35-37b63962be81 on n-h1-854663-10 Oct 27 10:27:56.087327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-72e05b2d-6c88-464e-aebe-a70c176d8a25 req-1e2ff54a-6026-4c68-a806-fc35862dfc69 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057539 Oct 27 10:27:56.087988 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2220/4638] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:56.100789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-115b5142-90e6-44e7-9727-9c536b8a99ef req-54a98b42-87a6-408f-9aa6-af60a65d6630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "tag": "ae4d4470-a4f9-491d-b4cb-91c4398b832b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:56.115003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-115b5142-90e6-44e7-9727-9c536b8a99ef req-54a98b42-87a6-408f-9aa6-af60a65d6630 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:56.115788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-115b5142-90e6-44e7-9727-9c536b8a99ef req-54a98b42-87a6-408f-9aa6-af60a65d6630 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:56.116379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-115b5142-90e6-44e7-9727-9c536b8a99ef req-54a98b42-87a6-408f-9aa6-af60a65d6630 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:56.128946 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-115b5142-90e6-44e7-9727-9c536b8a99ef req-54a98b42-87a6-408f-9aa6-af60a65d6630 service nova] Creating event network-changed:ae4d4470-a4f9-491d-b4cb-91c4398b832b for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:27:56.150813 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-115b5142-90e6-44e7-9727-9c536b8a99ef req-54a98b42-87a6-408f-9aa6-af60a65d6630 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058980 Oct 27 10:27:56.151795 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2221/4639] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:56.159046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:56.159786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:56.168147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:56.168945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:56.169571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:56.170517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:56.171175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:56.171807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:56.226254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:56.246174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:56.258601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:56.269554 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9c13a6f-d1bc-4951-a59b-1263ddc5b429 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 0.917738 Oct 27 10:27:56.284259 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2419/4640] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:55 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:27:56.292542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:56.292542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:56.306109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:56.306623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:56.307055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:56.307969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:56.308435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:56.308885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:56.755154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:56.767591 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-421061f3-256e-4577-8555-17e3206c939a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.614192 Oct 27 10:27:56.768869 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2222/4641] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:56 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:56.793802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e0f9917-88d7-4569-b706-08fdb8710c6e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:56.794808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e0f9917-88d7-4569-b706-08fdb8710c6e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: f0323dc6-2270-46a3-953b-b3c7b2603026] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:56.801658 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-6e0f9917-88d7-4569-b706-08fdb8710c6e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance f0323dc6-2270-46a3-953b-b3c7b2603026 could not be found. Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e0f9917-88d7-4569-b706-08fdb8710c6e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/f0323dc6-2270-46a3-953b-b3c7b2603026/action HTTP/1.1 Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 19 Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: {"forceDelete": {}} Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance f0323dc6-2270-46a3-953b-b3c7b2603026 could not be found. Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f0323dc6-2270-46a3-953b-b3c7b2603026', 'body': {'forceDelete': {}}} Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0323dc6-2270-46a3-953b-b3c7b2603026 could not be found. Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0323dc6-2270-46a3-953b-b3c7b2603026 could not be found. Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:56.813081 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:56.818283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:56.818283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:56.818283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0323dc6-2270-46a3-953b-b3c7b2603026 could not be found. Oct 27 10:27:56.818283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:56.821692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e0f9917-88d7-4569-b706-08fdb8710c6e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance f0323dc6-2270-46a3-953b-b3c7b2603026 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:56.822751 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e0f9917-88d7-4569-b706-08fdb8710c6e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/f0323dc6-2270-46a3-953b-b3c7b2603026/action" status: 404 len: 111 microversion: 2.1 time: 0.034508 Oct 27 10:27:56.824341 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2223/4642] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:27:56 2022] POST /compute/v2.1/servers/f0323dc6-2270-46a3-953b-b3c7b2603026/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:27:56.833400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:56.837648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:56.842934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:56.844794 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11cf7840-b7ce-478a-a5d9-f36e8779e3d0 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1402 microversion: 2.1 time: 0.573442 Oct 27 10:27:56.845595 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2420/4643] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:56 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1402 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:56.857935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:56.860072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:56.862360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:56.865339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:56.865991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:56.866686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:57.056240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:57.057184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:57.064243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:57.065490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:57.066096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:57.066984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:57.067594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:57.068199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:57.345630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:57.359901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:57.362142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:57.365044 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-512e9898-b6a7-4ab6-bda6-cc506ad384f6 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.313248 Oct 27 10:27:57.365717 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2421/4644] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:57 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:57.386159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:57.387055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:57.426817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:57.427557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:57.429857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:57.432743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:57.433415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:57.434008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:57.734158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:57.742688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c401c2f-dc9f-44cd-aa86-452100970618 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.913871 Oct 27 10:27:57.748784 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2224/4645] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:56 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:57.776723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:57.777985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:57.786364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:57.793450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:57.794185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:57.795130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:57.795789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:57.796404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:57.848997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:57.860463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:58.395507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:58.421594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:58.425852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:58.430436 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1a78abd8-0a20-4a97-8db1-177ad7b6b3e8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 1.061889 Oct 27 10:27:58.432422 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2422/4646] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:57 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:58.448264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:58.450070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:58.472711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:58.473484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:58.473929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:58.474663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:58.475116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:58.475543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:58.615153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:58.628626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c04d242-cfb6-44c3-929d-892f36e3abed tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.855645 Oct 27 10:27:58.629528 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2225/4647] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:57 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:58.635486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:58.636328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:58.652874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:58.653660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:58.654254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:58.655480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:58.656389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:58.657008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:58.837869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:58.853215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:58.855521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:58.857226 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1bf4681-ae72-4570-80c6-bcf0caad4ed9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.226481 Oct 27 10:27:58.858019 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2226/4648] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:58 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:27:58.863997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c2cb7e92-dae7-4c7f-aea7-d17b27153cf7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:58.867433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c2cb7e92-dae7-4c7f-aea7-d17b27153cf7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 1eab6125-67fa-49e0-a1e3-c29755ea809d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:58.880769 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c2cb7e92-dae7-4c7f-aea7-d17b27153cf7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 1eab6125-67fa-49e0-a1e3-c29755ea809d could not be found. Oct 27 10:27:58.885602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c2cb7e92-dae7-4c7f-aea7-d17b27153cf7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/1eab6125-67fa-49e0-a1e3-c29755ea809d/action HTTP/1.1 Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 39 Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: {"os-getConsoleOutput": {"length": 10}} Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 1eab6125-67fa-49e0-a1e3-c29755ea809d could not be found. Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '1eab6125-67fa-49e0-a1e3-c29755ea809d', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eab6125-67fa-49e0-a1e3-c29755ea809d could not be found. Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eab6125-67fa-49e0-a1e3-c29755ea809d could not be found. Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:58.890317 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:27:58.894580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:27:58.894580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:27:58.894580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:27:58.894580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:27:58.894580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eab6125-67fa-49e0-a1e3-c29755ea809d could not be found. Oct 27 10:27:58.894580 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:27:58.895840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c2cb7e92-dae7-4c7f-aea7-d17b27153cf7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 1eab6125-67fa-49e0-a1e3-c29755ea809d could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:27:58.902136 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8cc5b644-d3d4-42bc-98de-6f09f973dfe3 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1402 microversion: 2.1 time: 0.467854 Oct 27 10:27:58.905559 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2423/4649] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:58 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1402 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:58.914421 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c2cb7e92-dae7-4c7f-aea7-d17b27153cf7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/1eab6125-67fa-49e0-a1e3-c29755ea809d/action" status: 404 len: 111 microversion: 2.1 time: 0.049276 Oct 27 10:27:58.924119 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2227/4650] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:27:58 2022] POST /compute/v2.1/servers/1eab6125-67fa-49e0-a1e3-c29755ea809d/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:27:58.924933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:58.925635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:58.937345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:58.937848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:58.938519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:58.939391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:58.940064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:58.940934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:59.164910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9cc09262-1cf4-4209-b930-4ffa7231209e req-ee26a8df-dfc4-4ebf-ae03-fc8f78bb209b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39", "tag": "f4bf9ba7-53c2-4a70-9da2-6e9514c10258"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:59.187041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9cc09262-1cf4-4209-b930-4ffa7231209e req-ee26a8df-dfc4-4ebf-ae03-fc8f78bb209b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:59.187535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9cc09262-1cf4-4209-b930-4ffa7231209e req-ee26a8df-dfc4-4ebf-ae03-fc8f78bb209b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:59.187974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9cc09262-1cf4-4209-b930-4ffa7231209e req-ee26a8df-dfc4-4ebf-ae03-fc8f78bb209b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:59.215803 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9cc09262-1cf4-4209-b930-4ffa7231209e req-ee26a8df-dfc4-4ebf-ae03-fc8f78bb209b service nova] Creating event network-changed:f4bf9ba7-53c2-4a70-9da2-6e9514c10258 for instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 on n-h2-854663-10 Oct 27 10:27:59.223794 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9cc09262-1cf4-4209-b930-4ffa7231209e req-ee26a8df-dfc4-4ebf-ae03-fc8f78bb209b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063471 Oct 27 10:27:59.225566 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2228/4651] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:27:59.370078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:59.393838 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6dccd701-1abc-47c6-97cc-cf53f30effc8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.460917 Oct 27 10:27:59.394579 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2424/4652] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:58 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:59.431478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:59.432217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:59.440167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:59.440683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:59.441144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:59.441856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:59.442313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:59.442744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:59.462350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:59.463559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:59.475173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:59.475978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:59.476622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:59.478824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:59.479468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:59.484042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:00.010199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:00.020993 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-98b4b7e5-526f-401c-ba94-6428010a75d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.599124 Oct 27 10:28:00.025112 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2229/4653] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:59 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:00.034145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:00.042559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:00.049648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:00.056911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:00.057648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:00.059340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:00.060403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:00.061450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:00.079149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:00.094774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:00.097500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:00.102090 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d34f503-8232-4ff9-8fdc-3423a6a9cf41 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 0.643539 Oct 27 10:28:00.103097 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2425/4654] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:27:59 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:28:00.112470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:00.115818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:00.130446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:00.132643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:00.133452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:00.137076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:00.137884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:00.138484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:00.257812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:00.272626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:00.276566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:00.280089 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-24db7707-add4-4a55-a44c-6bcc4b818b3f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.249820 Oct 27 10:28:00.281301 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2230/4655] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:00 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:00.294919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f8f6004e-cf69-4ede-9015-ff077ecaef1c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:00.295724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f8f6004e-cf69-4ede-9015-ff077ecaef1c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 4234580e-ce59-403d-81c8-c1de3b2ac8a7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:00.309590 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f8f6004e-cf69-4ede-9015-ff077ecaef1c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 4234580e-ce59-403d-81c8-c1de3b2ac8a7 could not be found. Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f8f6004e-cf69-4ede-9015-ff077ecaef1c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/4234580e-ce59-403d-81c8-c1de3b2ac8a7 HTTP/1.1 Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 4234580e-ce59-403d-81c8-c1de3b2ac8a7 could not be found. Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '4234580e-ce59-403d-81c8-c1de3b2ac8a7'} Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4234580e-ce59-403d-81c8-c1de3b2ac8a7 could not be found. Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4234580e-ce59-403d-81c8-c1de3b2ac8a7 could not be found. Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:00.311399 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:00.315794 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:00.315794 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:00.315794 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:00.315794 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4234580e-ce59-403d-81c8-c1de3b2ac8a7 could not be found. Oct 27 10:28:00.315794 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:00.329774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f8f6004e-cf69-4ede-9015-ff077ecaef1c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 4234580e-ce59-403d-81c8-c1de3b2ac8a7 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:00.331706 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f8f6004e-cf69-4ede-9015-ff077ecaef1c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/4234580e-ce59-403d-81c8-c1de3b2ac8a7" status: 404 len: 111 microversion: 2.1 time: 0.049266 Oct 27 10:28:00.335209 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2231/4656] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:00 2022] GET /compute/v2.1/servers/4234580e-ce59-403d-81c8-c1de3b2ac8a7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:28:00.346083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:00.348526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:00.379630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:00.380357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:00.381128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:00.382463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:00.383254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:00.383926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:00.466888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:00.485038 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d152544f-afaa-48cd-8585-b4e573375387 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1402 microversion: 2.1 time: 0.379416 Oct 27 10:28:00.496716 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2426/4657] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:00 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1402 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:00.724019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:00.732053 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc5340e7-0c96-4ba4-bc68-2632748a1427 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.394099 Oct 27 10:28:00.762265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:00.763289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:00.768570 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2232/4658] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:00 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:00.770568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:00.771270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:00.771878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:00.772794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:00.776019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:00.776713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:01.132355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:01.133678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:01.144314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:01.145012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:01.145961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:01.146954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:01.147561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:01.148143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:01.595741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:01.612104 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54b56b1d-99a6-4f2b-9c66-b57e4400bddb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.853685 Oct 27 10:28:01.616219 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2427/4659] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:00 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:01.639464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3395ab1d-9e39-4d10-9b53-6fe5fb1c14d9 req-f217a32a-2d35-4ceb-b135-6e6a340646e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "tag": "5f638a13-8e41-4eb0-9395-0e98a33d43bd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:01.670536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3395ab1d-9e39-4d10-9b53-6fe5fb1c14d9 req-f217a32a-2d35-4ceb-b135-6e6a340646e0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:01.671239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3395ab1d-9e39-4d10-9b53-6fe5fb1c14d9 req-f217a32a-2d35-4ceb-b135-6e6a340646e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:01.673812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3395ab1d-9e39-4d10-9b53-6fe5fb1c14d9 req-f217a32a-2d35-4ceb-b135-6e6a340646e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:01.703684 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3395ab1d-9e39-4d10-9b53-6fe5fb1c14d9 req-f217a32a-2d35-4ceb-b135-6e6a340646e0 service nova] Creating event network-changed:5f638a13-8e41-4eb0-9395-0e98a33d43bd for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:01.723123 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3395ab1d-9e39-4d10-9b53-6fe5fb1c14d9 req-f217a32a-2d35-4ceb-b135-6e6a340646e0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104370 Oct 27 10:28:01.725105 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2428/4660] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:01.741647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:01.745429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:01.762693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:01.766762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:01.768085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:01.771174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:01.772289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:01.774174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:02.062748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:02.083349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:02.086605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:02.089664 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8913f517-8539-4123-826c-5baa09628142 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.361039 Oct 27 10:28:02.091034 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2429/4661] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:01 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:02.099035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:02.099898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:02.108051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:02.108823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:02.109406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:02.110294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:02.111000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:02.111744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:02.368101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:02.380720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:02.389455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:02.390891 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1908beca-07fc-4735-9f0f-cee46d6e890b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 1.263325 Oct 27 10:28:02.391457 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2233/4662] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:01 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:02.402174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-855b0fd9-1f3b-4dea-8ef4-c103cf9aea1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-192830031", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-855b0fd9-1f3b-4dea-8ef4-c103cf9aea1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 237 Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-192830031", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-192830031', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:02.427002 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-855b0fd9-1f3b-4dea-8ef4-c103cf9aea1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:02.431295 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-855b0fd9-1f3b-4dea-8ef4-c103cf9aea1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036029 Oct 27 10:28:02.434083 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2234/4663] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:28:02.444709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:02.445476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:02.467845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:02.468519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:02.469712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:02.471491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:02.472775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:02.473376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:03.079441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:03.087679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:03.091045 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a50951c5-3f3a-45bd-8164-a22aea7eee36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1402 microversion: 2.1 time: 0.998573 Oct 27 10:28:03.097600 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2430/4664] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:02 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1402 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:03.107674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-07c3452a-84a4-4ab1-a5f7-77a7ff1e31d4 req-f7e64c1c-22a9-40e5-94e4-d73aa22fb1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee938790-68f8-4a2d-bc35-37b63962be81", "name": "network-vif-plugged", "status": "completed", "tag": "2d25df33-e375-46be-b517-352b07423210"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:03.134540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-07c3452a-84a4-4ab1-a5f7-77a7ff1e31d4 req-f7e64c1c-22a9-40e5-94e4-d73aa22fb1b1 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:03.135050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-07c3452a-84a4-4ab1-a5f7-77a7ff1e31d4 req-f7e64c1c-22a9-40e5-94e4-d73aa22fb1b1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:03.135491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-07c3452a-84a4-4ab1-a5f7-77a7ff1e31d4 req-f7e64c1c-22a9-40e5-94e4-d73aa22fb1b1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:03.166432 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-07c3452a-84a4-4ab1-a5f7-77a7ff1e31d4 req-f7e64c1c-22a9-40e5-94e4-d73aa22fb1b1 service nova] Creating event network-vif-plugged:2d25df33-e375-46be-b517-352b07423210 for instance ee938790-68f8-4a2d-bc35-37b63962be81 on n-h1-854663-10 Oct 27 10:28:03.175620 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-07c3452a-84a4-4ab1-a5f7-77a7ff1e31d4 req-f7e64c1c-22a9-40e5-94e4-d73aa22fb1b1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074179 Oct 27 10:28:03.177689 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2431/4665] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:03.189189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:03.194467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:03.205410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:03.210874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:03.211578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:03.212481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:03.213134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:03.214026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:03.338356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:03.348990 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2975ccf1-7018-48df-83b8-71f72c336b69 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.912943 Oct 27 10:28:03.349602 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2235/4666] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:02 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:03.384059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:03.386464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:03.398270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:03.399865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:03.400489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:03.401538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:03.402153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:03.402735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:03.434638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:03.462907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:03.465721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:03.468875 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f57cf927-81fa-4f6c-b673-84ca79a5d64b tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.288454 Oct 27 10:28:03.473685 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2432/4667] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:03 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:03.500649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:03.502405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:03.522362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:03.526043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:03.526716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:03.529831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:03.532013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:03.534299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:03.965217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:03.974030 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f44d8b4-6cf7-480d-a3ff-67813f4117b9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.598952 Oct 27 10:28:03.975302 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2236/4668] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:03 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:03.981621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8fec447d-6068-4a94-a99e-90ec7ccbb3af req-727e3a09-df64-44da-a66c-a5ffa2ba9025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "tag": "0286aa77-bd3b-489b-9904-21ccf8dc4f03"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:03.991413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8fec447d-6068-4a94-a99e-90ec7ccbb3af req-727e3a09-df64-44da-a66c-a5ffa2ba9025 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:03.992251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8fec447d-6068-4a94-a99e-90ec7ccbb3af req-727e3a09-df64-44da-a66c-a5ffa2ba9025 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:03.992922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8fec447d-6068-4a94-a99e-90ec7ccbb3af req-727e3a09-df64-44da-a66c-a5ffa2ba9025 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:04.014863 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8fec447d-6068-4a94-a99e-90ec7ccbb3af req-727e3a09-df64-44da-a66c-a5ffa2ba9025 service nova] Creating event network-changed:0286aa77-bd3b-489b-9904-21ccf8dc4f03 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:04.020208 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8fec447d-6068-4a94-a99e-90ec7ccbb3af req-727e3a09-df64-44da-a66c-a5ffa2ba9025 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042419 Oct 27 10:28:04.021113 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2237/4669] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:04.124868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:04.125967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:04.145291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:04.146262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:04.146796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:04.147623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:04.148087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:04.148521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:04.172620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:04.192133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:04.196639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:04.197977 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98d44e7f-a81f-4efe-ac1f-a6ec10efe3ec tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 0.722924 Oct 27 10:28:04.203920 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2433/4670] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:03 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:04.212314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80604ac2-5dc2-481b-b36c-0257950ecbe4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1332171771", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80604ac2-5dc2-481b-b36c-0257950ecbe4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 235 Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1332171771", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1332171771', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:04.235768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80604ac2-5dc2-481b-b36c-0257950ecbe4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:04.240501 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80604ac2-5dc2-481b-b36c-0257950ecbe4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.031983 Oct 27 10:28:04.246664 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2434/4671] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:04 2022] POST /compute/v2.1/servers => generated 133 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:28:04.256290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:04.256938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:04.268041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:04.268516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:04.268980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:04.270399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:04.271009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:04.272713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:04.714127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:04.722737 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ff4c25c-e629-46c7-98ae-1846a0c7a615 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.471627 Oct 27 10:28:04.733937 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2435/4672] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:04 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:04.768133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:04.769095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:04.774921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:04.788418 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bdfc68cd-05f4-42b0-8dd2-a2218b89ca36 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1402 microversion: 2.1 time: 0.668183 Oct 27 10:28:04.793825 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2238/4673] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:04 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1402 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:04.801888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:04.804683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:04.809395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:04.810045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:04.811163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:04.812245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:04.813016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:04.816202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:04.822993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:04.823974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:04.824580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:04.825932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:04.826873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:04.827561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:05.052225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:05.081194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:05.083764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:05.085310 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5c53548-47b7-410a-b684-dcb2a2ad19a1 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.354268 Oct 27 10:28:05.087076 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2436/4674] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:04 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:05.233313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:05.234702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:05.240820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:05.241384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:05.241895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:05.242728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:05.243392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:05.243881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:05.327264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:05.337148 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac1cb2f3-4691-4d1f-b0dc-3fe7efd4082d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.541770 Oct 27 10:28:05.337868 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2239/4675] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:04 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:05.360293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f384a3f3-dc06-40aa-ab49-6e190889ac4e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:05.360851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f384a3f3-dc06-40aa-ab49-6e190889ac4e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 935b7979-fb0f-4852-8751-a882ceaab96b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:05.366441 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f384a3f3-dc06-40aa-ab49-6e190889ac4e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 935b7979-fb0f-4852-8751-a882ceaab96b could not be found. Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f384a3f3-dc06-40aa-ab49-6e190889ac4e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/935b7979-fb0f-4852-8751-a882ceaab96b/action HTTP/1.1 Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 13 Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: {"pause": {}} Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 935b7979-fb0f-4852-8751-a882ceaab96b could not be found. Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '935b7979-fb0f-4852-8751-a882ceaab96b', 'body': {'pause': {}}} Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935b7979-fb0f-4852-8751-a882ceaab96b could not be found. Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935b7979-fb0f-4852-8751-a882ceaab96b could not be found. Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:05.372629 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:05.378890 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:05.378890 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:05.378890 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935b7979-fb0f-4852-8751-a882ceaab96b could not be found. Oct 27 10:28:05.378890 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:05.378890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f384a3f3-dc06-40aa-ab49-6e190889ac4e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 935b7979-fb0f-4852-8751-a882ceaab96b could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:05.378890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f384a3f3-dc06-40aa-ab49-6e190889ac4e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/935b7979-fb0f-4852-8751-a882ceaab96b/action" status: 404 len: 111 microversion: 2.1 time: 0.018036 Oct 27 10:28:05.378890 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2240/4676] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:05 2022] POST /compute/v2.1/servers/935b7979-fb0f-4852-8751-a882ceaab96b/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:28:05.384111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:05.384900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:05.392931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:05.395326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:05.396134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:05.396756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:05.398246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:05.399048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:05.399777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:05.838897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:05.851837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:05.854778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:05.858743 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c2c66b9-b9f9-4d07-87b1-186ca3b9f7f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 0.629299 Oct 27 10:28:05.859997 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2437/4677] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:05 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:05.877420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:05.878324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:05.888730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:05.889467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:05.889897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:05.890835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:05.891438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:05.891890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:05.941152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:05.953643 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38965542-dc82-4c33-a1c4-3c864e468983 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.573716 Oct 27 10:28:05.954633 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2241/4678] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:05 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:05.978687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:05.979610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:05.986210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:05.986866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:05.987727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:05.988581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:05.989186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.001346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.012847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:06.395727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:06.412583 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d820de6-f477-4953-983e-88bb8d7ebdc5 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1590 microversion: 2.1 time: 0.550490 Oct 27 10:28:06.417588 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2438/4679] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:05 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1590 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:06.430327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:06.443602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:06.444288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:06.451428 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb7245ae-083b-4e0a-a49b-a8e308745361 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.476873 Oct 27 10:28:06.452444 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2242/4680] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:05 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:06.457153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1274d719-b0a3-4ab2-85ca-04732d12ee2d req-11d8f9f1-0519-4999-9124-9cbf06450af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "tag": "4b8708b4-e00c-4c04-aea0-e5d41c4d43c1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:06.462293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.463091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.463992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.465579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.467245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.468900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.483434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1274d719-b0a3-4ab2-85ca-04732d12ee2d req-11d8f9f1-0519-4999-9124-9cbf06450af6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.483916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1274d719-b0a3-4ab2-85ca-04732d12ee2d req-11d8f9f1-0519-4999-9124-9cbf06450af6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.484343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1274d719-b0a3-4ab2-85ca-04732d12ee2d req-11d8f9f1-0519-4999-9124-9cbf06450af6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.506986 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1274d719-b0a3-4ab2-85ca-04732d12ee2d req-11d8f9f1-0519-4999-9124-9cbf06450af6 service nova] Creating event network-changed:4b8708b4-e00c-4c04-aea0-e5d41c4d43c1 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:06.512845 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1274d719-b0a3-4ab2-85ca-04732d12ee2d req-11d8f9f1-0519-4999-9124-9cbf06450af6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058887 Oct 27 10:28:06.513989 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2243/4681] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:06.519566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-64bdcd15-6bce-4a52-88cf-b2b02a3cb624 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:06.520329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-64bdcd15-6bce-4a52-88cf-b2b02a3cb624 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:06.527412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64bdcd15-6bce-4a52-88cf-b2b02a3cb624 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.528137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64bdcd15-6bce-4a52-88cf-b2b02a3cb624 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.528755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64bdcd15-6bce-4a52-88cf-b2b02a3cb624 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.529798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64bdcd15-6bce-4a52-88cf-b2b02a3cb624 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.530403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64bdcd15-6bce-4a52-88cf-b2b02a3cb624 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.531006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64bdcd15-6bce-4a52-88cf-b2b02a3cb624 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.713140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:06.732640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:06.735938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:06.737866 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4552a93-44d9-4316-bba8-c44a9752555f tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.309362 Oct 27 10:28:06.739229 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2439/4682] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:06 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:06.744884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-afcf1b56-12d6-464f-aae6-915af8bf6d55 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:06.745609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-afcf1b56-12d6-464f-aae6-915af8bf6d55 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:06.746213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-64bdcd15-6bce-4a52-88cf-b2b02a3cb624 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.230763 Oct 27 10:28:06.747136 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2244/4683] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:28:06 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:06.753071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcf1b56-12d6-464f-aae6-915af8bf6d55 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.753825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcf1b56-12d6-464f-aae6-915af8bf6d55 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.754493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcf1b56-12d6-464f-aae6-915af8bf6d55 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.755409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcf1b56-12d6-464f-aae6-915af8bf6d55 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.755862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcf1b56-12d6-464f-aae6-915af8bf6d55 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.756286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcf1b56-12d6-464f-aae6-915af8bf6d55 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.853104 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-afcf1b56-12d6-464f-aae6-915af8bf6d55 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 202 len: 0 microversion: 2.1 time: 0.112123 Oct 27 10:28:06.859779 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2440/4684] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:06 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:28:06.864275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:06.865023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:06.876580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.890460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:06.891468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:06.893774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.894467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.895407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.897212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.898057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.905848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.907205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.907875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:06.910017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:06.912096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:06.913186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:08.351230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:08.367778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:08.369988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:08.370775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:08.373151 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-630a3d6f-70c6-4b0c-a35b-947d78bfb71c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 1.488710 Oct 27 10:28:08.381199 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6450133e-9ef5-480f-a3dd-7ac8911bf881 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1511 microversion: 2.1 time: 1.520848 Oct 27 10:28:08.382975 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2245/4685] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:06 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1511 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:08.394327 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2441/4686] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:06 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:28:08.399540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:08.400435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:08.408144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:08.409429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:08.410091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:08.411101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:08.411773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:08.412755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:08.592905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:08.604432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:08.606765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:08.608651 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54fcf603-8af3-45ec-86dc-b9cf60b5a371 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.224212 Oct 27 10:28:08.609420 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2246/4687] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:08 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:08.632840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c843a018-1fb6-46d0-b726-5af057bc0087 req-360320a5-f517-4829-b1e6-96d22bb78e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "tag": "782e6f7a-0715-4c1e-b24d-1ac485672640"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:08.644071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c843a018-1fb6-46d0-b726-5af057bc0087 req-360320a5-f517-4829-b1e6-96d22bb78e77 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:08.644886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c843a018-1fb6-46d0-b726-5af057bc0087 req-360320a5-f517-4829-b1e6-96d22bb78e77 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:08.645486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c843a018-1fb6-46d0-b726-5af057bc0087 req-360320a5-f517-4829-b1e6-96d22bb78e77 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:08.660921 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c843a018-1fb6-46d0-b726-5af057bc0087 req-360320a5-f517-4829-b1e6-96d22bb78e77 service nova] Creating event network-changed:782e6f7a-0715-4c1e-b24d-1ac485672640 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:08.670424 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c843a018-1fb6-46d0-b726-5af057bc0087 req-360320a5-f517-4829-b1e6-96d22bb78e77 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041251 Oct 27 10:28:08.671229 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2442/4688] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:09.399755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:09.408754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:09.409985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:09.412735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:09.435965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:09.438740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:09.439584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:09.439713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:09.440338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:09.441258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:09.442257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:09.443665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:09.444730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:09.445442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:09.445981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:09.450854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.488132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:10.501366 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-259f0654-3081-4c62-a8e2-b3f6144f0b06 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1491 microversion: 2.1 time: 1.099554 Oct 27 10:28:10.501989 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2443/4689] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:09 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1491 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:10.512848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:10.514066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:10.527510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:10.538428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.541318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.543424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:10.544187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.546541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.549327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:10.549726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.550370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.553285 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c33efd9c-cb93-4a2c-b7a8-4c1f5cc10058 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 1.157011 Oct 27 10:28:10.557309 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2247/4690] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:09 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:10.575134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:10.575935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:10.590737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.597644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.598648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.599682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.600285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.600885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.658191 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Cannot 'pause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state paused Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action HTTP/1.1 Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 13 Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: {"pause": {}} Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot 'pause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state paused Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df', 'body': {'pause': {}}} Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df in vm_state paused. Cannot pause while the instance is in this state. Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state paused Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:10.660423 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:10.664606 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:10.664606 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:10.664606 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:10.664606 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state paused Oct 27 10:28:10.664606 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:10.667088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 409 to user: Cannot 'pause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state paused {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:10.668590 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d95aa40c-c7ad-4c0a-bb37-2e8012e000c8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 409 len: 143 microversion: 2.1 time: 0.108734 Oct 27 10:28:10.669842 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2248/4691] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:10 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 143 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:28:10.690249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81dbdd87-fb04-490f-9846-308125f900d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:10.693744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-81dbdd87-fb04-490f-9846-308125f900d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:10.699336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:10.715286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81dbdd87-fb04-490f-9846-308125f900d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.715946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81dbdd87-fb04-490f-9846-308125f900d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.716456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81dbdd87-fb04-490f-9846-308125f900d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.717333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:10.718275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81dbdd87-fb04-490f-9846-308125f900d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.720201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:10.720982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81dbdd87-fb04-490f-9846-308125f900d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.721484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81dbdd87-fb04-490f-9846-308125f900d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.727466 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-facacb44-83ef-4031-9833-ee145d47e5ef tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1605 microversion: 2.32 time: 0.223830 Oct 27 10:28:10.728501 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2444/4692] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:10 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:10.896583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:10.897293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:10.907960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81dbdd87-fb04-490f-9846-308125f900d7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 202 len: 0 microversion: 2.1 time: 0.232839 Oct 27 10:28:10.917791 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2249/4693] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:10 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:28:10.922727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.923153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.923582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.937816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.938578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.939663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.941511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:10.946723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:10.970176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.971992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.972106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:10.974596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:10.977561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:10.978409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:11.517434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:11.527477 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78cae6ea-c56b-4ae2-944a-fe67b3025d73 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1590 microversion: 2.1 time: 0.635623 Oct 27 10:28:11.528800 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2445/4694] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:10 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1590 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:11.534907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1c52496d-8417-4e5d-9234-c1b30f26294f req-dfbaa93c-55cf-4cdd-8895-07631eeedc79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee938790-68f8-4a2d-bc35-37b63962be81", "tag": "2d25df33-e375-46be-b517-352b07423210"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:11.546087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1c52496d-8417-4e5d-9234-c1b30f26294f req-dfbaa93c-55cf-4cdd-8895-07631eeedc79 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:11.546858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1c52496d-8417-4e5d-9234-c1b30f26294f req-dfbaa93c-55cf-4cdd-8895-07631eeedc79 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:11.547573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1c52496d-8417-4e5d-9234-c1b30f26294f req-dfbaa93c-55cf-4cdd-8895-07631eeedc79 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:11.564136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:11.570920 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1c52496d-8417-4e5d-9234-c1b30f26294f req-dfbaa93c-55cf-4cdd-8895-07631eeedc79 service nova] Creating event network-changed:2d25df33-e375-46be-b517-352b07423210 for instance ee938790-68f8-4a2d-bc35-37b63962be81 on n-h1-854663-10 Oct 27 10:28:11.577122 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5e41f33-b390-4eea-b5cf-bd9cabb048eb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1498 microversion: 2.1 time: 0.655469 Oct 27 10:28:11.578294 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2250/4695] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:10 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1498 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:11.592515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:11.595934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:11.596222 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1c52496d-8417-4e5d-9234-c1b30f26294f req-dfbaa93c-55cf-4cdd-8895-07631eeedc79 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062358 Oct 27 10:28:11.598526 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2446/4696] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:11.614615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:11.616102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:11.616798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:11.618139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:11.618767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:11.619356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:11.756594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:11.757626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:11.768690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:11.772845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:11.773603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:11.774573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:11.777904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:11.778596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:11.868604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:11.870344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:11.871065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:11.871688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lazy-loading 'fault' on Instance uuid 8940a824-ca7a-4b64-a49f-e6a1ad2104ec {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:28:12.055886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:12.063915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:12.065764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb951a3d90647148776d44816f51fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065058d531b2447286141abf2292e6f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:12.067153 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1027110d-1a68-4f1d-a664-672fbf3c3f20 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 200 len: 1372 microversion: 2.32 time: 0.315323 Oct 27 10:28:12.068567 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2447/4697] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:11 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 1372 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:28:12.504689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:12.533471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:12.536284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:12.540500 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-580fb0f3-eac3-47b3-b682-f4e76b08665b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 0.955285 Oct 27 10:28:12.547673 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2251/4698] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:11 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:28:12.606379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:12.606993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:12.620394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:12.621328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:12.621774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:12.622485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:12.622932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:12.625937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:12.950196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:12.964553 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdbfa594-dc31-4831-8802-dd0ade6eff1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.362380 Oct 27 10:28:12.978403 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2448/4699] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:12 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:12.993774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:12.994592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:13.003748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.004651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.005201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:13.006021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.006544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.007067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:13.107424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:13.108108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:13.114598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.115298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.115880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:13.116897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.117500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.118067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:13.121687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:13.138122 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] HTTP exception thrown: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Request method failure captured: Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec HTTP/1.1 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWluv-Ng9DyxCwLu3rLu2jxFNVn1Yqy4HujFQPt6E-410rwaLUJi9Vzg1dlsfExW1Fj6kAqhcCLo_u1BqrJyU4rtYoW8ozifreLK-GPMYmYX-47v6S2xPyh53-ChK2bktQaqcEEXq3GuUjQPtjOUeaOwrnnYoMMxK-fHTAbY-pCTe12w Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 065058d531b2447286141abf2292e6f3 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TaggedBootDevicesTest-758595520 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/065058d531b2447286141abf2292e6f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/065058d531b2447286141abf2292e6f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_065058d531b2447286141abf2292e6f3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/065058d531b2447286141abf2292e6f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TaggedBootDevicesTest-758595520 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 065058d531b2447286141abf2292e6f3 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TaggedBootDevicesTest-758595520 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TaggedBootDevicesTest-758595520-project Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6cb951a3d90647148776d44816f51fb2 Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TaggedBootDevicesTest-758595520-project Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '8940a824-ca7a-4b64-a49f-e6a1ad2104ec'} Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:13.140057 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.145184 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:13.145184 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:13.145184 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:13.145184 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:13.145184 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:13.145184 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:13.145184 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.146922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Returning 404 to user: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:13.148133 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ecdadd3-1f7d-4d3f-99fb-3eea95c02dd9 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 404 len: 111 microversion: 2.32 time: 0.045229 Oct 27 10:28:13.149105 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2449/4700] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:13 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:28:13.160431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7c068e1-a3e9-4885-9308-e24f4f947b37 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '.version_select at 0x7f6d5a9e6700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:13.189181 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7c068e1-a3e9-4885-9308-e24f4f947b37 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1811059652" status: 204 len: 0 microversion: 2.32 time: 0.035286 Oct 27 10:28:13.190550 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2450/4701] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:28:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1811059652 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:28:13.446217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:13.449139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:13.449912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:13.482717 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2bb5d316-ceab-440b-a5c2-7a5a3e6e879b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.471786 Oct 27 10:28:13.483417 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2252/4702] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:12 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:13.490218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.492318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.493175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:13.498327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.500649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.502224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:13.506098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:13.511398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:13.539987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.539987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.539987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:13.542430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.542916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.543353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:13.584188 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0/action HTTP/1.1 Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 28 Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: {"reboot": {"type": "SOFT"}} Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '7616ad90-cb36-470d-967c-aca1f4bbd5e0', 'body': {'reboot': {'type': 'SOFT'}}} Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:13.587256 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:13.593790 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-47d66148-e596-40b2-9326-b9084c4408c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0/action" status: 404 len: 111 microversion: 2.1 time: 0.087360 Oct 27 10:28:13.597628 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2253/4703] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:13 2022] POST /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0/action => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:28:13.610001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:13.610635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:13.626966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.627462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.628316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:13.630694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:13.633394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:13.634705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:14.420578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:14.431559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56ccda06-7b75-40ad-85dd-7b68816bf311 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.988229 Oct 27 10:28:14.432161 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2451/4704] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:13 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:14.444807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:14.446860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:14.455044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:14.455845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:14.456278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:14.457013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:14.457428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:14.457876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:14.602961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:14.622547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:14.624328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:14.625494 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-98ad416b-6086-48a1-8a71-90970e4983d1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1892 microversion: 2.42 time: 1.026868 Oct 27 10:28:14.626796 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2254/4705] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:13 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1892 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:14.631490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:14.632088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:14.639466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:14.640120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:14.640904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:14.641769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:14.642353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:14.642904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:14.907403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:14.918968 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e039a19f-9d90-400e-9e70-499675dc3c56 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.485320 Oct 27 10:28:14.919896 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2452/4706] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:14 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:14.947621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:14.948233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:14.954536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:14.955020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:14.955462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:14.956152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:14.956606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:14.957058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.050159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:15.065785 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b3bb46df-28aa-422e-b771-5232a2a2b0f0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.437745 Oct 27 10:28:15.067523 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2255/4707] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:14 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:15.100047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:15.102710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:15.110076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.110931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.111596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.112716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.113388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.114026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.381235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:15.398985 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e411027-07d3-4032-84b1-4c4678bb1675 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.455890 Oct 27 10:28:15.400157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2453/4708] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:14 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:15.422897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-600aea56-5818-4eb6-b2a0-78e55e29d4be tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:15.426095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-600aea56-5818-4eb6-b2a0-78e55e29d4be tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: b30c9ef5-6d92-40b1-9db8-937b18cd240a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:15.440239 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-600aea56-5818-4eb6-b2a0-78e55e29d4be tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance b30c9ef5-6d92-40b1-9db8-937b18cd240a could not be found. Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-600aea56-5818-4eb6-b2a0-78e55e29d4be tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/b30c9ef5-6d92-40b1-9db8-937b18cd240a/action HTTP/1.1 Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 28 Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: {"reboot": {"type": "SOFT"}} Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b30c9ef5-6d92-40b1-9db8-937b18cd240a could not be found. Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b30c9ef5-6d92-40b1-9db8-937b18cd240a', 'body': {'reboot': {'type': 'SOFT'}}} Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30c9ef5-6d92-40b1-9db8-937b18cd240a could not be found. Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30c9ef5-6d92-40b1-9db8-937b18cd240a could not be found. Oct 27 10:28:15.442654 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:15.447242 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:15.447242 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:15.447242 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:15.447242 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:15.447242 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:15.447242 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:15.447242 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:15.447242 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30c9ef5-6d92-40b1-9db8-937b18cd240a could not be found. Oct 27 10:28:15.447242 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:15.450684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-600aea56-5818-4eb6-b2a0-78e55e29d4be tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance b30c9ef5-6d92-40b1-9db8-937b18cd240a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:15.451777 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-600aea56-5818-4eb6-b2a0-78e55e29d4be tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/b30c9ef5-6d92-40b1-9db8-937b18cd240a/action" status: 404 len: 111 microversion: 2.1 time: 0.033623 Oct 27 10:28:15.452712 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2454/4709] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:15 2022] POST /compute/v2.1/servers/b30c9ef5-6d92-40b1-9db8-937b18cd240a/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:28:15.462687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:15.463190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:15.471825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.472829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.473269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.474074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.474552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.474950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.494168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:15.503746 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7198ea86-c8b9-4485-9345-055e18feaaed tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.409252 Oct 27 10:28:15.517384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2256/4710] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:15 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:15.531537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:15.532438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:15.539975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.540727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.541333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.542215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.542663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.543231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.909341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:15.919479 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b16f167-6938-4a24-8dfa-9042cf070ab9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.462457 Oct 27 10:28:15.925908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:15.934316 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2455/4711] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:15 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:15.936786 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7b4da76-b853-4bf8-a8e4-b7810dddb3e1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.411887 Oct 27 10:28:15.939327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:15.939870 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2257/4712] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:15 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:15.951595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:15.952391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:15.956829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:15.961748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.962926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.963693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.964544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.965252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.965820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.974156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.979740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.980489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:15.981819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:15.982418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:15.982988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:16.589253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:16.608327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6afd9ea3-c8a0-48d5-84ab-2e4a2a982216 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.661105 Oct 27 10:28:16.609064 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2258/4713] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:15 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:16.628425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1087030440", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9405a813-2b98-46c3-9126-2e0aba2c6166"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:16.695686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:16.728352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:16.729835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:16.731129 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3bfef89-93d3-43d9-88a4-866b3cab474c tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.795688 Oct 27 10:28:16.731626 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2456/4714] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:15 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:16.770320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] validate_networks() for [('9405a813-2b98-46c3-9126-2e0aba2c6166', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:28:16.776600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:16.781513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:16.789945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:16.790677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:16.791362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:16.792427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:16.793054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:16.793664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:16.811318 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0/action HTTP/1.1 Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 65 Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '7616ad90-cb36-470d-967c-aca1f4bbd5e0', 'body': {'rebuild': {'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a'}}} Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 10:28:16.813498 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:16.818335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:16.819954 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9519857d-2f13-4df1-b2ff-f6bba9ced948 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0/action" status: 404 len: 111 microversion: 2.1 time: 0.084392 Oct 27 10:28:16.822576 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2457/4715] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:16 2022] POST /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:28:16.831243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:16.832239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:16.839964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:16.841534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:16.842199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:16.843189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:16.844008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:16.844679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:17.903960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:17.914338 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b883e59-b0a8-48fb-8c14-526ab063f93f tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 1.088400 Oct 27 10:28:17.915480 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2458/4716] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:16 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:17.920918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:17.925997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:17.934783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:17.935369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:17.936071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:17.936942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:17.937462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:17.938083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:18.783316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:18.825817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:18.827503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:18.829082 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8f2a766-0f80-4dc0-bbda-ad03d3b20172 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.912131 Oct 27 10:28:18.830232 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2459/4717] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:17 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:18.835361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:18.836307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:18.844324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:18.845071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:18.845649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:18.846791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:18.847386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:18.848098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:18.999439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:28:19.000050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:28:19.000332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:28:19.000790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:28:19.001336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:28:19.020356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.020889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.021331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.022063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.022518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.022970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.069730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:28:19.080985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for user 1ebcbfbb11e84fe5bbfebd8a9ebea128 and project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:28:19.098352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:28:19.109855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:28:19.170106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62047a55-0bdb-4a5f-bf9b-28fcae8fdd79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.559614 Oct 27 10:28:19.171483 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2259/4718] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:28:19.183550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:19.184325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:19.197750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.198473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.199257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.200287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.201141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.201760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.223743 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] HTTP exception thrown: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Request method failure captured: Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec HTTP/1.1 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWluv-Ng9DyxCwLu3rLu2jxFNVn1Yqy4HujFQPt6E-410rwaLUJi9Vzg1dlsfExW1Fj6kAqhcCLo_u1BqrJyU4rtYoW8ozifreLK-GPMYmYX-47v6S2xPyh53-ChK2bktQaqcEEXq3GuUjQPtjOUeaOwrnnYoMMxK-fHTAbY-pCTe12w Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 065058d531b2447286141abf2292e6f3 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TaggedBootDevicesTest-758595520 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/065058d531b2447286141abf2292e6f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/065058d531b2447286141abf2292e6f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_065058d531b2447286141abf2292e6f3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/065058d531b2447286141abf2292e6f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TaggedBootDevicesTest-758595520 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 065058d531b2447286141abf2292e6f3 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TaggedBootDevicesTest-758595520 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TaggedBootDevicesTest-758595520-project Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6cb951a3d90647148776d44816f51fb2 Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TaggedBootDevicesTest-758595520-project Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '8940a824-ca7a-4b64-a49f-e6a1ad2104ec'} Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:19.225620 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.230321 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.233716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Returning 404 to user: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:19.238187 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4e58d91-1234-46f8-bfac-ea4a197214d7 tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 404 len: 111 microversion: 2.32 time: 0.062103 Oct 27 10:28:19.239131 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2260/4719] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:28:19 2022] DELETE /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:28:19.239472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:19.246357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8cb2a75a-4dbf-4e14-8c5b-fd692e405d26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:19.247153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8cb2a75a-4dbf-4e14-8c5b-fd692e405d26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:19.258634 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4dcaef2b-4291-4a76-937e-b40e19f6d533 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.427130 Oct 27 10:28:19.259484 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2460/4720] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:18 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:19.265383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:19.266744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] [instance: 8940a824-ca7a-4b64-a49f-e6a1ad2104ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:19.282041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:19.284561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.285873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.286604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.287474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.288215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.289207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.319449 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] HTTP exception thrown: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Request method failure captured: Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec HTTP/1.1 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWluv-Ng9DyxCwLu3rLu2jxFNVn1Yqy4HujFQPt6E-410rwaLUJi9Vzg1dlsfExW1Fj6kAqhcCLo_u1BqrJyU4rtYoW8ozifreLK-GPMYmYX-47v6S2xPyh53-ChK2bktQaqcEEXq3GuUjQPtjOUeaOwrnnYoMMxK-fHTAbY-pCTe12w Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 065058d531b2447286141abf2292e6f3 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TaggedBootDevicesTest-758595520 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/065058d531b2447286141abf2292e6f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/065058d531b2447286141abf2292e6f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_065058d531b2447286141abf2292e6f3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/065058d531b2447286141abf2292e6f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TaggedBootDevicesTest-758595520 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 065058d531b2447286141abf2292e6f3 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TaggedBootDevicesTest-758595520 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TaggedBootDevicesTest-758595520-project Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6cb951a3d90647148776d44816f51fb2 Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TaggedBootDevicesTest-758595520-project Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '8940a824-ca7a-4b64-a49f-e6a1ad2104ec'} Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:19.321362 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] Returning 404 to user: Instance 8940a824-ca7a-4b64-a49f-e6a1ad2104ec could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e86ba380-f15e-4323-9ac5-bd8d6741150c tempest-TaggedBootDevicesTest-758595520 tempest-TaggedBootDevicesTest-758595520-project] 10.222.0.76 "GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec" status: 404 len: 111 microversion: 2.32 time: 0.062075 Oct 27 10:28:19.325862 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2461/4721] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:19 2022] GET /compute/v2.1/servers/8940a824-ca7a-4b64-a49f-e6a1ad2104ec => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:28:19.359278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be47364a-1df8-4b6a-b258-bf8b7573916a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:19.362353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be47364a-1df8-4b6a-b258-bf8b7573916a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 06a13ff5-6d25-49c8-b4ad-e3d606c3f151] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:19.368157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8cb2a75a-4dbf-4e14-8c5b-fd692e405d26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:19.372851 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-be47364a-1df8-4b6a-b258-bf8b7573916a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 06a13ff5-6d25-49c8-b4ad-e3d606c3f151 could not be found. Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be47364a-1df8-4b6a-b258-bf8b7573916a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/06a13ff5-6d25-49c8-b4ad-e3d606c3f151/action HTTP/1.1 Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 65 Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 06a13ff5-6d25-49c8-b4ad-e3d606c3f151 could not be found. Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '06a13ff5-6d25-49c8-b4ad-e3d606c3f151', 'body': {'rebuild': {'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a'}}} Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a13ff5-6d25-49c8-b4ad-e3d606c3f151 could not be found. Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 10:28:19.374549 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a13ff5-6d25-49c8-b4ad-e3d606c3f151 could not be found. Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a13ff5-6d25-49c8-b4ad-e3d606c3f151 could not be found. Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be47364a-1df8-4b6a-b258-bf8b7573916a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 06a13ff5-6d25-49c8-b4ad-e3d606c3f151 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be47364a-1df8-4b6a-b258-bf8b7573916a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/06a13ff5-6d25-49c8-b4ad-e3d606c3f151/action" status: 404 len: 111 microversion: 2.1 time: 0.051510 Oct 27 10:28:19.378333 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2462/4722] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:19 2022] POST /compute/v2.1/servers/06a13ff5-6d25-49c8-b4ad-e3d606c3f151/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:28:19.383213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8cb2a75a-4dbf-4e14-8c5b-fd692e405d26 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1215 microversion: 2.1 time: 0.141892 Oct 27 10:28:19.389550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:19.394054 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2261/4723] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:19 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:19.395610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:19.409563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.416179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.416736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.417796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.422158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.422838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.817789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:19.828468 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41b9a862-198d-4cd3-b4bb-756c99153128 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.440756 Oct 27 10:28:19.832155 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2463/4724] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:19 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:19.857868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:19.858265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:19.858898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:19.859495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:19.868678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.869529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.870191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.872212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.873598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.874584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.875895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.876439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.876963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:19.882515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:19.882731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:19.883346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:19.883820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:20.272193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:20.289798 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8e90e25-7800-4bdc-a492-a171c61c2797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.434449 Oct 27 10:28:20.303567 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2262/4725] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:19 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:20.319802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17162a77-bf59-4249-8f05-d940e1a1f827 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:20.320553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17162a77-bf59-4249-8f05-d940e1a1f827 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 5901dee0-34e9-4342-aaaf-2a1faee19bd8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:20.338671 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-17162a77-bf59-4249-8f05-d940e1a1f827 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 5901dee0-34e9-4342-aaaf-2a1faee19bd8 could not be found. Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17162a77-bf59-4249-8f05-d940e1a1f827 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/5901dee0-34e9-4342-aaaf-2a1faee19bd8/action HTTP/1.1 Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 15 Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: {"restore": {}} Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 5901dee0-34e9-4342-aaaf-2a1faee19bd8 could not be found. Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '5901dee0-34e9-4342-aaaf-2a1faee19bd8', 'body': {'restore': {}}} Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5901dee0-34e9-4342-aaaf-2a1faee19bd8 could not be found. Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5901dee0-34e9-4342-aaaf-2a1faee19bd8 could not be found. Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:20.340530 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:20.345079 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:20.345079 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:20.345079 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5901dee0-34e9-4342-aaaf-2a1faee19bd8 could not be found. Oct 27 10:28:20.345079 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:20.345079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17162a77-bf59-4249-8f05-d940e1a1f827 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 5901dee0-34e9-4342-aaaf-2a1faee19bd8 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:20.345079 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17162a77-bf59-4249-8f05-d940e1a1f827 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/5901dee0-34e9-4342-aaaf-2a1faee19bd8/action" status: 404 len: 111 microversion: 2.1 time: 0.030136 Oct 27 10:28:20.345079 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2263/4726] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:20 2022] POST /compute/v2.1/servers/5901dee0-34e9-4342-aaaf-2a1faee19bd8/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:28:20.359076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:20.359708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:20.382926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:20.383342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:20.383894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:20.384612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:20.390698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:20.391175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:20.422260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:20.446569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:20.452706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:20.458748 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17104dcc-76ef-4b7f-a122-f9306fc97f25 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.605464 Oct 27 10:28:20.464025 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2464/4727] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:19 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:20.489006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:20.496703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:20.535140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:20.537418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:20.539490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:20.545381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:20.548752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:20.549450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:20.665435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:20.679915 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aebbe119-0585-4097-94c7-22152c66a663 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.324402 Oct 27 10:28:20.693074 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2264/4728] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:20 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:20.713453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:20.714458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:20.728768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:20.729310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:20.729746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:20.730466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:20.730911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:20.734049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:20.751239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:20.762743 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df91bc79-6f06-474c-8ccb-56fcaf95a33c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1219 microversion: 2.1 time: 0.297311 Oct 27 10:28:20.765601 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2465/4729] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:20 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1219 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:21.152730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:21.165339 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0869e8b7-dfb0-4456-a0d5-db8e2c94397b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.456189 Oct 27 10:28:21.166906 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2265/4730] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:20 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:21.192868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:21.193534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:21.203180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:21.212566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:21.216043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:21.219324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:21.221103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:21.223212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:21.286367 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Cannot 'restore' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action HTTP/1.1 Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 15 Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: {"restore": {}} Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: exception: Cannot 'restore' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df', 'body': {'restore': {}}} Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df in vm_state active. Cannot restore while the instance is in this state. Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:21.288111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:21.292456 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:21.292456 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:21.292456 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:21.292456 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:28:21.292456 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:21.292456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 409 to user: Cannot 'restore' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:21.292456 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c294f05-506c-40e7-8087-a31a0f64a82b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 409 len: 145 microversion: 2.1 time: 0.101405 Oct 27 10:28:21.300465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:21.301051 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2466/4731] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:21 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 145 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:28:21.301806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:21.314779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:21.315467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:21.317196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:21.319500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:21.320217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:21.323732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:21.491533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:21.492581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:21.513644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:21.514369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:21.517576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:21.518580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:21.519402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:21.521991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:21.605926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:21.624249 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae70ffef-d960-487f-a5e3-d97f41f231e2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.329009 Oct 27 10:28:21.636151 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2266/4732] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:21 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:21.651524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:21.657536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:21.668434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:21.668927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:21.669311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:21.670410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:21.670524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:21.672105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.075829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:22.081699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:22.088710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:22.091440 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f39105f0-03bc-4558-a80f-474d818341c3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.444118 Oct 27 10:28:22.092031 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2267/4733] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:21 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:22.096620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:22.100689 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-edd7bbfa-a1ba-407a-9308-1c5ff65f6f0f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.610937 Oct 27 10:28:22.103193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:22.106417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:22.112928 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2467/4734] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:21 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:22.125335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bc0b2df-6057-446c-a2d5-3c54c4477bdd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:22.126126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9bc0b2df-6057-446c-a2d5-3c54c4477bdd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: a49a1116-1512-43ea-b0e0-c6dd4d80887a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:22.129202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.129954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.130951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.131908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.132850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.133521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.142747 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9bc0b2df-6057-446c-a2d5-3c54c4477bdd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance a49a1116-1512-43ea-b0e0-c6dd4d80887a could not be found. Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bc0b2df-6057-446c-a2d5-3c54c4477bdd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/a49a1116-1512-43ea-b0e0-c6dd4d80887a/action HTTP/1.1 Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 14 Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: {"resume": {}} Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance a49a1116-1512-43ea-b0e0-c6dd4d80887a could not be found. Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a49a1116-1512-43ea-b0e0-c6dd4d80887a', 'body': {'resume': {}}} Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49a1116-1512-43ea-b0e0-c6dd4d80887a could not be found. Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49a1116-1512-43ea-b0e0-c6dd4d80887a could not be found. Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:22.150772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:22.155553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:22.155553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:22.155553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49a1116-1512-43ea-b0e0-c6dd4d80887a could not be found. Oct 27 10:28:22.155553 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.158596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bc0b2df-6057-446c-a2d5-3c54c4477bdd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance a49a1116-1512-43ea-b0e0-c6dd4d80887a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:22.160329 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9bc0b2df-6057-446c-a2d5-3c54c4477bdd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/a49a1116-1512-43ea-b0e0-c6dd4d80887a/action" status: 404 len: 111 microversion: 2.1 time: 0.046085 Oct 27 10:28:22.162733 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2468/4735] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:22 2022] POST /compute/v2.1/servers/a49a1116-1512-43ea-b0e0-c6dd4d80887a/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:28:22.173810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:22.174749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:22.185742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.186575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.187257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.188004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.188951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.189489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.250446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:22.263395 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4fbb136-6e60-4322-85cd-9f9af1a507bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1273 microversion: 2.1 time: 0.164930 Oct 27 10:28:22.277254 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2268/4736] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:22 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:22.401788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:22.415539 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c2c7bd19-5937-4dab-adcf-7bda311d5671 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.247963 Oct 27 10:28:22.419724 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2469/4737] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:22 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:22.449082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:22.450360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:22.459456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.460303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.461055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.462036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.462647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.463255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.661890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:22.672571 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb78b1a6-ea18-4951-9f9b-f4646a41d6b8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.229940 Oct 27 10:28:22.687391 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2269/4738] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:22 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:22.696692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:22.697934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:22.705867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.706326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.706935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.707827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.708431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.709034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.737543 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Cannot 'resume' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action HTTP/1.1 Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 14 Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: {"resume": {}} Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: exception: Cannot 'resume' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df', 'body': {'resume': {}}} Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df in vm_state active. Cannot resume while the instance is in this state. Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:22.739194 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.743448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:22.743448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:22.743448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:22.743448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:22.743448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:22.743448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:28:22.743448 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:22.743448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 409 to user: Cannot 'resume' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:22.743448 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a26be66-c25d-45ba-a491-88afac9d5213 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 409 len: 144 microversion: 2.1 time: 0.048322 Oct 27 10:28:22.750122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:22.750945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:22.755161 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2470/4739] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:22 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 144 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:28:22.760207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.761175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.761809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.762726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.763450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.764100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:23.006384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:23.014958 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83ecd958-829b-464d-a36e-15cc623b4cd0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.268780 Oct 27 10:28:23.016301 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2270/4740] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:22 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:23.052226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:23.058243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:23.068461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:23.068970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:23.069438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:23.070219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:23.070672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:23.071092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:23.137801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:23.140565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:23.163816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:23.166807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:23.171171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:23.172155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:23.172813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:23.175138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:23.439232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:23.464191 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59938cc0-843b-4867-8aae-091752e8793c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.422022 Oct 27 10:28:23.464776 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2471/4741] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:23 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:23.486749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:23.489566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:23.500789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:23.501774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:23.502881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:23.503738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:23.504350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:23.504831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:23.518460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:23.520809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:23.522550 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8ad94882-6ca6-4bdc-97c0-bf55a550575b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.398874 Oct 27 10:28:23.523396 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2271/4742] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:23 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:23.529918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:23.553851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:23.720347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9604ae19-cdec-492a-999e-f3f79d270edd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9604ae19-cdec-492a-999e-f3f79d270edd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 160 Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "4e40c3bf-78c6-49ec-85b4-816b286fa1de"}]}} Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': '', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'networks': [{'uuid': '4e40c3bf-78c6-49ec-85b4-816b286fa1de'}]}}} Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '' Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:28:23.730326 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:23.734585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9604ae19-cdec-492a-999e-f3f79d270edd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:23.756010 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9604ae19-cdec-492a-999e-f3f79d270edd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.016305 Oct 27 10:28:23.756684 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2272/4743] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:23 2022] POST /compute/v2.1/servers => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:28:23.776204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:23.778210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:23.787622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:23.788625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:23.789340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:23.790405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:23.791080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:23.792545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:23.814856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:23.828292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c95efedd-1319-4781-9a0e-46b86967e883 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1315 microversion: 2.1 time: 0.362234 Oct 27 10:28:23.831778 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2472/4744] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:23 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:24.166426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:24.175257 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-415119ef-4d22-4b7b-a489-ca80af41ea83 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.413481 Oct 27 10:28:24.175847 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2273/4745] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:23 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:24.202945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:24.203569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:24.214707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:24.215212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:24.215659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:24.221722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:24.222231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:24.222688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:24.514025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:24.523697 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2dd6d12-675f-4f40-870b-a54d759018fe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.325259 Oct 27 10:28:24.537788 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2473/4746] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:24 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:24.554842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13c26f69-78d1-48ac-a49e-fad8229b7d25 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:24.555618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13c26f69-78d1-48ac-a49e-fad8229b7d25 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: a0e8f3d0-8dcf-448e-8649-282175dd76d4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:24.568585 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-13c26f69-78d1-48ac-a49e-fad8229b7d25 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance a0e8f3d0-8dcf-448e-8649-282175dd76d4 could not be found. Oct 27 10:28:24.573331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:24.574160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13c26f69-78d1-48ac-a49e-fad8229b7d25 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/a0e8f3d0-8dcf-448e-8649-282175dd76d4/action HTTP/1.1 Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 14 Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: {"shelve": {}} Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance a0e8f3d0-8dcf-448e-8649-282175dd76d4 could not be found. Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'a0e8f3d0-8dcf-448e-8649-282175dd76d4', 'body': {'shelve': {}}} Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e8f3d0-8dcf-448e-8649-282175dd76d4 could not be found. Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e8f3d0-8dcf-448e-8649-282175dd76d4 could not be found. Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:24.578621 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:24.582888 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:24.582888 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:24.582888 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e8f3d0-8dcf-448e-8649-282175dd76d4 could not be found. Oct 27 10:28:24.582888 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:24.583829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:24.584217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13c26f69-78d1-48ac-a49e-fad8229b7d25 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance a0e8f3d0-8dcf-448e-8649-282175dd76d4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:24.584801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:24.585391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:24.585714 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13c26f69-78d1-48ac-a49e-fad8229b7d25 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/a0e8f3d0-8dcf-448e-8649-282175dd76d4/action" status: 404 len: 111 microversion: 2.1 time: 0.039383 Oct 27 10:28:24.586433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:24.587007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:24.588303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:24.591098 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2274/4747] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:24 2022] POST /compute/v2.1/servers/a0e8f3d0-8dcf-448e-8649-282175dd76d4/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:28:24.602485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:24.603101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:24.618391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:24.622092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:24.623799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:24.627472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:24.628127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:24.628733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:24.969919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:24.975289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:24.979414 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-934a5be8-def6-449d-8e1b-ae2cc11ba933 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.387184 Oct 27 10:28:24.979995 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2275/4748] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:24 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:24.990172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:24.995537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:24.997527 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f0ee22d-9f69-496c-adca-4b4dbe9f1989 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.435839 Oct 27 10:28:25.001192 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2474/4749] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:24 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:25.011162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:25.017232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:25.018904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:25.019540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:25.035555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.036049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.036483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.037230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.037677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.038107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.044270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.044787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.045276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.045929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.046378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.046800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.451921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:25.457014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:25.479249 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83a2cf32-0755-4916-86a8-2e60845872a1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1315 microversion: 2.1 time: 0.485023 Oct 27 10:28:25.480916 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b32deff3-4eae-42f8-9bb8-a56c75912a45 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.478366 Oct 27 10:28:25.481763 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2276/4750] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:24 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:25.482593 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2475/4751] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:25 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:25.523236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:25.524237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:25.534585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.539595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.540290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.541973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.542600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.543951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.593182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lazy-loading 'flavor' on Instance uuid 80f1a184-24f6-43f3-8477-e15a2694f8df {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:28:25.922910 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5142e175-e560-4f59-bcd2-aa543cb23033 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 202 len: 0 microversion: 2.1 time: 0.404413 Oct 27 10:28:25.923898 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2277/4752] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:25 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:28:25.940741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:25.942620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:25.956879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.959002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.959849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.961785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.963300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.965670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:26.034121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:26.034991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:26.042799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:26.043290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:26.043719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:26.044418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:26.045124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:26.046099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:26.293596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:26.321195 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f2fee91-a669-4f63-9691-f73e1b357920 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.389874 Oct 27 10:28:26.322898 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2476/4753] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:25 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:26.333725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b48658c-5bbb-405b-be04-ffb0caedd2e9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:26.334506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b48658c-5bbb-405b-be04-ffb0caedd2e9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:26.341986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b48658c-5bbb-405b-be04-ffb0caedd2e9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:26.342883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b48658c-5bbb-405b-be04-ffb0caedd2e9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:26.343541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b48658c-5bbb-405b-be04-ffb0caedd2e9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:26.344640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b48658c-5bbb-405b-be04-ffb0caedd2e9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:26.345455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b48658c-5bbb-405b-be04-ffb0caedd2e9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:26.346272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b48658c-5bbb-405b-be04-ffb0caedd2e9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:26.378185 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b48658c-5bbb-405b-be04-ffb0caedd2e9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/ips" status: 200 len: 150 microversion: 2.20 time: 0.051515 Oct 27 10:28:26.379938 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2477/4754] 10.222.0.76 () {60 vars in 1289 bytes} [Thu Oct 27 10:28:26 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/ips => generated 150 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:28:26.387759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:26.402017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:26.402880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a1cbef9b-fb80-408b-a512-dc107001afa6 req-fcedf31f-92f3-4ea6-bd1b-364ec92e641f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e807fd8-2fb2-455e-a52a-5fb654f74682", "tag": "4dc4f634-1c13-4b89-bc05-7782d9e04eed"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:26.404606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:26.410850 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91901a8c-3ef2-4040-9ad4-45d11fbb9a90 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.382318 Oct 27 10:28:26.426813 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2278/4755] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:26 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:28:26.443220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1cbef9b-fb80-408b-a512-dc107001afa6 req-fcedf31f-92f3-4ea6-bd1b-364ec92e641f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:26.443714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1cbef9b-fb80-408b-a512-dc107001afa6 req-fcedf31f-92f3-4ea6-bd1b-364ec92e641f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:26.444146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1cbef9b-fb80-408b-a512-dc107001afa6 req-fcedf31f-92f3-4ea6-bd1b-364ec92e641f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:26.462201 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a1cbef9b-fb80-408b-a512-dc107001afa6 req-fcedf31f-92f3-4ea6-bd1b-364ec92e641f service nova] Creating event network-changed:4dc4f634-1c13-4b89-bc05-7782d9e04eed for instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 on n-h2-854663-10 Oct 27 10:28:26.468167 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a1cbef9b-fb80-408b-a512-dc107001afa6 req-fcedf31f-92f3-4ea6-bd1b-364ec92e641f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086622 Oct 27 10:28:26.470085 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2478/4756] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:26.506291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:26.507706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:26.515105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:26.515841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:26.516336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:26.517182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:26.517834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:26.518257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:26.703478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:26.711585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:26.714679 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e11dc12e-f08a-4bbd-aa67-522a59c4f8f1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1315 microversion: 2.1 time: 0.214332 Oct 27 10:28:26.734504 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2279/4757] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:26 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:27.349719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:27.350348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:27.365322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:27.366080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:27.366902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:27.367871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:27.368488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:27.370834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:27.446346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:27.447445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:27.459101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:27.459927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:27.461021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:27.472175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:27.473156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:27.473757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:28.220320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:28.234141 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9217db6-9104-4aa8-beb6-8e28e8536ba2 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.889794 Oct 27 10:28:28.234714 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2479/4758] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:27 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:28.255959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:28.256944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:28.266368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:28.267191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:28.268324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:28.269334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:28.269984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:28.270597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:28.310096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:28.325988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:28.328000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:28.334202 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b612571b-df23-4a3f-af36-bd0b9cfe86e4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.893635 Oct 27 10:28:28.336197 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2280/4759] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:27 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:28.493708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:28.503048 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1db498d3-dfa8-4685-a125-77511fca07ac tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1315 microversion: 2.1 time: 0.252887 Oct 27 10:28:28.523192 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2480/4760] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:28 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:29.260514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:29.261070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:29.267883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:29.274733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:29.275226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:29.279339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:29.280345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:29.281152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:29.281779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:29.362615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:29.363685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:29.377106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:29.382301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:29.384005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:29.394228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:29.396029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:29.396781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:29.397457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:29.770113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:29.779749 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8830ab72-7c3c-4647-b90a-f00f18f6c382 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.523496 Oct 27 10:28:29.780341 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2281/4761] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:29 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:29.786595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:29.787335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:29.800076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:29.800960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:29.801576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:29.802510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:29.803285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:29.804649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:29.820989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:29.838656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:29.840546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:29.842062 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40797b7f-6eef-4e18-b9b4-591e0a9ab389 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.484688 Oct 27 10:28:29.842975 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2481/4762] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:29 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:30.004265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:30.005451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:30.013523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.014247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.014959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.015954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.016642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.017306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.053508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lazy-loading 'flavor' on Instance uuid b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:28:30.079866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:30.095627 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7eca9871-32aa-475d-a5bf-345aee55e97e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1315 microversion: 2.1 time: 0.308057 Oct 27 10:28:30.095627 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2282/4763] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:29 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:30.493552 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-282703c5-3132-4b30-83f7-057e77c7875a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/action" status: 202 len: 0 microversion: 2.20 time: 0.493622 Oct 27 10:28:30.494696 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2482/4764] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:28:29 2022] POST /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:28:30.504886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:30.505635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:30.518151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.520307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.534229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.535001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.535472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.535896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.734403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:30.745091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:30.747133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:30.748446 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-28f335fa-3938-491f-9239-c9c2fa25a555 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.249502 Oct 27 10:28:30.749591 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2283/4765] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:30 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:30.810228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:30.811144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:30.822126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.823460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.824128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.824941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.826157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.826997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.870422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:30.870963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:30.880605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:30.886748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.888255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.889806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.890589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.891055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.894328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:31.273650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:31.282800 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a7d5cb3-81d4-4919-b1e0-54097a0072e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.478967 Oct 27 10:28:31.283598 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2483/4766] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:30 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:31.301334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:31.303066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:31.319065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:31.320258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:31.321548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:31.324774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:31.325499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:31.325918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:31.415132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:31.460501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:31.462804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:31.465065 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38732990-7bef-44d2-a634-ea22b9cc86c1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.599481 Oct 27 10:28:31.467857 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2284/4767] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:30 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:28:31.628373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:31.637737 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68ddad99-2bd1-46fc-8853-788d0b4caa8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1315 microversion: 2.1 time: 0.348293 Oct 27 10:28:31.638584 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2484/4768] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:31 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:31.776417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:31.777804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:31.788944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:31.790007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:31.790693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:31.791645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:31.792398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:31.793080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:32.077691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:32.090571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:32.092594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:32.094377 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d5a831da-e1a3-40a3-982b-0ed729490fdb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.323665 Oct 27 10:28:32.095606 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2285/4769] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:31 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:32.307381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:32.308626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:32.315033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:32.315733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:32.316334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:32.317204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:32.317833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:32.318416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:32.494333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:32.495083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:32.502718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:32.503531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:32.504556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:32.505901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:32.506593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:32.507412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:32.592339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:32.608839 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55ff2ce8-098d-4585-af35-fd2d174fe680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.305693 Oct 27 10:28:32.610551 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2485/4770] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:32 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:32.663719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:32.664938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:32.671647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:32.672475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:32.673166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:32.673994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:32.674581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:32.675099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:32.967658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:32.991728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:33.003026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:33.005363 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f923e0c2-36bb-43b1-88d3-7d8fe4506479 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.515648 Oct 27 10:28:33.006121 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2286/4771] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:32 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:33.047406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:33.058791 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d671b6b4-45b8-43a5-b66b-196c87390707 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1315 microversion: 2.1 time: 0.400121 Oct 27 10:28:33.059737 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2486/4772] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:32 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:33.120064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:33.120704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:33.132114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:33.133259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:33.133896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:33.137240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:33.138051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:33.138664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:33.362806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d5bcd803-76c6-4779-8bef-152634eb8383 req-7a758c14-d02f-4e20-9bd1-300a67eb33d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e807fd8-2fb2-455e-a52a-5fb654f74682", "name": "network-vif-plugged", "status": "completed", "tag": "4dc4f634-1c13-4b89-bc05-7782d9e04eed"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:33.386622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d5bcd803-76c6-4779-8bef-152634eb8383 req-7a758c14-d02f-4e20-9bd1-300a67eb33d0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:33.387095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d5bcd803-76c6-4779-8bef-152634eb8383 req-7a758c14-d02f-4e20-9bd1-300a67eb33d0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:33.387523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d5bcd803-76c6-4779-8bef-152634eb8383 req-7a758c14-d02f-4e20-9bd1-300a67eb33d0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:33.419015 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d5bcd803-76c6-4779-8bef-152634eb8383 req-7a758c14-d02f-4e20-9bd1-300a67eb33d0 service nova] Creating event network-vif-plugged:4dc4f634-1c13-4b89-bc05-7782d9e04eed for instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 on n-h2-854663-10 Oct 27 10:28:33.427077 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d5bcd803-76c6-4779-8bef-152634eb8383 req-7a758c14-d02f-4e20-9bd1-300a67eb33d0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070895 Oct 27 10:28:33.428512 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2487/4773] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:33.551848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:33.568627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:33.571035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:33.575406 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9334218c-7af8-4b41-b04a-767a8228b580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.459819 Oct 27 10:28:33.576698 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2287/4774] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:33 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:33.633794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:33.634498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:33.645628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:33.647451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:33.647960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:33.648777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:33.650485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:33.652291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:33.907692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:33.910694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:33.920680 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1576e4a2-f911-4f88-9069-633b549ecf7d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.291174 Oct 27 10:28:33.921392 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2488/4775] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:33 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:34.033990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:34.034597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:34.048112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:34.048599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:34.049058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:34.049741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:34.050196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:34.050608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:34.086498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:34.087226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:34.102022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:34.103373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:34.103880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:34.104856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:34.105561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:34.106172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:34.846930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:34.858416 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e78d4f5b-7a00-4a71-8740-5adf061d7305 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1315 microversion: 2.1 time: 0.776192 Oct 27 10:28:34.859647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2489/4776] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:34 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:34.866567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:34.868734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:34.884050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:34.885321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:34.885946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:34.889936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:34.897858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:34.900879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:34.903736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:34.906709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:34.908242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:34.909491 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc04d0a4-f367-433a-8a6a-5d974c750353 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.879650 Oct 27 10:28:34.913943 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2288/4777] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:34 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:34.946394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:34.947022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:34.959189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:34.959688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:34.960232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:34.965383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:34.966317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:34.966936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:35.386196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:35.401962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:35.403423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:35.405859 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23a5e66d-389a-457f-8688-ad00ba77fedb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.544973 Oct 27 10:28:35.407727 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2490/4778] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:34 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:35.423362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:35.439771 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-64a88d44-50a2-4250-a1bd-4c3d689dd70a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.498562 Oct 27 10:28:35.454317 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2289/4779] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:34 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:35.882108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:35.882902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:35.892249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:35.895216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:35.895699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:35.898903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:35.899485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:35.900046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:35.944257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:35.945488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:35.958250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:35.962119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:35.963172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:35.974256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:35.976939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:35.979315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:36.263253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:36.275720 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d6bffb1-d614-474e-9b56-72833e8f6706 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1502 microversion: 2.1 time: 0.397557 Oct 27 10:28:36.276859 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2491/4780] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:35 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1502 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:36.300339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:36.300914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:36.316440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:36.316964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:36.319865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:36.320610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:36.324617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:36.325525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:36.445104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:36.457454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:36.460926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:36.463187 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95847f86-cf40-49e4-9a19-3665045b00f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.523793 Oct 27 10:28:36.488538 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2290/4781] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:35 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:36.500511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:36.503803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:36.518431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:36.518933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:36.520768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:36.521736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:36.522345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:36.522969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:36.645068 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Removing security group 6025842c-3c0f-4642-97ca-57cb153afd95 from port 4dc4f634-1c13-4b89-bc05-7782d9e04eed Oct 27 10:28:36.956107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:36.991274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:36.996221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:37.012143 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-786b4b35-41d4-46c7-a87d-04d24fb905a3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.522235 Oct 27 10:28:37.039309 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2291/4782] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:36 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:37.054800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:37.057662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:37.083723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:37.086126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:37.087263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:37.090374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:37.092115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:37.093139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:37.375507 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6187fde8-c6e0-426c-8294-745c49a13064 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682/action" status: 202 len: 0 microversion: 2.1 time: 1.078475 Oct 27 10:28:37.384871 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2492/4783] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:36 2022] POST /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682/action => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:28:37.403543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7b644e0c-f808-452e-b225-9fd0bc8fa4fe req-5e900055-204e-41b7-ad12-430bf496465e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e807fd8-2fb2-455e-a52a-5fb654f74682", "tag": "4dc4f634-1c13-4b89-bc05-7782d9e04eed"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:37.421948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:37.431584 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c998292-89c9-4508-98df-6d38d56d7c70 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.389862 Oct 27 10:28:37.447552 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2292/4784] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:37 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:37.447552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:37.447552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:37.447552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:37.447552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:37.447552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:37.447552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:37.447552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:37.447552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:37.455404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7b644e0c-f808-452e-b225-9fd0bc8fa4fe req-5e900055-204e-41b7-ad12-430bf496465e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:37.456227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7b644e0c-f808-452e-b225-9fd0bc8fa4fe req-5e900055-204e-41b7-ad12-430bf496465e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:37.456905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7b644e0c-f808-452e-b225-9fd0bc8fa4fe req-5e900055-204e-41b7-ad12-430bf496465e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:37.470303 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7b644e0c-f808-452e-b225-9fd0bc8fa4fe req-5e900055-204e-41b7-ad12-430bf496465e service nova] Creating event network-changed:4dc4f634-1c13-4b89-bc05-7782d9e04eed for instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 on n-h2-854663-10 Oct 27 10:28:37.485747 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7b644e0c-f808-452e-b225-9fd0bc8fa4fe req-5e900055-204e-41b7-ad12-430bf496465e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098216 Oct 27 10:28:37.487405 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2493/4785] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:37.497383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:37.498672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:37.514396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:37.515259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:37.523420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:37.524595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:37.525327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:37.525999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:37.980588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:38.001054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:38.003614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:38.006295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:38.008477 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90389365-a3fc-49e3-854a-9fb36b74d304 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.516642 Oct 27 10:28:38.009477 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2494/4786] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:37 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:38.011812 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da69c7aa-b3a2-4965-ac18-fd57f5fe715a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1460 microversion: 2.1 time: 0.577938 Oct 27 10:28:38.012367 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2293/4787] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:37 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1460 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:38.046930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:38.047712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:38.051823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:38.055923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:38.060999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:38.061648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:38.063167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:38.065061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:38.066594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:38.067582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:38.068998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:38.073313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:38.074011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:38.075877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:38.077900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:38.078591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:38.419128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:38.436650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:38.439646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:38.440880 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2cb027a0-f2b4-4530-8433-cb51716e0493 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.399187 Oct 27 10:28:38.442249 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2294/4788] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:38 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:38.459072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:38.461075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:38.471025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:38.472054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:38.472726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:38.474271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:38.475152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:38.475805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:38.585537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:38.603865 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23b07856-4353-491c-8626-cad069969520 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.568641 Oct 27 10:28:38.606819 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2495/4789] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:38 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:38.640312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:38.641651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:38.649237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:38.650836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:38.651440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:38.652328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:38.652990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:38.653564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:38.809743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:38.818708 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da5ceb64-b1ed-4599-ac44-b9090e7de4f3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.365427 Oct 27 10:28:38.819944 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2295/4790] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:38 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:39.035796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:39.036707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:39.048867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:39.049596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:39.050970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:39.053199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:39.054894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:39.055528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:39.057932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:39.082036 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b9aef7b-bc3f-4dee-97a7-574876f73609 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.454419 Oct 27 10:28:39.096371 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2496/4791] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:38 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:39.114612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:39.116881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:39.117863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:39.126346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:39.126988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:39.127433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:39.128180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:39.128636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:39.129082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:39.909704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:39.920378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:39.922240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:39.923809 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ba842036-0559-47b1-be1e-fc99cccfec17 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.892102 Oct 27 10:28:39.924969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2296/4792] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:39 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:28:39.930719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:39.931554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:39.936127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:39.943520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:39.944465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:39.945012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:39.946948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:39.947606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:39.948258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:39.956960 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9fb648f4-8f00-4302-beac-40c540c31062 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.851754 Oct 27 10:28:39.959887 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2497/4793] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:39 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:39.972847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:39.972847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:40.003379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:40.003869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:40.004302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:40.005051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:40.011866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:40.012345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:40.196394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:40.206042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:40.207501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:40.208709 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77004509-b7e0-415f-a026-252783b5faeb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.282448 Oct 27 10:28:40.210900 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2297/4794] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:39 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:40.216711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:40.217346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:40.240957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:40.241606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:40.242111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:40.242853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:40.246317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:40.246975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:40.286331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:40.318477 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4dda1d45-7d23-409d-bd8f-174734c4911a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.355597 Oct 27 10:28:40.320394 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2498/4795] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:39 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:40.427289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:40.436213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58cc9f0f-c7f2-446d-919a-f50f452b9cb1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.224156 Oct 27 10:28:40.436840 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2298/4796] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:40 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:40.579442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2081130428", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9405a813-2b98-46c3-9126-2e0aba2c6166"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:40.642359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] validate_networks() for [('9405a813-2b98-46c3-9126-2e0aba2c6166', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:28:40.951491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:40.953310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:40.972465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:40.973206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:40.975025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:40.976282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:40.978215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:40.978978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:41.365118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:28:41.365651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:28:41.366345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:28:41.366888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:28:41.367552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:28:41.385574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:41.388196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:41.390429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:41.392544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:41.393276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:41.394585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:41.468434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:28:41.488466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Getting quotas for user 1ebcbfbb11e84fe5bbfebd8a9ebea128 and project eb2b0a77cbdc4d1bb17b8761358b04b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:28:41.534064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:28:41.542754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:28:41.673343 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b023c965-4afe-4b20-9d20-377fac3c918d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096413 Oct 27 10:28:41.680697 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2499/4797] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:28:41.695527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:41.696159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:41.709313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:41.710077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:41.710694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:41.711682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:41.712291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:41.712897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:41.738432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:41.752159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:41.759954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:41.761568 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4a51888b-e622-43be-9999-407c3adf7719 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.814025 Oct 27 10:28:41.766425 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2299/4798] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:40 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:28:41.775827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:41.776810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:41.795475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:41.796369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:41.797300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:41.798931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:41.800991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:41.803251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:42.027419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:42.044655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:42.047139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:42.052138 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ea9eefe-ab5d-4c96-ac38-f501b7fa966f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.366931 Oct 27 10:28:42.053659 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2500/4799] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:41 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:42.066404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-134997e3-dbe9-4acc-ab69-67d571d57fe4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:42.067378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-134997e3-dbe9-4acc-ab69-67d571d57fe4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:42.167382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-134997e3-dbe9-4acc-ab69-67d571d57fe4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:42.177529 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-134997e3-dbe9-4acc-ab69-67d571d57fe4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1215 microversion: 2.1 time: 0.118451 Oct 27 10:28:42.178303 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2501/4800] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:42 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:42.220930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:42.230615 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aff696d5-18e3-49fe-bcab-57eed8abc2ea tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.462796 Oct 27 10:28:42.251346 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2300/4801] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:41 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:42.791634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e73f6e42-6808-4dbd-a04a-07b9566c024a req-82af1b27-2fba-43e9-8277-5caadaa7fa17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-plugged", "status": "completed", "tag": "ae4d4470-a4f9-491d-b4cb-91c4398b832b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:42.796325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:42.797548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:42.809409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:42.809901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:42.811689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:42.812621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:42.813260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:42.814109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:42.833342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e73f6e42-6808-4dbd-a04a-07b9566c024a req-82af1b27-2fba-43e9-8277-5caadaa7fa17 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:42.837278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e73f6e42-6808-4dbd-a04a-07b9566c024a req-82af1b27-2fba-43e9-8277-5caadaa7fa17 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:42.844847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e73f6e42-6808-4dbd-a04a-07b9566c024a req-82af1b27-2fba-43e9-8277-5caadaa7fa17 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:42.905302 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e73f6e42-6808-4dbd-a04a-07b9566c024a req-82af1b27-2fba-43e9-8277-5caadaa7fa17 service nova] Creating event network-vif-plugged:ae4d4470-a4f9-491d-b4cb-91c4398b832b for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:42.919186 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e73f6e42-6808-4dbd-a04a-07b9566c024a req-82af1b27-2fba-43e9-8277-5caadaa7fa17 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375169 Oct 27 10:28:42.923312 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2502/4802] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:43.082863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:43.083914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:43.097226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:43.100093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:43.107669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:43.108474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:43.109490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:43.110189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:43.110937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:43.389550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:43.419677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:43.425143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:43.431785 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1a676529-955c-44eb-a024-cdbd2621e2a1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.640142 Oct 27 10:28:43.451544 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2301/4803] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:42 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:28:43.466940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:43.467885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:43.499293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:43.500309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:43.500994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:43.501991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:43.502637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:43.503286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:43.594184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:43.624323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:43.630982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:43.634738 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad9f423f-90ac-4c24-b7f9-b440205fefec tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.556960 Oct 27 10:28:43.636824 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2503/4804] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:43 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:43.650938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:43.653423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:43.660931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:43.669707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8dc9343-be3c-44d4-9d51-69723da0aade tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1267 microversion: 2.1 time: 0.216868 Oct 27 10:28:43.677210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:43.677624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:43.678835 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2302/4805] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:43 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:43.691847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:43.693244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:43.698646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:43.699394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:44.207945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:44.220815 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eda9ff74-8368-4f60-b4a4-05236b3f690b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.581107 Oct 27 10:28:44.224168 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2504/4806] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:43 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:44.463698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:44.464331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:44.480899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:44.481293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:44.485196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:44.486620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:44.490816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:44.491390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:44.659682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:44.660568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:44.675633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:44.685450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:44.685913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:44.686672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:44.687128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:44.687556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:45.714654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:45.726911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:45.737160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:45.738743 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc370d80-b4e3-46ef-9e72-4bce97221f32 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 1.083205 Oct 27 10:28:45.739576 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2505/4807] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:44 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:45.761448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:45.762386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:45.774900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:45.779634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:45.780199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:45.780944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:45.784121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:45.784597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:45.834927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:45.869292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:45.875041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:45.879087 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ceb45b6-8973-466a-b699-22b775df5bfa tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 1.418960 Oct 27 10:28:45.889661 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2303/4808] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:44 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:45.901256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0ed0ff41-0495-4aaf-afd1-7d256062bae6 req-d765d4fe-87f9-4904-b611-25a1fd2dc21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-plugged", "status": "completed", "tag": "2489d5fc-eae3-43ec-b706-bb225acfc6a5"}, {"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-plugged", "status": "completed", "tag": "87e5ceb2-bb58-4ae5-852d-ee73be4cb0f3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:45.930129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0ed0ff41-0495-4aaf-afd1-7d256062bae6 req-d765d4fe-87f9-4904-b611-25a1fd2dc21e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:45.930797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0ed0ff41-0495-4aaf-afd1-7d256062bae6 req-d765d4fe-87f9-4904-b611-25a1fd2dc21e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:45.931356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0ed0ff41-0495-4aaf-afd1-7d256062bae6 req-d765d4fe-87f9-4904-b611-25a1fd2dc21e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:45.962146 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0ed0ff41-0495-4aaf-afd1-7d256062bae6 req-d765d4fe-87f9-4904-b611-25a1fd2dc21e service nova] Creating event network-vif-plugged:2489d5fc-eae3-43ec-b706-bb225acfc6a5 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:45.966290 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0ed0ff41-0495-4aaf-afd1-7d256062bae6 req-d765d4fe-87f9-4904-b611-25a1fd2dc21e service nova] Creating event network-vif-plugged:87e5ceb2-bb58-4ae5-852d-ee73be4cb0f3 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:45.979890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0ed0ff41-0495-4aaf-afd1-7d256062bae6 req-d765d4fe-87f9-4904-b611-25a1fd2dc21e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088039 Oct 27 10:28:45.980958 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2304/4809] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:45.986818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:45.994819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:46.011901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:46.021337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:46.022147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:46.023593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:46.024328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:46.025559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:46.878198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:46.904616 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-751ba8bc-7857-442b-aee6-51766aafaf88 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1315 microversion: 2.1 time: 1.154292 Oct 27 10:28:46.905925 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2506/4810] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:45 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1315 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:46.911868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:46.916941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:46.918052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Searching by: {'deleted': False, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:28:46.925058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:46.925650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:46.926176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:46.927161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:46.927690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:46.937017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.099061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:28:47.143520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.153180 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3a63c58d-3b23-43ff-abc9-216227db505d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 1.170699 Oct 27 10:28:47.153985 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2305/4811] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:45 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:47.158844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:47.159745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:47.168756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.169604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.172461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.172461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.172461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.172461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.174889 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7f1a708-855b-488f-8a53-f35c98af4149 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.267527 Oct 27 10:28:47.175594 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2507/4812] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 10:28:46 2022] GET /compute/v2.1/servers => generated 340 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:47.283979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-47c7e83b-8ad6-4d6e-a802-7a99dda640a8 req-1277a9c8-63fe-4124-a482-e5e018579662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d1371c-3f59-487c-91e9-672f3bf5f71c", "tag": "5dce3f42-d9cc-43e4-8452-4a6a2d704f31"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:47.297298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-47c7e83b-8ad6-4d6e-a802-7a99dda640a8 req-1277a9c8-63fe-4124-a482-e5e018579662 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.298073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-47c7e83b-8ad6-4d6e-a802-7a99dda640a8 req-1277a9c8-63fe-4124-a482-e5e018579662 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.298679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-47c7e83b-8ad6-4d6e-a802-7a99dda640a8 req-1277a9c8-63fe-4124-a482-e5e018579662 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.313175 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-47c7e83b-8ad6-4d6e-a802-7a99dda640a8 req-1277a9c8-63fe-4124-a482-e5e018579662 service nova] Creating event network-changed:5dce3f42-d9cc-43e4-8452-4a6a2d704f31 for instance 56d1371c-3f59-487c-91e9-672f3bf5f71c on n-h2-854663-10 Oct 27 10:28:47.318975 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-47c7e83b-8ad6-4d6e-a802-7a99dda640a8 req-1277a9c8-63fe-4124-a482-e5e018579662 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141219 Oct 27 10:28:47.319980 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2508/4813] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:47.326426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:47.327493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:47.336057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.336759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.337600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.338989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.339720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.340291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.345613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:47.668152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.681734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.683519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.684927 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65856b22-30bc-455c-99ae-fe80a477cf74 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.529789 Oct 27 10:28:47.685715 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2306/4814] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:47 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:47.700412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:47.707245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.708139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Searching by: {'deleted': False, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:28:47.714468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.714919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.715365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.716219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.717109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.717556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.746672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:28:47.759118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.770780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.772561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.773923 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac0efbc8-a788-4209-a6a1-d5cb09b6eb26 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.452551 Oct 27 10:28:47.774498 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2509/4815] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:47 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:47.819638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.825475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.825980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.826407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.931408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:47.931976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:47.938555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.939044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.939467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.940159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.940604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.941065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.138620 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-04107609-bb70-4a6d-b66c-aa2190d77c2d tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.451524 Oct 27 10:28:48.139922 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2307/4816] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:28:47 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:48.144785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-786e345c-74c1-4636-a990-13887f29a55b req-18890fd9-605c-4118-b734-71856fd9e9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-plugged", "status": "completed", "tag": "0286aa77-bd3b-489b-9904-21ccf8dc4f03"}, {"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-plugged", "status": "completed", "tag": "4b8708b4-e00c-4c04-aea0-e5d41c4d43c1"}, {"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-plugged", "status": "completed", "tag": "782e6f7a-0715-4c1e-b24d-1ac485672640"}, {"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-plugged", "status": "completed", "tag": "5f638a13-8e41-4eb0-9395-0e98a33d43bd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:48.157462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-786e345c-74c1-4636-a990-13887f29a55b req-18890fd9-605c-4118-b734-71856fd9e9a7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.158514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-786e345c-74c1-4636-a990-13887f29a55b req-18890fd9-605c-4118-b734-71856fd9e9a7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.159125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-786e345c-74c1-4636-a990-13887f29a55b req-18890fd9-605c-4118-b734-71856fd9e9a7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.171734 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-786e345c-74c1-4636-a990-13887f29a55b req-18890fd9-605c-4118-b734-71856fd9e9a7 service nova] Creating event network-vif-plugged:0286aa77-bd3b-489b-9904-21ccf8dc4f03 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:48.172232 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-786e345c-74c1-4636-a990-13887f29a55b req-18890fd9-605c-4118-b734-71856fd9e9a7 service nova] Creating event network-vif-plugged:4b8708b4-e00c-4c04-aea0-e5d41c4d43c1 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:48.172895 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-786e345c-74c1-4636-a990-13887f29a55b req-18890fd9-605c-4118-b734-71856fd9e9a7 service nova] Creating event network-vif-plugged:782e6f7a-0715-4c1e-b24d-1ac485672640 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:48.173410 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-786e345c-74c1-4636-a990-13887f29a55b req-18890fd9-605c-4118-b734-71856fd9e9a7 service nova] Creating event network-vif-plugged:5f638a13-8e41-4eb0-9395-0e98a33d43bd for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:48.180102 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-786e345c-74c1-4636-a990-13887f29a55b req-18890fd9-605c-4118-b734-71856fd9e9a7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.038385 Oct 27 10:28:48.180750 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2308/4817] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:48.185911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7bf707f-d7f0-4d21-8f3a-64407dd7a10b tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:48.193838 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7bf707f-d7f0-4d21-8f3a-64407dd7a10b tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011934 Oct 27 10:28:48.194648 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2309/4818] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:28:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:48.207573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:48.208788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:48.219536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.223701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.225315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.227068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.227760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.228554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.233943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:48.257357 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-efd8f87d-e310-47b7-a8e3-098d6b6e5a73 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1315 microversion: 2.1 time: 0.321713 Oct 27 10:28:48.272518 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2510/4819] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:47 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:48.552489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:48.553027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:48.572533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.573052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.573484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.574191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.574632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.575049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.616428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:28:48.712406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:48.733415 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee11881a-9971-43d1-9836-2f4335f546f8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.537706 Oct 27 10:28:48.746780 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2310/4820] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:48 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:48.770134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:48.771093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:48.773888 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0821d0b1-80d5-44e3-a541-05b7a393d6f8 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 204 len: 0 microversion: 2.1 time: 0.223487 Oct 27 10:28:48.782163 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2511/4821] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:28:48 2022] DELETE /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:28:48.789890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:48.790914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:48.791501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.793141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.795048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.798463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.801853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.802411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.802834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.803775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.805601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.807090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.807899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.808544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:49.183861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:49.192262 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8045c09a-6aac-4f83-968c-12bf7fdee025 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1715 microversion: 2.1 time: 0.408116 Oct 27 10:28:49.193125 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2512/4822] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:48 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1715 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:49.205151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:49.205907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:49.213080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:49.213576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:49.214068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:49.215045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:49.215563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:49.216055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:49.225349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:49.235413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:49.237254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:49.238679 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b85db015-7872-4772-abd0-51b0eb9431ba tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.490528 Oct 27 10:28:49.239442 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2311/4823] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:48 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:49.284617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:49.285245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:49.292479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:49.293064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:49.293786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:49.294620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:49.295131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:49.295612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:49.962337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:49.974790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:49.978347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:49.979900 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56d27404-2637-49cf-8ed4-68daaf486d22 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.785646 Oct 27 10:28:49.981646 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2513/4824] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:49 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:49.987242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:49.988654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:49.997183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:49.998315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:49.999068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:50.000375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:50.001734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:50.002822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:50.080419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:50.093782 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46e03581-30d9-47aa-b142-4045767fa1ec tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1315 microversion: 2.1 time: 0.812955 Oct 27 10:28:50.106839 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2312/4825] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:49 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:50.219904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:50.221534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:50.239953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:50.241693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:50.242451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:50.243404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:50.244194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:50.245626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:50.401222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:50.416143 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7d99f3e-a800-4a8c-a94a-333fbfdd8ebd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.425688 Oct 27 10:28:50.417106 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2514/4826] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:49 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:50.424110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:50.424754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:50.454476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:50.454965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:50.455400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:50.456111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:50.456561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:50.457011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:50.542621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:50.550955 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-66a48b5f-ee44-4a37-b827-5a244e8ee801 tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1715 microversion: 2.1 time: 0.338337 Oct 27 10:28:50.555024 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2313/4827] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:50 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1715 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:50.689048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:50.702153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:50.703841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:50.705081 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-607a7875-ba7d-4a3a-87fb-9133da878b0a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.286822 Oct 27 10:28:50.727498 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2515/4828] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:50 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:51.016633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:51.017275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:51.028867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.029613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.030319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:51.031520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.032311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.033786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:51.119576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:51.120579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:51.133566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.134415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.134999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:51.135882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.136496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.140908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:51.554377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:51.558468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:51.573728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:51.575494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:51.576839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4c376ed-672a-43a0-aad5-1a0d6a120b72 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1880 microversion: 2.42 time: 0.564459 Oct 27 10:28:51.599337 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2314/4829] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:51 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1880 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:51.654617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:51.664224 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a0021fe-ea12-494c-a599-9151491ec2d5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1315 microversion: 2.1 time: 0.548443 Oct 27 10:28:51.677280 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2516/4830] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:51 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:51.686208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:51.687217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:51.694705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.695421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.696035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:51.696937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.697692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.698295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:51.820786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c041e846-b6ee-4d50-9b41-3bec0a0d257a tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-379597116", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:51.827608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c041e846-b6ee-4d50-9b41-3bec0a0d257a tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] HTTP exception thrown: min_count must be <= max_count Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c041e846-b6ee-4d50-9b41-3bec0a0d257a tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Request method failure captured: Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 183 Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl1jpO6zA-9k7aZDVDKCM7YU5HP4ReFXpcvPkOBoeXU75FCGT5nGXIoIPnM4RUu1-co_8vc8F1WjtYAxlU11wdMwJww6ecKKgBBxh8WIzmvw3-UPL-mGrot5WSdW-whZTAs-DE5E3XbUx8AuMy4_NxLUT9p8_l8VcfubdUuEyeh2DVc Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_25d985dbb01d40589e45d3ed4c826b7d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: b4280d5824cf4feca2e6c8f0d41a426d Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-379597116", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: exception: min_count must be <= max_count Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-379597116', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 27 10:28:51.829928 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:28:51.837351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c041e846-b6ee-4d50-9b41-3bec0a0d257a tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Returning 400 to user: min_count must be <= max_count {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:51.838449 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c041e846-b6ee-4d50-9b41-3bec0a0d257a tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.238308 Oct 27 10:28:51.839496 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2315/4831] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:51 2022] POST /compute/v2.1/servers => generated 74 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 10:28:51.844498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:51.845367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:51.854833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.855328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.855769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:51.857332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.857809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.858242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:52.018830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ba4cff95bf44a9892530e904020984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1e58c4aebb4852a2b1877bf30cbb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:52.030930 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25a22a4e-a978-4033-8c3d-011e9a4c2beb tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 200 len: 1647 microversion: 2.1 time: 0.190011 Oct 27 10:28:52.034912 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2316/4832] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:51 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 1647 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:52.055747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:52.056718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:52.063199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:52.063992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:52.064772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:52.065696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:52.066572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:52.067204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:52.100971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:52.109717 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d03f54e-8025-44d6-b5ee-d9a32ab3770c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1533 microversion: 2.1 time: 0.431015 Oct 27 10:28:52.114728 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2517/4833] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:51 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1533 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:52.134854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed357b1d-97ae-4e30-95d6-3b58b29a4c96 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1054403973", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "max_count": 0}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed357b1d-97ae-4e30-95d6-3b58b29a4c96 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Request method failure captured: Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 168 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl1jpO6zA-9k7aZDVDKCM7YU5HP4ReFXpcvPkOBoeXU75FCGT5nGXIoIPnM4RUu1-co_8vc8F1WjtYAxlU11wdMwJww6ecKKgBBxh8WIzmvw3-UPL-mGrot5WSdW-whZTAs-DE5E3XbUx8AuMy4_NxLUT9p8_l8VcfubdUuEyeh2DVc Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_25d985dbb01d40589e45d3ed4c826b7d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b4280d5824cf4feca2e6c8f0d41a426d Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1054403973", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "max_count": 0}} Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1054403973', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'max_count': 0}}} Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 0 Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:28:52.141655 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 10:28:52.145682 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.148372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed357b1d-97ae-4e30-95d6-3b58b29a4c96 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:52.150437 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed357b1d-97ae-4e30-95d6-3b58b29a4c96 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.034698 Oct 27 10:28:52.151307 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2518/4834] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:52 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:28:52.205603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6ac51e4-e668-472e-ae3b-e58a754769b7 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-215749172", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "max_count": 2.5}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6ac51e4-e668-472e-ae3b-e58a754769b7 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Request method failure captured: Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 169 Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl1jpO6zA-9k7aZDVDKCM7YU5HP4ReFXpcvPkOBoeXU75FCGT5nGXIoIPnM4RUu1-co_8vc8F1WjtYAxlU11wdMwJww6ecKKgBBxh8WIzmvw3-UPL-mGrot5WSdW-whZTAs-DE5E3XbUx8AuMy4_NxLUT9p8_l8VcfubdUuEyeh2DVc Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_25d985dbb01d40589e45d3ed4c826b7d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b4280d5824cf4feca2e6c8f0d41a426d Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-215749172", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "max_count": 2.5}} Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-215749172', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'max_count': 2.5}}} Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 2.5 Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:28:52.210967 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 10:28:52.214787 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.223204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6ac51e4-e668-472e-ae3b-e58a754769b7 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:52.224625 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6ac51e4-e668-472e-ae3b-e58a754769b7 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022954 Oct 27 10:28:52.238925 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2519/4835] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:52 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:28:52.293052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c63ee697-e94b-4c83-8c12-4ea4f433c64a tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1546351925", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 0}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c63ee697-e94b-4c83-8c12-4ea4f433c64a tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Request method failure captured: Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 168 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl1jpO6zA-9k7aZDVDKCM7YU5HP4ReFXpcvPkOBoeXU75FCGT5nGXIoIPnM4RUu1-co_8vc8F1WjtYAxlU11wdMwJww6ecKKgBBxh8WIzmvw3-UPL-mGrot5WSdW-whZTAs-DE5E3XbUx8AuMy4_NxLUT9p8_l8VcfubdUuEyeh2DVc Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_25d985dbb01d40589e45d3ed4c826b7d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b4280d5824cf4feca2e6c8f0d41a426d Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1546351925", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 0}} Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1546351925', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'min_count': 0}}} Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 0 Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:28:52.297768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 10:28:52.301699 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.305308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c63ee697-e94b-4c83-8c12-4ea4f433c64a tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:52.308725 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c63ee697-e94b-4c83-8c12-4ea4f433c64a tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019280 Oct 27 10:28:52.321417 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2520/4836] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:52 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:28:52.369917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cacdb88-e7b8-41a4-9341-84cd7f36baa5 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-839199441", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 2.5}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cacdb88-e7b8-41a4-9341-84cd7f36baa5 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Request method failure captured: Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 169 Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl1jpO6zA-9k7aZDVDKCM7YU5HP4ReFXpcvPkOBoeXU75FCGT5nGXIoIPnM4RUu1-co_8vc8F1WjtYAxlU11wdMwJww6ecKKgBBxh8WIzmvw3-UPL-mGrot5WSdW-whZTAs-DE5E3XbUx8AuMy4_NxLUT9p8_l8VcfubdUuEyeh2DVc Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_25d985dbb01d40589e45d3ed4c826b7d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25d985dbb01d40589e45d3ed4c826b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 25d985dbb01d40589e45d3ed4c826b7d Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1173576685 Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: b4280d5824cf4feca2e6c8f0d41a426d Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1173576685-project Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-839199441", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "min_count": 2.5}} Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-839199441', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'min_count': 2.5}}} Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 2.5 Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:28:52.377756 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cacdb88-e7b8-41a4-9341-84cd7f36baa5 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:52.382216 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8cacdb88-e7b8-41a4-9341-84cd7f36baa5 tempest-MultipleCreateNegativeTestJSON-1173576685 tempest-MultipleCreateNegativeTestJSON-1173576685-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014789 Oct 27 10:28:52.385440 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2521/4837] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:52 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:28:52.440172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:52.454765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:52.456707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:52.460992 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e36af39-4197-4fc9-8952-51a68daf0503 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1742 microversion: 2.20 time: 0.410591 Oct 27 10:28:52.461789 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2317/4838] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:52 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1742 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:52.609078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:52.609949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:52.622478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:52.628352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:52.629696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:52.632749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:52.634521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:52.635338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:52.637227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:52.691209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:52.691824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:52.701195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:52.701681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:52.702313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:52.706499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:52.707109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:52.707686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:53.706144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:53.717960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:53.732283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:53.733794 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72bd32ff-3163-41d2-84d6-b68c8c51a4c8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2837 microversion: 2.42 time: 1.131734 Oct 27 10:28:53.734723 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2522/4839] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:52 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2837 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:53.740000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0b691f63-b7bc-48be-b339-540cb5266ded req-9c23a488-2267-45e2-9889-06452c0de65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee938790-68f8-4a2d-bc35-37b63962be81", "name": "network-vif-deleted", "tag": "2d25df33-e375-46be-b517-352b07423210"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:53.775710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0b691f63-b7bc-48be-b339-540cb5266ded req-9c23a488-2267-45e2-9889-06452c0de65b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:53.776637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0b691f63-b7bc-48be-b339-540cb5266ded req-9c23a488-2267-45e2-9889-06452c0de65b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:53.777266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0b691f63-b7bc-48be-b339-540cb5266ded req-9c23a488-2267-45e2-9889-06452c0de65b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:53.801859 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0b691f63-b7bc-48be-b339-540cb5266ded req-9c23a488-2267-45e2-9889-06452c0de65b service nova] Creating event network-vif-deleted:2d25df33-e375-46be-b517-352b07423210 for instance ee938790-68f8-4a2d-bc35-37b63962be81 on n-h1-854663-10 Oct 27 10:28:53.810345 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0b691f63-b7bc-48be-b339-540cb5266ded req-9c23a488-2267-45e2-9889-06452c0de65b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073708 Oct 27 10:28:53.810966 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2523/4840] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:53.820804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:53.827009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] [instance: ee938790-68f8-4a2d-bc35-37b63962be81] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:53.842336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:53.842910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:53.845370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:53.846212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:53.846902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:53.859073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:53.885651 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] HTTP exception thrown: Instance ee938790-68f8-4a2d-bc35-37b63962be81 could not be found. Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Request method failure captured: Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 HTTP/1.1 Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl0WBbEBPR38_ByObjLn4-QxuMJTKIKCyeQWBtJYlLgBEh83X9PJIWfgRKThCqPi-7-pHuaFrmOZLXU4Lc_jNBQBqty1iBJtZzZFHHgrXunIuTwYrfwhJvkMBZ-OdyUUh0D9J9fIf-Dpzr8UtfEkJSFRjt3c85cmBadrqlwuQTSHTfY Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7d1e58c4aebb4852a2b1877bf30cbb9f Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersTestManualDisk-1179725527 Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7d1e58c4aebb4852a2b1877bf30cbb9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7d1e58c4aebb4852a2b1877bf30cbb9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7d1e58c4aebb4852a2b1877bf30cbb9f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7d1e58c4aebb4852a2b1877bf30cbb9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersTestManualDisk-1179725527 Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7d1e58c4aebb4852a2b1877bf30cbb9f Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersTestManualDisk-1179725527 Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersTestManualDisk-1179725527-project Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c2ba4cff95bf44a9892530e904020984 Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersTestManualDisk-1179725527-project Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance ee938790-68f8-4a2d-bc35-37b63962be81 could not be found. Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'ee938790-68f8-4a2d-bc35-37b63962be81'} Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee938790-68f8-4a2d-bc35-37b63962be81 could not be found. Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee938790-68f8-4a2d-bc35-37b63962be81 could not be found. Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:53.887765 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:53.891883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:53.891883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:53.891883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:53.891883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:53.891883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:53.891883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee938790-68f8-4a2d-bc35-37b63962be81 could not be found. Oct 27 10:28:53.891883 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:28:53.893718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Returning 404 to user: Instance ee938790-68f8-4a2d-bc35-37b63962be81 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:53.894805 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75506226-194c-4e06-8d42-af780cdd7ace tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81" status: 404 len: 111 microversion: 2.1 time: 0.078812 Oct 27 10:28:53.898919 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2524/4841] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:53 2022] GET /compute/v2.1/servers/ee938790-68f8-4a2d-bc35-37b63962be81 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:28:53.904269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:53.905217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:53.911745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:53.912523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:53.913229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:53.914170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:53.914841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:53.915489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:53.936264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:53.957499 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e72f63e4-000a-449d-8e3f-7e5080d4ee8c tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1315 microversion: 2.1 time: 1.259616 Oct 27 10:28:53.958438 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2318/4842] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:52 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1315 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:53.982786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:53.984310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:54.016303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:54.016866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:54.017316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:54.018044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:54.018496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:54.018921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:54.295718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:54.319160 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe489ca5-6256-49d5-aaf0-a86552a8d797 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.418542 Oct 27 10:28:54.335185 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2525/4843] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:53 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:54.362883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a85d378-2013-4130-a4e5-0b49baeebcc8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:54.363525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a85d378-2013-4130-a4e5-0b49baeebcc8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:54.391260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a85d378-2013-4130-a4e5-0b49baeebcc8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:54.391829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a85d378-2013-4130-a4e5-0b49baeebcc8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:54.392206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a85d378-2013-4130-a4e5-0b49baeebcc8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:54.396760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a85d378-2013-4130-a4e5-0b49baeebcc8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:54.397340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a85d378-2013-4130-a4e5-0b49baeebcc8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:54.397841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a85d378-2013-4130-a4e5-0b49baeebcc8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:54.433410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:54.454092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:54.456145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:54.457944 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25269f53-0a56-409d-92eb-b02e7e6796d3 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.498487 Oct 27 10:28:54.459110 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2319/4844] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:53 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:54.469795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67da6341-0e78-4324-b57f-aedcff7d8b9b tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] Calling method '.version_select at 0x7f6d5a85e0d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:54.539030 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67da6341-0e78-4324-b57f-aedcff7d8b9b tempest-ServersTestManualDisk-1179725527 tempest-ServersTestManualDisk-1179725527-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84163679" status: 202 len: 0 microversion: 2.1 time: 0.073874 Oct 27 10:28:54.541479 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2320/4845] 10.222.0.76 () {58 vars in 1215 bytes} [Thu Oct 27 10:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84163679 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:28:54.753727 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a85d378-2013-4130-a4e5-0b49baeebcc8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.409998 Oct 27 10:28:54.755136 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2526/4846] 10.222.0.76 () {60 vars in 1316 bytes} [Thu Oct 27 10:28:54 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5/os-interface => generated 1830 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:54.925852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8f707632-39e8-4892-8ef2-0421058e3fc5 req-5eb4ebe0-9954-4ce6-8cf1-d164cf46a18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d1371c-3f59-487c-91e9-672f3bf5f71c", "name": "network-vif-plugged", "status": "completed", "tag": "5dce3f42-d9cc-43e4-8452-4a6a2d704f31"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:54.983845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8f707632-39e8-4892-8ef2-0421058e3fc5 req-5eb4ebe0-9954-4ce6-8cf1-d164cf46a18e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:54.984459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8f707632-39e8-4892-8ef2-0421058e3fc5 req-5eb4ebe0-9954-4ce6-8cf1-d164cf46a18e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:54.984953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:54.985826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:54.994250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:54.995378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:54.996093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:54.997362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:54.997957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8f707632-39e8-4892-8ef2-0421058e3fc5 req-5eb4ebe0-9954-4ce6-8cf1-d164cf46a18e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:54.998357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:54.999051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:55.042903 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8f707632-39e8-4892-8ef2-0421058e3fc5 req-5eb4ebe0-9954-4ce6-8cf1-d164cf46a18e service nova] Creating event network-vif-plugged:5dce3f42-d9cc-43e4-8452-4a6a2d704f31 for instance 56d1371c-3f59-487c-91e9-672f3bf5f71c on n-h2-854663-10 Oct 27 10:28:55.058572 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8f707632-39e8-4892-8ef2-0421058e3fc5 req-5eb4ebe0-9954-4ce6-8cf1-d164cf46a18e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142213 Oct 27 10:28:55.061080 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2321/4847] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:28:55.350392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:55.351270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:55.371360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:55.371906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:55.372417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:55.380113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:55.380969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:55.382299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:57.007770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:57.034332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:57.035257 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-de4a7e89-88fd-41dc-afb0-c5c94345ad39 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 1.685284 Oct 27 10:28:57.037440 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2322/4848] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:55 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:57.061496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:57.064260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:57.092969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:57.093828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:57.096791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:57.097930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:57.098555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:57.100179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:57.124809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:57.152839 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae6ed6cd-5bb0-4a4c-b8c9-80f0c80b4ea2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1315 microversion: 2.1 time: 2.156787 Oct 27 10:28:57.162630 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2527/4849] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:54 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1315 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:57.618867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:57.630161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:57.638168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:57.639835 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1607793d-0ff8-42bd-b3ab-6a6958019ddf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.596989 Oct 27 10:28:57.640556 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2323/4850] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:57 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:28:58.061795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:58.063769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:58.075448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:58.077599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:58.080220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:58.084939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:58.085794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:58.086656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:58.187227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:58.188919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:58.201374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:58.206182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:58.213743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:58.214466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:58.216376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:58.218736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:58.225380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:58.226737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:59.174855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:59.181322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:59.201253 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c56a9294-d5fb-4993-828f-82ec8c4af5b1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1502 microversion: 2.1 time: 1.019409 Oct 27 10:28:59.209080 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d580d53-0851-4d95-844f-44daaf5c27f9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 1.151673 Oct 27 10:28:59.228223 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2528/4851] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:58 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:59.229734 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2324/4852] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:58 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1502 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:59.237162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:59.238396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:59.245168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f032c9aa-3041-489a-8f9f-cb758aab9c55 req-e430d8f2-007b-47a6-8dc4-645eb2ea1914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39", "name": "network-vif-plugged", "status": "completed", "tag": "f4bf9ba7-53c2-4a70-9da2-6e9514c10258"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:59.261337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:59.263309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:59.264273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:59.266797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:59.267524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:59.268551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f032c9aa-3041-489a-8f9f-cb758aab9c55 req-e430d8f2-007b-47a6-8dc4-645eb2ea1914 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:59.269569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f032c9aa-3041-489a-8f9f-cb758aab9c55 req-e430d8f2-007b-47a6-8dc4-645eb2ea1914 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:59.269948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:59.271654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f032c9aa-3041-489a-8f9f-cb758aab9c55 req-e430d8f2-007b-47a6-8dc4-645eb2ea1914 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:59.311948 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f032c9aa-3041-489a-8f9f-cb758aab9c55 req-e430d8f2-007b-47a6-8dc4-645eb2ea1914 service nova] Creating event network-vif-plugged:f4bf9ba7-53c2-4a70-9da2-6e9514c10258 for instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 on n-h2-854663-10 Oct 27 10:28:59.328692 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f032c9aa-3041-489a-8f9f-cb758aab9c55 req-e430d8f2-007b-47a6-8dc4-645eb2ea1914 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095209 Oct 27 10:28:59.335499 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2529/4853] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:59.371346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e8dfe38-ac54-4115-bbeb-fbd2ef2bbf62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:59.374172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e8dfe38-ac54-4115-bbeb-fbd2ef2bbf62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:59.395051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe38-ac54-4115-bbeb-fbd2ef2bbf62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:59.396183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe38-ac54-4115-bbeb-fbd2ef2bbf62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:59.397468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe38-ac54-4115-bbeb-fbd2ef2bbf62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:59.400158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe38-ac54-4115-bbeb-fbd2ef2bbf62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:59.401444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe38-ac54-4115-bbeb-fbd2ef2bbf62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:59.426973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe38-ac54-4115-bbeb-fbd2ef2bbf62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:59.487783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:59.700176 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e8dfe38-ac54-4115-bbeb-fbd2ef2bbf62 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c/action" status: 202 len: 0 microversion: 2.1 time: 0.361884 Oct 27 10:28:59.704970 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2530/4854] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:59 2022] POST /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:28:59.724767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6ec1d276-327a-4bdf-b4fc-2211fb4c2189 req-f2ce46e2-fb99-40e9-b872-06632bb4916f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "tag": "2489d5fc-eae3-43ec-b706-bb225acfc6a5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:59.774496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6ec1d276-327a-4bdf-b4fc-2211fb4c2189 req-f2ce46e2-fb99-40e9-b872-06632bb4916f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:59.775034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6ec1d276-327a-4bdf-b4fc-2211fb4c2189 req-f2ce46e2-fb99-40e9-b872-06632bb4916f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:59.776433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6ec1d276-327a-4bdf-b4fc-2211fb4c2189 req-f2ce46e2-fb99-40e9-b872-06632bb4916f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:59.847344 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6ec1d276-327a-4bdf-b4fc-2211fb4c2189 req-f2ce46e2-fb99-40e9-b872-06632bb4916f service nova] Creating event network-changed:2489d5fc-eae3-43ec-b706-bb225acfc6a5 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:28:59.863288 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6ec1d276-327a-4bdf-b4fc-2211fb4c2189 req-f2ce46e2-fb99-40e9-b872-06632bb4916f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155878 Oct 27 10:28:59.864258 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2531/4855] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:59.876993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:59.877725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:59.894235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:59.895004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:59.895501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:59.895941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:59.896677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:59.903133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:59.903496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:59.907894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:59.913101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:59.917294 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78d66573-82a4-4cf8-91a6-ac16633a58f8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.686326 Oct 27 10:28:59.922642 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2325/4856] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:28:59 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:00.233671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:00.235079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:00.248038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:00.248650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:00.249117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:00.249833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:00.250282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:00.250709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:00.453802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:00.474266 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7903ad5e-fe02-4364-9336-5d06300d28ef tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1507 microversion: 2.1 time: 0.607822 Oct 27 10:29:00.477509 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2532/4857] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:59 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:00.774185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:00.789551 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5aa5032f-88ee-4ec2-9340-ef7fa58f406e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.554220 Oct 27 10:29:00.790446 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2326/4858] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:00 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:00.950613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:00.950613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:00.963980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:00.964520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:00.973620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:00.974513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:00.975476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:00.976017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:01.366474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9148be86-a07d-4312-8938-9a929c027d4d req-38ac751d-7b5a-4c34-b564-06d475271a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f1a184-24f6-43f3-8477-e15a2694f8df", "name": "network-vif-plugged", "status": "completed", "tag": "d3e32e88-f305-4079-a874-e75520cad0d1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:01.393367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:01.406909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9148be86-a07d-4312-8938-9a929c027d4d req-38ac751d-7b5a-4c34-b564-06d475271a76 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:01.415762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9148be86-a07d-4312-8938-9a929c027d4d req-38ac751d-7b5a-4c34-b564-06d475271a76 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:01.420021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9148be86-a07d-4312-8938-9a929c027d4d req-38ac751d-7b5a-4c34-b564-06d475271a76 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:01.468605 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9148be86-a07d-4312-8938-9a929c027d4d req-38ac751d-7b5a-4c34-b564-06d475271a76 service nova] Creating event network-vif-plugged:d3e32e88-f305-4079-a874-e75520cad0d1 for instance 80f1a184-24f6-43f3-8477-e15a2694f8df on n-h1-854663-10 Oct 27 10:29:01.500043 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9148be86-a07d-4312-8938-9a929c027d4d req-38ac751d-7b5a-4c34-b564-06d475271a76 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137753 Oct 27 10:29:01.500756 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2327/4859] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:29:01.519154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:01.519870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:01.522754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:01.538505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:01.548851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:01.549342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:01.549776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:01.550506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:01.551202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:01.551627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:01.553252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:01.558235 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d481bc2f-e86d-4cd7-a0f2-fc1ec392539a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.609767 Oct 27 10:29:01.562031 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2533/4860] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:00 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:01.815310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:01.816317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:01.829350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:01.835120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:01.843846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:01.847554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:01.848220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:01.852560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:02.122984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:02.145353 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa97979d-16cb-4f4a-808d-e56ff8961040 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1487 microversion: 2.1 time: 0.630529 Oct 27 10:29:02.167813 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2328/4861] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:01 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1487 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:02.194089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:02.194714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:02.210299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:02.210796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:02.211232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:02.211947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:02.212395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:02.243885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:02.322118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lazy-loading 'flavor' on Instance uuid 56d1371c-3f59-487c-91e9-672f3bf5f71c {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:29:02.818819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:02.846876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d10c4831-ff71-4bcd-b7f8-cc85eec5a1df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 1.035449 Oct 27 10:29:02.940596 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2534/4862] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:01 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:02.959420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:02.960606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:02.970050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:02.970750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:02.971524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:02.972633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:02.973258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:02.974030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:03.380022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:03.435475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:03.439393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:03.443114 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-239a211a-2048-4ce1-a756-ec06749a4474 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.500638 Oct 27 10:29:03.446760 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2535/4863] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:02 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:03.881104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:03.884216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:03.903049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:03.907379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:03.908263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:03.909490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:03.911827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:03.914061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:04.243975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:04.259805 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35738e81-66d6-480d-93c6-c8ec0709833d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.384444 Oct 27 10:29:04.275482 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2536/4864] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:03 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:04.472446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:04.473297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:04.490078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:04.493431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:04.494359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:04.496643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:04.500302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:04.503211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:04.986566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:05.015979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:05.022707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:05.028482 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e66962c-e5a1-4435-b91a-b34989be1b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.556938 Oct 27 10:29:05.032119 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2537/4865] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:04 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:05.298917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:05.299883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:05.339177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:05.344973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:05.346924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:05.351029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:05.355360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:05.359679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:05.780734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:05.794656 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2edfb3c6-2e85-4ad5-befa-7dd1cf835656 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.501819 Oct 27 10:29:05.796168 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2538/4866] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:05 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:06.062810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:06.064104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:06.073857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:06.075978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:06.077246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:06.082309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:06.082990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:06.087693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:06.378636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:06.390404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:06.392880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:06.394471 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c1a1840-6bee-47ed-a6a2-64ce36783159 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.340246 Oct 27 10:29:06.395897 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2539/4867] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:06 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:06.823658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:06.824302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:06.845448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:06.845979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:06.858106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:06.858930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:06.870498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:06.871225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:07.407021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:07.434359 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0a4fc8f-fc7a-405e-8330-d79435b24db6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.613186 Oct 27 10:29:07.451370 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2540/4868] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:06 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:07.463791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:07.465682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:07.482188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:07.482962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:07.483593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:07.486298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:07.487463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:07.488311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:08.306712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:08.315577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:08.333114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:08.334649 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db1cd4bf-4f09-4ca3-bf6a-5909f88a9ecd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.879762 Oct 27 10:29:08.337713 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2541/4869] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:07 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:08.461387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:08.462828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:08.475898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:08.481218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:08.482013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:08.483334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:08.496505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:08.497362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:09.472423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:09.483929 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e821378a-73dd-4a7d-a030-140d79f2e4a1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 1.026441 Oct 27 10:29:09.499479 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2542/4870] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:08 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:09.523267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:09.527334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:09.547926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:09.551568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:09.558384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:09.561889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:09.562733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:09.570672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:10.899540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:10.915424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:10.919316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:10.924960 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3ff161c-31be-4a40-88aa-222d183db954 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 1.422032 Oct 27 10:29:10.925713 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2543/4871] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:09 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:10.945406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:10.946091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:10.971645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:10.972572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:10.979250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:10.988842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:10.991363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:10.997019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:11.509019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:11.526199 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba5152f0-5d91-4bfe-ab7e-ce5cd79d87e3 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.594643 Oct 27 10:29:11.527118 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2544/4872] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:10 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:11.956306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:11.958936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:11.977658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:11.983054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:11.984354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:11.985633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:11.992124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:11.993690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:12.198638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:12.615447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:12.630305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:12.660941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:12.664649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:12.667224 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3f4e80a-f015-4eca-aeb8-10824b3538d1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.716673 Oct 27 10:29:12.668931 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2545/4873] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:11 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:12.681289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:12.684057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:12.715612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:12.719240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:12.720111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:12.726005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:12.730171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:12.732884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:13.386076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:13.388645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:13.399660 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf5aa7a1-9f67-4df7-9f8e-dca36e6fb937 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.729360 Oct 27 10:29:13.419157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2546/4874] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:12 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:13.700039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:13.700863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:13.703152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:13.733307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:13.734270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:13.736894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:13.737848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:13.740429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:13.741165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:14.221727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:14.263370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:14.265169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:14.269072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ccc64572-5edb-44a8-b05a-4802f8fb3eb7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.572931 Oct 27 10:29:14.273125 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2547/4875] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:13 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:29:14.437696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:14.438411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:14.484719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:14.492510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:14.494707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:14.495484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:14.502046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:14.502666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:15.312582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:15.324344 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1571d251-de6a-4623-826f-5f965da2a124 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.892698 Oct 27 10:29:15.343194 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2548/4876] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:14 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:15.361652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:15.365604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:15.415931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:15.415931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:15.415931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:15.428487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:15.453994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:15.455625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:16.106493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:16.122286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:16.128134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:16.139611 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b4b7f883-196a-4239-933a-6fe128295a01 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.794866 Oct 27 10:29:16.142775 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2549/4877] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:15 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:16.352402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:16.353002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:16.393231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:16.394223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:16.395585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:16.398125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:16.400637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:16.401358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:16.950398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:16.963347 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f77d0b7-f1d8-432a-8c35-8fb699fe5f84 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.613532 Oct 27 10:29:16.984610 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2550/4878] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:16 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:17.170680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:17.171519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:17.186300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:17.190612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:17.191710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:17.195225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:17.197243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:17.202186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:18.305745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:18.341491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:18.355873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:18.358908 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0dd942af-13ab-447f-bc50-1fdc0f8460b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 1.194537 Oct 27 10:29:18.380107 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2551/4879] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:17 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:29:18.410230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:18.414643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:18.457076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:18.465697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:18.467340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:18.476782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:18.481914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:18.482464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:19.544845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:19.570427 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39ba7537-1182-4a2c-8da6-9c8276d79908 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 1.187941 Oct 27 10:29:19.575984 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2552/4880] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:18 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:19.588778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:19.635081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:19.638668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:19.643571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:19.645385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:19.657576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:19.659781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:19.660711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:20.316529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:20.332357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:20.337988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:20.339788 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77c89f14-8b8d-4c94-bda7-2b58ca6f4f63 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.760028 Oct 27 10:29:20.342632 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2553/4881] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:19 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:20.601696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:20.606365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:20.618616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:20.621405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:20.622563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:20.623649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:20.624376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:20.624987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:21.112049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:21.128208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7e13141-7b50-479e-b5f7-0b4e3fa2f5cc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1528 microversion: 2.1 time: 0.530228 Oct 27 10:29:21.132073 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2554/4882] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:20 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1528 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:21.513443 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55a5e7b2-a96a-422e-844d-ab7ae57738d1 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c/action" status: 202 len: 0 microversion: 2.1 time: 19.344166 Oct 27 10:29:21.518139 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2329/4883] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:29:02 2022] POST /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c/action => generated 0 bytes in 19350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:29:21.523581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:21.524291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:21.571771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:21.572350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:21.572822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:21.589513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:21.590216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:21.590682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:22.118173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1982703150", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "22cddf29-3837-4a3c-9e3f-6c6a24e3ce52"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:22.194906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:22.226795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:22.228496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:22.238983 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f3e2c91-f119-4a06-b367-879097ec824c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1737 microversion: 2.20 time: 0.719517 Oct 27 10:29:22.242798 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2330/4884] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:21 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1737 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:22.253550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:22.254250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:22.284406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:22.286787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:22.287546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:22.288750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:22.292652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:22.293385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:22.350829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] validate_networks() for [('22cddf29-3837-4a3c-9e3f-6c6a24e3ce52', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:29:22.854637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:22.867415 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-08cd1a01-1bf4-4170-af61-15389e395ba8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1514 microversion: 2.1 time: 0.622463 Oct 27 10:29:22.869524 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2331/4885] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:22 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1514 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:22.910625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:22.916863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:22.925545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:22.926512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:22.927457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:22.929196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:22.930385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:22.931841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:23.693443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:23.708121 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ffd391e-288a-4701-83a3-fd63f6d017ec tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1510 microversion: 2.1 time: 0.834502 Oct 27 10:29:23.709219 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2332/4886] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:22 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1510 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:23.724268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:23.725078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:23.741039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:23.741910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:23.742570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:23.743638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:23.744270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:23.744881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:24.262328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:29:24.263524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:29:24.264288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:29:24.264939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:29:24.265658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:29:24.281698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:24.284432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:24.296795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:24.306434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:24.307102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:24.308053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:24.329547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:24.342231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:24.344142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:24.345864 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1baf18c3-ab3d-41c3-9f92-f3f09ace5590 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1719 microversion: 2.20 time: 0.630614 Oct 27 10:29:24.346966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2333/4887] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:23 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1719 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:24.352577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:24.353558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:24.362267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:24.363675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Getting quotas for project 1a3cc8f8e9d14ca788dc49f2951aed22. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:29:24.364009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:24.364768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:24.365926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:24.366553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:24.367137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:24.377684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Getting quotas for user e11dad026f2b4e6d8eb8ad307b0f9be3 and project 1a3cc8f8e9d14ca788dc49f2951aed22. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:29:24.451391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:29:24.458794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:29:24.610167 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca2f28ee-e204-41c8-bfc4-e8cf016c7910 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.467077 Oct 27 10:29:24.613453 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2555/4888] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:29:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:29:24.615435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:24.621115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e7a4e0a0-7a35-48c5-960a-f94fc80e5091 req-a8b0dd03-67dc-42c3-98f6-6f4dbbcf6a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f1a184-24f6-43f3-8477-e15a2694f8df", "name": "network-vif-unplugged", "status": "completed", "tag": "d3e32e88-f305-4079-a874-e75520cad0d1"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:24.631089 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31a9f71d-6007-4133-a1d2-0292e3c2a05f tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.282571 Oct 27 10:29:24.638271 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2334/4889] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:24 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:24.649062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d210cd01-1068-4774-975d-adbc1cead0fe tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:24.649754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d210cd01-1068-4774-975d-adbc1cead0fe tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:24.663352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e7a4e0a0-7a35-48c5-960a-f94fc80e5091 req-a8b0dd03-67dc-42c3-98f6-6f4dbbcf6a3a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:24.665751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e7a4e0a0-7a35-48c5-960a-f94fc80e5091 req-a8b0dd03-67dc-42c3-98f6-6f4dbbcf6a3a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:24.667326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e7a4e0a0-7a35-48c5-960a-f94fc80e5091 req-a8b0dd03-67dc-42c3-98f6-6f4dbbcf6a3a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:24.684439 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e7a4e0a0-7a35-48c5-960a-f94fc80e5091 req-a8b0dd03-67dc-42c3-98f6-6f4dbbcf6a3a service nova] Creating event network-vif-unplugged:d3e32e88-f305-4079-a874-e75520cad0d1 for instance 80f1a184-24f6-43f3-8477-e15a2694f8df on n-h1-854663-10 Oct 27 10:29:24.692395 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e7a4e0a0-7a35-48c5-960a-f94fc80e5091 req-a8b0dd03-67dc-42c3-98f6-6f4dbbcf6a3a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077195 Oct 27 10:29:24.693842 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2556/4890] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:29:24.745340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:24.748774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:24.778335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:24.781235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:24.782240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:24.786914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:24.790687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:24.791275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:24.849683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d210cd01-1068-4774-975d-adbc1cead0fe tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:24.862513 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d210cd01-1068-4774-975d-adbc1cead0fe tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1225 microversion: 2.1 time: 0.222604 Oct 27 10:29:24.863510 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2335/4891] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:24 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1225 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:25.255878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:25.286951 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af3b18a5-06ae-4076-b165-cbc253e597ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1510 microversion: 2.1 time: 0.548440 Oct 27 10:29:25.322691 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2557/4892] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:24 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1510 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:25.376643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:25.378969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:25.402255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:25.408957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:25.411273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:25.418164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:25.418875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:25.422254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:25.672032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:25.673148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:25.698047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:25.698536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:25.700589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:25.701915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:25.703852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:25.706313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:26.321493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:26.338790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:26.340896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:26.342866 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31b01c5e-750b-4adf-b030-c7f4a5608b65 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1719 microversion: 2.20 time: 0.970826 Oct 27 10:29:26.347356 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2336/4893] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:25 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1719 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:26.356614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:26.357601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:26.389182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:26.389182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:26.389182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:26.394402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:26.403231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:26.404533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:26.711650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:26.729631 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12939fa7-e022-4033-9257-8af6744a86f5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 1.063430 Oct 27 10:29:26.731001 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2558/4894] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:25 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:26.738410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:26.739418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:26.750616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:26.751843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:26.752486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:26.753779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:26.754761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:26.755556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:26.782825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:26.829175 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1a3e2638-1a8f-4546-9073-1e55003c540c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1221 microversion: 2.1 time: 0.479316 Oct 27 10:29:26.847427 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2337/4895] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:26 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1221 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:26.862414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4eeb23f1-6516-4fba-9ea2-b619de6a5b12 req-57b1d41a-02be-4c47-99b3-c4e33f3f7565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d1371c-3f59-487c-91e9-672f3bf5f71c", "name": "network-vif-plugged", "status": "completed", "tag": "5dce3f42-d9cc-43e4-8452-4a6a2d704f31"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:26.881386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4eeb23f1-6516-4fba-9ea2-b619de6a5b12 req-57b1d41a-02be-4c47-99b3-c4e33f3f7565 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:26.882998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4eeb23f1-6516-4fba-9ea2-b619de6a5b12 req-57b1d41a-02be-4c47-99b3-c4e33f3f7565 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:26.883741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4eeb23f1-6516-4fba-9ea2-b619de6a5b12 req-57b1d41a-02be-4c47-99b3-c4e33f3f7565 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:26.919504 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4eeb23f1-6516-4fba-9ea2-b619de6a5b12 req-57b1d41a-02be-4c47-99b3-c4e33f3f7565 service nova] Creating event network-vif-plugged:5dce3f42-d9cc-43e4-8452-4a6a2d704f31 for instance 56d1371c-3f59-487c-91e9-672f3bf5f71c on n-h2-854663-10 Oct 27 10:29:26.938351 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4eeb23f1-6516-4fba-9ea2-b619de6a5b12 req-57b1d41a-02be-4c47-99b3-c4e33f3f7565 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085593 Oct 27 10:29:26.938995 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2338/4896] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:29:27.375613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:27.376323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:27.388205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:27.389038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:27.389631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:27.392052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:27.392737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:27.394446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:27.936533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:27.952521 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f916162f-910e-4799-9f47-f5b52ce176bd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1513 microversion: 2.1 time: 1.218683 Oct 27 10:29:27.970767 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2559/4897] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:26 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1513 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:27.985321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:27.986197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:27.994266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:27.995038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:27.996047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:27.996991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:27.997669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:27.998310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:28.505112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:28.524425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:28.531890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:28.535374 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8180dbe8-5478-44c4-a24f-065d0f22594d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1662 microversion: 2.20 time: 1.164331 Oct 27 10:29:28.536201 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2339/4898] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:27 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1662 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:28.542812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:28.543601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:28.551150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:28.551911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:28.552831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:28.554378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:28.555040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:28.555692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:28.603960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:28.618006 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30d4418f-2d7e-4057-9f0b-c1d4124b6497 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.641424 Oct 27 10:29:28.621825 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2560/4899] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:27 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:28.630415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:28.642491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:28.659446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:28.659930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:28.660356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:28.661088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:28.661508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:28.661970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:29.149907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:29.159480 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07c1b7c5-d8bf-4242-84dc-62d15423fbdd tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1283 microversion: 2.1 time: 0.621639 Oct 27 10:29:29.174303 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2340/4900] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:28 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1283 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:29.192194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b856c51-be04-4d12-86be-3d5f5e7a4650 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2edeec9-14be-45ce-95ff-614310228491"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:29.196119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b856c51-be04-4d12-86be-3d5f5e7a4650 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:29.205452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b856c51-be04-4d12-86be-3d5f5e7a4650 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:29.206402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b856c51-be04-4d12-86be-3d5f5e7a4650 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:29.207091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b856c51-be04-4d12-86be-3d5f5e7a4650 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:29.208054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b856c51-be04-4d12-86be-3d5f5e7a4650 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:29.208842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b856c51-be04-4d12-86be-3d5f5e7a4650 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:29.209717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b856c51-be04-4d12-86be-3d5f5e7a4650 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:29.492540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:29.504918 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66adf110-afd7-4591-a9a3-1b124db744ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1453 microversion: 2.1 time: 0.878312 Oct 27 10:29:29.509691 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2561/4901] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:28 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1453 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:29.521544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-55b3918f-c64b-4150-bb1e-e79605bc4c4c req-799b18e5-6625-4604-9eac-787a18cbfa00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39", "name": "network-vif-unplugged", "status": "completed", "tag": "f4bf9ba7-53c2-4a70-9da2-6e9514c10258"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:29.551642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-55b3918f-c64b-4150-bb1e-e79605bc4c4c req-799b18e5-6625-4604-9eac-787a18cbfa00 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:29.552145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-55b3918f-c64b-4150-bb1e-e79605bc4c4c req-799b18e5-6625-4604-9eac-787a18cbfa00 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:29.554882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-55b3918f-c64b-4150-bb1e-e79605bc4c4c req-799b18e5-6625-4604-9eac-787a18cbfa00 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:29.582640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_external_events [req-55b3918f-c64b-4150-bb1e-e79605bc4c4c req-799b18e5-6625-4604-9eac-787a18cbfa00 service nova] Unable to find a host for instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39. Dropping event network-vif-unplugged {{(pid=120720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 10:29:29.583926 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-55b3918f-c64b-4150-bb1e-e79605bc4c4c req-799b18e5-6625-4604-9eac-787a18cbfa00 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.072638 Oct 27 10:29:29.585607 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2562/4902] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 10:29:29.631376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:29.633274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:29.656119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:29.658738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:29.660035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:29.667864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:29.670818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:29.673406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:29.711009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lazy-loading 'flavor' on Instance uuid 80f1a184-24f6-43f3-8477-e15a2694f8df {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:29:29.728184 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Cannot 'shelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state shelved_offloaded Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action HTTP/1.1 Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 14 Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: {"shelve": {}} Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: exception: Cannot 'shelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state shelved_offloaded Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df', 'body': {'shelve': {}}} Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:29:29.730575 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state shelved_offloaded Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state shelved_offloaded Oct 27 10:29:29.735459 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:29:29.738887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 409 to user: Cannot 'shelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state shelved_offloaded {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:29:29.740186 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-962d8790-96be-4b8a-940a-1b53206a9b64 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 409 len: 155 microversion: 2.1 time: 0.127046 Oct 27 10:29:29.741831 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2563/4903] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:29:29 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 155 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:29:29.748942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:29.749930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:29.759094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:29.759920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:29.760726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:29.761778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:29.762433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:29.763030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:29.817224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b856c51-be04-4d12-86be-3d5f5e7a4650 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.634711 Oct 27 10:29:29.825082 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2341/4904] 10.222.0.76 () {62 vars in 1364 bytes} [Thu Oct 27 10:29:29 2022] POST /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments => generated 188 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:29:29.840536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:29.842796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:29.857210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:29.857898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:29.860304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:29.861207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:29.863066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:29.863603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:30.140633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:30.150915 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c52d1ee1-b68c-4532-8dc4-e47fc5015004 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.407764 Oct 27 10:29:30.157381 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2564/4905] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:29 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:30.162432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:30.166429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:30.178490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:30.179831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:30.179831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:30.180451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:30.187290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:30.187869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:30.221180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:30.274845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120720) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 10:29:30.305851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120719) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 10:29:30.516290 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69d363b8-c9e6-4260-be01-99ad2eba29bc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/action" status: 202 len: 0 microversion: 2.20 time: 0.358631 Oct 27 10:29:30.541387 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2565/4906] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:29:30 2022] POST /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:29:30.562543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:30.564951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:30.588058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:30.591811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:30.594344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:30.595452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:30.596579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:30.597981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:30.600140 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39c91b6d-c6e3-4930-9918-ab194b285bf6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 202 len: 0 microversion: 2.1 time: 0.772130 Oct 27 10:29:30.605422 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2342/4907] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:29:29 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:29:30.621474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:30.622772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:30.639591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:30.640441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:30.641650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:30.642532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:30.643145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:30.643728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:31.141256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:31.150591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c3c07c79-9154-4741-97b3-bb970ecffb05 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1325 microversion: 2.1 time: 0.606856 Oct 27 10:29:31.157407 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2566/4908] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:30 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1325 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:31.162856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:31.163500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:31.178629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:31.180357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:31.181002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:31.181876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:31.182281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:31.183759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:31.184356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:31.201959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:31.203519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:31.204789 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c523973-7820-4394-9d11-15c976eccc1d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1748 microversion: 2.20 time: 0.597260 Oct 27 10:29:31.205367 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2343/4909] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:30 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1748 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:31.210423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:31.222294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:31.232150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:31.243088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:31.243898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:31.244870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:31.245491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:31.246119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:31.291391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:32.043570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:32.045466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:32.072789 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5e6677b-3ae2-4f13-b23d-06dc4ab77c66 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1461 microversion: 2.1 time: 0.911337 Oct 27 10:29:32.072789 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2567/4910] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:31 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1461 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:32.094130 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6064474-85d8-4e05-b835-cb255bbe306e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.887009 Oct 27 10:29:32.095130 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2344/4911] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:31 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:32.205891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:32.206971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:32.238861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:32.239514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:32.250977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:32.250977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:32.250977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:32.250977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:32.250977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:32.250977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:32.267104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:32.270043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:32.270555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:32.277389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:32.278791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:32.281174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:32.754719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:32.781666 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-847647fc-a4bb-4f02-a9d1-4a1bc765f8e0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1325 microversion: 2.1 time: 0.575576 Oct 27 10:29:32.782938 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2568/4912] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:32 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1325 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:32.889885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:32.913660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:32.918752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:32.924778 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d17e783-7069-4d3d-8a09-fc0d2b5e5fee tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1748 microversion: 2.20 time: 0.694787 Oct 27 10:29:32.928266 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2345/4913] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:32 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1748 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:29:32.938369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-35f19de1-7e27-4fc9-bdb5-a70e95313f4c req-70abc76a-4c3f-46bf-80d6-88556c807995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d634c112-a4df-43c0-9574-6ea0fb32d60c", "tag": "557cc7cc-f08f-4993-90f4-665c72d35870"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:32.961705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-35f19de1-7e27-4fc9-bdb5-a70e95313f4c req-70abc76a-4c3f-46bf-80d6-88556c807995 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:32.962426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-35f19de1-7e27-4fc9-bdb5-a70e95313f4c req-70abc76a-4c3f-46bf-80d6-88556c807995 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:32.965187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-35f19de1-7e27-4fc9-bdb5-a70e95313f4c req-70abc76a-4c3f-46bf-80d6-88556c807995 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:33.001548 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-35f19de1-7e27-4fc9-bdb5-a70e95313f4c req-70abc76a-4c3f-46bf-80d6-88556c807995 service nova] Creating event network-changed:557cc7cc-f08f-4993-90f4-665c72d35870 for instance d634c112-a4df-43c0-9574-6ea0fb32d60c on n-h1-854663-10 Oct 27 10:29:33.014130 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-35f19de1-7e27-4fc9-bdb5-a70e95313f4c req-70abc76a-4c3f-46bf-80d6-88556c807995 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079264 Oct 27 10:29:33.015764 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2569/4914] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:29:33.095720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:33.096490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:33.108653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:33.109194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:33.118020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:33.120638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:33.123719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:33.125786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:33.128831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:33.131546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:33.146628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:33.148612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:33.149461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:33.151721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:33.152564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:33.153532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:34.343346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:34.431197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:34.620272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:34.632847 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba55897e-2175-454a-a49c-9e3ba07d1cf2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 1.511011 Oct 27 10:29:34.644460 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2570/4915] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:33 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:34.654079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:34.657174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:34.694155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:34.697507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:34.698202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:34.699194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:34.701220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:34.702001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:34.735977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:34.751715 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ee8a4e1-fe88-4b5d-8e47-0db162cba4cd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1461 microversion: 2.1 time: 1.658581 Oct 27 10:29:34.768709 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2346/4916] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:33 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1461 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:34.777725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:34.777725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:34.800416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:34.806716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:34.817141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:34.818214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:34.818699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:34.826160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:34.927326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:35.047887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:35.060558 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5525414f-36e0-4281-88db-b7db55a8be3b tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1325 microversion: 2.1 time: 0.414533 Oct 27 10:29:35.061371 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2571/4917] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:34 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1325 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:35.257799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:35.269670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:35.271822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:35.273851 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b09c1b8f-34ae-4225-a312-e9158c84f2be tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1750 microversion: 2.20 time: 0.512671 Oct 27 10:29:35.275043 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2347/4918] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:34 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1750 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:35.670275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:35.671621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:35.684460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:35.695912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:35.696756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:35.697738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:35.698509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:35.699159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:35.786110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:35.791467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:35.812375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:35.813872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:35.818802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:35.821138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:35.823595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:35.826044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:36.507913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:36.530379 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9629bf1e-0ace-45fb-bc5c-5d5dbeb95a66 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.863527 Oct 27 10:29:36.533007 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2572/4919] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:35 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:36.544792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:36.545508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:36.569888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:36.570938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:36.572573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:36.573733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:36.575100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:36.576362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:36.926755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:36.945942 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92764b98-b633-42c3-95ee-9a3350b86cfb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 1.164172 Oct 27 10:29:36.950758 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2348/4920] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:35 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:36.961009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:36.971916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:36.991061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:36.993923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:37.001481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:37.002524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:37.003166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:37.003813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:37.417759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:37.427491 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2daa60b-ea38-4f26-99f2-9a90bc3320ec tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1325 microversion: 2.1 time: 0.892709 Oct 27 10:29:37.432154 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2573/4921] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:36 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1325 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:37.561258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:37.562082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:37.578881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:37.579546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:37.581843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:37.583521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:37.586056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:37.590584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:37.636653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:37.648301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:37.661329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:37.663425 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93c5d3bf-3820-49d0-b3e1-02f5b3e9a132 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1750 microversion: 2.20 time: 0.711522 Oct 27 10:29:37.668454 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2349/4922] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:36 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1750 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:37.976223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:37.976892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:37.996137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:38.001912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:38.002585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:38.009537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:38.014139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:38.017262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:38.634752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:38.658939 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d91f8122-31e1-4c81-a6f5-49b54a709250 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 1.098164 Oct 27 10:29:38.661503 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2574/4923] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:37 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:38.681832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:38.686585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:38.690008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:38.706076 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13ed892e-5628-4789-9e36-e93dd04eb7c5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.731849 Oct 27 10:29:38.707517 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2350/4924] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:37 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:38.709782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:38.710269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:38.713688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:38.714566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:38.716545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:38.717645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:38.721535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:38.722288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:38.723063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:38.723719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:38.724933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:38.725894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:38.726607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:38.726855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:39.270668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:39.294075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:39.295938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:39.299513 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7980c83e-50c7-46c1-829d-4dd5934d1969 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1750 microversion: 2.20 time: 0.590692 Oct 27 10:29:39.304962 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2351/4925] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:38 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1750 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:39.366189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:39.376494 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09a2d842-9274-4f35-9f32-dd8d815775c4 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1325 microversion: 2.1 time: 0.713184 Oct 27 10:29:39.386235 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2575/4926] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:38 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1325 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:39.688326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:39.689488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:39.710649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:39.711647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:39.712335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:39.719237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:39.720130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:39.720865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:39.739361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:39.743086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:39.764336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:39.773933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:39.774557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:39.775531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:39.776952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:39.782023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:40.212061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:40.222890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-294ca1bc-0254-4f7b-91f4-d30398edbf52 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.538258 Oct 27 10:29:40.226573 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2352/4927] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:39 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:40.233159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:40.248166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-174c0373-cdc8-4e7a-8572-443a7c967749 req-07e8fd57-6131-499a-b2d8-c2d88194d848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f1a184-24f6-43f3-8477-e15a2694f8df", "tag": "d3e32e88-f305-4079-a874-e75520cad0d1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:40.248554 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-871b8581-1575-4426-a497-abb1e7ef3095 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.510828 Oct 27 10:29:40.249556 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2576/4928] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:39 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:40.268540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-174c0373-cdc8-4e7a-8572-443a7c967749 req-07e8fd57-6131-499a-b2d8-c2d88194d848 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:40.274242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-174c0373-cdc8-4e7a-8572-443a7c967749 req-07e8fd57-6131-499a-b2d8-c2d88194d848 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:40.275600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-174c0373-cdc8-4e7a-8572-443a7c967749 req-07e8fd57-6131-499a-b2d8-c2d88194d848 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:40.295463 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-174c0373-cdc8-4e7a-8572-443a7c967749 req-07e8fd57-6131-499a-b2d8-c2d88194d848 service nova] Creating event network-changed:d3e32e88-f305-4079-a874-e75520cad0d1 for instance 80f1a184-24f6-43f3-8477-e15a2694f8df on n-h2-854663-10 Oct 27 10:29:40.302440 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-174c0373-cdc8-4e7a-8572-443a7c967749 req-07e8fd57-6131-499a-b2d8-c2d88194d848 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073365 Oct 27 10:29:40.305017 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2353/4929] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:29:40.332986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:40.334321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:40.346602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:40.349610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:40.350410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:40.351182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:40.354589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:40.355501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:40.422193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:40.423223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:40.439448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:40.440701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:40.440972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:40.441915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:40.442557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:40.443326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:40.929861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:40.952426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:40.953115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:40.961798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:40.962754 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-252242f8-c984-40e9-bcb8-f7752a561cb7 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1325 microversion: 2.1 time: 0.553246 Oct 27 10:29:40.963064 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59c3752b-9466-462c-bb9d-15511f1b505b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1750 microversion: 2.20 time: 0.634332 Oct 27 10:29:40.968707 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2354/4930] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:40 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1325 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:40.972143 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2577/4931] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:40 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1750 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:41.254545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:41.255405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:41.276717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:41.277667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:41.278627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:41.281002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:41.283621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:41.285712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:41.288438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:41.289575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:41.297385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:41.297904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:41.298353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:41.299169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:41.299624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:41.300067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:41.641372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:41.655289 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1035b66f-a917-43f3-899b-1e71b4a4c04e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.382721 Oct 27 10:29:41.675648 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2578/4932] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:41 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:41.781801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:41.791076 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-36cbee57-5d5f-4aa7-84d0-70894cf580fc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.541048 Oct 27 10:29:41.792012 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2355/4933] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:41 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:42.003987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:42.004603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:42.010748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:42.011618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:42.028713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:42.041176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:42.041702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:42.042125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:42.042949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:42.043406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:42.049323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:42.052676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:42.053522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:42.054345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:42.067058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:42.068074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:42.594864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:42.649531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:42.658912 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17b44236-6e25-4705-81a8-3cb817c72e42 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1325 microversion: 2.1 time: 0.658798 Oct 27 10:29:42.671298 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2579/4934] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:41 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1325 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:42.684489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9af102fd-54f2-4162-b8f4-ee50d9d2ed49 req-60000433-67c5-4c11-baf8-239c1e9a716b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d634c112-a4df-43c0-9574-6ea0fb32d60c", "name": "network-vif-plugged", "status": "completed", "tag": "557cc7cc-f08f-4993-90f4-665c72d35870"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:42.699574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9af102fd-54f2-4162-b8f4-ee50d9d2ed49 req-60000433-67c5-4c11-baf8-239c1e9a716b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:42.700621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9af102fd-54f2-4162-b8f4-ee50d9d2ed49 req-60000433-67c5-4c11-baf8-239c1e9a716b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:42.700848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:42.701225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9af102fd-54f2-4162-b8f4-ee50d9d2ed49 req-60000433-67c5-4c11-baf8-239c1e9a716b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:42.710805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:42.715045 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9af102fd-54f2-4162-b8f4-ee50d9d2ed49 req-60000433-67c5-4c11-baf8-239c1e9a716b service nova] Creating event network-vif-plugged:557cc7cc-f08f-4993-90f4-665c72d35870 for instance d634c112-a4df-43c0-9574-6ea0fb32d60c on n-h1-854663-10 Oct 27 10:29:42.721533 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9af102fd-54f2-4162-b8f4-ee50d9d2ed49 req-60000433-67c5-4c11-baf8-239c1e9a716b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048612 Oct 27 10:29:42.726592 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2580/4935] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:29:42.727271 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-70ec5d9f-9b58-46fc-a749-0ab8f788f0ef tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1750 microversion: 2.20 time: 0.712381 Oct 27 10:29:42.738349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:42.749261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:42.749528 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2356/4936] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:42 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1750 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:42.808423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:42.811287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:42.816847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:42.817654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:42.818153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:42.818575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:42.819521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:42.820533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:42.831789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:42.837284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:42.840248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:42.842349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:42.845193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:42.846514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:42.847963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:43.778858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:43.804851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:43.805590 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1e6acb4-8cc4-4f52-88e2-7d8243fe84e8 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.987681 Oct 27 10:29:43.833703 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2357/4937] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:42 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:43.841742 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a2a5ea9-d816-4a48-8dc1-fec08b0763df tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 1.111672 Oct 27 10:29:43.843202 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2581/4938] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:42 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:43.851535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:43.852477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:43.881291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:43.882069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:43.885461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:43.887368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:43.888193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:43.892131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:43.893233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:43.894777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:43.905795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:43.933854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:43.944914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:43.951935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:43.954940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:43.963202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:43.969395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:43.971637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:44.456324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:44.473171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:44.479119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:44.481196 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0b183d2-ba72-44dc-8434-338c7810379f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1750 microversion: 2.20 time: 0.635097 Oct 27 10:29:44.493825 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2582/4939] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:43 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1750 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:44.547854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:44.557456 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f72cea8-b16d-4ce8-9d84-f61046ba1757 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1325 microversion: 2.1 time: 0.722444 Oct 27 10:29:44.570246 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2358/4940] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:43 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1325 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:44.840819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:44.842033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:44.851002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:44.871520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:44.872922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:44.876865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:44.879061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:44.882410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:44.884392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:44.886449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:44.887282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:44.888541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:44.890758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:44.893690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:44.896338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:44.898145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:45.962994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:45.981248 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3009b84-6ef3-4dc4-9b8e-ce7344cbe099 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 1.145054 Oct 27 10:29:45.989993 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2583/4941] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:44 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:46.072872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:46.089435 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b3b04c45-9260-496e-a2c8-cb3f97936f09 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 1.220581 Oct 27 10:29:46.092536 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2359/4942] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:44 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:46.106966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:46.115513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:46.146362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:46.146907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:46.147364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:46.155142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:46.157005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:46.161633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:46.656535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:46.684171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:46.689367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:46.706521 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4a3cce2-0a4b-4b8f-876e-901ed7caacb6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1750 microversion: 2.20 time: 0.607971 Oct 27 10:29:46.716797 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2360/4943] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:46 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1750 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:46.727433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:46.727433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:46.741619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:46.743308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:46.743604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:46.747005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:46.748768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:46.748768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:46.923481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1769263871", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:47.261431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:47.269251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:47.292644 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38c5e4d0-968c-4490-9993-29abcf13f35e tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1522 microversion: 2.1 time: 0.582280 Oct 27 10:29:47.295042 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2361/4944] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:46 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1522 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:47.314180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:47.315231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:47.324930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:47.325712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:47.326653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:47.327684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:47.328857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:47.329471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:47.614829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:47.638711 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1c7aa06-e46f-4fb8-97e4-879bce4a99e2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.337979 Oct 27 10:29:47.647294 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2362/4945] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:47 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:47.665049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:47.666139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:47.683025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:47.683531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:47.683970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:47.684737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:47.685187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:47.686554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:48.099051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:48.118485 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1300e2ce-94d6-4854-aa78-a25b6d323fcd tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.459691 Oct 27 10:29:48.119477 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2363/4946] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:47 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:48.135236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:48.138006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:48.152101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:48.153526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:48.154299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:48.155308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:48.156758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:48.157825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:48.188175 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] HTTP exception thrown: Instance is not a member of specified network Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Request method failure captured: Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c/ips/invalid HTTP/1.1 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl2AvL3K0a7FDB7Wk3R3v0J9ssYjW1X_uQItull8veqRPi0xAmARYJeAUKjonj97YuWXDOsf0zke9VzxbyMdhvvuOEB5As7vITNsEHjmBm4zxECOIPANkkq4Ai6JVvaL_Lyn0xxnFJl2ocpl4MGebV8k4XjD83ly0ogUWDCjHlUn3wU Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1a3cc8f8e9d14ca788dc49f2951aed22 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1034594995 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a3cc8f8e9d14ca788dc49f2951aed22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a3cc8f8e9d14ca788dc49f2951aed22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a3cc8f8e9d14ca788dc49f2951aed22", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a3cc8f8e9d14ca788dc49f2951aed22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1034594995 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1a3cc8f8e9d14ca788dc49f2951aed22 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1034594995 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerAddressesNegativeTestJSON-1034594995-project Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: e11dad026f2b4e6d8eb8ad307b0f9be3 Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1034594995-project Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance is not a member of specified network Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'server_id': 'd634c112-a4df-43c0-9574-6ea0fb32d60c', 'id': 'invalid'} Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 27 10:29:48.198288 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:48.206081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:29:48.208889 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6cdc0f6-9c71-4a64-ba19-44e6c72ddcd3 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.087418 Oct 27 10:29:48.218384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2364/4947] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:29:48 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c/ips/invalid => generated 91 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:29:48.227086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:48.233160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:48.252928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:48.253866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:48.254540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:48.257486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:48.259054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:48.262755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:48.598097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:48.609190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:48.620173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:48.627452 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bad9fba1-a4db-4e49-9227-a79e271d3ef6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.407278 Oct 27 10:29:48.641414 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2365/4948] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:48 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:48.649343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1352b2e2-5083-434f-87c0-ddb89f5d451d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:48.649741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1352b2e2-5083-434f-87c0-ddb89f5d451d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Failed to fetch instance by id 999 {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 10:29:48.650263 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-1352b2e2-5083-434f-87c0-ddb89f5d451d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] HTTP exception thrown: Instance 999 could not be found. Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1352b2e2-5083-434f-87c0-ddb89f5d451d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Request method failure captured: Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl2AvL3K0a7FDB7Wk3R3v0J9ssYjW1X_uQItull8veqRPi0xAmARYJeAUKjonj97YuWXDOsf0zke9VzxbyMdhvvuOEB5As7vITNsEHjmBm4zxECOIPANkkq4Ai6JVvaL_Lyn0xxnFJl2ocpl4MGebV8k4XjD83ly0ogUWDCjHlUn3wU Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1a3cc8f8e9d14ca788dc49f2951aed22 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1034594995 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a3cc8f8e9d14ca788dc49f2951aed22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a3cc8f8e9d14ca788dc49f2951aed22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a3cc8f8e9d14ca788dc49f2951aed22", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a3cc8f8e9d14ca788dc49f2951aed22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1034594995 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1a3cc8f8e9d14ca788dc49f2951aed22 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1034594995 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerAddressesNegativeTestJSON-1034594995-project Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: e11dad026f2b4e6d8eb8ad307b0f9be3 Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1034594995-project Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 999 could not be found. Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'server_id': '999'} Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 27 10:29:48.664651 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:48.672373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1352b2e2-5083-434f-87c0-ddb89f5d451d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:29:48.672373 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1352b2e2-5083-434f-87c0-ddb89f5d451d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.034529 Oct 27 10:29:48.675813 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2366/4949] 10.222.0.76 () {58 vars in 1149 bytes} [Thu Oct 27 10:29:48 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:29:48.688163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:48.688163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:48.715151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:48.715151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:48.715151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:48.715151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:48.715151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:48.715151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:48.786020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:29:48.975162 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22dc5e29-b782-4424-8c49-3b76a7ac28af tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 204 len: 0 microversion: 2.1 time: 0.298502 Oct 27 10:29:48.977498 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2367/4950] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:29:48 2022] DELETE /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:29:48.991438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:49.002254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:49.028140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:49.036716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:49.042928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:49.046408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:49.048648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:49.053527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:49.362522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:49.373400 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a9d28d5-4fa5-4e3c-937e-1c78d91bfdf4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 0.390884 Oct 27 10:29:49.389574 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2368/4951] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:48 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:49.399607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:49.400514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:49.407832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:49.408562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:49.409791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:49.411459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:49.412100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:49.412701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:49.602334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:49.612585 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1fc360f1-bf8d-4c85-997e-50bde73d4c1d tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1528 microversion: 2.1 time: 0.221747 Oct 27 10:29:49.614002 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2369/4952] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:49 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1528 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:49.639019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:49.640072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:49.653722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:49.654043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:49.654261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:49.655072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:49.655536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:49.655964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:50.107412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:50.120005 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3e722874-8f80-4f22-9493-48b51df905c7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.491468 Oct 27 10:29:50.135351 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2370/4953] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:49 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:50.144029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:50.145121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:50.158435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:50.160579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:50.160986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:50.168294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:50.169169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:50.170583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:50.616065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:50.638922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:50.640459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:50.661728 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d5c0c70c-6f8e-4232-8478-7049dd34960c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.524806 Oct 27 10:29:50.672692 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2371/4954] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:50 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:50.672692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:50.672692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:50.705881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:50.706391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:50.706843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:50.707894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:50.708808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:50.709425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:50.760791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] validate_networks() for [('811fe1a3-a0ca-449c-95d2-a85eb7ac8c73', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:29:52.447695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:52.461314 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c43c07c-3d7b-4b89-a54a-4e6dd11c5ff5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 1.797687 Oct 27 10:29:52.468293 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2372/4955] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:50 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:52.480799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:52.484493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:52.497800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:52.498538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:52.499133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:52.500028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:52.500870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:52.501527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:52.912243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:52.929707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-555bd8ca-b945-43cf-9f0d-305d376f25d0 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1528 microversion: 2.1 time: 0.460021 Oct 27 10:29:52.931779 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2373/4956] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:52 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1528 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:52.963848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:52.971108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:53.008601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:53.026045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:53.033291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:53.037861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:53.040713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:53.041742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:53.721424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:53.730848 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f474d4b-a626-429d-aaae-c94ff51e5680 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.796059 Oct 27 10:29:53.750415 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2374/4957] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:52 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:53.759584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:53.760942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:53.790363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:53.791124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:53.791800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:53.792749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:53.795960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:53.801990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:53.884188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:29:53.884829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:29:53.901844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:29:53.905840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:29:53.905840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:29:53.921797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:53.922456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:53.922988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:53.923826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:53.924539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:53.925413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:53.953964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Getting quotas for project a76b3a0a8c7443edb88dcacd70e551ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:29:53.965757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Getting quotas for user acdcf812d2a543ee823947d22febb739 and project a76b3a0a8c7443edb88dcacd70e551ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:29:54.044631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:29:54.052389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:29:54.164396 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eda25921-8073-4268-82cc-9df0c901fd7e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.171281 Oct 27 10:29:54.174965 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2584/4958] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:29:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 8184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:29:54.184264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:54.185583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:54.212185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:54.212982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:54.214148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:54.215481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:54.216221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:54.217089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:54.525661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:54.543499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:54.545166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:54.546413 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dde0241a-3b31-4cba-b17f-fc21965aa5b6 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.794540 Oct 27 10:29:54.547150 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2375/4959] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:53 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:54.552597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-aeff66f0-3011-4ff4-8e82-b5a4f69f6da7 req-cf7fdb03-ef3f-48ef-8967-51ed6a0339dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d634c112-a4df-43c0-9574-6ea0fb32d60c", "name": "network-vif-deleted", "tag": "557cc7cc-f08f-4993-90f4-665c72d35870"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:54.564528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aeff66f0-3011-4ff4-8e82-b5a4f69f6da7 req-cf7fdb03-ef3f-48ef-8967-51ed6a0339dd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:54.565542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aeff66f0-3011-4ff4-8e82-b5a4f69f6da7 req-cf7fdb03-ef3f-48ef-8967-51ed6a0339dd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:54.565959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aeff66f0-3011-4ff4-8e82-b5a4f69f6da7 req-cf7fdb03-ef3f-48ef-8967-51ed6a0339dd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:54.647093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:54.654072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4481489-4c1b-456d-b860-f7379140341b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1506 microversion: 2.1 time: 0.476583 Oct 27 10:29:54.654808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2585/4960] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:54 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:54.680851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:54.681757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:54.692424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:54.693375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:54.694014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:54.694953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:54.695573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:54.696187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:54.748155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:54.748790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:54.749631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:54.750119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lazy-loading 'fault' on Instance uuid d634c112-a4df-43c0-9574-6ea0fb32d60c {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:29:54.805504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11dad026f2b4e6d8eb8ad307b0f9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc8f8e9d14ca788dc49f2951aed22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:54.814928 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74c0c318-c091-4fad-8bdb-b5c25375cb01 tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 200 len: 1315 microversion: 2.1 time: 0.146902 Oct 27 10:29:54.816581 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2586/4961] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:54 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:54.822345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-211b023c-6500-4734-964c-9d1d9e892f18 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:54.824098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-211b023c-6500-4734-964c-9d1d9e892f18 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:54.910403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-211b023c-6500-4734-964c-9d1d9e892f18 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:54.919543 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-211b023c-6500-4734-964c-9d1d9e892f18 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1214 microversion: 2.1 time: 0.101507 Oct 27 10:29:54.930419 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2587/4962] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:54 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:54.938725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:54.939586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:54.948900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:54.949854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:54.950694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:54.951761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:54.953846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:54.955926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:54.989122 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-aeff66f0-3011-4ff4-8e82-b5a4f69f6da7 req-cf7fdb03-ef3f-48ef-8967-51ed6a0339dd service nova] Creating event network-vif-deleted:557cc7cc-f08f-4993-90f4-665c72d35870 for instance d634c112-a4df-43c0-9574-6ea0fb32d60c on n-h1-854663-10 Oct 27 10:29:54.997213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-aeff66f0-3011-4ff4-8e82-b5a4f69f6da7 req-cf7fdb03-ef3f-48ef-8967-51ed6a0339dd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.448417 Oct 27 10:29:54.998137 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2376/4963] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:29:55.127213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:55.136192 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d23b41b1-0bc8-4c2e-a791-d7ef188daa33 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.204002 Oct 27 10:29:55.145967 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2588/4964] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:54 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:55.579345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:55.580055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:55.587340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:55.588105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:55.588797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:55.590026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:55.590155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:55.590515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:55.684182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:55.684853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:55.692864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:55.696001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:55.696468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:55.697241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:55.697704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:55.698133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:55.914813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:55.927767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:55.930013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:55.931889 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af69bc00-382e-48d9-8bd7-ddd3520d803a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.357422 Oct 27 10:29:55.945928 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2377/4965] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:55 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:55.961102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:55.961989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] [instance: d634c112-a4df-43c0-9574-6ea0fb32d60c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:55.969778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:55.970585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:55.971203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:55.972162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:55.972820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:55.973607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:56.006877 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] HTTP exception thrown: Instance d634c112-a4df-43c0-9574-6ea0fb32d60c could not be found. Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Request method failure captured: Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c HTTP/1.1 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl2AvL3K0a7FDB7Wk3R3v0J9ssYjW1X_uQItull8veqRPi0xAmARYJeAUKjonj97YuWXDOsf0zke9VzxbyMdhvvuOEB5As7vITNsEHjmBm4zxECOIPANkkq4Ai6JVvaL_Lyn0xxnFJl2ocpl4MGebV8k4XjD83ly0ogUWDCjHlUn3wU Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 1a3cc8f8e9d14ca788dc49f2951aed22 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1034594995 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a3cc8f8e9d14ca788dc49f2951aed22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1a3cc8f8e9d14ca788dc49f2951aed22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1a3cc8f8e9d14ca788dc49f2951aed22", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1a3cc8f8e9d14ca788dc49f2951aed22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1034594995 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 1a3cc8f8e9d14ca788dc49f2951aed22 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1034594995 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerAddressesNegativeTestJSON-1034594995-project Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: e11dad026f2b4e6d8eb8ad307b0f9be3 Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1034594995-project Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance d634c112-a4df-43c0-9574-6ea0fb32d60c could not be found. Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'd634c112-a4df-43c0-9574-6ea0fb32d60c'} Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d634c112-a4df-43c0-9574-6ea0fb32d60c could not be found. Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d634c112-a4df-43c0-9574-6ea0fb32d60c could not be found. Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:56.013485 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:29:56.018457 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:56.018457 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:29:56.018457 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:29:56.018457 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:29:56.018457 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:29:56.018457 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:29:56.018457 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d634c112-a4df-43c0-9574-6ea0fb32d60c could not be found. Oct 27 10:29:56.018457 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:29:56.023307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] Returning 404 to user: Instance d634c112-a4df-43c0-9574-6ea0fb32d60c could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:29:56.024462 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0229230c-cfc2-49cf-87d3-523e7dd2292c tempest-ServerAddressesNegativeTestJSON-1034594995 tempest-ServerAddressesNegativeTestJSON-1034594995-project] 10.222.0.76 "GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c" status: 404 len: 111 microversion: 2.1 time: 0.077140 Oct 27 10:29:56.028995 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2378/4966] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:55 2022] GET /compute/v2.1/servers/d634c112-a4df-43c0-9574-6ea0fb32d60c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:29:56.038853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:56.039608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:56.054483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:56.060030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:56.060531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:56.061097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:56.061831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:56.062677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:56.063118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:56.071148 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1724d5ac-775a-4f3e-a025-39dbf867d223 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1506 microversion: 2.1 time: 0.388251 Oct 27 10:29:56.072394 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2589/4967] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:55 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:56.114238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:56.160061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:56.161304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:56.178280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:56.185099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:56.187160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:56.188220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:56.191715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:56.194239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:56.330219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:56.345825 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b25e3a74-f3fa-4c85-ac69-dc52bc49c4ee tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1284 microversion: 2.1 time: 0.315175 Oct 27 10:29:56.346424 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2379/4968] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:56 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1284 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:56.351457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-95157ba0-e27c-4c4d-b06f-b56d97f720c1 req-d48a4944-a62d-48de-b1f0-97df08002f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d1371c-3f59-487c-91e9-672f3bf5f71c", "name": "network-vif-unplugged", "status": "completed", "tag": "5dce3f42-d9cc-43e4-8452-4a6a2d704f31"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:56.394682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-95157ba0-e27c-4c4d-b06f-b56d97f720c1 req-d48a4944-a62d-48de-b1f0-97df08002f91 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:56.404791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-95157ba0-e27c-4c4d-b06f-b56d97f720c1 req-d48a4944-a62d-48de-b1f0-97df08002f91 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:56.405525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-95157ba0-e27c-4c4d-b06f-b56d97f720c1 req-d48a4944-a62d-48de-b1f0-97df08002f91 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:56.460566 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-95157ba0-e27c-4c4d-b06f-b56d97f720c1 req-d48a4944-a62d-48de-b1f0-97df08002f91 service nova] Creating event network-vif-unplugged:5dce3f42-d9cc-43e4-8452-4a6a2d704f31 for instance 56d1371c-3f59-487c-91e9-672f3bf5f71c on n-h2-854663-10 Oct 27 10:29:56.477889 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-95157ba0-e27c-4c4d-b06f-b56d97f720c1 req-d48a4944-a62d-48de-b1f0-97df08002f91 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128669 Oct 27 10:29:56.479272 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2380/4969] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:29:56.741162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:56.749388 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca56f9ad-d0d5-4504-bb6e-cc9f537b7f1b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.593877 Oct 27 10:29:56.760281 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2590/4970] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:56 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:56.964618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:56.965366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:56.985123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:56.985865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:56.986490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:56.987408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:56.988776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:56.989439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:57.101520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:57.102196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:57.120119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:57.120614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:57.121041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:57.121773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:57.122231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:57.122621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:57.473380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:57.489146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:57.490807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:57.492066 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e571491-ba37-4e54-a702-ec90dc0a0438 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.532055 Oct 27 10:29:57.513813 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2381/4971] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:56 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:57.527072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:57.528615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:57.543477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:57.546024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:57.546707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:57.548212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:57.551949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:57.552562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:57.731320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:57.746327 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bffb313-722b-4721-920f-46cf421f9ba6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1506 microversion: 2.1 time: 0.651436 Oct 27 10:29:57.746924 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2591/4972] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:57 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:29:57.753068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:57.768196 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25a9347c-7b96-4e07-b176-e52cc485b9e6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1272 microversion: 2.1 time: 0.250786 Oct 27 10:29:57.769171 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2382/4973] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:57 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:57.780454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:57.781446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:57.790789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:57.791555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:57.792211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:57.793195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:57.802683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:57.802683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:58.179645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:58.180749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:58.200037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:58.201004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:58.201643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:58.202554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:58.203166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:58.203747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:58.736615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:58.760580 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5091736-5aa5-4358-b12f-2c7367685f5b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.973882 Oct 27 10:29:58.760580 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2592/4974] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:57 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:58.773517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:58.774545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:58.784482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:58.785025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:58.786220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:58.786606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:58.787189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:58.787622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:58.964129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:58.987690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:58.992966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:58.996600 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a654e8b4-272f-4c2d-8a29-26d85b18e173 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2955 microversion: 2.42 time: 0.823866 Oct 27 10:29:58.999504 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2383/4975] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:58 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2955 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:29:59.012997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:59.014608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:59.029429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:59.030381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:59.030813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:59.031766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:59.032415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:59.033006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:59.136173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:59.151990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:59.155930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:59.161323 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98a18947-cb28-40e5-a82e-daa281bb4989 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.393049 Oct 27 10:29:59.163686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2593/4976] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:29:58 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:29:59.191015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:59.194744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:59.209547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:59.210049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:59.210512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:59.213736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:59.214227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:59.214674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:59.500078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:59.514583 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4f0db2d-ca43-47c1-8f00-d35af26acb58 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1506 microversion: 2.1 time: 0.513445 Oct 27 10:29:59.546063 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2384/4977] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:58 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:59.557139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-106b4253-e5c2-493b-8a7b-e30d5c757490 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:59.557969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-106b4253-e5c2-493b-8a7b-e30d5c757490 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:59.567154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-106b4253-e5c2-493b-8a7b-e30d5c757490 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:59.568314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-106b4253-e5c2-493b-8a7b-e30d5c757490 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:59.568990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-106b4253-e5c2-493b-8a7b-e30d5c757490 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:59.569957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-106b4253-e5c2-493b-8a7b-e30d5c757490 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:59.570632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-106b4253-e5c2-493b-8a7b-e30d5c757490 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:59.571228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-106b4253-e5c2-493b-8a7b-e30d5c757490 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:59.720793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:29:59.741100 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-646abbab-34e2-4515-8aa7-b7b03c6713bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1314 microversion: 2.1 time: 0.575776 Oct 27 10:29:59.776483 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2594/4978] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:59 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:59.787064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:29:59.787799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:59.800927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:59.802290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:59.804547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:59.805426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:59.807992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:59.808446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:59.901949 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-106b4253-e5c2-493b-8a7b-e30d5c757490 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.351630 Oct 27 10:29:59.902544 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2385/4979] 10.222.0.76 () {60 vars in 1316 bytes} [Thu Oct 27 10:29:59 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5/os-interface => generated 1830 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:00.188521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:00.190144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:00.202626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:00.203425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:00.206812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:00.208594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:00.209305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:00.209902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:00.680568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:00.705179 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5515823b-21f9-4376-8324-e8847f2214ac tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.922649 Oct 27 10:30:00.706805 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2595/4980] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:29:59 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:00.716724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:00.725959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:00.744459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:00.745181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:00.758181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:00.759373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:00.760139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:00.762232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:01.166785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:01.205624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:01.209763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:01.222921 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-48c74dcc-672a-4e87-9e46-a08247b1ae13 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 1.033378 Oct 27 10:30:01.246075 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2386/4981] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:00 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:01.266907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:01.267831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:01.279472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:01.280290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:01.282220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:01.283280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:01.284023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:01.284601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:01.711653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:01.742310 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-697bdea3-5d0a-4aa0-b30a-9775b50ff7df tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1506 microversion: 2.1 time: 1.033883 Oct 27 10:30:01.746257 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2596/4982] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:00 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1506 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:01.781046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:01.788791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:01.802224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:01.811523 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b116420-2b34-4de8-8bd2-4592e860de17 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1314 microversion: 2.1 time: 0.559467 Oct 27 10:30:01.812979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:01.813497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:01.813925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:01.814675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:01.815133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:01.815564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:01.818460 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2387/4983] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:01 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:02.253274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:02.253986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:02.285374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:02.287893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:02.291099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:02.293505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:02.303988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:02.304808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:02.391833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:02.421194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5e0afbb-8e13-497e-8904-200c10d71c2d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.670578 Oct 27 10:30:02.425626 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2597/4984] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:01 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:02.773252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:02.774028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:02.787963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:02.788607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:02.790068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:02.791817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:02.793193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:02.794488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:02.995077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:03.021048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:03.027133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:03.032457 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d8522e2-fe89-41cb-ab47-dc4b78a2878b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.779822 Oct 27 10:30:03.034877 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2388/4985] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:02 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:03.053015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:03.054947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:03.073056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:03.077068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:03.085493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:03.097952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:03.105281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:03.109874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:03.937692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:04.022720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:04.040619 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4034bfee-b2b2-4faf-ac6e-20fc6ddd15ff tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 200 len: 1509 microversion: 2.1 time: 1.270280 Oct 27 10:30:04.075167 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2598/4986] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:02 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 1509 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:04.085471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:04.102489 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-53605ffb-a3fd-4be6-934c-8a7a6a8da182 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1314 microversion: 2.1 time: 1.065261 Oct 27 10:30:04.103105 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2389/4987] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:03 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1314 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:04.111456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:04.125141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:04.133672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:04.134855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:04.155685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:04.155685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:04.155685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:04.155685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:04.155685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:04.155685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:04.160794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:04.161723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:04.164553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:04.165535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:04.168359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:04.169133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:04.885594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:04.899729 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bcd4e818-5029-451c-be38-22ded5535822 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.819784 Oct 27 10:30:04.901885 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2599/4988] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:04 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:04.906909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:04.907948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:04.916196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:04.918887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:04.919636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:04.919762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:04.923635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:04.924784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:04.925815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:04.930705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:04.936037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:04.937585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:04.940422 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3655a6d9-fca5-4a96-842e-c58c4b3a86cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.836267 Oct 27 10:30:04.976008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:04.977236 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2390/4989] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:04 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:04.990907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c2ead09c-bade-4a45-8c21-88063c65b8d1 req-b182cee1-f96c-46c9-ac66-a55383e0a2cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e3b9d4-a1a4-4e40-83d2-bed8f2596202", "tag": "e72e84c9-c0a2-443b-ba78-e488172ffcd4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:05.004908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c2ead09c-bade-4a45-8c21-88063c65b8d1 req-b182cee1-f96c-46c9-ac66-a55383e0a2cd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:05.005740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c2ead09c-bade-4a45-8c21-88063c65b8d1 req-b182cee1-f96c-46c9-ac66-a55383e0a2cd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:05.006202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c2ead09c-bade-4a45-8c21-88063c65b8d1 req-b182cee1-f96c-46c9-ac66-a55383e0a2cd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:05.030747 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c2ead09c-bade-4a45-8c21-88063c65b8d1 req-b182cee1-f96c-46c9-ac66-a55383e0a2cd service nova] Creating event network-changed:e72e84c9-c0a2-443b-ba78-e488172ffcd4 for instance 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 on n-h1-854663-10 Oct 27 10:30:05.037218 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c2ead09c-bade-4a45-8c21-88063c65b8d1 req-b182cee1-f96c-46c9-ac66-a55383e0a2cd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058539 Oct 27 10:30:05.038463 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2391/4990] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:30:05.130880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:05.132482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:05.169557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:05.170792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:05.171453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:05.172404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:05.180811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:05.181621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:05.488893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:05.505959 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0ff903a-755b-4572-a6c4-3594737f36c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.602634 Oct 27 10:30:05.517434 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2600/4991] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:04 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:05.537502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:05.538096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:05.549373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:05.549868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:05.550313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:05.551044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:05.551571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:05.562190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:05.788607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:05.802438 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9922914b-a5a3-43e2-b434-988d52fb9009 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1314 microversion: 2.1 time: 0.674231 Oct 27 10:30:05.804534 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2392/4992] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:05 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:05.930817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:05.931813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:05.944011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:05.944968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:05.945758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:05.946684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:05.947345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:05.949849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:06.014797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:06.028028 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ce12e2c-d080-40ac-a868-aacd18a683b4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.494897 Oct 27 10:30:06.062766 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2601/4993] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:05 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:06.084433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:06.084433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:06.092294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:06.095047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:06.095610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:06.101112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:06.101869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:06.102429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:06.479382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:06.507624 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58710e96-d352-4312-81f4-a8c5f572c130 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.581307 Oct 27 10:30:06.513548 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2393/4994] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:05 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:06.534770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:06.535673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:06.542793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:06.543354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:06.543920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:06.544958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:06.545658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:06.546466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:06.847551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:06.862565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:06.867958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:06.875773 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76a51103-abf1-47cf-8316-e19da4854524 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.811789 Oct 27 10:30:06.909102 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2602/4995] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:06 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:06.939356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:06.956439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:06.974768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:06.975471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:06.976125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:06.980251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:06.980947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:06.981542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:07.269293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:07.280203 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-060ebb43-8e6a-4e9d-a840-9ec3ac9531e7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.749871 Oct 27 10:30:07.312392 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2394/4996] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:06 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:07.327845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:07.328447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:07.352544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:07.353118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:07.353562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:07.354370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:07.355126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:07.355637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:08.393337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:08.425273 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f18ba7d-37af-4011-9c1a-098e078042e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1314 microversion: 2.1 time: 1.514835 Oct 27 10:30:08.432808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2603/4997] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:06 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1314 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:08.444794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:08.446791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:08.455738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:08.456240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:08.456709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:08.457480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:08.460295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:08.460976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:08.482404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:08.498466 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e715d813-523d-4335-b00d-b95a7bc66e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 1.180787 Oct 27 10:30:08.505108 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2395/4998] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:07 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:08.529624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:08.530636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:08.548842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:08.549564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:08.550187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:08.551152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:08.558347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:08.560703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:08.978675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:08.997799 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52ce7e43-cc08-483a-8fdd-e71391b357e6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.562934 Oct 27 10:30:08.998412 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2604/4999] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:08 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:09.037869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ee70999-6b53-42c8-8a51-4234fe075338 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:09.061984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ee70999-6b53-42c8-8a51-4234fe075338 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:09.071253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ee70999-6b53-42c8-8a51-4234fe075338 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:09.072758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ee70999-6b53-42c8-8a51-4234fe075338 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:09.102877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:09.118468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:09.136814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:09.140047 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-28d232be-71fb-437c-b541-8ebf7038eacd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.633552 Oct 27 10:30:09.140700 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2396/5000] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:08 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:09.190739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ee70999-6b53-42c8-8a51-4234fe075338 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:30:09.343953 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ee70999-6b53-42c8-8a51-4234fe075338 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.321501 Oct 27 10:30:09.344611 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2605/5001] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:08 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:30:09.353855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:09.354772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:09.363009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:09.363807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:09.364799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:09.365869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:09.366497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:09.367109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:09.463023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:09.464612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:09.480296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:09.486400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:09.487312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:09.488487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:09.489471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:09.490382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:10.059707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:10.067132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:10.070129 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b59cc96-b92c-493e-a61f-c2819c723fa9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.720738 Oct 27 10:30:10.071615 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2397/5002] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:09 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:10.087868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:10.104392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:10.116641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:10.118015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:10.119553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:10.124517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:10.125750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:10.126756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:10.210283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:10.223070 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97ec8863-0ed5-4dab-bd40-82c7cef4c03c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1314 microversion: 2.1 time: 0.766165 Oct 27 10:30:10.224246 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2606/5003] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:09 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:10.242434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:10.243510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:10.250046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:10.250839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:10.251334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:10.252202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:10.252655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:10.253094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:10.362631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:10.378061 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f238eb5c-f450-410e-a1cd-d46260ec892e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.305068 Oct 27 10:30:10.378679 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2398/5004] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:10 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:10.461793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:10.472697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:10.474457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:10.475594 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4579ae50-b5fe-4d7f-9f95-bd50a56584e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.246715 Oct 27 10:30:10.476977 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2607/5005] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:10 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:11.098181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:11.098802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:11.109280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.109765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.114326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:11.115259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.115742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.116178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:11.249698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:11.251651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:11.263353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.265888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.266579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:11.272264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.273322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.274024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:11.675647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:11.696806 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2f40695-9f19-476b-b739-5a50eb32bc89 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.602082 Oct 27 10:30:11.700651 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2399/5006] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:11 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:11.715402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:11.716387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:11.733320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.735397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.738368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:11.739448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.741001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.742586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:11.815732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:11.833880 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4d05b2f-d855-4c84-b768-dcf5dbba5339 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1314 microversion: 2.1 time: 0.585002 Oct 27 10:30:11.838567 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2608/5007] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:11 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:11.857209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:11.862202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:11.881134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.882770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.883422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:11.885894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.886625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.892538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:12.070966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:12.095257 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bbc27bf3-ceb8-4481-9cf0-14911fb98672 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.389947 Oct 27 10:30:12.096305 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2400/5008] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:11 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:12.228330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:12.293210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:12.295477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:12.300027 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f95475e-ad8b-473c-aa47-2bc71e3f2f5c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.460208 Oct 27 10:30:12.301779 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2609/5009] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:11 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:12.724415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:12.725092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:12.735748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:12.737647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:12.740526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:12.741548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:12.742182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:12.743955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:12.870706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:12.871341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:12.914716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:12.918616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:12.919108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:12.922845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:12.927626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:12.928195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:13.312337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:13.352443 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4cba9c05-e646-44b4-8996-fc740aabc32a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.632683 Oct 27 10:30:13.357096 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2401/5010] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:12 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:13.367493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:13.370758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:13.405989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:13.408422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:13.409611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:13.410268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:13.410940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:13.411883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:13.412610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:13.413240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:13.417287 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db42d8d5-bab7-4dd6-9e5a-1f6270ac60cd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1314 microversion: 2.1 time: 0.558313 Oct 27 10:30:13.433782 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2610/5011] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:12 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:13.442668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a68fd05a-64a2-4d85-b84e-5e0877029ec9 req-6a3c9417-f4d1-46c4-8ca6-ee43f02d47fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e3b9d4-a1a4-4e40-83d2-bed8f2596202", "name": "network-vif-plugged", "status": "completed", "tag": "e72e84c9-c0a2-443b-ba78-e488172ffcd4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:13.455874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a68fd05a-64a2-4d85-b84e-5e0877029ec9 req-6a3c9417-f4d1-46c4-8ca6-ee43f02d47fb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:13.456584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a68fd05a-64a2-4d85-b84e-5e0877029ec9 req-6a3c9417-f4d1-46c4-8ca6-ee43f02d47fb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:13.457233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a68fd05a-64a2-4d85-b84e-5e0877029ec9 req-6a3c9417-f4d1-46c4-8ca6-ee43f02d47fb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:13.470989 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a68fd05a-64a2-4d85-b84e-5e0877029ec9 req-6a3c9417-f4d1-46c4-8ca6-ee43f02d47fb service nova] Creating event network-vif-plugged:e72e84c9-c0a2-443b-ba78-e488172ffcd4 for instance 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 on n-h1-854663-10 Oct 27 10:30:13.478098 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a68fd05a-64a2-4d85-b84e-5e0877029ec9 req-6a3c9417-f4d1-46c4-8ca6-ee43f02d47fb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042712 Oct 27 10:30:13.479446 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2611/5012] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:30:13.485199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:13.486169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:13.493960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:13.494881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:13.495632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:13.496488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:13.497123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:13.497970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:13.749972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:13.772439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:13.775160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:13.777422 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62baa9eb-792b-41d9-a681-cf20f2a417ac tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.296552 Oct 27 10:30:13.778665 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2612/5013] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:13 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:13.984988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:13.994350 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ceb30094-30cf-48cb-b1c2-bb9549f80c6b tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.635954 Oct 27 10:30:13.998991 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2402/5014] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:13 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:14.376402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:14.378186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:14.391683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:14.396398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:14.401009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:14.401852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:14.403902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:14.405923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:14.406607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:14.448152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:14.448890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:14.494554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:14.494554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:14.494554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:14.495281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:14.495745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:14.506058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:15.085709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:15.092435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:15.105226 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2d1308ac-8f93-4ff7-8b61-5113187258d6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1314 microversion: 2.1 time: 0.662280 Oct 27 10:30:15.110137 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec7adddb-551b-473b-9bfa-c42d3b665408 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.738049 Oct 27 10:30:15.121915 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2613/5015] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:14 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:15.130718 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2403/5016] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:14 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:15.134600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:15.135437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:15.143138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:15.143138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:15.144174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:15.145049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:15.145669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:15.147080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:15.147708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:15.148295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:15.165992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:15.169445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:15.170115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:15.172384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:15.173100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:15.173744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:15.445167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:15.460050 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7533670-0b40-4315-9db0-d78d048c13b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.329178 Oct 27 10:30:15.464073 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2404/5017] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:15 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:15.480079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:15.496764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:15.500576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:15.502470 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35f27cad-d1ad-476d-9a38-f955b66f98c9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.379185 Oct 27 10:30:15.503404 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2614/5018] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:15 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:15.637003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e1543210-d8e8-46a4-bce4-beb8e6c98b68 req-538184a7-c1c8-4463-b7a0-913bcd57e6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39", "name": "network-vif-plugged", "status": "completed", "tag": "f4bf9ba7-53c2-4a70-9da2-6e9514c10258"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:15.647649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e1543210-d8e8-46a4-bce4-beb8e6c98b68 req-538184a7-c1c8-4463-b7a0-913bcd57e6b2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:15.648219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e1543210-d8e8-46a4-bce4-beb8e6c98b68 req-538184a7-c1c8-4463-b7a0-913bcd57e6b2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:15.648747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e1543210-d8e8-46a4-bce4-beb8e6c98b68 req-538184a7-c1c8-4463-b7a0-913bcd57e6b2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:15.661513 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e1543210-d8e8-46a4-bce4-beb8e6c98b68 req-538184a7-c1c8-4463-b7a0-913bcd57e6b2 service nova] Creating event network-vif-plugged:f4bf9ba7-53c2-4a70-9da2-6e9514c10258 for instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 on n-h2-854663-10 Oct 27 10:30:15.667850 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e1543210-d8e8-46a4-bce4-beb8e6c98b68 req-538184a7-c1c8-4463-b7a0-913bcd57e6b2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034518 Oct 27 10:30:15.669250 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2405/5019] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:30:16.140625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:16.141474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:16.142164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:16.142817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:16.152011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:16.152627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:16.154122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:16.155132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:16.155604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:16.156039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:16.159200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:16.160806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:16.161501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:16.164267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:16.164997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:16.166439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:16.561957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:16.575510 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17d6cf69-5bb3-4e1a-9920-555be45a7611 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1500 microversion: 2.1 time: 0.438285 Oct 27 10:30:16.576582 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2615/5020] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:16 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1500 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:16.618223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:16.618913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:16.620118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:16.639079 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f37d775-1c5d-4859-be3e-0057cc8f4b24 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.498525 Oct 27 10:30:16.639944 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2406/5021] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:16 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:16.641685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:16.642564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:16.643024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:16.643784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:16.644484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:16.645042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:16.663345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:16.664594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:16.679164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:16.681951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:16.683614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:16.684588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:16.688804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:16.689306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:17.020507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:17.030775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:17.038867 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-89cdd192-ff50-4b3a-9098-7fd2024ff474 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.433903 Oct 27 10:30:17.039681 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2616/5022] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:16 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:17.057373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:17.063841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:17.075527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:17.082021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:17.084333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:17.085029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:17.087141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:17.088191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:17.088695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:17.089143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:17.089400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:17.090778 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-561643f6-1475-4e4c-8cc9-9de85e3310e0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.450056 Oct 27 10:30:17.091512 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2407/5023] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:16 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:17.162686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lazy-loading 'flavor' on Instance uuid 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:17.314560 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-549196f4-a37c-49ec-b76d-412cc554b05a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "POST /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202/action" status: 200 len: 32 microversion: 2.1 time: 0.272477 Oct 27 10:30:17.316115 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2617/5024] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:17 2022] POST /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:30:17.329202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:17.329990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:17.361795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:17.369018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:17.370985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:17.372270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:17.374894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:17.376961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:17.687943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:17.689016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:17.723463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:17.723819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:17.724246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:17.731924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:17.732459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:17.732939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:18.276381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:18.307888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c172c6a2-398b-4dc7-81b0-7afe1b157fdd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.976608 Oct 27 10:30:18.313575 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2408/5025] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:17 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:18.327220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:18.327718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:18.339924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:18.341170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:18.341877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:18.342901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:18.343540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:18.344150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:18.640917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:18.650504 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-368f5758-6f72-4556-9936-c72f65f9258b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.987542 Oct 27 10:30:18.668353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2618/5026] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:17 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:18.674130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:18.675155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:18.684719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:18.685795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:18.686398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:18.687324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:18.687929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:18.688505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:19.646897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:19.658627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:19.660082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:19.661537 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f012d06d-ec2f-427d-b526-7bd40192fcc2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1806 microversion: 2.20 time: 0.991745 Oct 27 10:30:19.662290 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2619/5027] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:18 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1806 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:19.691347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2bfa725b-4f23-4769-a10b-489666e105b3 req-ae042956-db21-4512-a557-373120caf42b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f1a184-24f6-43f3-8477-e15a2694f8df", "name": "network-vif-plugged", "status": "completed", "tag": "d3e32e88-f305-4079-a874-e75520cad0d1"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:19.704373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2bfa725b-4f23-4769-a10b-489666e105b3 req-ae042956-db21-4512-a557-373120caf42b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:19.705164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2bfa725b-4f23-4769-a10b-489666e105b3 req-ae042956-db21-4512-a557-373120caf42b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:19.705787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2bfa725b-4f23-4769-a10b-489666e105b3 req-ae042956-db21-4512-a557-373120caf42b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:19.720320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:19.722373 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2bfa725b-4f23-4769-a10b-489666e105b3 req-ae042956-db21-4512-a557-373120caf42b service nova] Creating event network-vif-plugged:d3e32e88-f305-4079-a874-e75520cad0d1 for instance 80f1a184-24f6-43f3-8477-e15a2694f8df on n-h2-854663-10 Oct 27 10:30:19.730611 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2bfa725b-4f23-4769-a10b-489666e105b3 req-ae042956-db21-4512-a557-373120caf42b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046516 Oct 27 10:30:19.731861 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2620/5028] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:30:19.738435 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bf16733f-9cc8-41ad-a154-96fd14519f31 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 1.415670 Oct 27 10:30:19.739026 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2409/5029] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:18 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:19.739895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:19.740958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:19.747587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:19.748366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:19.761202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:19.767981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:19.769015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:19.769599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:19.770482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:19.770792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:19.772123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:19.774803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:19.775341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:19.776196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:19.778258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:19.780111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:20.388134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:20.406115 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f6bf37cf-2f63-4986-b9ce-28ec8ab13760 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1676 microversion: 2.1 time: 0.658972 Oct 27 10:30:20.407101 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2410/5030] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:19 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1676 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:20.469818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:20.487192 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c01973e4-ef63-4a69-b8e0-96a9e87e7823 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.753676 Oct 27 10:30:20.489385 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2621/5031] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:19 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:20.695750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:20.699094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:20.707293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:20.708296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:20.709205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:20.710081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:20.710684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:20.711266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:20.764681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:20.766269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:20.779363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:20.781238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:20.782122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:20.782911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:20.783378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:20.783793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:21.114932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:21.126097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:21.127854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:21.129543 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eda8c07c-7467-4c34-82fa-a8e20c4ac47f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1793 microversion: 2.20 time: 0.438991 Oct 27 10:30:21.145581 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2411/5032] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:30:20 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1793 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:30:21.176826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:21.188405 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75d638fc-e465-4d00-ad69-ad27105d1446 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.431042 Oct 27 10:30:21.189037 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2622/5033] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:20 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:21.437307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:21.438394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:21.448827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:21.451320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:21.453776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:21.455313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:21.457186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:21.458635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:21.518110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:21.519148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:21.539621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:21.540254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:21.540935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:21.542348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:21.542965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:21.543592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:22.112783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:22.127000 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7ed4153e-4497-4e89-9d27-e8738d69abda tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1653 microversion: 2.1 time: 0.695696 Oct 27 10:30:22.128942 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2412/5034] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:21 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1653 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:22.156630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd8565b2-b222-4d94-b805-4f0411f097a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:22.164750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd8565b2-b222-4d94-b805-4f0411f097a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:22.165826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd8565b2-b222-4d94-b805-4f0411f097a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:22.166136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd8565b2-b222-4d94-b805-4f0411f097a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:22.172443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:22.190595 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d73e256e-c304-44f0-b8b4-288d04ac466e tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.677698 Oct 27 10:30:22.193821 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2623/5035] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:21 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:22.218006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:22.224312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:22.229468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd8565b2-b222-4d94-b805-4f0411f097a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Going to try to start instance {{(pid=120719) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 10:30:22.240021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:22.240567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:22.249353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:22.250155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:22.250638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:22.251079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:22.331357 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd8565b2-b222-4d94-b805-4f0411f097a3 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.179684 Oct 27 10:30:22.332343 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2413/5036] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:22 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:30:22.344505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:22.350379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:22.379276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:22.380245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:22.387577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:22.390202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:22.391011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:22.391526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:22.416892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:22.741323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:22.757851 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b986e7a9-9083-4eff-9023-30581357f504 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1519 microversion: 2.1 time: 0.545609 Oct 27 10:30:22.769286 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2624/5037] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:22 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1519 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:22.885977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:22.897041 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bde00119-6364-462f-b3d2-7c0deed99a6e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1662 microversion: 2.1 time: 0.559878 Oct 27 10:30:22.904373 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2414/5038] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:22 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1662 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:23.222873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:23.224593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:23.241959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:23.243713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:23.245844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:23.247932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:23.249096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:23.250947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:23.674080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:23.684160 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-88115a09-7b41-493f-bea7-92dfcc2ddbde tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.466522 Oct 27 10:30:23.687608 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2625/5039] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:23 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:23.782411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:23.783786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:23.799625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:23.800139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:23.800896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:23.801877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:23.802340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:23.802779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:23.926556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:23.927551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:23.943399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:23.944899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:23.944899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:23.945260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:23.945714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:23.946142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:24.249426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:24.265008 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4d8074c-a5c6-48fc-89b7-f8c5e56d80cb tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.487386 Oct 27 10:30:24.266881 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2415/5040] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:23 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:24.303072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:24.307843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:24.331241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:24.331912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:24.332529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:24.333449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:24.334040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:24.334544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:24.355555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:24.379424 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-efbfe53d-2097-4c51-aa9a-36850e39d561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1662 microversion: 2.1 time: 0.456173 Oct 27 10:30:24.385169 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2626/5041] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:23 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1662 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:24.717619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:24.719057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:24.755599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:24.767915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:24.771373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:24.772593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:24.775226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:24.776044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:24.833307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:24.845864 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6b0f3f35-2d03-47b7-b1bb-5254936de9f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.551165 Oct 27 10:30:24.846479 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2416/5042] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:24 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:24.881678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:24.883056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:24.890031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:24.890803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:24.891417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:24.892307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:24.892944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:24.893779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:25.159353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:25.169208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a592b3dd-ee46-4b97-a841-ad076191a4bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.463445 Oct 27 10:30:25.169910 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2627/5043] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:24 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:25.177968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:25.196539 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7be93ea-cfbe-433e-a29b-b2866bd18400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.320758 Oct 27 10:30:25.197163 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2417/5044] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:24 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:25.221546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eca33c2d-d657-4de4-b58d-512d0bce7cb6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:25.229094 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-eca33c2d-d657-4de4-b58d-512d0bce7cb6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 2d4b6609-56a8-4de6-8ff5-6a8f13bdb099 has no mapping to a cell. Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eca33c2d-d657-4de4-b58d-512d0bce7cb6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/2d4b6609-56a8-4de6-8ff5-6a8f13bdb099/action HTTP/1.1 Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 15 Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: {"os-stop": {}} Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 2d4b6609-56a8-4de6-8ff5-6a8f13bdb099 has no mapping to a cell. Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '2d4b6609-56a8-4de6-8ff5-6a8f13bdb099', 'body': {'os-stop': {}}} Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 2d4b6609-56a8-4de6-8ff5-6a8f13bdb099 has no mapping to a cell. Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:25.264209 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4b6609-56a8-4de6-8ff5-6a8f13bdb099 has no mapping to a cell. Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4b6609-56a8-4de6-8ff5-6a8f13bdb099 has no mapping to a cell. Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eca33c2d-d657-4de4-b58d-512d0bce7cb6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 2d4b6609-56a8-4de6-8ff5-6a8f13bdb099 has no mapping to a cell. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eca33c2d-d657-4de4-b58d-512d0bce7cb6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/2d4b6609-56a8-4de6-8ff5-6a8f13bdb099/action" status: 404 len: 117 microversion: 2.1 time: 0.048724 Oct 27 10:30:25.268770 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2418/5045] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:25 2022] POST /compute/v2.1/servers/2d4b6609-56a8-4de6-8ff5-6a8f13bdb099/action => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:30:25.290688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:25.293410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:25.318302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:25.318818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:25.319264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:25.319995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:25.333211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:25.337689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:25.545998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1447412602", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:25.662887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:25.685156 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f3f4b19b-5753-4c81-8336-1b83922f2ec8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.401989 Oct 27 10:30:25.686621 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2419/5046] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:25 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:25.691982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:25.698582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:25.707683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:25.708370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:25.713839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] validate_networks() for [('1f9890b2-b368-458a-8f22-d7c30444ab0a', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:30:25.731772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:25.732516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:25.733038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:25.733513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:26.204881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:26.219847 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e42f7e92-c5c7-484a-96be-e3599ab7ab32 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.527906 Oct 27 10:30:26.221241 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2420/5047] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:25 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:26.227774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:26.228724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:26.236275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:26.237575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:26.238590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:26.239872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:26.240624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:26.241806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:26.579427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:26.590302 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13fc03c2-cec3-4f84-99b1-343f0e8fa6b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.367580 Oct 27 10:30:26.591881 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2421/5048] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:26 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:26.599760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:26.601841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:26.614104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:26.615067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:26.615765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:26.617565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:26.618278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:26.618927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:26.853607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:30:26.854799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:30:26.855498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:30:26.856100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:30:26.856739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:30:26.873509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:26.874228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:26.875308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:26.876355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:26.877067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:26.877689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:26.906872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Getting quotas for project 74a512b4f55c47c385f66af3b0801792. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:30:26.916111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Getting quotas for user 71877d9b89b7483a99dd772ccfaf4007 and project 74a512b4f55c47c385f66af3b0801792. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:30:26.930910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:26.938893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:30:26.941890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c7e11105-7c87-4fb7-afcf-91bcfa3396fe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.348189 Oct 27 10:30:26.943697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2422/5049] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:26 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:26.947001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:30:26.952528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:26.959227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:26.968566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:26.969332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:26.969909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:26.970800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:26.971400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:26.972758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:27.025980 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a338679-0592-4a42-a28f-82e37a4060d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.849834 Oct 27 10:30:27.026918 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2628/5050] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:30:27.035077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-017a2bb4-0842-47e8-8b46-581aff42b16d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:27.037375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-017a2bb4-0842-47e8-8b46-581aff42b16d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: bbb81792-aeeb-439a-94cd-5d046496c0bd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:27.047760 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-017a2bb4-0842-47e8-8b46-581aff42b16d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance bbb81792-aeeb-439a-94cd-5d046496c0bd could not be found. Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-017a2bb4-0842-47e8-8b46-581aff42b16d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/bbb81792-aeeb-439a-94cd-5d046496c0bd/action HTTP/1.1 Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 15 Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: {"suspend": {}} Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance bbb81792-aeeb-439a-94cd-5d046496c0bd could not be found. Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'bbb81792-aeeb-439a-94cd-5d046496c0bd', 'body': {'suspend': {}}} Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb81792-aeeb-439a-94cd-5d046496c0bd could not be found. Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb81792-aeeb-439a-94cd-5d046496c0bd could not be found. Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:27.050204 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:27.059014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:27.059014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:27.059014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb81792-aeeb-439a-94cd-5d046496c0bd could not be found. Oct 27 10:30:27.059014 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:27.061735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-017a2bb4-0842-47e8-8b46-581aff42b16d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance bbb81792-aeeb-439a-94cd-5d046496c0bd could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:27.064388 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-017a2bb4-0842-47e8-8b46-581aff42b16d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/bbb81792-aeeb-439a-94cd-5d046496c0bd/action" status: 404 len: 111 microversion: 2.1 time: 0.033887 Oct 27 10:30:27.065808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2629/5051] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:27 2022] POST /compute/v2.1/servers/bbb81792-aeeb-439a-94cd-5d046496c0bd/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:27.086995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-039ae3a6-2d5c-46b0-b242-036dddabe23d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:27.089421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-039ae3a6-2d5c-46b0-b242-036dddabe23d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:27.318601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-039ae3a6-2d5c-46b0-b242-036dddabe23d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:27.334031 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-039ae3a6-2d5c-46b0-b242-036dddabe23d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1224 microversion: 2.1 time: 0.266667 Oct 27 10:30:27.334621 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2630/5052] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:27 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1224 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:27.359952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:27.360553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:27.377773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:27.378262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:27.378762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:27.383082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:27.383552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:27.383995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:27.580536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:27.595894 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86beff21-1349-4f6a-be7e-b49a62e69495 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.645796 Oct 27 10:30:27.598164 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2423/5053] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:26 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:27.628002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:27.628932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:27.644366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:27.646085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:27.646695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:27.648515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:27.649246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:27.651240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:28.214609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:28.235714 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ee00357-67b1-4f40-b547-80b82ff0077a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.889254 Oct 27 10:30:28.240314 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2631/5054] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:27 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:28.256278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:28.262937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:28.280181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:28.283282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:28.283722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:28.284637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:28.286608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:28.287044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:28.350003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:28.367510 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-648f3613-d7fa-4be0-9033-ce0ffe621136 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.744416 Oct 27 10:30:28.377866 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2424/5055] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:27 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:28.401762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:28.407247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:28.424837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:28.425809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:28.429374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:28.430386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:28.430999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:28.434704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:28.548118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:28.562090 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22eb802a-0d30-434a-9fc9-1e7220e2f5bc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.318213 Oct 27 10:30:28.577598 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2632/5056] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:28 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:28.585759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:28.586609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:28.604122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:28.605197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:28.605798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:28.607111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:28.608353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:28.608987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:28.810954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:28.826505 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc866b5b-94ed-4c6b-b235-5d2c1e322ed8 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.446858 Oct 27 10:30:28.841234 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2425/5057] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:28 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:28.857511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:28.858627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:28.874627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:28.875332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:28.876977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:28.877912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:28.878564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:28.879319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:29.349204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:29.362270 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff680d4a-88ae-458a-91d2-fa839213fd69 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1276 microversion: 2.1 time: 0.783221 Oct 27 10:30:29.365904 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2633/5058] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:28 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1276 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:29.377715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:29.380879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:29.400316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:29.401141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:29.402137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:29.405873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:29.407631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:29.408496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:29.493674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lazy-loading 'flavor' on Instance uuid 80f1a184-24f6-43f3-8477-e15a2694f8df {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:29.513799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:29.725173 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c1a8a02-65ee-4bf8-9045-ff226884a787 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 202 len: 0 microversion: 2.1 time: 0.357662 Oct 27 10:30:29.727318 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2634/5059] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:29 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:30:29.743711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:29.744576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:29.760724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:29.763284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:29.763973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:29.766891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:29.773313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:29.780449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:29.889419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:29.898742 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f217d321-29ce-41f8-b50a-46a70d9bec77 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 1.056023 Oct 27 10:30:29.902606 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2426/5060] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:28 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:29.910681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:29.916699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:29.932032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:29.938598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:29.943224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:29.944207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:29.944840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:29.945402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:30.271785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:30.286706 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b10f9069-bce9-43d1-9953-509e9574b8be tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.557326 Oct 27 10:30:30.287497 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2635/5061] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:29 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:30.295323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:30.298750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:30.314711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:30.315537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:30.321276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:30.322401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:30.323058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:30.323686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:30.438353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:30.452225 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4645335d-eec6-49f3-b50d-a66dea36b4b6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1514 microversion: 2.1 time: 0.545520 Oct 27 10:30:30.453284 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2427/5062] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:29 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1514 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:30.458658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:30.465884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:30.477939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:30.482483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:30.485035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:30.487093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:30.487875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:30.488911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:30.661769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:30.673721 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5fbe6328-646b-4d0c-a586-78edc0513e87 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1282 microversion: 2.1 time: 0.218971 Oct 27 10:30:30.674323 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2428/5063] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:30 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:30.768322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:30.789135 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-726f4caf-1152-4f07-ad6e-5dae7016598d tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.500276 Oct 27 10:30:30.790511 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2636/5064] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:30 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:30.816890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:30.817898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:30.827789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:30.830055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:30.833110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:30.835826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:30.837241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:30.841403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:30.898006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lazy-loading 'flavor' on Instance uuid 12306d2d-5e05-4a81-b323-1fc83906167e {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:31.069330 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e2d92ea9-30f2-48ca-9765-30aaba732bb4 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.256551 Oct 27 10:30:31.070697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2429/5065] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:30 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:30:31.079513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:31.080321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:31.094603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:31.095157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:31.101334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:31.103861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:31.103861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:31.103861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:31.322334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:31.323426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:31.340563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:31.345430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:31.345904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:31.346913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:31.348292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:31.349899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:31.424335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:31.595699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:31.606924 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2e5630c-5570-4c1e-89de-5312fce72b1b tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1674 microversion: 2.1 time: 0.531840 Oct 27 10:30:31.615484 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2637/5066] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:31 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1674 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:31.629171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:31.631415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:31.648276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:31.649364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:31.651712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:31.652700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:31.653389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:31.658374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:31.918260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:31.932345 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c4e9db7-7c90-4ea0-8e7f-33b455b12136 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.622035 Oct 27 10:30:31.950099 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2430/5067] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:31 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:31.954444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:31.958032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:31.960399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:31.969021 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-acab1745-bfe5-491d-9c2f-ea763a38a91e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1497 microversion: 2.1 time: 0.350922 Oct 27 10:30:31.970340 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2638/5068] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:31 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1497 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:31.989402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:31.992125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:31.997745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:31.999777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.003431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.004461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.007234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:32.008443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:32.027705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.029603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.030258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.033583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.034159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.034702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.147145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lazy-loading 'flavor' on Instance uuid 80f1a184-24f6-43f3-8477-e15a2694f8df {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:32.167457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Cannot 'suspend' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state suspended Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action HTTP/1.1 Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 15 Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: {"suspend": {}} Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: exception: Cannot 'suspend' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state suspended Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df', 'body': {'suspend': {}}} Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df in vm_state suspended. Cannot suspend while the instance is in this state. Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 27 10:30:32.179154 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state suspended Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state suspended Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 409 to user: Cannot 'suspend' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state suspended {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-daac46d0-70b6-46ce-b08f-cb3ca90d5810 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 409 len: 148 microversion: 2.1 time: 0.190986 Oct 27 10:30:32.183236 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2639/5069] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:31 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 148 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:30:32.190195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bb83db0-4389-461a-b2e5-c639ec6873b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:32.190742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bb83db0-4389-461a-b2e5-c639ec6873b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:32.202451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb83db0-4389-461a-b2e5-c639ec6873b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.202944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb83db0-4389-461a-b2e5-c639ec6873b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.209109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb83db0-4389-461a-b2e5-c639ec6873b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.212017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb83db0-4389-461a-b2e5-c639ec6873b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.213809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb83db0-4389-461a-b2e5-c639ec6873b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.220897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb83db0-4389-461a-b2e5-c639ec6873b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.393457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:32.413108 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd1f9ec1-d038-444a-8e97-8864875246a8 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1324 microversion: 2.1 time: 0.457937 Oct 27 10:30:32.429810 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2431/5070] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:31 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:32.433614 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bb83db0-4389-461a-b2e5-c639ec6873b4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 202 len: 0 microversion: 2.1 time: 0.246186 Oct 27 10:30:32.433772 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2640/5071] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:32 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:30:32.446036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:32.447212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:32.455263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.456331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.457398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.459414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.461184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.462742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.579774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ae0f5ac1-4428-4837-9d70-7f85a94fee0e req-e4f4e32a-03cc-46f8-8318-5e6e3b6ad40d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecb2d22-a521-4b9b-b0d3-b1982f676996", "tag": "c5a23b03-e6fb-4b9d-93a8-ada42cf30c84"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:32.623439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ae0f5ac1-4428-4837-9d70-7f85a94fee0e req-e4f4e32a-03cc-46f8-8318-5e6e3b6ad40d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.623946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ae0f5ac1-4428-4837-9d70-7f85a94fee0e req-e4f4e32a-03cc-46f8-8318-5e6e3b6ad40d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.624366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ae0f5ac1-4428-4837-9d70-7f85a94fee0e req-e4f4e32a-03cc-46f8-8318-5e6e3b6ad40d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.665612 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ae0f5ac1-4428-4837-9d70-7f85a94fee0e req-e4f4e32a-03cc-46f8-8318-5e6e3b6ad40d service nova] Creating event network-changed:c5a23b03-e6fb-4b9d-93a8-ada42cf30c84 for instance eecb2d22-a521-4b9b-b0d3-b1982f676996 on n-h2-854663-10 Oct 27 10:30:32.684047 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ae0f5ac1-4428-4837-9d70-7f85a94fee0e req-e4f4e32a-03cc-46f8-8318-5e6e3b6ad40d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108285 Oct 27 10:30:32.691529 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2641/5072] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:30:32.715248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:32.716220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:32.757706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.767425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.768284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.783295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.786992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.787438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.916055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:32.933225 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9dee78d7-f58d-45f7-a22d-3d59c3df38ca tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1503 microversion: 2.1 time: 0.495098 Oct 27 10:30:32.940831 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2432/5073] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:32 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1503 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:32.956391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:32.957077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:32.965444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.966370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.967046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:32.967923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:32.968806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:32.971168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:33.217695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:33.227009 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b34b0ba-71c1-44c0-b082-a29db6bf5ec9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1657 microversion: 2.1 time: 0.518294 Oct 27 10:30:33.233597 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2642/5074] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:32 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1657 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:33.260426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97285bf8-954f-4a82-a0b8-2d1c4c0cc499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:33.261282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97285bf8-954f-4a82-a0b8-2d1c4c0cc499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:33.273302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97285bf8-954f-4a82-a0b8-2d1c4c0cc499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:33.274302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97285bf8-954f-4a82-a0b8-2d1c4c0cc499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:33.274924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97285bf8-954f-4a82-a0b8-2d1c4c0cc499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:33.275814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97285bf8-954f-4a82-a0b8-2d1c4c0cc499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:33.276447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97285bf8-954f-4a82-a0b8-2d1c4c0cc499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:33.280718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97285bf8-954f-4a82-a0b8-2d1c4c0cc499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:33.427135 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97285bf8-954f-4a82-a0b8-2d1c4c0cc499 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action" status: 202 len: 0 microversion: 2.1 time: 0.170909 Oct 27 10:30:33.430712 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2643/5075] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:33 2022] POST /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:30:33.446928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:33.447974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:33.470035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:33.471039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:33.471747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:33.472927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:33.475268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:33.476558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:33.478462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:33.496625 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-04ae03e5-bb6e-464f-9e88-4dfd8cb1df2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.544538 Oct 27 10:30:33.509181 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2433/5076] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:32 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:33.520165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:33.520902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:33.554725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:33.555820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:33.556499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:33.557482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:33.558136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:33.558760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:34.031992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:34.049838 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81f5904c-8b03-4779-8d7d-8a961c962f5b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1324 microversion: 2.1 time: 0.539183 Oct 27 10:30:34.052927 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2434/5077] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:33 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1324 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:34.058542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:34.059432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:34.069906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:34.070414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:34.070857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:34.073600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:34.077259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:34.078480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:34.191294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:34.208081 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55c85296-1bcc-4348-adff-e026505ef77a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1663 microversion: 2.1 time: 0.772973 Oct 27 10:30:34.209295 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2644/5078] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:33 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1663 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:34.432046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:34.450353 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34b380d2-311a-4a2f-845b-6b87c3eaa9bc tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1503 microversion: 2.1 time: 0.389644 Oct 27 10:30:34.451572 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2435/5079] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:34 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1503 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:34.540163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:34.541307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:34.557164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:34.558513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:34.559135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:34.560015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:34.560834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:34.561414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:34.807813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:34.820162 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dfec0ef4-d782-4d46-8e25-601d27ada5cf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.284278 Oct 27 10:30:34.820784 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2645/5080] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:34 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:35.082837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:35.085461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:35.105639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:35.108826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:35.109544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:35.110463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:35.111090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:35.111666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:35.233934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:35.236473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:35.255579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:35.256577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:35.257563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:35.258570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:35.259180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:35.259760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:35.566153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:35.581503 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-036c2153-effa-4d2f-a781-5c7e2fe266c5 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1663 microversion: 2.1 time: 0.352051 Oct 27 10:30:35.583334 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2646/5081] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:35 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1663 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:35.594073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:35.604144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:35.619096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:35.619865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:35.620483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:35.621560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:35.624384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:35.626183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:35.912271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:35.930883 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c14e592-0565-400c-aaac-c13dcbf44408 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1324 microversion: 2.1 time: 0.857704 Oct 27 10:30:35.949323 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2436/5082] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:35 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1324 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:35.954868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:35.955796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:35.962683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:35.963470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:35.964132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:35.965078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:35.965738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:35.966384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:36.180279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:36.195066 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdf53d40-1284-4770-b28f-c88d4e266d4a tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1503 microversion: 2.1 time: 0.609030 Oct 27 10:30:36.195926 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2647/5083] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:35 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1503 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:36.584966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:36.597964 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ca6aa30-7090-4e9b-85bc-005280957475 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.646892 Oct 27 10:30:36.599704 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2437/5084] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:35 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:36.609873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:36.613637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:36.628410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:36.629079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:36.629642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:36.630422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:36.630827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:36.631291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:36.657351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:36.893515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:36.961487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:36.963396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:36.981752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:36.983736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:36.985655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:36.988184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:36.989491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:36.990456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:37.323181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:37.513090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:37.526206 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-226517a7-ee70-4977-94b2-cc8bb062b189 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1663 microversion: 2.1 time: 0.921177 Oct 27 10:30:37.528307 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2648/5085] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:36 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1663 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:37.547327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:37.549396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:37.558251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:37.561082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:37.561707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:37.564294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:37.574672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:37.575193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:37.743568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:37.755276 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd6a87fa-0902-4fbe-8841-e9851458e0d0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1324 microversion: 2.1 time: 0.802821 Oct 27 10:30:37.755877 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2438/5086] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:36 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1324 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:37.766902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:37.767606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:37.783597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:37.784097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:37.784543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:37.785701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:37.790514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:37.791192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:37.934400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:37.948888 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a75bbb7b-1d0b-4ae8-9e03-d53050097cc0 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.418896 Oct 27 10:30:37.950605 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2649/5087] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:37 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:37.981373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:37.982433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:37.995780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:37.996509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:37.997216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.000937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.004540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.006186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.108324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:38.127345 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c5904bd-2ad1-4179-a23c-2fa466643cc8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.370071 Oct 27 10:30:38.146049 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2439/5088] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:37 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:38.194539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:38.208281 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aaddfa89-d742-4de7-a7ad-48453731d331 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.231399 Oct 27 10:30:38.209353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2650/5089] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:37 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:38.233195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a4f9adbd-8572-4c2f-b040-b0d1882e45f4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:38.234235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a4f9adbd-8572-4c2f-b040-b0d1882e45f4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: b7dadd9d-2ce9-48ad-b15e-03f67cdc391a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:38.242726 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a4f9adbd-8572-4c2f-b040-b0d1882e45f4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance b7dadd9d-2ce9-48ad-b15e-03f67cdc391a could not be found. Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a4f9adbd-8572-4c2f-b040-b0d1882e45f4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/b7dadd9d-2ce9-48ad-b15e-03f67cdc391a/action HTTP/1.1 Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 15 Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: {"unpause": {}} Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance b7dadd9d-2ce9-48ad-b15e-03f67cdc391a could not be found. Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'b7dadd9d-2ce9-48ad-b15e-03f67cdc391a', 'body': {'unpause': {}}} Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dadd9d-2ce9-48ad-b15e-03f67cdc391a could not be found. Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dadd9d-2ce9-48ad-b15e-03f67cdc391a could not be found. Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:38.250402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:38.255347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:38.255347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:38.255347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dadd9d-2ce9-48ad-b15e-03f67cdc391a could not be found. Oct 27 10:30:38.255347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.255347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a4f9adbd-8572-4c2f-b040-b0d1882e45f4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance b7dadd9d-2ce9-48ad-b15e-03f67cdc391a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:38.255347 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a4f9adbd-8572-4c2f-b040-b0d1882e45f4 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/b7dadd9d-2ce9-48ad-b15e-03f67cdc391a/action" status: 404 len: 111 microversion: 2.1 time: 0.023260 Oct 27 10:30:38.255347 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2440/5090] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:38 2022] POST /compute/v2.1/servers/b7dadd9d-2ce9-48ad-b15e-03f67cdc391a/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:38.265345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:38.266462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:38.282095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.282743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.283162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.285427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.286097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.286862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.460969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:38.478315 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b48f53a2-dcab-42e7-9195-10141599a876 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.218400 Oct 27 10:30:38.478920 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2651/5091] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:38 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:38.503952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:38.504584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:38.512735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.513465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.513894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.514932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.515826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.517476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.556106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:38.557499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:38.568540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.569396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.569840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.570563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.571173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.571753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.716355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:38.727833 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fdc52545-5ad6-4713-bf35-d9e128892f90 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.227680 Oct 27 10:30:38.729756 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2441/5092] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:38 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:38.752572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:38.754754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:38.761618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.762309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.762895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.763773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.764392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.765016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.771610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:38.780862 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e55b1b8-2bef-44e3-91ef-849c378c7f93 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.233250 Oct 27 10:30:38.797606 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2652/5093] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:38 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:38.799902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:38.800810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:38.808648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.809582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.810004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.810866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.811311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.811751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.812425 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Cannot 'unpause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action HTTP/1.1 Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 15 Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: {"unpause": {}} Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot 'unpause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df', 'body': {'unpause': {}}} Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df in vm_state active. Cannot unpause while the instance is in this state. Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:38.825102 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:38.830003 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:38.830003 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:38.830003 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:38.830003 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:30:38.830003 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:38.830003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 409 to user: Cannot 'unpause' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:38.830003 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b2c0aee-2106-4f0a-9cf7-c5e7357187c6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 409 len: 145 microversion: 2.1 time: 0.079855 Oct 27 10:30:38.830522 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2442/5094] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:38 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 145 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 10:30:38.835712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:38.836758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:38.844198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.844819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.845611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:38.846654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:38.847235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:38.847862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:39.183263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:39.193080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:39.197065 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf3179d1-6a68-48fa-9f6e-c34653d75fd0 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1324 microversion: 2.1 time: 0.404713 Oct 27 10:30:39.197978 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2653/5095] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:38 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:39.205141 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ace3d5d0-db33-4c06-a38a-ae4316e69f70 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1666 microversion: 2.1 time: 0.372459 Oct 27 10:30:39.211770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:39.212790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:39.217477 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2443/5096] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:38 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1666 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:39.231902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9ffebb5e-794b-496a-9556-06caa9b03a8e req-57d3511a-0142-4aad-8271-aed8c61e6473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecb2d22-a521-4b9b-b0d3-b1982f676996", "name": "network-vif-plugged", "status": "completed", "tag": "c5a23b03-e6fb-4b9d-93a8-ada42cf30c84"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:39.232918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:39.234026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:39.234648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:39.235530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:39.236249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:39.236869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:39.267330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9ffebb5e-794b-496a-9556-06caa9b03a8e req-57d3511a-0142-4aad-8271-aed8c61e6473 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:39.268195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9ffebb5e-794b-496a-9556-06caa9b03a8e req-57d3511a-0142-4aad-8271-aed8c61e6473 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:39.268960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9ffebb5e-794b-496a-9556-06caa9b03a8e req-57d3511a-0142-4aad-8271-aed8c61e6473 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:39.287861 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9ffebb5e-794b-496a-9556-06caa9b03a8e req-57d3511a-0142-4aad-8271-aed8c61e6473 service nova] Creating event network-vif-plugged:c5a23b03-e6fb-4b9d-93a8-ada42cf30c84 for instance eecb2d22-a521-4b9b-b0d3-b1982f676996 on n-h2-854663-10 Oct 27 10:30:39.297397 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9ffebb5e-794b-496a-9556-06caa9b03a8e req-57d3511a-0142-4aad-8271-aed8c61e6473 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078366 Oct 27 10:30:39.298991 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2444/5097] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:30:39.310600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:39.311874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:39.322357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:39.323869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:39.324703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:39.327532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:39.328926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:39.329989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:39.599771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:39.614116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-263e142b-453a-42e0-b9ff-8f4b5118e4c9 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.406423 Oct 27 10:30:39.621386 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2654/5098] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:39 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:39.626528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:39.627030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:39.634667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:39.646923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:39.647678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:39.648316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:39.651559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:39.652186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:39.652824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:39.730223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:39.742930 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c10188e-25d2-4754-b2ba-0f6fd452b0bf tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.439945 Oct 27 10:30:39.743529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2445/5099] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:39 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:39.761353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:30:39.771317 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.api [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Working on deleting snapshot afb7a6af-c70f-46ab-8eea-c6375efbce9c from shelved instance... Oct 27 10:30:39.775557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:39.792099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:39.800491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:39.801407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:39.803871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:39.804821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:39.805288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:39.805719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:40.064300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:40.075960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6aab9a4b-58ec-4322-913d-6444d0cc82e7 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.330348 Oct 27 10:30:40.079085 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2446/5100] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:39 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:40.118135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c69aa714-e2ff-4285-874b-0cf1bcef020e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:40.118763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c69aa714-e2ff-4285-874b-0cf1bcef020e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 4091e51a-5b75-4202-b5e9-a79614225a90] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:40.136588 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c69aa714-e2ff-4285-874b-0cf1bcef020e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 4091e51a-5b75-4202-b5e9-a79614225a90 could not be found. Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c69aa714-e2ff-4285-874b-0cf1bcef020e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/4091e51a-5b75-4202-b5e9-a79614225a90/action HTTP/1.1 Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 18 Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: {"unshelve": null} Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 4091e51a-5b75-4202-b5e9-a79614225a90 could not be found. Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '4091e51a-5b75-4202-b5e9-a79614225a90', 'body': {'unshelve': None}} Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4091e51a-5b75-4202-b5e9-a79614225a90 could not be found. Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4091e51a-5b75-4202-b5e9-a79614225a90 could not be found. Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:40.146814 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:40.151918 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:40.151918 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:40.151918 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:40.151918 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:40.151918 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:40.151918 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:40.151918 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4091e51a-5b75-4202-b5e9-a79614225a90 could not be found. Oct 27 10:30:40.151918 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:40.154288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c69aa714-e2ff-4285-874b-0cf1bcef020e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 4091e51a-5b75-4202-b5e9-a79614225a90 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:40.156756 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c69aa714-e2ff-4285-874b-0cf1bcef020e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/4091e51a-5b75-4202-b5e9-a79614225a90/action" status: 404 len: 111 microversion: 2.1 time: 0.049955 Oct 27 10:30:40.158212 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2447/5101] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:40 2022] POST /compute/v2.1/servers/4091e51a-5b75-4202-b5e9-a79614225a90/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:40.181361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:40.181981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:40.212441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:40.213756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:40.214411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:40.218118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:40.218826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:40.219615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:40.526834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:40.536275 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef445d44-b1c5-4c46-87b5-38891e1374b1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.371125 Oct 27 10:30:40.549451 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2448/5102] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:40 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:40.562985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:40.563607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:40.565837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Doing local delete in cell 9ce304fc-b6ad-4e74-a4d9-928e79c98b2f(cell1) {{(pid=120720) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 27 10:30:40.567835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:40.569919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:40.570155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:40.570754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:40.570925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:40.571556 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.api [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 27 10:30:40.571789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:40.572708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:40.573365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:40.573963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:40.575132 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [e44c52f7-f17a-4366-90cf-172ab593c76f] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:30:40.782101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:40.786988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:40.795487 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22235396-e15f-407a-b9f6-e30cf913213d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1324 microversion: 2.1 time: 0.244600 Oct 27 10:30:40.807904 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2449/5103] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:40 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1324 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:40.807904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:40.807904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:40.818924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:40.820434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:40.821281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:40.822400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:40.823356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:40.824168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:41.033938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:41.051379 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6df98e9-a997-4808-b139-2416cb5b80f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.253643 Oct 27 10:30:41.056833 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2450/5104] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:40 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:41.061911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:41.062534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:41.069191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:41.069876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:41.070464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:41.071224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:41.071705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:41.072132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:41.378588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:41.387084 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fbbf031-1cb5-4669-a06c-40c5acc72fd5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.329170 Oct 27 10:30:41.401356 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2451/5105] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:41 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:41.408794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:41.409402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:41.414959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:41.416731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:41.417215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:41.417648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:41.418414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:41.418920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:41.419372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:41.446365 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Cannot 'unshelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action HTTP/1.1 Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 18 Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: {"unshelve": null} Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: exception: Cannot 'unshelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df', 'body': {'unshelve': None}} Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df in vm_state active. Cannot unshelve while the instance is in this state. Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 10:30:41.448096 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 409 to user: Cannot 'unshelve' instance 80f1a184-24f6-43f3-8477-e15a2694f8df while it is in vm_state active {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ef3181a-f692-48ba-bb61-63a76e483340 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action" status: 409 len: 146 microversion: 2.1 time: 0.047031 Oct 27 10:30:41.452833 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2452/5106] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:41 2022] POST /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df/action => generated 146 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:30:41.461856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:41.462484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:41.469795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:41.470282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:41.470736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:41.472332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:41.472332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:41.472629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:41.588615 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [e44c52f7-f17a-4366-90cf-172ab593c76f] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 40038. Oct 27 10:30:41.602654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] deallocate_for_instance() {{(pid=120720) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 27 10:30:41.742805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:41.757184 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7d4e014-bbfe-47b6-bbb9-f23933c3e8f6 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.301079 Oct 27 10:30:41.757789 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2453/5107] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:41 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:41.789703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:41.792392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:41.799370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:41.800132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:41.807536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:41.808925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:41.809620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:41.810318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:42.105807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:42.116967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9c6e007-4bb1-4f40-9b33-0f085779454d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.332507 Oct 27 10:30:42.120064 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2454/5108] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:41 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:42.125166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:42.135512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:42.143269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:42.144069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:42.144980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:42.145953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:42.146718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:42.147366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:42.419396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:42.434011 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c9fdd9f6-900f-4797-8434-d8b1c84cc874 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1519 microversion: 2.1 time: 0.310912 Oct 27 10:30:42.434719 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2455/5109] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:42 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1519 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:42.475300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ebf58e5-69a4-409d-9dee-02f774dae957 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-764665555_updated"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:42.479434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0ebf58e5-69a4-409d-9dee-02f774dae957 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 3ab2218d-52b8-4aae-9e99-1b45b4ec5923] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:42.486824 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0ebf58e5-69a4-409d-9dee-02f774dae957 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 3ab2218d-52b8-4aae-9e99-1b45b4ec5923 could not be found. Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ebf58e5-69a4-409d-9dee-02f774dae957 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: request: PUT /compute/v2.1/servers/3ab2218d-52b8-4aae-9e99-1b45b4ec5923 HTTP/1.1 Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 80 Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-764665555_updated"}} Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 3ab2218d-52b8-4aae-9e99-1b45b4ec5923 could not be found. Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '3ab2218d-52b8-4aae-9e99-1b45b4ec5923', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-764665555_updated'}}} Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ab2218d-52b8-4aae-9e99-1b45b4ec5923 could not be found. Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 27 10:30:42.489057 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ab2218d-52b8-4aae-9e99-1b45b4ec5923 could not be found. Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ab2218d-52b8-4aae-9e99-1b45b4ec5923 could not be found. Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ebf58e5-69a4-409d-9dee-02f774dae957 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 3ab2218d-52b8-4aae-9e99-1b45b4ec5923 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ebf58e5-69a4-409d-9dee-02f774dae957 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "PUT /compute/v2.1/servers/3ab2218d-52b8-4aae-9e99-1b45b4ec5923" status: 404 len: 111 microversion: 2.1 time: 0.021983 Oct 27 10:30:42.493776 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2456/5110] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 10:30:42 2022] PUT /compute/v2.1/servers/3ab2218d-52b8-4aae-9e99-1b45b4ec5923 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:42.498996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:42.500597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:42.507826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Updating instance_info_cache with network_info: [] {{(pid=120720) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:30:42.517358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:42.518173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:42.519861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:42.521411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:42.522358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:42.523212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:42.825465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:42.849201 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4db1731-ea3d-4a33-9537-e0b1e29904ac tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.355515 Oct 27 10:30:42.849828 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2457/5111] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:42 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:42.866929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:42.867999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:42.876415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:42.876957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:42.877401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:42.878115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:42.878611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:42.879104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.078476 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-779507ba-4950-4a0d-94ab-bf676a2fbdfb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "DELETE /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 204 len: 0 microversion: 2.1 time: 3.455798 Oct 27 10:30:43.083665 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2655/5112] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:30:39 2022] DELETE /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 0 bytes in 3458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:30:43.228044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:43.239122 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00f51210-b933-4148-9178-bc91556acebe tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.388047 Oct 27 10:30:43.244043 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2458/5113] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:42 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:43.249129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cde48928-32d4-4f50-8d1d-e4cd18a74b2e tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-429972260", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cde48928-32d4-4f50-8d1d-e4cd18a74b2e tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Request method failure captured: Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 242 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl3AJ0kkm_IeDyLM8ghO4pNaGOPbazkvbqE66VEPlyd4KH1ljPlS8_GNZWP0wJl6IM8sAgkH9lL5pOEWGsYzK4SXmC3HurhICm_gcg1Hcb6r2Ym4U8ufexqDm2VNMXA42SxQsoCLc88S_Y_MnbJ_s_Nfng-GXb54zRRkJrq9wr0PkhM Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74a512b4f55c47c385f66af3b0801792", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 71877d9b89b7483a99dd772ccfaf4007 Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-429972260", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-429972260', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '1f9890b2-b368-458a-8f22-d7c30444ab0a'}]}}} Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:43.259303 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cde48928-32d4-4f50-8d1d-e4cd18a74b2e tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:43.267495 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cde48928-32d4-4f50-8d1d-e4cd18a74b2e tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.015458 Oct 27 10:30:43.276237 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2459/5114] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:30:43 2022] POST /compute/v2.1/servers => generated 175 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:30:43.291214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:43.294008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 56d1371c-3f59-487c-91e9-672f3bf5f71c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:43.295718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f8007499-5064-40c4-a1d8-65461b94e017 req-7034ffcc-7a79-4805-beed-efcba3cf0036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d1371c-3f59-487c-91e9-672f3bf5f71c", "name": "network-vif-deleted", "tag": "5dce3f42-d9cc-43e4-8452-4a6a2d704f31"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:43.310487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.312494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.313535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.314993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f8007499-5064-40c4-a1d8-65461b94e017 req-7034ffcc-7a79-4805-beed-efcba3cf0036 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.315429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.315545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f8007499-5064-40c4-a1d8-65461b94e017 req-7034ffcc-7a79-4805-beed-efcba3cf0036 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.316700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.317184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f8007499-5064-40c4-a1d8-65461b94e017 req-7034ffcc-7a79-4805-beed-efcba3cf0036 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.318358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.335746 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] HTTP exception thrown: Instance 56d1371c-3f59-487c-91e9-672f3bf5f71c could not be found. Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Request method failure captured: Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c HTTP/1.1 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlvFjvwCvJWajeEXqgzH-z_DFVkhQLebs9WsHxyKvtwa_JOeb71FsuVl2sDDbQKYE0FBFhO7HmuuecVkwQXAih8Jai9-pgze9OrG_VlxirEFv8mOsE5s7mk2MO7WGTUbVJb9ZHmIrthFWebesL1PNYS_R9HmcU_APCswB1BtPswgOz0 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eb2b0a77cbdc4d1bb17b8761358b04b9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "tempest-type-769482829", "name": "tempest-service-832747904", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1ebcbfbb11e84fe5bbfebd8a9ebea128 Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 56d1371c-3f59-487c-91e9-672f3bf5f71c could not be found. Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '56d1371c-3f59-487c-91e9-672f3bf5f71c'} Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d1371c-3f59-487c-91e9-672f3bf5f71c could not be found. Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d1371c-3f59-487c-91e9-672f3bf5f71c could not be found. Oct 27 10:30:43.336830 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d1371c-3f59-487c-91e9-672f3bf5f71c could not be found. Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Returning 404 to user: Instance 56d1371c-3f59-487c-91e9-672f3bf5f71c could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:43.340747 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5c9e3a8-02e4-4a43-85d8-7a4ac020e3e9 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c" status: 404 len: 111 microversion: 2.1 time: 0.060709 Oct 27 10:30:43.342303 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2460/5115] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:43 2022] GET /compute/v2.1/servers/56d1371c-3f59-487c-91e9-672f3bf5f71c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:43.347567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:43.348232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:43.352226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_external_events [req-f8007499-5064-40c4-a1d8-65461b94e017 req-7034ffcc-7a79-4805-beed-efcba3cf0036 service nova] Unable to find a host for instance 56d1371c-3f59-487c-91e9-672f3bf5f71c. Dropping event network-vif-deleted {{(pid=120720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 10:30:43.355458 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f8007499-5064-40c4-a1d8-65461b94e017 req-7034ffcc-7a79-4805-beed-efcba3cf0036 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.270355 Oct 27 10:30:43.358147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.358696 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2656/5116] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 274 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 10:30:43.359457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.359910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.360714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.361173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.361598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.370392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f61fd92-ab56-4236-b366-f213d99e5326 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:43.371192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f61fd92-ab56-4236-b366-f213d99e5326 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: 7beaefd6-6661-45ec-bd0d-fd65b6555fac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:43.385165 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3f61fd92-ab56-4236-b366-f213d99e5326 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] HTTP exception thrown: Instance 7beaefd6-6661-45ec-bd0d-fd65b6555fac could not be found. Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f61fd92-ab56-4236-b366-f213d99e5326 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Request method failure captured: Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/7beaefd6-6661-45ec-bd0d-fd65b6555fac/metadata HTTP/1.1 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl3AJ0kkm_IeDyLM8ghO4pNaGOPbazkvbqE66VEPlyd4KH1ljPlS8_GNZWP0wJl6IM8sAgkH9lL5pOEWGsYzK4SXmC3HurhICm_gcg1Hcb6r2Ym4U8ufexqDm2VNMXA42SxQsoCLc88S_Y_MnbJ_s_Nfng-GXb54zRRkJrq9wr0PkhM Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74a512b4f55c47c385f66af3b0801792", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 71877d9b89b7483a99dd772ccfaf4007 Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 7beaefd6-6661-45ec-bd0d-fd65b6555fac could not be found. Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': '7beaefd6-6661-45ec-bd0d-fd65b6555fac'} Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7beaefd6-6661-45ec-bd0d-fd65b6555fac could not be found. Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7beaefd6-6661-45ec-bd0d-fd65b6555fac could not be found. Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.392977 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.397238 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:43.397238 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:43.397238 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7beaefd6-6661-45ec-bd0d-fd65b6555fac could not be found. Oct 27 10:30:43.397238 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.407981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f61fd92-ab56-4236-b366-f213d99e5326 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Returning 404 to user: Instance 7beaefd6-6661-45ec-bd0d-fd65b6555fac could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:43.409142 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f61fd92-ab56-4236-b366-f213d99e5326 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/7beaefd6-6661-45ec-bd0d-fd65b6555fac/metadata" status: 404 len: 111 microversion: 2.1 time: 0.048992 Oct 27 10:30:43.416867 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2657/5117] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:30:43 2022] GET /compute/v2.1/servers/7beaefd6-6661-45ec-bd0d-fd65b6555fac/metadata => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:43.422563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:43.423297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:43.444480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.449192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.449859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.451022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.453511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.454206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.484429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:30:43.570871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:43.627121 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a21e147-8209-49c1-beb4-b7b7fc70fed2 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 204 len: 0 microversion: 2.1 time: 0.208635 Oct 27 10:30:43.628025 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2658/5118] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:30:43 2022] DELETE /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:30:43.644056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14858ef9-67df-4e51-9010-b74d65acd84b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911697942", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:43.645463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14858ef9-67df-4e51-9010-b74d65acd84b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Request method failure captured: Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 499 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl3AJ0kkm_IeDyLM8ghO4pNaGOPbazkvbqE66VEPlyd4KH1ljPlS8_GNZWP0wJl6IM8sAgkH9lL5pOEWGsYzK4SXmC3HurhICm_gcg1Hcb6r2Ym4U8ufexqDm2VNMXA42SxQsoCLc88S_Y_MnbJ_s_Nfng-GXb54zRRkJrq9wr0PkhM Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74a512b4f55c47c385f66af3b0801792", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 71877d9b89b7483a99dd772ccfaf4007 Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911697942", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1911697942', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1f9890b2-b368-458a-8f22-d7c30444ab0a'}]}}} Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 10:30:43.649291 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.652939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.656755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14858ef9-67df-4e51-9010-b74d65acd84b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:43.657825 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14858ef9-67df-4e51-9010-b74d65acd84b tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.028230 Oct 27 10:30:43.659090 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2659/5119] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:30:43 2022] POST /compute/v2.1/servers => generated 687 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:30:43.671397 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78a40e8c-4a1d-486a-936c-ce54c27ea400 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.327863 Oct 27 10:30:43.672736 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2461/5120] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:43 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:43.676145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:43.678118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:43.693440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.693937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.694382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.695102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.695558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.695985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.698634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67a91a3b-c585-4667-a1d0-1a191f2fd99d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67a91a3b-c585-4667-a1d0-1a191f2fd99d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: request: PUT /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df HTTP/1.1 Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 280 Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.704328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67a91a3b-c585-4667-a1d0-1a191f2fd99d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:43.710820 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67a91a3b-c585-4667-a1d0-1a191f2fd99d tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "PUT /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 400 len: 619 microversion: 2.1 time: 0.012760 Oct 27 10:30:43.715982 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2462/5121] 10.222.0.76 () {60 vars in 1257 bytes} [Thu Oct 27 10:30:43 2022] PUT /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:30:43.717821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:43.718454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:43.730235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.730809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.731253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.732775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.733243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.734701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.891826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:43.902055 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17eaebb5-3936-49b3-8879-ed4ce0eb325e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1466 microversion: 2.1 time: 0.241498 Oct 27 10:30:43.917530 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2660/5122] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:43 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1466 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:43.925702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b19ad1c4-0676-41ca-905a-581e4e7934fd tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-88660506", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b19ad1c4-0676-41ca-905a-581e4e7934fd tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Request method failure captured: Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 498 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl3AJ0kkm_IeDyLM8ghO4pNaGOPbazkvbqE66VEPlyd4KH1ljPlS8_GNZWP0wJl6IM8sAgkH9lL5pOEWGsYzK4SXmC3HurhICm_gcg1Hcb6r2Ym4U8ufexqDm2VNMXA42SxQsoCLc88S_Y_MnbJ_s_Nfng-GXb54zRRkJrq9wr0PkhM Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74a512b4f55c47c385f66af3b0801792", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 71877d9b89b7483a99dd772ccfaf4007 Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-88660506", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-88660506', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1f9890b2-b368-458a-8f22-d7c30444ab0a'}]}}} Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 10:30:43.931467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:43.934709 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:43.938196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b19ad1c4-0676-41ca-905a-581e4e7934fd tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:43.939354 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b19ad1c4-0676-41ca-905a-581e4e7934fd tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.020541 Oct 27 10:30:43.957343 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2661/5123] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:30:43 2022] POST /compute/v2.1/servers => generated 689 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:30:43.968649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:43.976644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:43.994312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:43.995134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:43.996373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:43.998366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.000813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.001664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.012990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:44.026597 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e64978b-1c3a-4f25-aff9-33948e9549ce tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.313628 Oct 27 10:30:44.027490 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2463/5124] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:43 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:44.034328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5f9e5a2-6b59-456a-8d35-0d2df87b6f53 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-552730105", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5f9e5a2-6b59-456a-8d35-0d2df87b6f53 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Request method failure captured: Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 753 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl3AJ0kkm_IeDyLM8ghO4pNaGOPbazkvbqE66VEPlyd4KH1ljPlS8_GNZWP0wJl6IM8sAgkH9lL5pOEWGsYzK4SXmC3HurhICm_gcg1Hcb6r2Ym4U8ufexqDm2VNMXA42SxQsoCLc88S_Y_MnbJ_s_Nfng-GXb54zRRkJrq9wr0PkhM Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74a512b4f55c47c385f66af3b0801792", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 71877d9b89b7483a99dd772ccfaf4007 Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-552730105", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-552730105', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1f9890b2-b368-458a-8f22-d7c30444ab0a'}]}}} Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:30:44.043007 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:30:44.046195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:30:44.048874 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:44.048874 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.049928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5f9e5a2-6b59-456a-8d35-0d2df87b6f53 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:44.051284 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5f9e5a2-6b59-456a-8d35-0d2df87b6f53 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.022069 Oct 27 10:30:44.052649 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2464/5125] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:30:44 2022] POST /compute/v2.1/servers => generated 1197 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 27 10:30:44.073479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:44.076499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:44.087576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.088298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.088994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.089880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.090498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.091088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.339639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:44.355038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:44.356250 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8a733647-f737-4c87-8055-2da75943c026 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.301745 Oct 27 10:30:44.356912 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2465/5126] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:44 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:44.365892 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-558da009-9be8-4a24-8c3a-962327b01b08 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.406178 Oct 27 10:30:44.369449 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2662/5127] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:43 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:44.379762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07a65807-57ce-4e53-8daa-a1635ddf2065 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-88223501", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:44.380013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8a6b798-6593-4c07-8d57-8b6c450b5e4c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8a6b798-6593-4c07-8d57-8b6c450b5e4c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: request: PUT /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df HTTP/1.1 Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 24 Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: {"server": {"name": ""}} Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df', 'body': {'server': {'name': ''}}} Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '' Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:30:44.387234 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 10:30:44.391732 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.393528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8a6b798-6593-4c07-8d57-8b6c450b5e4c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:44.394705 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8a6b798-6593-4c07-8d57-8b6c450b5e4c tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "PUT /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 400 len: 108 microversion: 2.1 time: 0.019149 Oct 27 10:30:44.395505 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2663/5128] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 10:30:44 2022] PUT /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07a65807-57ce-4e53-8daa-a1635ddf2065 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Request method failure captured: Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 1264 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl3AJ0kkm_IeDyLM8ghO4pNaGOPbazkvbqE66VEPlyd4KH1ljPlS8_GNZWP0wJl6IM8sAgkH9lL5pOEWGsYzK4SXmC3HurhICm_gcg1Hcb6r2Ym4U8ufexqDm2VNMXA42SxQsoCLc88S_Y_MnbJ_s_Nfng-GXb54zRRkJrq9wr0PkhM Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74a512b4f55c47c385f66af3b0801792", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 71877d9b89b7483a99dd772ccfaf4007 Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-88223501", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f9890b2-b368-458a-8f22-d7c30444ab0a"}]}} Oct 27 10:30:44.400605 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-88223501', 'imageRef': 'e360a591-87a4-48a1-b578-afd9703b636a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1f9890b2-b368-458a-8f22-d7c30444ab0a'}]}}} Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.402785 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:30:44.403898 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:30:44.410557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 10:30:44.410557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.411320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:44.411320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:44.421259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07a65807-57ce-4e53-8daa-a1635ddf2065 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:44.421464 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07a65807-57ce-4e53-8daa-a1635ddf2065 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.063011 Oct 27 10:30:44.425152 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2466/5129] 10.222.0.76 () {60 vars in 1148 bytes} [Thu Oct 27 10:30:44 2022] POST /compute/v2.1/servers => generated 2221 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 27 10:30:44.429691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.433236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.433694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.434429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.434885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.435717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.440869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-289f3137-23fc-4113-8d41-2acf1f40a71d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:44.441380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-289f3137-23fc-4113-8d41-2acf1f40a71d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: f9748c24-a36b-48ae-90bc-130f913079fe] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:44.453376 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-289f3137-23fc-4113-8d41-2acf1f40a71d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] HTTP exception thrown: Instance f9748c24-a36b-48ae-90bc-130f913079fe could not be found. Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-289f3137-23fc-4113-8d41-2acf1f40a71d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Request method failure captured: Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/f9748c24-a36b-48ae-90bc-130f913079fe/metadata/test2 HTTP/1.1 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl3AJ0kkm_IeDyLM8ghO4pNaGOPbazkvbqE66VEPlyd4KH1ljPlS8_GNZWP0wJl6IM8sAgkH9lL5pOEWGsYzK4SXmC3HurhICm_gcg1Hcb6r2Ym4U8ufexqDm2VNMXA42SxQsoCLc88S_Y_MnbJ_s_Nfng-GXb54zRRkJrq9wr0PkhM Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74a512b4f55c47c385f66af3b0801792", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 71877d9b89b7483a99dd772ccfaf4007 Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance f9748c24-a36b-48ae-90bc-130f913079fe could not be found. Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'server_id': 'f9748c24-a36b-48ae-90bc-130f913079fe', 'id': 'test2'} Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9748c24-a36b-48ae-90bc-130f913079fe could not be found. Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9748c24-a36b-48ae-90bc-130f913079fe could not be found. Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:44.456591 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:44.473978 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:44.473978 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:44.473978 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9748c24-a36b-48ae-90bc-130f913079fe could not be found. Oct 27 10:30:44.473978 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:44.473978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-289f3137-23fc-4113-8d41-2acf1f40a71d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Returning 404 to user: Instance f9748c24-a36b-48ae-90bc-130f913079fe could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:44.473978 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-289f3137-23fc-4113-8d41-2acf1f40a71d tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/f9748c24-a36b-48ae-90bc-130f913079fe/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.028050 Oct 27 10:30:44.473978 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2467/5130] 10.222.0.76 () {58 vars in 1281 bytes} [Thu Oct 27 10:30:44 2022] GET /compute/v2.1/servers/f9748c24-a36b-48ae-90bc-130f913079fe/metadata/test2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:44.479028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:44.479526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:44.505392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.505392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.505392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.505392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.505392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.505849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.573399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:30:44.604811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:44.618089 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-124d7a97-a03c-49fb-88cf-433971eb701e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1506 microversion: 2.1 time: 0.216430 Oct 27 10:30:44.619622 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2664/5131] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:44 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:44.741614 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-47371ab3-4806-4c65-97d3-0cb0719310d7 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "DELETE /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 204 len: 0 microversion: 2.1 time: 0.266556 Oct 27 10:30:44.742795 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2468/5132] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:30:44 2022] DELETE /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:30:44.751751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:44.752474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:44.761471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.762108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.763211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.764061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.764638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.765390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.942853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:44.943586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:44.958102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.963043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.963875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:44.964810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:44.965555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:44.966150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:45.055943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:45.067520 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28e2da6c-ed8a-4821-a097-a6832a1bba28 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1525 microversion: 2.1 time: 0.320464 Oct 27 10:30:45.069431 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2665/5133] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:44 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1525 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:45.180938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:45.203639 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b2dcbc3-76dc-4339-9ccc-8b170e670d61 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1466 microversion: 2.1 time: 0.268646 Oct 27 10:30:45.204238 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2469/5134] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:44 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1466 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:45.392005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:45.392728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:45.403435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:45.403959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:45.404481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:45.405541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:45.409851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:45.411586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:45.680334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:45.715552 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-046a7ab9-0e25-476b-959b-ea3f45cb9a2d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.323817 Oct 27 10:30:45.721618 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2666/5135] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:45 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:46.094611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:46.095262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:46.104755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:46.105232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:46.105662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:46.106547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:46.110047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:46.114036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:46.227672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:46.228274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:46.239256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:46.239808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:46.240274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:46.241013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:46.241674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:46.242271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:46.532501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:46.542009 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6b01d69-4a95-42ca-8a3e-131ed9b44d02 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1466 microversion: 2.1 time: 0.318173 Oct 27 10:30:46.566081 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2667/5136] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:46 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1466 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:46.640772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:46.655697 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e529fc51-b86d-4488-9507-3593e927dadc tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1525 microversion: 2.1 time: 0.566238 Oct 27 10:30:46.668965 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2470/5137] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:46 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1525 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:46.746343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:46.746675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:46.761678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:46.762455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:46.763063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:46.763951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:46.764557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:46.765188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:47.121691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:47.130311 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21df8827-1285-41e6-b32d-59064a85aae0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.388010 Oct 27 10:30:47.135438 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2668/5138] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:46 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:47.574147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-df3d139f-3a65-463d-96b4-759485f2aa0b req-a6fa4bf7-64fa-492b-878f-879398b6e3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e807fd8-2fb2-455e-a52a-5fb654f74682", "name": "network-vif-deleted", "tag": "4dc4f634-1c13-4b89-bc05-7782d9e04eed"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:47.580420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:47.581553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:47.601827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:47.602315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:47.604473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-df3d139f-3a65-463d-96b4-759485f2aa0b req-a6fa4bf7-64fa-492b-878f-879398b6e3b4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:47.605243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:47.606185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:47.614429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-df3d139f-3a65-463d-96b4-759485f2aa0b req-a6fa4bf7-64fa-492b-878f-879398b6e3b4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:47.615406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:47.616134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:47.616261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-df3d139f-3a65-463d-96b4-759485f2aa0b req-a6fa4bf7-64fa-492b-878f-879398b6e3b4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:47.643272 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-df3d139f-3a65-463d-96b4-759485f2aa0b req-a6fa4bf7-64fa-492b-878f-879398b6e3b4 service nova] Creating event network-vif-deleted:4dc4f634-1c13-4b89-bc05-7782d9e04eed for instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 on n-h2-854663-10 Oct 27 10:30:47.668432 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-df3d139f-3a65-463d-96b4-759485f2aa0b req-a6fa4bf7-64fa-492b-878f-879398b6e3b4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096123 Oct 27 10:30:47.676404 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2669/5139] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:30:47.699523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:47.700518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:47.733540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:47.736858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:47.737471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:47.739625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:47.743559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:47.744176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:47.811748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:47.816639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:47.824133 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b5233ba8-0040-4f4d-9a80-0723a9735561 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1466 microversion: 2.1 time: 0.255302 Oct 27 10:30:47.824746 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2471/5140] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:47 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1466 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:48.134710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:48.153094 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-103fa4b8-6606-444d-9819-3d9743e1fec2 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1525 microversion: 2.1 time: 0.469028 Oct 27 10:30:48.173542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:48.174243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:48.182295 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2670/5141] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:47 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1525 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:48.184477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:48.185004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:48.185643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:48.186541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:48.187176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:48.187773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:48.555892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:48.570485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-63b666e0-8956-4a95-a981-6fd5dfd82e71 req-94622625-b2e2-4922-ab48-f99632e31f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecb2d22-a521-4b9b-b0d3-b1982f676996", "name": "network-vif-deleted", "tag": "c5a23b03-e6fb-4b9d-93a8-ada42cf30c84"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:48.572608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d12f39f2-4a68-4fb1-b766-f8e6c1898771 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1506 microversion: 2.1 time: 0.401393 Oct 27 10:30:48.573592 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2472/5142] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:48 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:48.585359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-63b666e0-8956-4a95-a981-6fd5dfd82e71 req-94622625-b2e2-4922-ab48-f99632e31f7c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:48.586415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-63b666e0-8956-4a95-a981-6fd5dfd82e71 req-94622625-b2e2-4922-ab48-f99632e31f7c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:48.587006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-63b666e0-8956-4a95-a981-6fd5dfd82e71 req-94622625-b2e2-4922-ab48-f99632e31f7c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:48.636145 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-63b666e0-8956-4a95-a981-6fd5dfd82e71 req-94622625-b2e2-4922-ab48-f99632e31f7c service nova] Creating event network-vif-deleted:c5a23b03-e6fb-4b9d-93a8-ada42cf30c84 for instance eecb2d22-a521-4b9b-b0d3-b1982f676996 on n-h2-854663-10 Oct 27 10:30:48.643174 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-63b666e0-8956-4a95-a981-6fd5dfd82e71 req-94622625-b2e2-4922-ab48-f99632e31f7c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076138 Oct 27 10:30:48.645734 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2671/5143] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:30:48.849045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:48.849962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:48.865763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:48.866530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:48.868090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:48.870521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:48.870997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:48.871640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:49.032438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:49.036155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:49.037685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:49.039046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lazy-loading 'fault' on Instance uuid 9e807fd8-2fb2-455e-a52a-5fb654f74682 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:49.186695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:49.198609 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35d8e4b7-956f-4309-9bef-4b5323bb69bc tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 200 len: 1305 microversion: 2.1 time: 0.351047 Oct 27 10:30:49.208931 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2473/5144] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:48 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 1305 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:49.210218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:49.211047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:49.223441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:49.226861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:49.229330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:49.230333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:49.232267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:49.233015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:49.311027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:49.311885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:49.314336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:49.315051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lazy-loading 'fault' on Instance uuid eecb2d22-a521-4b9b-b0d3-b1982f676996 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:49.449517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71877d9b89b7483a99dd772ccfaf4007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a512b4f55c47c385f66af3b0801792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:49.480817 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b43290b-f51a-46b2-9146-9c6f2b2053e1 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 200 len: 1314 microversion: 2.1 time: 0.272231 Oct 27 10:30:49.484200 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2672/5145] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:49 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:49.598005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:49.599320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:49.616970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:49.617668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:49.618664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:49.620174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:49.621243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:49.621805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.227805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:50.228557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 9e807fd8-2fb2-455e-a52a-5fb654f74682] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:50.245279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.245768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.246200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.246910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.247360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.247781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.282126 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] HTTP exception thrown: Instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 could not be found. Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Request method failure captured: Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 HTTP/1.1 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlvFjvwCvJWajeEXqgzH-z_DFVkhQLebs9WsHxyKvtwa_JOeb71FsuVl2sDDbQKYE0FBFhO7HmuuecVkwQXAih8Jai9-pgze9OrG_VlxirEFv8mOsE5s7mk2MO7WGTUbVJb9ZHmIrthFWebesL1PNYS_R9HmcU_APCswB1BtPswgOz0 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eb2b0a77cbdc4d1bb17b8761358b04b9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "tempest-type-769482829", "name": "tempest-service-832747904", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 1ebcbfbb11e84fe5bbfebd8a9ebea128 Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 could not be found. Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '9e807fd8-2fb2-455e-a52a-5fb654f74682'} Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 could not be found. Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 could not be found. Oct 27 10:30:50.291012 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.296245 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:50.296245 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.296245 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:50.296245 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:50.296245 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:50.296245 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:50.296245 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:50.296245 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 could not be found. Oct 27 10:30:50.296245 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.297784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Returning 404 to user: Instance 9e807fd8-2fb2-455e-a52a-5fb654f74682 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:50.298825 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42e6b04c-351b-435b-a6d0-d0c4b3d6d7c6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682" status: 404 len: 111 microversion: 2.1 time: 0.076423 Oct 27 10:30:50.299900 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2673/5146] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:50 2022] GET /compute/v2.1/servers/9e807fd8-2fb2-455e-a52a-5fb654f74682 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:30:50.308435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:50.309301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:50.317146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.318125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.318763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.319709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.320354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.320997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.352267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:30:50.468966 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a8a013c-5379-4846-92d3-c96006b2f458 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "DELETE /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 204 len: 0 microversion: 2.1 time: 0.164075 Oct 27 10:30:50.470346 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2674/5147] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:30:50 2022] DELETE /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:30:50.478363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-844849942", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "b5992b86-5ab6-4486-b25d-8f48266b9847"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:50.483150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:50.497878 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81ce84e0-79a6-45cf-80a2-2846a6e26da6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1486 microversion: 2.1 time: 0.906102 Oct 27 10:30:50.499912 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2474/5148] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:49 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1486 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:50.536119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:50.536816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:50.549965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.550463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.554356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.555119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.555589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.556019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.559616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] validate_networks() for [('b5992b86-5ab6-4486-b25d-8f48266b9847', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:30:50.896604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:50.904946 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3cbe7ab5-ff56-4692-9e1d-4418af09daf7 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1506 microversion: 2.1 time: 0.384642 Oct 27 10:30:50.905537 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2475/5149] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:50 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:50.924218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:50.924972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] [instance: eecb2d22-a521-4b9b-b0d3-b1982f676996] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:50.932142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.934968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.935465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.936803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.936803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.937148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.953185 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] HTTP exception thrown: Instance eecb2d22-a521-4b9b-b0d3-b1982f676996 could not be found. Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Request method failure captured: Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 HTTP/1.1 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl3AJ0kkm_IeDyLM8ghO4pNaGOPbazkvbqE66VEPlyd4KH1ljPlS8_GNZWP0wJl6IM8sAgkH9lL5pOEWGsYzK4SXmC3HurhICm_gcg1Hcb6r2Ym4U8ufexqDm2VNMXA42SxQsoCLc88S_Y_MnbJ_s_Nfng-GXb54zRRkJrq9wr0PkhM Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74a512b4f55c47c385f66af3b0801792", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74a512b4f55c47c385f66af3b0801792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 74a512b4f55c47c385f66af3b0801792 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1844984229 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 71877d9b89b7483a99dd772ccfaf4007 Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1844984229-project Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance eecb2d22-a521-4b9b-b0d3-b1982f676996 could not be found. Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'eecb2d22-a521-4b9b-b0d3-b1982f676996'} Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eecb2d22-a521-4b9b-b0d3-b1982f676996 could not be found. Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eecb2d22-a521-4b9b-b0d3-b1982f676996 could not be found. Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.954490 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecb2d22-a521-4b9b-b0d3-b1982f676996 could not be found. Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] Returning 404 to user: Instance eecb2d22-a521-4b9b-b0d3-b1982f676996 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f75bad73-b903-409d-a470-4efe91a93001 tempest-ServerMetadataNegativeTestJSON-1844984229 tempest-ServerMetadataNegativeTestJSON-1844984229-project] 10.222.0.76 "GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996" status: 404 len: 111 microversion: 2.1 time: 0.037826 Oct 27 10:30:50.960980 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2476/5150] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:50 2022] GET /compute/v2.1/servers/eecb2d22-a521-4b9b-b0d3-b1982f676996 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:50.974173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1081735686", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:51.045399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] validate_networks() for [('811fe1a3-a0ca-449c-95d2-a85eb7ac8c73', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:30:51.581811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:30:51.583016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:30:51.583680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:30:51.584578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:30:51.584726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:30:51.608523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:51.609343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:51.609945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:51.610846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:51.611474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:51.613231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:51.646835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Getting quotas for project 5bacaacf85ed472cb4719853652501f2. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:30:51.653247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Getting quotas for user 939c5936f19a4590ad0996447c4774c8 and project 5bacaacf85ed472cb4719853652501f2. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:30:51.668159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:30:51.670852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:30:51.737205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f9e193e-15db-4706-a492-8d2850b3d726 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265158 Oct 27 10:30:51.745062 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2675/5151] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:30:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:30:51.750406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:51.751129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:51.761000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:51.761711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:51.762333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:51.763209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:51.763806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:51.765284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:51.786942 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 HTTP/1.1 Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '7616ad90-cb36-470d-967c-aca1f4bbd5e0'} Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:51.788992 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:51.793079 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:51.793879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:51.794654 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d5323a0-4b4e-4d28-bea6-a707bcb11f7e tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 404 len: 111 microversion: 2.1 time: 0.048223 Oct 27 10:30:51.795043 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2676/5152] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:30:51 2022] DELETE /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:51.810911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a91a424-88a9-4307-8863-532b0ae6d4a9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:51.815129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a91a424-88a9-4307-8863-532b0ae6d4a9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:51.934250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:30:51.934852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:30:51.935243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:30:51.936099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:30:51.936753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:30:51.962934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:51.967643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:51.968370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:51.969371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:51.969842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:51.970276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:52.036979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a91a424-88a9-4307-8863-532b0ae6d4a9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:52.037986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Getting quotas for project a76b3a0a8c7443edb88dcacd70e551ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:30:52.044927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Getting quotas for user acdcf812d2a543ee823947d22febb739 and project a76b3a0a8c7443edb88dcacd70e551ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:30:52.055729 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a91a424-88a9-4307-8863-532b0ae6d4a9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1213 microversion: 2.1 time: 0.253498 Oct 27 10:30:52.057535 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2677/5153] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:51 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1213 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:52.067960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:30:52.070635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:30:52.083975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:52.084750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 7616ad90-cb36-470d-967c-aca1f4bbd5e0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:52.093024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:52.094693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:52.095281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:52.096190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:52.096949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:52.097570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:52.116818 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 HTTP/1.1 Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '7616ad90-cb36-470d-967c-aca1f4bbd5e0'} Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:52.118653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:52.125127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:52.125127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:52.125127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:52.125127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:52.125127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:52.125127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. Oct 27 10:30:52.125127 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:30:52.133232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 7616ad90-cb36-470d-967c-aca1f4bbd5e0 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:52.134269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-445ab79f-7a16-4b0e-8a12-0aa8890f9516 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0" status: 404 len: 111 microversion: 2.1 time: 0.062321 Oct 27 10:30:52.134868 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2678/5154] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:52 2022] GET /compute/v2.1/servers/7616ad90-cb36-470d-967c-aca1f4bbd5e0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:52.148867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:52.149798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:52.161573 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7eb09dfb-94f9-4e27-a616-af32756cfc60 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.202880 Oct 27 10:30:52.162138 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2477/5155] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:30:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:30:52.168410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:52.168410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:52.168410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:52.168410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:52.168410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:52.168410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:52.168915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:52.168915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:52.182042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:52.182544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:52.183030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:52.183828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:52.184634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:52.185444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:52.224133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:30:52.444214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:52.458287 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01c3ce36-8397-4cde-bf80-a5f3879456bd tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1506 microversion: 2.1 time: 0.318823 Oct 27 10:30:52.459753 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2679/5156] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:52 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:52.477163 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2d827832-967a-438e-873e-a222a87792ff tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 204 len: 0 microversion: 2.1 time: 0.311752 Oct 27 10:30:52.477685 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2478/5157] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:30:52 2022] DELETE /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:30:52.485988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d458db9b-b68d-4299-8591-7f5e0ffff8d8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:52.486671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d458db9b-b68d-4299-8591-7f5e0ffff8d8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:52.494682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:52.497748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:52.512596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:52.513470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:52.517134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:52.518381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:52.519312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:52.519935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:52.678848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d458db9b-b68d-4299-8591-7f5e0ffff8d8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:52.694617 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d458db9b-b68d-4299-8591-7f5e0ffff8d8 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1214 microversion: 2.1 time: 0.220686 Oct 27 10:30:52.695359 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2680/5158] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:52 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:52.783440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:52.798743 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67a6e983-81a2-45db-8069-36230efe5659 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.316288 Oct 27 10:30:52.804753 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2479/5159] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:52 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:53.084937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:53.085630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:53.094427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:53.105396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:53.106148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:53.107067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:53.107697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:53.108461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:53.244043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:53.259925 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-748ee219-c9c3-4ac9-96a3-9244da58e5f8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1217 microversion: 2.1 time: 0.178689 Oct 27 10:30:53.261484 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2681/5160] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:53 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:53.483506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:53.484804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:53.493299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:53.494065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:53.494666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:53.495551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:53.496203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:53.496823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:53.594438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:53.610322 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c68e590c-c76a-44c7-b1b4-fb771280df11 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1464 microversion: 2.1 time: 0.130844 Oct 27 10:30:53.616399 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2480/5161] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:53 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1464 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:53.718538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:53.720322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:53.727243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:53.727936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:53.728520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:53.729399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:53.730147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:53.730745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:53.755332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:53.756547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-493690b4-9246-4014-8fd7-d4192a1e9976 req-89d09d50-1191-4596-80af-104836d89539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42645020-6574-4ccd-a940-5488825620c9", "name": "network-vif-deleted", "tag": "5ea362d9-27fd-4b51-908c-273002fca9d8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:53.776290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-493690b4-9246-4014-8fd7-d4192a1e9976 req-89d09d50-1191-4596-80af-104836d89539 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:53.785546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-493690b4-9246-4014-8fd7-d4192a1e9976 req-89d09d50-1191-4596-80af-104836d89539 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:53.786484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-493690b4-9246-4014-8fd7-d4192a1e9976 req-89d09d50-1191-4596-80af-104836d89539 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:53.800257 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-493690b4-9246-4014-8fd7-d4192a1e9976 req-89d09d50-1191-4596-80af-104836d89539 service nova] Creating event network-vif-deleted:5ea362d9-27fd-4b51-908c-273002fca9d8 for instance 42645020-6574-4ccd-a940-5488825620c9 on n-h2-854663-10 Oct 27 10:30:53.806805 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-493690b4-9246-4014-8fd7-d4192a1e9976 req-89d09d50-1191-4596-80af-104836d89539 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055231 Oct 27 10:30:53.807969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2481/5162] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:30:53.826997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:53.827712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:53.838416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:53.839219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:53.839656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:53.840408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:53.840994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:53.841425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:53.864240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:53.879616 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de2b821e-a74d-46f7-a9c1-8c7ab73fe3d0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1218 microversion: 2.1 time: 0.164965 Oct 27 10:30:53.894092 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2682/5163] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:53 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:54.229071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:54.243907 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4a74a35-4e21-4112-a6c6-482522b8d966 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1512 microversion: 2.1 time: 0.421581 Oct 27 10:30:54.259091 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2482/5164] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:53 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1512 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:54.289885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:54.290506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:54.301703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:54.302450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:54.313420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:54.314789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:54.315695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:54.316460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:54.475892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:54.485394 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7d6c859-83ff-4184-b54d-b759b8efc3b2 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1209 microversion: 2.1 time: 0.201101 Oct 27 10:30:54.488898 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2683/5165] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:54 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1209 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:54.572385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83311a65-7b34-4002-b5a3-49667923ef19 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:54.573199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83311a65-7b34-4002-b5a3-49667923ef19 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:54.582846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83311a65-7b34-4002-b5a3-49667923ef19 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:54.583335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83311a65-7b34-4002-b5a3-49667923ef19 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:54.583759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83311a65-7b34-4002-b5a3-49667923ef19 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:54.584515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83311a65-7b34-4002-b5a3-49667923ef19 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:54.602234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83311a65-7b34-4002-b5a3-49667923ef19 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:54.602975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83311a65-7b34-4002-b5a3-49667923ef19 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:54.635893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:54.636530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:54.643794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:54.648789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:54.649276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:54.650019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:54.650474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:54.650901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:54.678073 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83311a65-7b34-4002-b5a3-49667923ef19 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments/e2edeec9-14be-45ce-95ff-614310228491" status: 200 len: 194 microversion: 2.20 time: 0.109851 Oct 27 10:30:54.684955 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2483/5166] 10.222.0.76 () {60 vars in 1454 bytes} [Thu Oct 27 10:30:54 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments/e2edeec9-14be-45ce-95ff-614310228491 => generated 194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:30:54.737685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:54.739939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:54.741121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:54.743097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lazy-loading 'fault' on Instance uuid 42645020-6574-4ccd-a940-5488825620c9 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:54.793072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:54.793960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:54.801978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:54.802906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:54.803851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:54.804935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:54.805535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:54.806111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:54.975134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lazy-loading 'services' on Instance uuid b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:55.057872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:55.078111 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d11ec5ec-8fd9-443f-b716-06c00c90a765 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 200 len: 1304 microversion: 2.1 time: 0.442035 Oct 27 10:30:55.100427 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2684/5167] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:54 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 1304 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:55.105908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:55.108406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:55.135031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.135031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.136134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.137676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.140171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.140635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.193614 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2f57643-2257-4d46-aabe-56b0fcefb177 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments/e2edeec9-14be-45ce-95ff-614310228491" status: 202 len: 0 microversion: 2.20 time: 0.405197 Oct 27 10:30:55.194529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2484/5168] 10.222.0.76 () {60 vars in 1457 bytes} [Thu Oct 27 10:30:54 2022] DELETE /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments/e2edeec9-14be-45ce-95ff-614310228491 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:30:55.209909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-37ab40b4-bef0-4817-9db7-bdb33486d964 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:55.231849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-37ab40b4-bef0-4817-9db7-bdb33486d964 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:55.258110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37ab40b4-bef0-4817-9db7-bdb33486d964 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.264220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37ab40b4-bef0-4817-9db7-bdb33486d964 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.271267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37ab40b4-bef0-4817-9db7-bdb33486d964 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.272240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37ab40b4-bef0-4817-9db7-bdb33486d964 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.272755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37ab40b4-bef0-4817-9db7-bdb33486d964 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.273186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37ab40b4-bef0-4817-9db7-bdb33486d964 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.314782 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-37ab40b4-bef0-4817-9db7-bdb33486d964 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115906 Oct 27 10:30:55.320395 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2485/5169] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:30:55 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:30:55.325582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:55.326525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:55.333750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.336342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.339645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.343758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.344761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.345369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.400049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.400536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.401080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.401925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lazy-loading 'fault' on Instance uuid 80f1a184-24f6-43f3-8477-e15a2694f8df {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:55.492716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:55.502684 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1e9e08e-3d33-4582-a96f-0704c6d8b694 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1266 microversion: 2.1 time: 0.400733 Oct 27 10:30:55.503657 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2685/5170] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:55 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1266 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:55.513650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:55.514515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:55.522325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.522830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.523985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.524907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.525361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.525924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.530777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:55.548577 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-450769de-c1db-4c89-ba6e-e0a6d0c901ab tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1307 microversion: 2.1 time: 0.226029 Oct 27 10:30:55.550886 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2486/5171] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:55 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:55.825680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3e839b94-e2d6-43cb-b8d6-66813c644796 req-864b3a46-3e57-4320-9751-5d371cecbc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f1a184-24f6-43f3-8477-e15a2694f8df", "name": "network-vif-deleted", "tag": "d3e32e88-f305-4079-a874-e75520cad0d1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:55.837263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3e839b94-e2d6-43cb-b8d6-66813c644796 req-864b3a46-3e57-4320-9751-5d371cecbc67 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:55.838207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3e839b94-e2d6-43cb-b8d6-66813c644796 req-864b3a46-3e57-4320-9751-5d371cecbc67 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:55.838698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3e839b94-e2d6-43cb-b8d6-66813c644796 req-864b3a46-3e57-4320-9751-5d371cecbc67 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:55.852115 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3e839b94-e2d6-43cb-b8d6-66813c644796 req-864b3a46-3e57-4320-9751-5d371cecbc67 service nova] Creating event network-vif-deleted:d3e32e88-f305-4079-a874-e75520cad0d1 for instance 80f1a184-24f6-43f3-8477-e15a2694f8df on n-h2-854663-10 Oct 27 10:30:55.857709 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3e839b94-e2d6-43cb-b8d6-66813c644796 req-864b3a46-3e57-4320-9751-5d371cecbc67 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035733 Oct 27 10:30:55.858321 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2487/5172] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:30:56.106053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:56.107029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 42645020-6574-4ccd-a940-5488825620c9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:56.126064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:56.150214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.152133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.156236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.159047 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f41e6ffc-eef0-4435-92d3-767133d56233 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1209 microversion: 2.1 time: 0.644121 Oct 27 10:30:56.160950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.162461 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2686/5173] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:55 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1209 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:56.168100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.170268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.191912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:56.226616 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] HTTP exception thrown: Instance 42645020-6574-4ccd-a940-5488825620c9 could not be found. Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Request method failure captured: Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 HTTP/1.1 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlvFjvwCvJWajeEXqgzH-z_DFVkhQLebs9WsHxyKvtwa_JOeb71FsuVl2sDDbQKYE0FBFhO7HmuuecVkwQXAih8Jai9-pgze9OrG_VlxirEFv8mOsE5s7mk2MO7WGTUbVJb9ZHmIrthFWebesL1PNYS_R9HmcU_APCswB1BtPswgOz0 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eb2b0a77cbdc4d1bb17b8761358b04b9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "tempest-type-769482829", "name": "tempest-service-832747904", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1ebcbfbb11e84fe5bbfebd8a9ebea128 Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 42645020-6574-4ccd-a940-5488825620c9 could not be found. Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '42645020-6574-4ccd-a940-5488825620c9'} Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42645020-6574-4ccd-a940-5488825620c9 could not be found. Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42645020-6574-4ccd-a940-5488825620c9 could not be found. Oct 27 10:30:56.230575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:56.235575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:56.235575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:56.235575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:56.235575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:56.235575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:56.235575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:56.235575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:56.235575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42645020-6574-4ccd-a940-5488825620c9 could not be found. Oct 27 10:30:56.235575 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:56.236871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Returning 404 to user: Instance 42645020-6574-4ccd-a940-5488825620c9 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:56.238643 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd13447e-3db4-44e4-bed5-d117cd247720 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9" status: 404 len: 111 microversion: 2.1 time: 0.138000 Oct 27 10:30:56.239534 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2488/5174] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:56 2022] GET /compute/v2.1/servers/42645020-6574-4ccd-a940-5488825620c9 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:56.251282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:56.251282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:56.263471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:56.269402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.269957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.277081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.279999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.280532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.281001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.340117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c286fd7-53e3-415c-9d82-20689ceb0870 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:56.346759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c286fd7-53e3-415c-9d82-20689ceb0870 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:56.371533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c286fd7-53e3-415c-9d82-20689ceb0870 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.376362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c286fd7-53e3-415c-9d82-20689ceb0870 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.377230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c286fd7-53e3-415c-9d82-20689ceb0870 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.378574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c286fd7-53e3-415c-9d82-20689ceb0870 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.385011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c286fd7-53e3-415c-9d82-20689ceb0870 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.387088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c286fd7-53e3-415c-9d82-20689ceb0870 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.389512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:30:56.459372 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c286fd7-53e3-415c-9d82-20689ceb0870 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135182 Oct 27 10:30:56.462324 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2489/5175] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:30:56 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:30:56.535847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:56.536214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:56.567070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.567626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.568074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.575772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.576431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.577940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.611299 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b31bf7a0-7f75-4c76-a02b-0b3995723b71 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 204 len: 0 microversion: 2.1 time: 0.366086 Oct 27 10:30:56.611902 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2687/5176] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:30:56 2022] DELETE /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:30:56.635511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:56.643034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:56.670113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.673376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.673833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.678464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.684143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.685851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.757514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:56.758286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:56.758995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:56.759671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lazy-loading 'fault' on Instance uuid 80f1a184-24f6-43f3-8477-e15a2694f8df {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:57.011117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2252caef8d76405a8db702970ab03fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8bfafdd15ce4d76ba83efe7d2f6d8cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:57.026526 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd41b0c8-3729-48cc-9f0b-1b28250d9ba5 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 200 len: 1307 microversion: 2.1 time: 0.409748 Oct 27 10:30:57.031249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:57.041042 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2688/5177] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:56 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 1307 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:57.043402 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58d57125-aff5-462a-b581-c8e31a89eb5d tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1272 microversion: 2.1 time: 0.515995 Oct 27 10:30:57.043990 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2490/5178] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:56 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1272 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:57.068313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:57.070827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:57.083586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:57.096285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:57.096953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:57.097841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:57.098433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:57.098954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:57.190361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:57.191438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:57.194769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:57.213123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:57.219712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:57.222785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:57.224474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:57.226052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:57.226726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:57.492892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:57.506221 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00de9022-7c6a-422c-a304-3e1e2cca999c tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1283 microversion: 2.1 time: 0.319809 Oct 27 10:30:57.520612 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2491/5179] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:57 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1283 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:57.534643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3bebcecf-ec8f-49df-863c-e0dcd8becf2c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:57.537106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3bebcecf-ec8f-49df-863c-e0dcd8becf2c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:57.557454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bebcecf-ec8f-49df-863c-e0dcd8becf2c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:57.557970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bebcecf-ec8f-49df-863c-e0dcd8becf2c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:57.558410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bebcecf-ec8f-49df-863c-e0dcd8becf2c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:57.562664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bebcecf-ec8f-49df-863c-e0dcd8becf2c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:57.563163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bebcecf-ec8f-49df-863c-e0dcd8becf2c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:57.563623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bebcecf-ec8f-49df-863c-e0dcd8becf2c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:57.646766 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3bebcecf-ec8f-49df-863c-e0dcd8becf2c tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124541 Oct 27 10:30:57.647602 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2492/5180] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:30:57 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:30:57.865161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:57.880049 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-91b81c7f-1141-4457-bb38-66e331266462 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1492 microversion: 2.1 time: 0.837223 Oct 27 10:30:57.882153 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2689/5181] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:57 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1492 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:58.065154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:58.066626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] [instance: 80f1a184-24f6-43f3-8477-e15a2694f8df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:58.072977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:58.073602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:58.074847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.075568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.076224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.077347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.077972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.078582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.085787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.090541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.091179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.092086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.097751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.098424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.104509 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] HTTP exception thrown: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df could not be found. Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Request method failure captured: Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df HTTP/1.1 Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzeqgQ0mlEcrTggygiTuFN0hu7ouRd6wkWBGR1Bqh_6P2YeSdOUW-f1dbO4cKRyrpjWBv3kMUpZGWhEiBdP471n0K49zvJ4oNWnXnSDiBOKRB5FrL1CcWfJb9d5X_1faDeRg2l024tsLk-quos48shf1iS0kPNjcAwH5gefbWWBX1Q Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d8bfafdd15ce4d76ba83efe7d2f6d8cf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d8bfafdd15ce4d76ba83efe7d2f6d8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d8bfafdd15ce4d76ba83efe7d2f6d8cf Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1130888696 Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 2252caef8d76405a8db702970ab03fb2 Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-1130888696-project Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df could not be found. Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '80f1a184-24f6-43f3-8477-e15a2694f8df'} Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df could not be found. Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df could not be found. Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:30:58.109207 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:58.114134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:30:58.114134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:30:58.114134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:30:58.114134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:30:58.114134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:30:58.114134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df could not be found. Oct 27 10:30:58.114134 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:30:58.115393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] Returning 404 to user: Instance 80f1a184-24f6-43f3-8477-e15a2694f8df could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:30:58.116443 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fdfc6b60-bf16-4b67-a50e-db9cef3177e1 tempest-ServersNegativeTestJSON-1130888696 tempest-ServersNegativeTestJSON-1130888696-project] 10.222.0.76 "GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df" status: 404 len: 111 microversion: 2.1 time: 0.055257 Oct 27 10:30:58.122094 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2493/5182] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:58 2022] GET /compute/v2.1/servers/80f1a184-24f6-43f3-8477-e15a2694f8df => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:30:58.481125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f451c8db-1c83-4fce-b2b4-8a3d64b60a85 req-e0d97737-efc6-4981-858e-51d552fb1402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a16e810-2ce6-4fa0-829e-1af369376408", "name": "network-vif-deleted", "tag": "ab9f117e-7d8a-42ff-becc-c634bb030367"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:58.516051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f451c8db-1c83-4fce-b2b4-8a3d64b60a85 req-e0d97737-efc6-4981-858e-51d552fb1402 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.517690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f451c8db-1c83-4fce-b2b4-8a3d64b60a85 req-e0d97737-efc6-4981-858e-51d552fb1402 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.518441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f451c8db-1c83-4fce-b2b4-8a3d64b60a85 req-e0d97737-efc6-4981-858e-51d552fb1402 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.614766 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f451c8db-1c83-4fce-b2b4-8a3d64b60a85 req-e0d97737-efc6-4981-858e-51d552fb1402 service nova] Creating event network-vif-deleted:ab9f117e-7d8a-42ff-becc-c634bb030367 for instance 7a16e810-2ce6-4fa0-829e-1af369376408 on n-h2-854663-10 Oct 27 10:30:58.640181 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f451c8db-1c83-4fce-b2b4-8a3d64b60a85 req-e0d97737-efc6-4981-858e-51d552fb1402 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156027 Oct 27 10:30:58.643647 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2494/5183] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:30:58.658246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:58.662608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:58.667839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:58.672118 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30bd7856-8d17-45fd-806b-62a6acdd5fa6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.604849 Oct 27 10:30:58.675430 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2690/5184] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:58 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:58.686922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08ccfdb7-92cf-41d9-a732-4507ec68b80b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:58.702742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08ccfdb7-92cf-41d9-a732-4507ec68b80b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:58.709894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ccfdb7-92cf-41d9-a732-4507ec68b80b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.710667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ccfdb7-92cf-41d9-a732-4507ec68b80b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.711375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ccfdb7-92cf-41d9-a732-4507ec68b80b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.712275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ccfdb7-92cf-41d9-a732-4507ec68b80b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.713102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.714230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ccfdb7-92cf-41d9-a732-4507ec68b80b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.715240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ccfdb7-92cf-41d9-a732-4507ec68b80b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.715599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.719214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.721821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.731071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.733327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.783369 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08ccfdb7-92cf-41d9-a732-4507ec68b80b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105454 Oct 27 10:30:58.792678 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2691/5185] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:30:58 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:30:58.905397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:58.906733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:58.916211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.919615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.921252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:58.923683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:58.924156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:58.924706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:59.012293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:59.027230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:59.042025 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34eaaafb-9427-48ff-bcbb-cd38360e01f9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1271 microversion: 2.1 time: 0.396268 Oct 27 10:30:59.044869 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2495/5186] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:58 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1271 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:59.047122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:59.048468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:59.050613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lazy-loading 'fault' on Instance uuid 7a16e810-2ce6-4fa0-829e-1af369376408 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:30:59.128335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:59.146108 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97c4e691-5ce2-4db7-b336-de4789413d69 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 200 len: 1303 microversion: 2.1 time: 0.244171 Oct 27 10:30:59.146744 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2692/5187] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:58 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 1303 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:59.702241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:59.703777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:59.723074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:59.724266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:59.724917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:59.725837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:59.726483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:59.727135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:59.796248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1057b02-d378-4d9e-91a2-a6764dd24c45 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:59.799071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1057b02-d378-4d9e-91a2-a6764dd24c45 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:59.819999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1057b02-d378-4d9e-91a2-a6764dd24c45 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:59.824507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1057b02-d378-4d9e-91a2-a6764dd24c45 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:59.825092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1057b02-d378-4d9e-91a2-a6764dd24c45 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:59.826765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1057b02-d378-4d9e-91a2-a6764dd24c45 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:59.827320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1057b02-d378-4d9e-91a2-a6764dd24c45 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:59.830220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1057b02-d378-4d9e-91a2-a6764dd24c45 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:59.912271 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1057b02-d378-4d9e-91a2-a6764dd24c45 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118585 Oct 27 10:30:59.919157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2693/5188] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:30:59 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:31:00.045175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:00.061420 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6d4caa13-53da-4e35-93af-07d568996db9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.363604 Oct 27 10:31:00.062254 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2496/5189] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:59 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:00.084916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:00.085554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:00.096917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:00.101233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:00.101870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:00.102819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:00.106312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:00.107116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:00.182842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:00.183854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 7a16e810-2ce6-4fa0-829e-1af369376408] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:00.193664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:00.194797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:00.195457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:00.196478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:00.199011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:00.199902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:00.237351 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] HTTP exception thrown: Instance 7a16e810-2ce6-4fa0-829e-1af369376408 could not be found. Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Request method failure captured: Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 HTTP/1.1 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlvFjvwCvJWajeEXqgzH-z_DFVkhQLebs9WsHxyKvtwa_JOeb71FsuVl2sDDbQKYE0FBFhO7HmuuecVkwQXAih8Jai9-pgze9OrG_VlxirEFv8mOsE5s7mk2MO7WGTUbVJb9ZHmIrthFWebesL1PNYS_R9HmcU_APCswB1BtPswgOz0 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eb2b0a77cbdc4d1bb17b8761358b04b9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "tempest-type-769482829", "name": "tempest-service-832747904", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1ebcbfbb11e84fe5bbfebd8a9ebea128 Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 7a16e810-2ce6-4fa0-829e-1af369376408 could not be found. Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '7a16e810-2ce6-4fa0-829e-1af369376408'} Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a16e810-2ce6-4fa0-829e-1af369376408 could not be found. Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a16e810-2ce6-4fa0-829e-1af369376408 could not be found. Oct 27 10:31:00.239391 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a16e810-2ce6-4fa0-829e-1af369376408 could not be found. Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Returning 404 to user: Instance 7a16e810-2ce6-4fa0-829e-1af369376408 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af9c4e5c-c53b-4818-8975-6b277a35c402 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408" status: 404 len: 111 microversion: 2.1 time: 0.075481 Oct 27 10:31:00.249385 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2497/5190] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:00 2022] GET /compute/v2.1/servers/7a16e810-2ce6-4fa0-829e-1af369376408 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:31:00.253880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:00.265498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:00.273009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:00.273602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:00.274151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:00.275126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:00.275792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:00.282092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:00.335515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:31:00.532710 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dec4b1c3-5f38-45d9-9fd7-ab842619fde0 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "DELETE /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 204 len: 0 microversion: 2.1 time: 0.284506 Oct 27 10:31:00.533785 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2498/5191] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:31:00 2022] DELETE /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:31:00.544802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:00.545676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:00.559405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:00.560003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:00.560459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:00.561230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:00.561841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:00.562934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:01.166015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:01.183437 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff802d20-575b-4c34-b546-941b0db185eb tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1672 microversion: 2.1 time: 0.644872 Oct 27 10:31:01.184279 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2499/5192] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:00 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1672 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:01.189539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ffaf9db-5726-4edb-8ed5-1ccb2cd0f394 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:01.204242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ffaf9db-5726-4edb-8ed5-1ccb2cd0f394 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:01.223532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ffaf9db-5726-4edb-8ed5-1ccb2cd0f394 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:01.227036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ffaf9db-5726-4edb-8ed5-1ccb2cd0f394 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:01.231030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ffaf9db-5726-4edb-8ed5-1ccb2cd0f394 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:01.231916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ffaf9db-5726-4edb-8ed5-1ccb2cd0f394 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:01.233513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ffaf9db-5726-4edb-8ed5-1ccb2cd0f394 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:01.236322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ffaf9db-5726-4edb-8ed5-1ccb2cd0f394 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:01.311783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:01.315494 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ffaf9db-5726-4edb-8ed5-1ccb2cd0f394 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129676 Oct 27 10:31:01.324159 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1906328c-aa1a-4b8e-92f4-197db04e24d6 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1313 microversion: 2.1 time: 1.243992 Oct 27 10:31:01.325054 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2500/5193] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:31:01 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:31:01.335142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:01.341395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:01.345759 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2694/5194] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:00 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1313 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:01.358817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4fff82e4-be08-47c4-8f2a-008d04999ef6 req-6e06302a-0640-4ea5-a692-592847b1e4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a3bceb-d9c8-4318-891a-dd9eb199f118", "tag": "ba6aac24-71ac-4ba8-bcea-b6b188187ad7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:01.364448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:01.365381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:01.366073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:01.367054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:01.375909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:01.377730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:01.383304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4fff82e4-be08-47c4-8f2a-008d04999ef6 req-6e06302a-0640-4ea5-a692-592847b1e4e7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:01.383807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4fff82e4-be08-47c4-8f2a-008d04999ef6 req-6e06302a-0640-4ea5-a692-592847b1e4e7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:01.384290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4fff82e4-be08-47c4-8f2a-008d04999ef6 req-6e06302a-0640-4ea5-a692-592847b1e4e7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:01.412597 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4fff82e4-be08-47c4-8f2a-008d04999ef6 req-6e06302a-0640-4ea5-a692-592847b1e4e7 service nova] Creating event network-changed:ba6aac24-71ac-4ba8-bcea-b6b188187ad7 for instance 29a3bceb-d9c8-4318-891a-dd9eb199f118 on n-h2-854663-10 Oct 27 10:31:01.419995 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4fff82e4-be08-47c4-8f2a-008d04999ef6 req-6e06302a-0640-4ea5-a692-592847b1e4e7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070342 Oct 27 10:31:01.425995 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2695/5195] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:01.942031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:01.956589 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1632027-d32e-4c74-9591-7ed89621e50c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.628222 Oct 27 10:31:01.962123 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2501/5196] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:01 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:02.226708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:02.227808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:02.241415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:02.258132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:02.258937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:02.260528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:02.262120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:02.262729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:02.263672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:02.332493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8ac423ce-2d6c-4635-b69b-474c1d963f4e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:02.334938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8ac423ce-2d6c-4635-b69b-474c1d963f4e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:02.340989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:02.342362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:02.344428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ac423ce-2d6c-4635-b69b-474c1d963f4e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:02.345052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ac423ce-2d6c-4635-b69b-474c1d963f4e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:02.345654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ac423ce-2d6c-4635-b69b-474c1d963f4e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:02.346581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ac423ce-2d6c-4635-b69b-474c1d963f4e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:02.347388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ac423ce-2d6c-4635-b69b-474c1d963f4e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:02.347926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ac423ce-2d6c-4635-b69b-474c1d963f4e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:02.423469 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8ac423ce-2d6c-4635-b69b-474c1d963f4e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095184 Oct 27 10:31:02.433641 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2502/5197] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:31:02 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:31:02.446040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:02.447329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:02.461987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:02.462897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:02.464962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:02.466166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:02.468949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:02.469653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:02.688597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:03.103388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:03.126987 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-663b8a23-9ab4-4314-958c-4e18aef7c484 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1672 microversion: 2.1 time: 0.918401 Oct 27 10:31:03.129367 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2696/5198] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:02 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1672 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:03.155902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:03.156525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:03.171028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:03.171532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:03.171971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:03.172794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:03.173251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:03.173678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:03.177538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:03.273265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:03.287198 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6d80b6d3-4927-424a-8aba-9bd884593ac8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1313 microversion: 2.1 time: 0.852003 Oct 27 10:31:03.294349 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2503/5199] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:02 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:03.444847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0b055f42-abcb-4aee-989e-ad2358c551ad tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:03.450319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0b055f42-abcb-4aee-989e-ad2358c551ad tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:03.461975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b055f42-abcb-4aee-989e-ad2358c551ad tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:03.463284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b055f42-abcb-4aee-989e-ad2358c551ad tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:03.465245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b055f42-abcb-4aee-989e-ad2358c551ad tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:03.466314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b055f42-abcb-4aee-989e-ad2358c551ad tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:03.466943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b055f42-abcb-4aee-989e-ad2358c551ad tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:03.467976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b055f42-abcb-4aee-989e-ad2358c551ad tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:03.509525 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0b055f42-abcb-4aee-989e-ad2358c551ad tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072430 Oct 27 10:31:03.515612 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2504/5200] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:31:03 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:03.515786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5657764a-a56a-4532-a422-b059f2edc1f0 req-c7af61a3-1f20-45d6-99e1-7aad33004204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e320be9b-4f69-435c-ad80-2e1da09b2af6", "tag": "b357c2a6-cfec-45d0-bad7-268f27189372"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:03.534438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5657764a-a56a-4532-a422-b059f2edc1f0 req-c7af61a3-1f20-45d6-99e1-7aad33004204 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:03.535216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5657764a-a56a-4532-a422-b059f2edc1f0 req-c7af61a3-1f20-45d6-99e1-7aad33004204 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:03.535799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5657764a-a56a-4532-a422-b059f2edc1f0 req-c7af61a3-1f20-45d6-99e1-7aad33004204 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:03.553628 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5657764a-a56a-4532-a422-b059f2edc1f0 req-c7af61a3-1f20-45d6-99e1-7aad33004204 service nova] Creating event network-changed:b357c2a6-cfec-45d0-bad7-268f27189372 for instance e320be9b-4f69-435c-ad80-2e1da09b2af6 on n-h2-854663-10 Oct 27 10:31:03.560269 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5657764a-a56a-4532-a422-b059f2edc1f0 req-c7af61a3-1f20-45d6-99e1-7aad33004204 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048191 Oct 27 10:31:03.565429 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2505/5201] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:03.614187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:03.614849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:03.622093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:03.622604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:03.623042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:03.624193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:03.624884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:03.625473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:03.648102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:03.659960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:31:03.680284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:03.690822 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad29783a-3356-4cd8-a33d-0728b64ee6f3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.538673 Oct 27 10:31:03.694861 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2697/5202] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:03 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:03.818456 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62b7e2d2-1f43-4925-8d80-da6cdeea7b0b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 204 len: 0 microversion: 2.20 time: 0.213267 Oct 27 10:31:03.819071 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2506/5203] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:31:03 2022] DELETE /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 10:31:03.827408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:03.828232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:03.839410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:03.840081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:03.843527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:03.844319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:03.844814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:03.845255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:04.157408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:04.158378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:04.175434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:04.181013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:04.181668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:04.191507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:04.193663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:04.200232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:04.902537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:04.911566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:04.913072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:04.914274 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38ff5c38-d7c9-4c1b-96bc-0f3ffbacdf60 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 1.090963 Oct 27 10:31:04.921088 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2698/5204] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:03 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:04.926094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:04.926716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:04.946899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:04.947870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:04.948919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:04.949921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:04.950382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:04.950818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:05.298889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:05.337804 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d6f216a2-4d5c-4a8c-93e4-381277483f3e tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1672 microversion: 2.1 time: 1.182036 Oct 27 10:31:05.339638 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2507/5205] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:04 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1672 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:05.352561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:05.360350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:05.377048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:05.379647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:05.380309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:05.383008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:05.383722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:05.387742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:05.450633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:05.472344 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dcbd3c87-91ae-4cd5-8d1b-bed6a0fcb8b7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1313 microversion: 2.1 time: 0.544158 Oct 27 10:31:05.474881 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2699/5206] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:04 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:05.874124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:05.906973 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1fd4bae-dcc4-45ad-a3ac-039301c8e1ae tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.558499 Oct 27 10:31:05.910172 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2508/5207] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:05 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:05.940193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:05.941161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:05.947771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:05.948481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:05.949141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:05.949869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:05.950517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:05.951089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:06.028235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a9e247bd-1405-48c5-a090-f611b8c05ace req-6d33d393-5bc8-4e63-834b-0f4c8492a6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12306d2d-5e05-4a81-b323-1fc83906167e", "name": "network-vif-deleted", "tag": "c4641136-d2e9-4b66-ae69-f73839df90bc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:06.047980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a9e247bd-1405-48c5-a090-f611b8c05ace req-6d33d393-5bc8-4e63-834b-0f4c8492a6e0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:06.048982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a9e247bd-1405-48c5-a090-f611b8c05ace req-6d33d393-5bc8-4e63-834b-0f4c8492a6e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:06.049771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a9e247bd-1405-48c5-a090-f611b8c05ace req-6d33d393-5bc8-4e63-834b-0f4c8492a6e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:06.086664 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a9e247bd-1405-48c5-a090-f611b8c05ace req-6d33d393-5bc8-4e63-834b-0f4c8492a6e0 service nova] Creating event network-vif-deleted:c4641136-d2e9-4b66-ae69-f73839df90bc for instance 12306d2d-5e05-4a81-b323-1fc83906167e on n-h2-854663-10 Oct 27 10:31:06.097389 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a9e247bd-1405-48c5-a090-f611b8c05ace req-6d33d393-5bc8-4e63-834b-0f4c8492a6e0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074809 Oct 27 10:31:06.100492 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2509/5208] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:31:06.343026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:06.360167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:06.368744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:06.369631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:06.370717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:06.373793 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42822df3-97e7-4ca5-9310-c4711f36cbde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1721 microversion: 2.20 time: 0.437074 Oct 27 10:31:06.374562 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2700/5209] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:05 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1721 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:06.396337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:06.396337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:06.396704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:06.397558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:06.398024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:06.398464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:06.499139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:06.500177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:06.500901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:06.501645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:06.502301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lazy-loading 'fault' on Instance uuid 12306d2d-5e05-4a81-b323-1fc83906167e {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:31:06.503377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:06.514936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:06.517360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:06.518137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:06.520036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:06.521417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:06.524455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:06.631659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebcbfbb11e84fe5bbfebd8a9ebea128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b0a77cbdc4d1bb17b8761358b04b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:06.641337 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f8dea87-dc7a-4297-a961-7a5b830b2e79 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 200 len: 1325 microversion: 2.1 time: 0.279335 Oct 27 10:31:06.642052 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2510/5210] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:06 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 1325 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:06.919654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:06.937106 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-780a49cb-5024-42ca-9820-ac535584a191 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1313 microversion: 2.1 time: 0.441768 Oct 27 10:31:06.937784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:06.938720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:06.940331 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2701/5211] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:06 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:06.956427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:06.957385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:06.958019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:06.958926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:06.959720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:06.960308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.263755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:07.281970 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8b0b5cb-eb1f-42fc-b0e4-4fab0f72bb4b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.348604 Oct 27 10:31:07.285459 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2511/5212] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:06 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:07.407497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:07.408510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:07.438114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.438114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:07.439376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.440044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.441026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:07.441555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.590064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:07.613316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:07.616223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:07.617808 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3a6d5c4-98ef-49fa-ad5d-9bf4c0d85a1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1654 microversion: 2.20 time: 0.214456 Oct 27 10:31:07.628725 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2702/5213] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:07 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1654 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:07.666868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:07.668038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] [instance: 12306d2d-5e05-4a81-b323-1fc83906167e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:07.675130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.675998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:07.676612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.677824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.678868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:07.679581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.697513 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] HTTP exception thrown: Instance 12306d2d-5e05-4a81-b323-1fc83906167e could not be found. Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Request method failure captured: Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e HTTP/1.1 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlvFjvwCvJWajeEXqgzH-z_DFVkhQLebs9WsHxyKvtwa_JOeb71FsuVl2sDDbQKYE0FBFhO7HmuuecVkwQXAih8Jai9-pgze9OrG_VlxirEFv8mOsE5s7mk2MO7WGTUbVJb9ZHmIrthFWebesL1PNYS_R9HmcU_APCswB1BtPswgOz0 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eb2b0a77cbdc4d1bb17b8761358b04b9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eb2b0a77cbdc4d1bb17b8761358b04b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "tempest-type-769482829", "name": "tempest-service-832747904", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: eb2b0a77cbdc4d1bb17b8761358b04b9 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-1553574344 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1ebcbfbb11e84fe5bbfebd8a9ebea128 Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-1553574344-project Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 12306d2d-5e05-4a81-b323-1fc83906167e could not be found. Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '12306d2d-5e05-4a81-b323-1fc83906167e'} Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12306d2d-5e05-4a81-b323-1fc83906167e could not be found. Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12306d2d-5e05-4a81-b323-1fc83906167e could not be found. Oct 27 10:31:07.700178 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:07.704143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:07.704143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:07.704143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:07.704143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:07.704143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:07.704143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:31:07.704143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:31:07.704143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12306d2d-5e05-4a81-b323-1fc83906167e could not be found. Oct 27 10:31:07.704143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:07.706101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Returning 404 to user: Instance 12306d2d-5e05-4a81-b323-1fc83906167e could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:31:07.707668 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-557b6406-6c28-4a90-99c3-46719bac92b6 tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e" status: 404 len: 111 microversion: 2.1 time: 0.045224 Oct 27 10:31:07.708441 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2512/5214] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:07 2022] GET /compute/v2.1/servers/12306d2d-5e05-4a81-b323-1fc83906167e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:31:07.716792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ad5d600-9f0f-494d-b4f2-c2003bd6fa1a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] Calling method '.version_select at 0x7f6d59ef8040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:07.759682 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ad5d600-9f0f-494d-b4f2-c2003bd6fa1a tempest-ServerActionsTestJSON-1553574344 tempest-ServerActionsTestJSON-1553574344-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4719984" status: 202 len: 0 microversion: 2.1 time: 0.046571 Oct 27 10:31:07.761022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2703/5215] 10.222.0.76 () {58 vars in 1212 bytes} [Thu Oct 27 10:31:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4719984 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:31:07.962684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:07.963789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:07.996298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.998244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.002739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:08.027455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:08.028506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.029094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:08.313755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:08.315106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:08.345994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:08.346770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.347396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:08.348159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:08.348787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.349226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:08.738089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:08.750688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0215437f-7f95-4ed6-912d-9447e65364d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1313 microversion: 2.1 time: 0.792243 Oct 27 10:31:08.753077 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2513/5216] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:07 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1313 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:08.765520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-55ec2da4-72d2-4856-b275-53846349bbbb req-0ee89f69-e051-43a4-bdbf-af5c9abcb605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39", "name": "network-vif-deleted", "tag": "f4bf9ba7-53c2-4a70-9da2-6e9514c10258"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:08.794935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-55ec2da4-72d2-4856-b275-53846349bbbb req-0ee89f69-e051-43a4-bdbf-af5c9abcb605 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:08.796374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-55ec2da4-72d2-4856-b275-53846349bbbb req-0ee89f69-e051-43a4-bdbf-af5c9abcb605 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.799486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-55ec2da4-72d2-4856-b275-53846349bbbb req-0ee89f69-e051-43a4-bdbf-af5c9abcb605 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:08.832092 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-55ec2da4-72d2-4856-b275-53846349bbbb req-0ee89f69-e051-43a4-bdbf-af5c9abcb605 service nova] Creating event network-vif-deleted:f4bf9ba7-53c2-4a70-9da2-6e9514c10258 for instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 on n-h2-854663-10 Oct 27 10:31:08.851436 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-55ec2da4-72d2-4856-b275-53846349bbbb req-0ee89f69-e051-43a4-bdbf-af5c9abcb605 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096183 Oct 27 10:31:08.852157 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2514/5217] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:08.881032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:08.884797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:08.908471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:08.909495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.911789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:08.914770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:08.915492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.917170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:08.960251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:08.961414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.962252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:08.963588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lazy-loading 'fault' on Instance uuid b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:31:09.199134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:09.212285 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be139a98-667e-43f0-925b-e39e324f40fd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.901985 Oct 27 10:31:09.214528 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2704/5218] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:08 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:09.236435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:09.246511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:09.249171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:09.251015 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b71eea0-1575-4f33-ba0f-3baeeadc6580 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 200 len: 1371 microversion: 2.20 time: 0.391754 Oct 27 10:31:09.252316 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2515/5219] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:08 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:09.779940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:09.780570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:09.788490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:09.789017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:09.789451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:09.797056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:09.809520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:09.810247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:10.241271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:10.242501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:10.257338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:10.258085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:10.258766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:10.259646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:10.260119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:10.260556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:10.550809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:10.562014 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae1a6348-1cf3-46d4-8fe0-cca784833117 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1313 microversion: 2.1 time: 0.786064 Oct 27 10:31:10.575621 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2705/5220] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:09 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:10.589706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:10.590720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:10.600329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:10.600871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:10.601395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:10.605779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:10.606295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:10.606901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:10.627213 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] HTTP exception thrown: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Request method failure captured: Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 HTTP/1.1 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl0M9aep192vrh8vl0CuTrVUlGgRv_AffJmkjgTXD_8O-lz_F1FWGr2iqRtKJ6FR6zizWijlmifwzUgfjYZg_5NgxXhfOO1gX1SYoKDczh-ni_jqu577BxWN_cUiIxfLAtBpcJ1F-OYpSSGUxjBXlLyJXbuwAAqJaf8RYs3rFgZ1-dU Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2ac83c84f1234dea80c2b074896559c8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 742c83e928b64f588265112ea7f4c3c9 Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39'} Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:31:10.630836 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Returning 404 to user: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:31:10.635641 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10a02d04-98c2-417b-8761-2a11cd62f55b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 404 len: 111 microversion: 2.20 time: 0.053784 Oct 27 10:31:10.637325 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2706/5221] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:10 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:31:10.642404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c94daa74-cc8e-4ca8-a41e-f451788c34b9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '.version_select at 0x7f6d59f0f310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:10.678782 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c94daa74-cc8e-4ca8-a41e-f451788c34b9 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344567849" status: 204 len: 0 microversion: 2.20 time: 0.039161 Oct 27 10:31:10.683987 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2707/5222] 10.222.0.76 () {60 vars in 1259 bytes} [Thu Oct 27 10:31:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344567849 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:31:10.869622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:10.879107 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-986cbe06-c95d-4733-a7bc-ac2da1818007 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.641835 Oct 27 10:31:10.879661 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2516/5223] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:10 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:11.509055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c9935a00-b630-47e8-97aa-fe30a298663a req-aaafd00e-0eab-47d6-929f-da00c4eb97fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e320be9b-4f69-435c-ad80-2e1da09b2af6", "name": "network-vif-plugged", "status": "completed", "tag": "b357c2a6-cfec-45d0-bad7-268f27189372"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:11.542996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c9935a00-b630-47e8-97aa-fe30a298663a req-aaafd00e-0eab-47d6-929f-da00c4eb97fe service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:11.543772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c9935a00-b630-47e8-97aa-fe30a298663a req-aaafd00e-0eab-47d6-929f-da00c4eb97fe service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:11.543944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c9935a00-b630-47e8-97aa-fe30a298663a req-aaafd00e-0eab-47d6-929f-da00c4eb97fe service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:11.587417 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c9935a00-b630-47e8-97aa-fe30a298663a req-aaafd00e-0eab-47d6-929f-da00c4eb97fe service nova] Creating event network-vif-plugged:b357c2a6-cfec-45d0-bad7-268f27189372 for instance e320be9b-4f69-435c-ad80-2e1da09b2af6 on n-h2-854663-10 Oct 27 10:31:11.592707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:11.593907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:11.595602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c9935a00-b630-47e8-97aa-fe30a298663a req-aaafd00e-0eab-47d6-929f-da00c4eb97fe service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091685 Oct 27 10:31:11.600410 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2708/5224] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:11.611921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:11.615097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:11.618726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:11.619580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:11.622043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:11.622624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:11.907774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:11.908765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:11.921647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:11.922394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:11.923591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:11.924902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:11.925717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:11.926576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:12.232526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:12.246572 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c761099-e362-4b70-bef7-d1799bce4ce8 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1313 microversion: 2.1 time: 0.659155 Oct 27 10:31:12.248012 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2517/5225] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:11 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1313 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:12.363060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:12.375058 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60c590e6-d4c4-48c0-8a5c-5e4506dbc908 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.474101 Oct 27 10:31:12.376206 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2709/5226] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:11 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:13.151234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0fe1ba2a-f134-477c-a28d-1edf70d3d707 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'create', calling method: .version_select at 0x7f6d5b400c10>, body: {"keypair": {"name": "tempest-keypair-926289581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFFbp7K0GEAFYP8GSk7v2awdZRQYfgTWllRzctBVIguYbVfMaC7+y6qjJ/ocwklqIQZ9zlr72KHJeRpSjGIU4suvMpnATF7cvXnbBJs20Cn2PhCZr86RkdCtBcU7RJ/Wg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:13.186828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-0fe1ba2a-f134-477c-a28d-1edf70d3d707 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Getting quotas for project 2ac83c84f1234dea80c2b074896559c8. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:31:13.205018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-0fe1ba2a-f134-477c-a28d-1edf70d3d707 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Getting quotas for user 742c83e928b64f588265112ea7f4c3c9 and project 2ac83c84f1234dea80c2b074896559c8. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:31:13.238072 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0fe1ba2a-f134-477c-a28d-1edf70d3d707 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:31:13.275509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:13.278792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:13.293473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:13.295578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:13.302595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:13.304226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:13.305561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:13.306293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:13.824763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:13.845831 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fe1c243-339d-4a81-96d7-2a418068db2a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1498 microversion: 2.1 time: 0.577254 Oct 27 10:31:13.847163 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2710/5227] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:13 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1498 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:13.855535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:13.856596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:13.868529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:13.870342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:13.872330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:13.874276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:13.875283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:13.875967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:14.251009 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-0fe1ba2a-f134-477c-a28d-1edf70d3d707 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 40612. Oct 27 10:31:14.284470 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0fe1ba2a-f134-477c-a28d-1edf70d3d707 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.136631 Oct 27 10:31:14.288447 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2518/5228] 10.222.0.76 () {62 vars in 1200 bytes} [Thu Oct 27 10:31:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 10:31:14.296455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e4e89a71-4ab8-49af-9b54-ceb9bc074e75 req-180fb193-85e0-4deb-b226-4dd82d22244c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a3bceb-d9c8-4318-891a-dd9eb199f118", "name": "network-vif-plugged", "status": "completed", "tag": "ba6aac24-71ac-4ba8-bcea-b6b188187ad7"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:14.329995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:14.331944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e4e89a71-4ab8-49af-9b54-ceb9bc074e75 req-180fb193-85e0-4deb-b226-4dd82d22244c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:14.336641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e4e89a71-4ab8-49af-9b54-ceb9bc074e75 req-180fb193-85e0-4deb-b226-4dd82d22244c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:14.337450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e4e89a71-4ab8-49af-9b54-ceb9bc074e75 req-180fb193-85e0-4deb-b226-4dd82d22244c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:14.353949 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bf617b6-d889-4bfc-9d0f-392b8422bde7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.501265 Oct 27 10:31:14.355140 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2711/5229] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:13 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:14.367371 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e4e89a71-4ab8-49af-9b54-ceb9bc074e75 req-180fb193-85e0-4deb-b226-4dd82d22244c service nova] Creating event network-vif-plugged:ba6aac24-71ac-4ba8-bcea-b6b188187ad7 for instance 29a3bceb-d9c8-4318-891a-dd9eb199f118 on n-h2-854663-10 Oct 27 10:31:14.386798 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e4e89a71-4ab8-49af-9b54-ceb9bc074e75 req-180fb193-85e0-4deb-b226-4dd82d22244c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095745 Oct 27 10:31:14.387412 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2519/5230] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:14.476255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:14.476781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:14.484803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:14.485548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:14.486178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:14.487132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:14.487784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:14.488359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:14.518124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:31:14.647215 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8c67732-0697-4d3c-93e5-eef53c03d3dc tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 204 len: 0 microversion: 2.1 time: 0.175855 Oct 27 10:31:14.651000 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2712/5231] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:31:14 2022] DELETE /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:31:14.657596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:14.658319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:14.666057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:14.666554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:14.666998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:14.667716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:14.668357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:14.669083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:15.103433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:15.137097 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07f91529-54b0-4cae-9119-d344eed2732a tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1504 microversion: 2.1 time: 0.478208 Oct 27 10:31:15.138257 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2520/5232] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:14 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1504 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:15.381323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:15.382634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:15.391082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:15.391773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:15.392373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:15.393321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:15.394736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:15.395342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:15.826699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:15.856324 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28a3ee3e-494d-4ca4-ac16-34d29d8f03cc tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1314 microversion: 2.1 time: 0.479141 Oct 27 10:31:15.858761 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2713/5233] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:15 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:16.168539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:16.169514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:16.188173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:16.189203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:16.190160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:16.191103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:16.192553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:16.193304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:16.882306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:16.887221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:16.903842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:16.905711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:16.908062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:16.908928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:16.912028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:16.912519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:17.460554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:17.485936 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f25227c7-3bdc-4917-ab7a-72d06ebae415 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1504 microversion: 2.1 time: 1.322322 Oct 27 10:31:17.487765 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2521/5234] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:16 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1504 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:17.509615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:17.532987 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62768132-eb7f-47a6-b145-26f965d1e5e2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1500 microversion: 2.1 time: 0.655193 Oct 27 10:31:17.536204 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2714/5235] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:16 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1500 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:17.567579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:17.570860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:17.582134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:17.582635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:17.583074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:17.583791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:17.588528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:17.589078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:17.671411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lazy-loading 'flavor' on Instance uuid 29a3bceb-d9c8-4318-891a-dd9eb199f118 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:31:17.795162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:17.851680 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d25e9181-9fa3-4860-b9f2-6c0b10e40fca tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "POST /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118/action" status: 200 len: 32 microversion: 2.1 time: 0.291238 Oct 27 10:31:17.863954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:17.865035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:17.870836 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2522/5236] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:31:17 2022] POST /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118/action => generated 32 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:31:17.872826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:17.873641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:17.874291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:17.875309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:17.876104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:17.876814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:17.907801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:18.312141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:18.320815 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-000d619d-c8a9-41dd-87b4-3fc68ad57540 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.462105 Oct 27 10:31:18.326687 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2715/5237] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:17 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:18.515656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:18.523892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:18.535089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a2d3fa39-7df4-4e6a-8974-5216ef7afb2c req-412f640a-8e2f-4866-a4c0-d45a1068af45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e320be9b-4f69-435c-ad80-2e1da09b2af6", "name": "network-vif-deleted", "tag": "b357c2a6-cfec-45d0-bad7-268f27189372"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:18.572020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:18.572504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:18.581728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a2d3fa39-7df4-4e6a-8974-5216ef7afb2c req-412f640a-8e2f-4866-a4c0-d45a1068af45 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:18.582967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a2d3fa39-7df4-4e6a-8974-5216ef7afb2c req-412f640a-8e2f-4866-a4c0-d45a1068af45 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:18.583404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:18.586521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a2d3fa39-7df4-4e6a-8974-5216ef7afb2c req-412f640a-8e2f-4866-a4c0-d45a1068af45 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:18.588885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:18.590599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:18.591983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:18.653383 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a2d3fa39-7df4-4e6a-8974-5216ef7afb2c req-412f640a-8e2f-4866-a4c0-d45a1068af45 service nova] Creating event network-vif-deleted:b357c2a6-cfec-45d0-bad7-268f27189372 for instance e320be9b-4f69-435c-ad80-2e1da09b2af6 on n-h2-854663-10 Oct 27 10:31:18.665309 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a2d3fa39-7df4-4e6a-8974-5216ef7afb2c req-412f640a-8e2f-4866-a4c0-d45a1068af45 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135239 Oct 27 10:31:18.676138 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2716/5238] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:18.824748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:18.837948 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aeb93225-fccd-4d0d-b2d4-364d7ea5dd58 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 200 len: 1298 microversion: 2.1 time: 0.326807 Oct 27 10:31:18.854218 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2523/5239] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:18 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 1298 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:19.357010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:19.358739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:19.374602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:19.375203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:19.379233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:19.380442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:19.381956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:19.383302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:19.835250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:19.857701 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5f390b8-4315-4d61-a41d-ac2b890b77e0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.498249 Oct 27 10:31:19.891784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:19.891784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: e320be9b-4f69-435c-ad80-2e1da09b2af6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:19.891784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:19.891784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:19.891784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:19.891784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:19.891784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:19.891784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:19.909865 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2717/5240] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:19 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:19.923783 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] HTTP exception thrown: Instance e320be9b-4f69-435c-ad80-2e1da09b2af6 could not be found. Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Request method failure captured: Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 HTTP/1.1 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl3WCXdEDynW1qOF785l2riPYhzmAhbmO3P148gCYvgQ-lX4xEoTbwwL2d-fI3Fs010hkjcV3gtHue7LPd42urKBy7cZGH7oAoDN7azaT7rENWThBIJ7uNFd2ZT4n2L5DB-ygN-3c2Yl1zhWsaLwlFmensN1wrOyVw8Hs8gMgsWXRPE Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 5bacaacf85ed472cb4719853652501f2 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesActionsTest-232912030 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5bacaacf85ed472cb4719853652501f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5bacaacf85ed472cb4719853652501f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5bacaacf85ed472cb4719853652501f2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5bacaacf85ed472cb4719853652501f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesActionsTest-232912030 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 5bacaacf85ed472cb4719853652501f2 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesActionsTest-232912030 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesActionsTest-232912030-project Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 939c5936f19a4590ad0996447c4774c8 Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesActionsTest-232912030-project Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e320be9b-4f69-435c-ad80-2e1da09b2af6 could not be found. Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e320be9b-4f69-435c-ad80-2e1da09b2af6'} Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e320be9b-4f69-435c-ad80-2e1da09b2af6 could not be found. Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e320be9b-4f69-435c-ad80-2e1da09b2af6 could not be found. Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:19.925904 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:19.931535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:19.931535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:19.931535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:19.931535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:31:19.931535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:31:19.931535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e320be9b-4f69-435c-ad80-2e1da09b2af6 could not be found. Oct 27 10:31:19.931535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:19.931535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Returning 404 to user: Instance e320be9b-4f69-435c-ad80-2e1da09b2af6 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:31:19.935093 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c80eca46-a200-47d7-9917-093e66afc03f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6" status: 404 len: 111 microversion: 2.1 time: 0.073725 Oct 27 10:31:19.935990 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2524/5241] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:19 2022] GET /compute/v2.1/servers/e320be9b-4f69-435c-ad80-2e1da09b2af6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:31:20.081562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1181407005", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "b5992b86-5ab6-4486-b25d-8f48266b9847"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:20.146540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] validate_networks() for [('b5992b86-5ab6-4486-b25d-8f48266b9847', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:31:20.898291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:20.898913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:20.917837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:20.918431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:20.918883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:20.919642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:20.920078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:20.933366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:21.115724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:31:21.116292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:31:21.116876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:31:21.117587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:31:21.117922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:31:21.140225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:21.143148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:21.144263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:21.147377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:21.151393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:21.152069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:21.204117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Getting quotas for project 5bacaacf85ed472cb4719853652501f2. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:31:21.216061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Getting quotas for user 939c5936f19a4590ad0996447c4774c8 and project 5bacaacf85ed472cb4719853652501f2. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:31:21.231242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:31:21.233767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:31:21.276767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:21.285665 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-756237e2-914d-4270-aa93-ea18d7690df9 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.391237 Oct 27 10:31:21.286505 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2525/5242] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:20 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:21.324793 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1fd4a8c-67ff-49d3-bae3-5749a2c1f0ec tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247065 Oct 27 10:31:21.325996 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2718/5243] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:31:21.338813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5907f953-50d9-4e93-9ded-9338358609ac tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:21.339707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5907f953-50d9-4e93-9ded-9338358609ac tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:21.370105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:21.451966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5907f953-50d9-4e93-9ded-9338358609ac tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:21.466450 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5907f953-50d9-4e93-9ded-9338358609ac tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1214 microversion: 2.1 time: 0.132040 Oct 27 10:31:21.471072 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2719/5244] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:21 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:21.657569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1210418822", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "d7775133-2ec0-4ec8-9c1f-e6ddb1bf0759"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:21.733817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] validate_networks() for [('d7775133-2ec0-4ec8-9c1f-e6ddb1bf0759', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:31:22.315802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:22.317295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:22.329550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:22.332623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:22.333111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:22.335003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:22.336978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:22.337727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:22.769856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:22.788328 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a89e2ed-b6b2-43e0-89d8-f01b9c2c1774 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.478227 Oct 27 10:31:22.806816 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2720/5245] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:22 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:22.821885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:22.822915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:22.829671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:22.830624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:22.831270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:22.832144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:22.833407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:22.834152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:22.935943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:22.946158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:31:22.946733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:31:22.947187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:31:22.947630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:31:22.948038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:31:22.963574 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a07a4205-b62a-413c-a783-a5221fbe296b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1266 microversion: 2.1 time: 0.155513 Oct 27 10:31:22.967311 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2721/5246] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:22 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:22.969017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:22.969625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:22.970067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:22.971115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:22.972039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:22.975162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:23.008810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:23.052314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Getting quotas for project ff58df5a2aa446ec9b5c70c56a818425. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:31:23.070749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Getting quotas for user 1f5139d46c7249a093d9827cb509d146 and project ff58df5a2aa446ec9b5c70c56a818425. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:31:23.132546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:31:23.137647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:31:23.282132 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-469b3b17-403b-4a1a-9e96-297f3be9cbe0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.980565 Oct 27 10:31:23.284188 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2526/5247] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:31:23.294421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7712b93-1eb7-48eb-85ef-5bfbfc328f0a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:23.295035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7712b93-1eb7-48eb-85ef-5bfbfc328f0a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:23.479459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c7712b93-1eb7-48eb-85ef-5bfbfc328f0a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:23.490183 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7712b93-1eb7-48eb-85ef-5bfbfc328f0a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1216 microversion: 2.1 time: 0.199588 Oct 27 10:31:23.490786 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2722/5248] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:23 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1216 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:23.814735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:23.815781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:23.830809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:23.833141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:23.834425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:23.836273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:23.837877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:23.839040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:23.990537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:23.991391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:24.009842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:24.011192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:24.012265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:24.014044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:24.015393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:24.016029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:24.248194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:24.258957 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46f3a920-b192-412b-8006-ac5ec82c892d tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1272 microversion: 2.1 time: 0.273261 Oct 27 10:31:24.300381 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2723/5249] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:23 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:24.518770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:24.520324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:24.542285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:24.543101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:24.545668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:24.546680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:24.550123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:24.550987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:25.249384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:25.268176 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eadac996-4394-4a93-acf1-5604ca5ffde0 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1212 microversion: 2.1 time: 0.754946 Oct 27 10:31:25.269602 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2724/5250] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:24 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1212 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:25.294594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:25.295225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:25.306637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:25.320819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:25.321629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:25.328444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:25.330007 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d5334b1a-30f6-4cd1-bac5-18f4398c6b1a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 1.518629 Oct 27 10:31:25.331039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:25.333948 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2527/5251] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:23 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:25.343159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:25.351265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:25.501203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:25.510961 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b441aedc-7e55-48d5-8b8f-1a80f291597f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1272 microversion: 2.1 time: 0.220699 Oct 27 10:31:25.513253 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2725/5252] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:25 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:26.296600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:26.297574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:26.311981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:26.321636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:26.322437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:26.323466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:26.333509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:26.334281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:26.357490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:26.358102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:26.374907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:26.394694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:26.397992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:26.398828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:26.399305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:26.399737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:26.687456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:26.699839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1a1287e6-f44d-48a9-9d72-04e5f3baccb3 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1274 microversion: 2.1 time: 0.407326 Oct 27 10:31:26.706560 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2528/5253] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:26 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1274 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:26.712194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1869340057", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "caf9c7a3-96f4-4a9a-9b36-4095b49119e4"}], "security_groups": [{"name": "tempest-securitygroup--1747288653"}], "key_name": "tempest-keypair-926289581", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:27.211629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:27.219661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] validate_networks() for [('caf9c7a3-96f4-4a9a-9b36-4095b49119e4', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:31:27.228307 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d0fbbf1-72db-4bfd-98c2-9127725adf13 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.874788 Oct 27 10:31:27.231858 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2726/5254] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:26 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:27.246278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:27.247178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:27.261404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:27.262526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:27.263210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:27.266116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:27.267012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:27.267778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:27.461266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:27.481516 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf573a7a-6b91-47fd-a149-800339923a38 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1272 microversion: 2.1 time: 0.248091 Oct 27 10:31:27.483120 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2727/5255] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:27 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:27.724334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:27.725326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:27.733200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:27.734028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:27.734878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:27.735708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:27.736115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:27.737078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:28.232194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:28.243998 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f23e2f2-239c-4a8e-b024-1f886343b565 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1316 microversion: 2.1 time: 0.523173 Oct 27 10:31:28.262279 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2728/5256] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:27 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:28.277227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:28.278073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:28.291693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:28.292264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:28.293696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:28.294476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:28.296494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:28.297054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:29.207510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:31:29.208053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:31:29.208487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:31:29.209147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:31:29.209808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:31:29.229117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:29.230033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:29.230697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:29.231671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:29.232967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:29.233738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:29.269790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Getting quotas for project 2ac83c84f1234dea80c2b074896559c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:31:29.277232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Getting quotas for user 742c83e928b64f588265112ea7f4c3c9 and project 2ac83c84f1234dea80c2b074896559c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:31:29.295563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:31:29.298427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:31:29.311943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:29.331944 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-84b14e3a-7cc4-4343-9305-afbc920aaad2 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 1.065866 Oct 27 10:31:29.348967 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2729/5257] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:28 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:29.355414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:29.356041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:29.363546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:29.364041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:29.364475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:29.365741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:29.366723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:29.367173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:29.448604 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-815ffdb0-d32c-41b7-8f81-82faa33ac270 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.740620 Oct 27 10:31:29.449655 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2529/5258] 10.222.0.76 () {62 vars in 1188 bytes} [Thu Oct 27 10:31:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 10:31:29.462397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-915febdc-7609-4433-880e-b7b19d72c6fa req-c0e9ee47-cfb6-4e44-8c89-3387f8aa3cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123f5768-b396-4574-aa8f-a980fcacd0df", "tag": "3b0ee953-a13d-41cb-83ec-4e5c38cbb003"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:29.480542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-915febdc-7609-4433-880e-b7b19d72c6fa req-c0e9ee47-cfb6-4e44-8c89-3387f8aa3cfc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:29.481333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-915febdc-7609-4433-880e-b7b19d72c6fa req-c0e9ee47-cfb6-4e44-8c89-3387f8aa3cfc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:29.481767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-915febdc-7609-4433-880e-b7b19d72c6fa req-c0e9ee47-cfb6-4e44-8c89-3387f8aa3cfc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:29.514826 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-915febdc-7609-4433-880e-b7b19d72c6fa req-c0e9ee47-cfb6-4e44-8c89-3387f8aa3cfc service nova] Creating event network-changed:3b0ee953-a13d-41cb-83ec-4e5c38cbb003 for instance 123f5768-b396-4574-aa8f-a980fcacd0df on n-h2-854663-10 Oct 27 10:31:29.521683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-915febdc-7609-4433-880e-b7b19d72c6fa req-c0e9ee47-cfb6-4e44-8c89-3387f8aa3cfc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063114 Oct 27 10:31:29.522704 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2530/5259] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:29.531388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:29.532306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:29.542461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:29.542987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:29.543594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:29.544589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:29.545140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:29.545565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:30.131113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:30.148434 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2741a9fa-b54b-4d49-b5f8-92dab2eadb36 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1314 microversion: 2.1 time: 0.805338 Oct 27 10:31:30.149796 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2730/5260] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:29 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:30.154815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be34f752-d4eb-4d34-ada6-d1119a809154 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:30.165686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be34f752-d4eb-4d34-ada6-d1119a809154 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:30.354859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:30.366075 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac684254-ff13-444f-a82c-468029830e74 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1316 microversion: 2.1 time: 0.841844 Oct 27 10:31:30.366683 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2531/5261] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:29 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1316 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:30.398899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be34f752-d4eb-4d34-ada6-d1119a809154 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:30.402404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:30.403654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:30.421458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:30.422204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:30.422857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:30.429395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:30.430250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:30.430858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:30.432835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be34f752-d4eb-4d34-ada6-d1119a809154 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:30.440692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be34f752-d4eb-4d34-ada6-d1119a809154 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:30.446584 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be34f752-d4eb-4d34-ada6-d1119a809154 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1281 microversion: 2.20 time: 0.294468 Oct 27 10:31:30.450036 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2731/5262] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:30 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1281 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:31.132072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:31.163202 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7533ab5-0a8c-4e76-9a64-fb5d78fc0b0c tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.774732 Oct 27 10:31:31.170103 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2532/5263] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:30 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:31.198508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:31.199479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:31.209296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:31.211442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:31.212242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:31.213084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:31.214160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:31.214991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:31.215629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:31.390688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:31.391841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:31.404412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:31.407180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:31.412368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:31.413429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:31.414049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:31.414654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:31.761078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:31.772464 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e92700ad-ad90-4252-b6b3-c70a4e64ffe7 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1314 microversion: 2.1 time: 0.604441 Oct 27 10:31:31.773429 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2732/5264] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:31 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:31.778626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:31.780115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:31.787688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:31.788711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:31.789294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:31.790225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:31.790673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:31.791089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:31.960177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:31.969846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:31.972001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:31.973448 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61fbb91f-9494-4813-81f7-06f085bfc8fc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1339 microversion: 2.20 time: 0.198919 Oct 27 10:31:31.982436 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2733/5265] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:31 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1339 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:32.015377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:32.025420 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e85eddea-307a-42c9-811e-0ae142d40f72 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1316 microversion: 2.1 time: 0.638980 Oct 27 10:31:32.028156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2533/5266] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:31 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:32.089609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-60e6d3f5-a196-4213-ad4d-ea6e8f927f3c req-e56729dd-11b5-418b-ab40-9a93fc7c13a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04130263-f7e6-4464-b5ff-01f166d477dd", "tag": "0f979296-829f-4747-bece-43c0571c2d0c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:32.113206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-60e6d3f5-a196-4213-ad4d-ea6e8f927f3c req-e56729dd-11b5-418b-ab40-9a93fc7c13a3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:32.113723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-60e6d3f5-a196-4213-ad4d-ea6e8f927f3c req-e56729dd-11b5-418b-ab40-9a93fc7c13a3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:32.114285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-60e6d3f5-a196-4213-ad4d-ea6e8f927f3c req-e56729dd-11b5-418b-ab40-9a93fc7c13a3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:32.192368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:32.195639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:32.207815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:32.209943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:32.211388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:32.216775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:32.218264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:32.221051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:32.519852 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-60e6d3f5-a196-4213-ad4d-ea6e8f927f3c req-e56729dd-11b5-418b-ab40-9a93fc7c13a3 service nova] Creating event network-changed:0f979296-829f-4747-bece-43c0571c2d0c for instance 04130263-f7e6-4464-b5ff-01f166d477dd on n-h1-854663-10 Oct 27 10:31:32.525028 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-60e6d3f5-a196-4213-ad4d-ea6e8f927f3c req-e56729dd-11b5-418b-ab40-9a93fc7c13a3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.441492 Oct 27 10:31:32.525644 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2734/5267] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:31:32.770945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:32.781331 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ad329d94-3221-49da-a368-e90376e48cb3 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.593302 Oct 27 10:31:32.782308 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2534/5268] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:32 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:32.796070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:32.796990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:32.804027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:32.804475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:32.805165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:32.805856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:32.806486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:32.806913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:32.999365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:32.999995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:33.016427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:33.016950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:33.017467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:33.018339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:33.018796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:33.019225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:33.625699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:33.646692 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-240f51b8-7440-4482-a2f9-69277da57c85 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1314 microversion: 2.1 time: 0.854823 Oct 27 10:31:33.648235 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2735/5269] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:32 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1314 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:33.655164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:33.656517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:33.662464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:33.670019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:33.671638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:33.673279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:33.673582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:33.676352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:33.677299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:33.678602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:33.679673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:33.693430 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67b8c54a-dba6-4c40-95cc-961e8af93f24 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1339 microversion: 2.20 time: 0.684639 Oct 27 10:31:33.694251 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2535/5270] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:32 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1339 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:31:33.810223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:33.811712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:33.865071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:33.867372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:33.869373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:33.872949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:33.875159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:33.875971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:34.270711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:34.298674 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31e4d405-71ad-41bc-902b-a09b583beae8 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1316 microversion: 2.1 time: 0.648996 Oct 27 10:31:34.309057 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2736/5271] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:33 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:34.458477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:34.472466 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d28ec552-9687-4cdc-a85c-ad8f5346b442 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.669317 Oct 27 10:31:34.476976 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2536/5272] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:33 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:34.675192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:34.676227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:34.691599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:34.695622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:34.697269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:34.699268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:34.702672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:34.703875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:34.933640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c79f34ce-3f67-4a00-9e5d-f0fadc986eca tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: .version_select at 0x7f6d59ea19d0>, body: {"keypair": {"name": "tempest-keypair-1763209385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBXNeF3E1cMrUTLdtoy4AWkwNPAqyncgMQpq9uGJH00JplsYQQ8xzDn2S+0s5jemtdgK8wbeH0ON1SSXJI33rm9C36TLsUSQnm8x5IKClfBcMvGikYPpPsap8n52LpJhw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:34.961846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c79f34ce-3f67-4a00-9e5d-f0fadc986eca tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for project 7e188614201142b089c88d6c819922df. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:31:34.977892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-c79f34ce-3f67-4a00-9e5d-f0fadc986eca tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for user 258cd38b77cb4f63950f937ec3bdb134 and project 7e188614201142b089c88d6c819922df. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:31:35.013633 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c79f34ce-3f67-4a00-9e5d-f0fadc986eca tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.351592 Oct 27 10:31:35.015021 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2737/5273] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:31:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:35.029448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:35.030648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:35.043225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:35.043952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:35.053952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:35.055187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:35.055847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:35.056463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:35.105067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:35.407143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:35.424281 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6f85361-b955-4670-bca9-475753b6c9d9 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1314 microversion: 2.1 time: 0.754185 Oct 27 10:31:35.442673 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2537/5274] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:34 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:35.450114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:35.451011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:35.459500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:35.460623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:35.461324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:35.462783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:35.463545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:35.464184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:35.827965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:35.842522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:35.844426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:35.848815 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bb8765e-b598-45f7-81fb-76df4186525d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1407 microversion: 2.20 time: 0.828498 Oct 27 10:31:35.849780 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2738/5275] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:35 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1407 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:35.878079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:35.879089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:35.896376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:35.900739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:35.901403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:35.910638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:35.911238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:35.911887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:36.032084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:36.048998 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-08be4697-e130-432b-9154-dc1c16c65c6b tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1316 microversion: 2.1 time: 0.602738 Oct 27 10:31:36.081108 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2538/5276] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:35 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:36.095350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-cb106556-c074-45ed-8cee-dc545fe73cf7 req-9060b72e-0be5-429b-9c99-9931ec66074c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123f5768-b396-4574-aa8f-a980fcacd0df", "name": "network-vif-plugged", "status": "completed", "tag": "3b0ee953-a13d-41cb-83ec-4e5c38cbb003"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:36.137589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cb106556-c074-45ed-8cee-dc545fe73cf7 req-9060b72e-0be5-429b-9c99-9931ec66074c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:36.138135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cb106556-c074-45ed-8cee-dc545fe73cf7 req-9060b72e-0be5-429b-9c99-9931ec66074c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:36.138578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cb106556-c074-45ed-8cee-dc545fe73cf7 req-9060b72e-0be5-429b-9c99-9931ec66074c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:36.159852 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-cb106556-c074-45ed-8cee-dc545fe73cf7 req-9060b72e-0be5-429b-9c99-9931ec66074c service nova] Creating event network-vif-plugged:3b0ee953-a13d-41cb-83ec-4e5c38cbb003 for instance 123f5768-b396-4574-aa8f-a980fcacd0df on n-h2-854663-10 Oct 27 10:31:36.172463 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-cb106556-c074-45ed-8cee-dc545fe73cf7 req-9060b72e-0be5-429b-9c99-9931ec66074c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086409 Oct 27 10:31:36.175305 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2539/5277] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:36.455469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:36.456301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:36.475486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:36.476296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:36.477710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:36.480871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:36.481545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:36.482789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:37.337789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:37.351855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7841296-70cb-491e-85ba-8eacb91c989f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 1.499391 Oct 27 10:31:37.352833 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2739/5278] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:35 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:37.363939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:37.364495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:37.375892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:37.376399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:37.382402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:37.383304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:37.383800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:37.384240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:37.600722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:37.614220 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8ff17e0-184d-47c4-aab8-23dfc29f7e81 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1314 microversion: 2.1 time: 1.164610 Oct 27 10:31:37.615640 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2540/5279] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:36 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1314 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:37.621204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:37.627499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:37.636096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:37.636950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:37.637586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:37.638692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:37.639309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:37.639896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:38.241348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:38.255762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:38.257257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:38.264096 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57407597-a6a3-4a1a-aad9-ef3e71996cde tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1407 microversion: 2.20 time: 0.909955 Oct 27 10:31:38.276797 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2740/5280] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:37 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1407 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:38.279818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e54db887-9ee5-494c-91b8-c25bea89ddb1 req-02d5e454-2013-4dc3-9ef9-7905717a8ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba912bf-5c13-4318-9f4b-e9af04d7e03b", "tag": "c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:38.314461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e54db887-9ee5-494c-91b8-c25bea89ddb1 req-02d5e454-2013-4dc3-9ef9-7905717a8ab2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:38.324399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e54db887-9ee5-494c-91b8-c25bea89ddb1 req-02d5e454-2013-4dc3-9ef9-7905717a8ab2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:38.325058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e54db887-9ee5-494c-91b8-c25bea89ddb1 req-02d5e454-2013-4dc3-9ef9-7905717a8ab2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:38.367191 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e54db887-9ee5-494c-91b8-c25bea89ddb1 req-02d5e454-2013-4dc3-9ef9-7905717a8ab2 service nova] Creating event network-changed:c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b for instance aba912bf-5c13-4318-9f4b-e9af04d7e03b on n-h1-854663-10 Oct 27 10:31:38.378876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e54db887-9ee5-494c-91b8-c25bea89ddb1 req-02d5e454-2013-4dc3-9ef9-7905717a8ab2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112541 Oct 27 10:31:38.379807 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2741/5281] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:38.403208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:38.414891 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b7d3123-14d0-4a69-936c-bf3acac2fdc2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1316 microversion: 2.1 time: 0.797674 Oct 27 10:31:38.415518 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2541/5282] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:37 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1316 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:38.422674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:38.428076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:38.446507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:38.448071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:38.448621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:38.451247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:38.453267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:38.453737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:38.483122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1230054569", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "f1622e18-28e1-4cdf-9a88-c085942b576d"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:38.489492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:38.594174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] validate_networks() for [('f1622e18-28e1-4cdf-9a88-c085942b576d', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:31:39.251512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:39.289602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=16 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:39.321216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:39.331320 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3948ec07-452e-40a7-aaca-7fb069853fe1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.913177 Oct 27 10:31:39.332379 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2542/5283] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:38 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:39.337636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:39.338435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:39.351106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:39.351944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:39.352618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:39.353369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:39.353823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:39.354551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:39.827018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:39.836320 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1aa212e4-5b77-4f60-a858-93a6d283a118 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1314 microversion: 2.1 time: 0.502609 Oct 27 10:31:39.855741 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2543/5284] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:39 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:39.864953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:39.867000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:39.878032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:39.878869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:39.879313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:39.880278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:39.880828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:39.881478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:40.281949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:31:40.283260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:31:40.283974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:31:40.284968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:31:40.285620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:31:40.299446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:40.300025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:40.300689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:40.301965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:40.302615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:40.303625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:40.323462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Getting quotas for project 25e6808a3d624cd4b3d4f43256fbdac2. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:31:40.329035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Getting quotas for user c2093b3baf494d979c09addfc5e42ad3 and project 25e6808a3d624cd4b3d4f43256fbdac2. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:31:40.342528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:31:40.345085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:31:40.372892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:40.385360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:40.387621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:40.390083 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-57a13ec7-a5e2-4407-a7f2-b34ddfd5abed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1407 microversion: 2.20 time: 0.532850 Oct 27 10:31:40.391168 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2544/5285] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:39 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:40.396933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-01527258-3344-4362-bacd-155dcc2ad0f3 req-b17634f6-ae41-406f-bcf5-9b9ac773b124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04130263-f7e6-4464-b5ff-01f166d477dd", "name": "network-vif-plugged", "status": "completed", "tag": "0f979296-829f-4747-bece-43c0571c2d0c"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:40.411604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-01527258-3344-4362-bacd-155dcc2ad0f3 req-b17634f6-ae41-406f-bcf5-9b9ac773b124 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:40.412927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-01527258-3344-4362-bacd-155dcc2ad0f3 req-b17634f6-ae41-406f-bcf5-9b9ac773b124 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:40.413634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-01527258-3344-4362-bacd-155dcc2ad0f3 req-b17634f6-ae41-406f-bcf5-9b9ac773b124 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:40.415697 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df49becb-8d23-4be8-8081-8ef35db78e02 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.030323 Oct 27 10:31:40.416758 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2742/5286] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:31:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:31:40.429513 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-01527258-3344-4362-bacd-155dcc2ad0f3 req-b17634f6-ae41-406f-bcf5-9b9ac773b124 service nova] Creating event network-vif-plugged:0f979296-829f-4747-bece-43c0571c2d0c for instance 04130263-f7e6-4464-b5ff-01f166d477dd on n-h1-854663-10 Oct 27 10:31:40.432869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:40.433524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:40.444758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:40.445295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:40.445893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:40.446841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:40.447614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:40.448048 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-01527258-3344-4362-bacd-155dcc2ad0f3 req-b17634f6-ae41-406f-bcf5-9b9ac773b124 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055255 Oct 27 10:31:40.448533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:40.449483 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2545/5287] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:40.459447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:40.460537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:40.472828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:40.473754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:40.476028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:40.476971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:40.477592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:40.478454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.014141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:41.023172 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a123c40e-d32f-4db5-8661-3f43034e6e64 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1504 microversion: 2.1 time: 0.605159 Oct 27 10:31:41.024275 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2743/5288] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:40 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1504 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:41.030518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:41.031303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:41.037943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.038726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.039430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.040359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.040793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.041375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.061106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:41.084849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-89d50f6b-cd3f-4ad8-ae7e-e49649730792 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.631972 Oct 27 10:31:41.085451 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2546/5289] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:40 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:41.111462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:41.112356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:41.121311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.122109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.122762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.123632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.124239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.124893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.192774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:41.204535 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad80673a-e042-4c7b-9360-de1f698b5dcf tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1221 microversion: 2.1 time: 0.178984 Oct 27 10:31:41.212740 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2744/5290] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:41 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:41.213774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a047aac-549d-4043-9264-4812f739d1c2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:41.214279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a047aac-549d-4043-9264-4812f739d1c2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:41.228458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a047aac-549d-4043-9264-4812f739d1c2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.228984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a047aac-549d-4043-9264-4812f739d1c2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.229420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a047aac-549d-4043-9264-4812f739d1c2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.230129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a047aac-549d-4043-9264-4812f739d1c2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.230576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a047aac-549d-4043-9264-4812f739d1c2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.230991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a047aac-549d-4043-9264-4812f739d1c2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.341352 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a047aac-549d-4043-9264-4812f739d1c2 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "DELETE /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.134336 Oct 27 10:31:41.344221 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2745/5291] 10.222.0.76 () {58 vars in 1296 bytes} [Thu Oct 27 10:31:41 2022] DELETE /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df/os-server-password => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:31:41.355213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bcadb81a-235c-4c5e-8a57-23cdc2021ea9 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:41.357457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bcadb81a-235c-4c5e-8a57-23cdc2021ea9 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:41.366272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcadb81a-235c-4c5e-8a57-23cdc2021ea9 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.367011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcadb81a-235c-4c5e-8a57-23cdc2021ea9 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.367655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcadb81a-235c-4c5e-8a57-23cdc2021ea9 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.368863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcadb81a-235c-4c5e-8a57-23cdc2021ea9 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.369684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcadb81a-235c-4c5e-8a57-23cdc2021ea9 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.370305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcadb81a-235c-4c5e-8a57-23cdc2021ea9 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.402677 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bcadb81a-235c-4c5e-8a57-23cdc2021ea9 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.053217 Oct 27 10:31:41.404203 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2746/5292] 10.222.0.76 () {58 vars in 1293 bytes} [Thu Oct 27 10:31:41 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df/os-server-password => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:31:41.421150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:41.422597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:41.430519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.431163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.431597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.432804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.434170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.434768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.469589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:31:41.573170 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70cfce9c-5ad4-416a-96f1-7d8b39c1952a tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "DELETE /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 204 len: 0 microversion: 2.1 time: 0.161020 Oct 27 10:31:41.573777 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2747/5293] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:31:41 2022] DELETE /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:31:41.581287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:41.581990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:41.588560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.589337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.589933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.590642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.591089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.591506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.955678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:41.975163 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b710214a-a060-446f-8dbd-3dbab4ef1f2b tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1314 microversion: 2.1 time: 0.871288 Oct 27 10:31:41.975750 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2547/5294] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:41 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:41.984903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:41.985746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:41.992633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.993500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.994085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:41.996531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:41.997174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:41.997761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:42.041161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:42.051158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:42.052701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:42.054574 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3280326-fb16-4254-9e15-822f5dbdbaaf tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1407 microversion: 2.20 time: 0.479426 Oct 27 10:31:42.055681 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2748/5295] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:41 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1407 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:42.111367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:42.112401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:42.120089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:42.120579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:42.121040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:42.121748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:42.122208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:42.122617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:42.373265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:42.383101 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1052dd06-1aec-445a-87b2-630972ad5c50 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1510 microversion: 2.1 time: 0.406042 Oct 27 10:31:42.385388 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2548/5296] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:41 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:42.400957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:42.402157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:42.413830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:42.415512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:42.416918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:42.419437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:42.422132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:42.425475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:42.426009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:42.431296 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5ac8b53-6438-4576-b115-6fba582a01bd tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.324652 Oct 27 10:31:42.432397 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2749/5297] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:42 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:42.459451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-224563276", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2b52e2f-b838-490c-bf1e-3da0faf47ab8"}], "security_groups": [{"name": "tempest-securitygroup--160045842"}], "key_name": "tempest-keypair-1763209385", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:42.536631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:42.549156 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bbbee0a1-0714-4385-aa79-5315c09eb8f2 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1277 microversion: 2.1 time: 0.159135 Oct 27 10:31:42.550817 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2549/5298] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:42 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:42.606670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] validate_networks() for [('a2b52e2f-b838-490c-bf1e-3da0faf47ab8', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:31:42.998239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:42.998847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:43.005484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:43.006260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:43.006952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:43.007829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:43.008272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:43.008880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:43.242249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:31:43.242667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:31:43.243139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:31:43.243551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:31:43.243957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:31:43.249098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:43.255117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:43.255597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:43.256029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:43.256769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:43.257216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:43.257633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:43.278083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for project 7e188614201142b089c88d6c819922df. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:31:43.284351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for user 258cd38b77cb4f63950f937ec3bdb134 and project 7e188614201142b089c88d6c819922df. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:31:43.290201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=27 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:43.291766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:43.300754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:31:43.302025 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-320245b5-41d0-4d13-a0b4-79e77dcc88a1 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1499 microversion: 2.1 time: 0.307458 Oct 27 10:31:43.303032 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2550/5299] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:42 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1499 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:43.304294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:31:43.322336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:43.340565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:43.351238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:43.351826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:43.352270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:43.353400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:43.353907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:43.354487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:43.364310 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ede7096e-30d3-468a-8428-2deb08ab8f41 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.930451 Oct 27 10:31:43.365353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2750/5300] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:31:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:31:43.377745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26c6a5fb-fd3c-414a-b76b-346a5db153f3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:43.380456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26c6a5fb-fd3c-414a-b76b-346a5db153f3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:43.586931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-26c6a5fb-fd3c-414a-b76b-346a5db153f3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:43.595888 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26c6a5fb-fd3c-414a-b76b-346a5db153f3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1241 microversion: 2.1 time: 0.222170 Oct 27 10:31:43.596455 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2751/5301] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:43 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1241 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:43.613425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:43.618572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:43.629919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:43.630649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:43.631243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:43.632125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:43.632803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:43.633479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.120133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:44.134369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:44.138499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:44.147793 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e67d3744-2fb1-4209-b320-7962422474b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1407 microversion: 2.20 time: 0.843495 Oct 27 10:31:44.148969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2551/5302] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:43 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1407 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:44.154207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:44.162920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:44.163384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:44.170443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:44.171111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:44.173928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.174794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:44.175370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:44.176759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.197325 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1cb7b4f-f33a-4799-9280-694ea264ca96 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1510 microversion: 2.1 time: 0.585947 Oct 27 10:31:44.210442 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2752/5303] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:43 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1510 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:44.230143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:44.230858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:44.253261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:44.253798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:44.254242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.255007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:44.256210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:44.256696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.559570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:44.569483 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6792c2c5-6749-4153-a4e0-bf9e0fb429d0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1275 microversion: 2.1 time: 0.357682 Oct 27 10:31:44.581904 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2753/5304] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:44 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1275 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:44.600554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5b18999e-e1a1-4e6a-a95b-7e2d6bc00db5 req-87413a19-e4cc-48ed-953e-3e4e1d3b8008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba912bf-5c13-4318-9f4b-e9af04d7e03b", "name": "network-vif-plugged", "status": "completed", "tag": "c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:44.615296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5b18999e-e1a1-4e6a-a95b-7e2d6bc00db5 req-87413a19-e4cc-48ed-953e-3e4e1d3b8008 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:44.616051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5b18999e-e1a1-4e6a-a95b-7e2d6bc00db5 req-87413a19-e4cc-48ed-953e-3e4e1d3b8008 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:44.616625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5b18999e-e1a1-4e6a-a95b-7e2d6bc00db5 req-87413a19-e4cc-48ed-953e-3e4e1d3b8008 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.634675 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5b18999e-e1a1-4e6a-a95b-7e2d6bc00db5 req-87413a19-e4cc-48ed-953e-3e4e1d3b8008 service nova] Creating event network-vif-plugged:c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b for instance aba912bf-5c13-4318-9f4b-e9af04d7e03b on n-h1-854663-10 Oct 27 10:31:44.645082 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5b18999e-e1a1-4e6a-a95b-7e2d6bc00db5 req-87413a19-e4cc-48ed-953e-3e4e1d3b8008 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054059 Oct 27 10:31:44.648889 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2754/5305] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:44.672565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:44.674124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:44.696364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:44.697088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:44.698474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.699569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:44.700175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:44.700819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.742141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:44.755005 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6ed6593-9586-4017-8c1b-8e4f04f1cab1 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.604669 Oct 27 10:31:44.756126 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2552/5306] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:44 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:44.760344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:31:44.767878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:44.769569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:44.770449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:44.790069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:44.793888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:44.794519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.795957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:44.796183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:44.797837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:44.982559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:44.985591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a9b2215-af04-43ce-929f-70716aa0a3ce tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "DELETE /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 204 len: 0 microversion: 2.1 time: 0.329921 Oct 27 10:31:44.986540 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2755/5307] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:31:44 2022] DELETE /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:31:44.998094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a8dfb57b-1106-40d3-ba7d-623f581cd792 req-71af684d-e41f-4a02-8ef1-50aa38562ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123f5768-b396-4574-aa8f-a980fcacd0df", "name": "network-vif-deleted", "tag": "3b0ee953-a13d-41cb-83ec-4e5c38cbb003"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:45.009134 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e00b834-b9fe-4419-8f57-ac52514265df tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1293 microversion: 2.1 time: 0.248334 Oct 27 10:31:45.009953 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2553/5308] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:44 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1293 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:45.019645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:45.020755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:45.029415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a8dfb57b-1106-40d3-ba7d-623f581cd792 req-71af684d-e41f-4a02-8ef1-50aa38562ad7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.033758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a8dfb57b-1106-40d3-ba7d-623f581cd792 req-71af684d-e41f-4a02-8ef1-50aa38562ad7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.034837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a8dfb57b-1106-40d3-ba7d-623f581cd792 req-71af684d-e41f-4a02-8ef1-50aa38562ad7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.043301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.045057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.045679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.046994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.054750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.055340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.062720 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a8dfb57b-1106-40d3-ba7d-623f581cd792 req-71af684d-e41f-4a02-8ef1-50aa38562ad7 service nova] Creating event network-vif-deleted:3b0ee953-a13d-41cb-83ec-4e5c38cbb003 for instance 123f5768-b396-4574-aa8f-a980fcacd0df on n-h2-854663-10 Oct 27 10:31:45.069906 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a8dfb57b-1106-40d3-ba7d-623f581cd792 req-71af684d-e41f-4a02-8ef1-50aa38562ad7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078582 Oct 27 10:31:45.083963 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2756/5309] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:45.183093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:45.184279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:45.193818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.194315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.195410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.196132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.196597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.197049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.228180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:45.237532 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e59830df-9691-47c1-a4e8-b2ffaf062c02 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1505 microversion: 2.1 time: 0.224289 Oct 27 10:31:45.238371 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2554/5310] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:45 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:45.244345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:45.245179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:45.252129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.252872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.255126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.257617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.258099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.261250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.301297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.301786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.303310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.304420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lazy-loading 'fault' on Instance uuid 123f5768-b396-4574-aa8f-a980fcacd0df {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:31:45.366779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5139d46c7249a093d9827cb509d146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff58df5a2aa446ec9b5c70c56a818425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:45.374781 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1628bffb-74de-4abc-bcee-a58b68e93314 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 200 len: 1306 microversion: 2.1 time: 0.135181 Oct 27 10:31:45.388885 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2555/5311] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:45 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 1306 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:45.405867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:45.422209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:45.424230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:45.426142 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa6620c1-6947-42f1-83a7-8af3970b2c8a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1407 microversion: 2.20 time: 0.250840 Oct 27 10:31:45.427180 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2757/5312] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:45 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:45.595727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:45.597142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:45.605474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.606425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.607322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.608318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.609647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.610341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.775313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:45.783281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:45.785979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:45.786530 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fae14686-647c-4cfa-b0c7-532e57740461 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.195332 Oct 27 10:31:45.793724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.794304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.794962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.795877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:45.796571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:45.797102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:45.807921 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2556/5313] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:45 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:45.972920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:45.982750 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e11be8d-1944-4065-a03d-6912b44e15aa tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.204474 Oct 27 10:31:45.983373 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2758/5314] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:45 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:46.038515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:46.039266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:46.046260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.046862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.047308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.048049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.048528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.048990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.123045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:46.132044 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d68eaa39-ced3-4ed5-91fe-dd597aa27241 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1293 microversion: 2.1 time: 0.097660 Oct 27 10:31:46.145044 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2557/5315] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:46 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:46.265973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:46.266804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:46.279173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.280908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.281572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.282947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.285386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.286013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.400706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:46.402074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] [instance: 123f5768-b396-4574-aa8f-a980fcacd0df] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:46.416705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.419378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.420039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.420972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.421590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.422206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.450980 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] HTTP exception thrown: Instance 123f5768-b396-4574-aa8f-a980fcacd0df could not be found. Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Request method failure captured: Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df HTTP/1.1 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl34TPOwdvFtoARgEAM8oCHkylgy0gBs3f3BCBM-43K6JauOMOw01VdyTxoYCOKdJvFs-zdd39a9asbHE8R4uLA98R2qAwsbqXWrzVsOS6Q06rvrACA9-pN75HYg3hAo7zhV3voqlJDk7N-2dg_2OwlQmp4yeB10AHNmiux81b6iGuc Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ff58df5a2aa446ec9b5c70c56a818425 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerPasswordTestJSON-2006622559 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ff58df5a2aa446ec9b5c70c56a818425"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ff58df5a2aa446ec9b5c70c56a818425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ff58df5a2aa446ec9b5c70c56a818425", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ff58df5a2aa446ec9b5c70c56a818425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerPasswordTestJSON-2006622559 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ff58df5a2aa446ec9b5c70c56a818425 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2006622559 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerPasswordTestJSON-2006622559-project Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 1f5139d46c7249a093d9827cb509d146 Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerPasswordTestJSON-2006622559-project Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 123f5768-b396-4574-aa8f-a980fcacd0df could not be found. Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '123f5768-b396-4574-aa8f-a980fcacd0df'} Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123f5768-b396-4574-aa8f-a980fcacd0df could not be found. Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123f5768-b396-4574-aa8f-a980fcacd0df could not be found. Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:46.454112 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:46.459195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:46.459195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:46.459195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:46.459195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:31:46.459195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:31:46.459195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123f5768-b396-4574-aa8f-a980fcacd0df could not be found. Oct 27 10:31:46.459195 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:46.460779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] Returning 404 to user: Instance 123f5768-b396-4574-aa8f-a980fcacd0df could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:31:46.461849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-40b7e2c4-dd5f-4fdf-8bf0-fb7ba316fbe1 tempest-ServerPasswordTestJSON-2006622559 tempest-ServerPasswordTestJSON-2006622559-project] 10.222.0.76 "GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df" status: 404 len: 111 microversion: 2.1 time: 0.065216 Oct 27 10:31:46.462996 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2558/5316] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:46 2022] GET /compute/v2.1/servers/123f5768-b396-4574-aa8f-a980fcacd0df => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:31:46.468512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:46.469923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:46.477351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.478075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.478679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.479554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.480167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.481072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.742430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:46.754153 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82e7b88d-bb40-4b78-b349-1c4e6dcc0f1f tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1505 microversion: 2.1 time: 0.491877 Oct 27 10:31:46.755677 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2759/5317] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:46 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:46.814250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:46.821114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:46.824040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:46.843868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:46.846810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.848715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.849834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:46.850567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.853032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:46.853791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:46.854614 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b126a84-6b37-488b-a338-6ed069bdccbc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1407 microversion: 2.20 time: 0.388692 Oct 27 10:31:46.855155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:46.855410 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2559/5318] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:46 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:47.007507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:47.008795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:47.019105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:47.019723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:47.020539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:47.021398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:47.021953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:47.022476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:47.029135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:47.310837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:47.319530 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74f2814e-ab6c-4948-bfcd-020901d588ec tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.513416 Oct 27 10:31:47.320691 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2760/5319] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:46 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:47.325434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4ff93b6f-5ac5-4bac-bae3-021aa54e90a4 req-b8a8ea2d-bce6-47e6-81ec-a620afdb7205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfaccad-e931-4582-93dc-11816616d3f1", "tag": "1a6c37f5-f619-4d1f-9195-30e57a414413"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:47.356240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4ff93b6f-5ac5-4bac-bae3-021aa54e90a4 req-b8a8ea2d-bce6-47e6-81ec-a620afdb7205 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:47.356750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4ff93b6f-5ac5-4bac-bae3-021aa54e90a4 req-b8a8ea2d-bce6-47e6-81ec-a620afdb7205 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:47.357189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4ff93b6f-5ac5-4bac-bae3-021aa54e90a4 req-b8a8ea2d-bce6-47e6-81ec-a620afdb7205 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:47.370128 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4ff93b6f-5ac5-4bac-bae3-021aa54e90a4 req-b8a8ea2d-bce6-47e6-81ec-a620afdb7205 service nova] Creating event network-changed:1a6c37f5-f619-4d1f-9195-30e57a414413 for instance 8cfaccad-e931-4582-93dc-11816616d3f1 on n-h2-854663-10 Oct 27 10:31:47.375398 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4ff93b6f-5ac5-4bac-bae3-021aa54e90a4 req-b8a8ea2d-bce6-47e6-81ec-a620afdb7205 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053371 Oct 27 10:31:47.377121 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2761/5320] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:47.383879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:47.384793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:47.392604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:47.393299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:47.393919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:47.404483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:47.406271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:47.406928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:47.561203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:47.568910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:47.573754 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3dfb4c5-9995-4e99-b06b-78364069f8ba tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.570441 Oct 27 10:31:47.577171 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2560/5321] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:47 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:47.579933 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-85fffaa0-b9d3-4532-a182-d20837e64eed tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1299 microversion: 2.1 time: 0.198496 Oct 27 10:31:47.580835 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2762/5322] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:47 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:47.781133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:47.782754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:47.792150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:47.793222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:47.793981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:47.795609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:47.796498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:47.797222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:47.883112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:47.884611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:47.892137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:47.893308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:47.893985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:47.894944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:47.895915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:47.896935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:48.575542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:48.588438 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bc3634d-b308-4ae4-b4bd-8fd3fd2e9313 tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1505 microversion: 2.1 time: 0.813764 Oct 27 10:31:48.590070 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2561/5323] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:47 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1505 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:48.597853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:48.598502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:48.600596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:48.606050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:48.606760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:48.607335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:48.608358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:48.612740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:48.621729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:48.622186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:48.622928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:48.629170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:48.630636 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59074da2-63d0-4787-a757-43547f303d64 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1598 microversion: 2.20 time: 0.753093 Oct 27 10:31:48.633900 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2763/5324] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:31:47 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1598 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:31:48.640281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:48.641129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:48.657639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:48.658156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:48.660683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:48.661453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:48.661919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:48.662350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:49.179160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:49.188352 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-85281cac-5774-426a-bb27-b134c2b57b07 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.553155 Oct 27 10:31:49.192085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:49.200278 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea438e20-4e85-429f-9d20-f297797cc5a3 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.608916 Oct 27 10:31:49.200532 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2764/5325] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:48 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:49.214742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:49.215557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:49.218981 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2562/5326] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:48 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:49.226337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:49.227034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:49.227174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b438edce-a9fb-417c-8ad7-fbf9d70c504e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:49.227681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b438edce-a9fb-417c-8ad7-fbf9d70c504e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:49.228055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:49.229237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:49.229892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:49.230470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:49.242619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b438edce-a9fb-417c-8ad7-fbf9d70c504e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:49.245195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b438edce-a9fb-417c-8ad7-fbf9d70c504e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:49.248988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b438edce-a9fb-417c-8ad7-fbf9d70c504e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:49.249926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b438edce-a9fb-417c-8ad7-fbf9d70c504e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:49.250552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b438edce-a9fb-417c-8ad7-fbf9d70c504e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:49.251216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b438edce-a9fb-417c-8ad7-fbf9d70c504e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:49.486983 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b438edce-a9fb-417c-8ad7-fbf9d70c504e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.266472 Oct 27 10:31:49.487607 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2563/5327] 10.222.0.76 () {60 vars in 1316 bytes} [Thu Oct 27 10:31:49 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/os-interface => generated 284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:31:49.492495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-d6956eb1-0f73-45fb-9432-548145919199 req-247a195e-e1ad-402b-937d-6c573b31a715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04130263-f7e6-4464-b5ff-01f166d477dd", "name": "network-vif-deleted", "tag": "0f979296-829f-4747-bece-43c0571c2d0c"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:49.517219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d6956eb1-0f73-45fb-9432-548145919199 req-247a195e-e1ad-402b-937d-6c573b31a715 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:49.517737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d6956eb1-0f73-45fb-9432-548145919199 req-247a195e-e1ad-402b-937d-6c573b31a715 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:49.518158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d6956eb1-0f73-45fb-9432-548145919199 req-247a195e-e1ad-402b-937d-6c573b31a715 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:49.539700 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-d6956eb1-0f73-45fb-9432-548145919199 req-247a195e-e1ad-402b-937d-6c573b31a715 service nova] Creating event network-vif-deleted:0f979296-829f-4747-bece-43c0571c2d0c for instance 04130263-f7e6-4464-b5ff-01f166d477dd on n-h1-854663-10 Oct 27 10:31:49.548304 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-d6956eb1-0f73-45fb-9432-548145919199 req-247a195e-e1ad-402b-937d-6c573b31a715 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059002 Oct 27 10:31:49.549961 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2564/5328] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:49.621322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:49.622356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:49.635687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:49.637090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:49.637693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:49.638580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:49.639190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:49.639823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:49.693178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:49.693931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:49.694520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:49.695167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lazy-loading 'fault' on Instance uuid 04130263-f7e6-4464-b5ff-01f166d477dd {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:31:49.716386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:49.729190 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05c55b79-f35a-46ca-8a6c-4dd106848075 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1366 microversion: 2.1 time: 0.527292 Oct 27 10:31:49.730513 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2765/5329] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:49 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:49.785802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c5936f19a4590ad0996447c4774c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bacaacf85ed472cb4719853652501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:49.799420 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc311d73-9bc9-49e1-8e06-286e5d02f3df tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 200 len: 1304 microversion: 2.1 time: 0.182196 Oct 27 10:31:49.800967 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2565/5330] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:49 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:50.218967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:50.222673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:50.229479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:50.230113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:50.237098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:50.237908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:50.238056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:50.238626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:50.238999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:50.239455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:50.240052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:50.240169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:50.240607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:50.241264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:50.241906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:50.243777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:50.543338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:50.553582 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9781594-ed89-4147-965f-d74b36b21f00 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.339568 Oct 27 10:31:50.554182 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2766/5331] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:50 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:50.643529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:50.663358 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec3579da-5b3d-46cc-8130-48badb514943 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.438286 Oct 27 10:31:50.666609 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2566/5332] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:50 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:50.752897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:50.754543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:50.767728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:50.768405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:50.768884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:50.769676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:50.770137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:50.770565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:50.823594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:50.824236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] [instance: 04130263-f7e6-4464-b5ff-01f166d477dd] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:50.831250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:50.831820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:50.832253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:50.833015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:50.833465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:50.833877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:50.850284 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] HTTP exception thrown: Instance 04130263-f7e6-4464-b5ff-01f166d477dd could not be found. Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Request method failure captured: Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd HTTP/1.1 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl3WCXdEDynW1qOF785l2riPYhzmAhbmO3P148gCYvgQ-lX4xEoTbwwL2d-fI3Fs010hkjcV3gtHue7LPd42urKBy7cZGH7oAoDN7azaT7rENWThBIJ7uNFd2ZT4n2L5DB-ygN-3c2Yl1zhWsaLwlFmensN1wrOyVw8Hs8gMgsWXRPE Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 5bacaacf85ed472cb4719853652501f2 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesActionsTest-232912030 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5bacaacf85ed472cb4719853652501f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5bacaacf85ed472cb4719853652501f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5bacaacf85ed472cb4719853652501f2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5bacaacf85ed472cb4719853652501f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesActionsTest-232912030 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 5bacaacf85ed472cb4719853652501f2 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesActionsTest-232912030 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesActionsTest-232912030-project Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 939c5936f19a4590ad0996447c4774c8 Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesActionsTest-232912030-project Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 04130263-f7e6-4464-b5ff-01f166d477dd could not be found. Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '04130263-f7e6-4464-b5ff-01f166d477dd'} Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04130263-f7e6-4464-b5ff-01f166d477dd could not be found. Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04130263-f7e6-4464-b5ff-01f166d477dd could not be found. Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:50.852328 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04130263-f7e6-4464-b5ff-01f166d477dd could not be found. Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] Returning 404 to user: Instance 04130263-f7e6-4464-b5ff-01f166d477dd could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa186487-23fe-4844-93e2-dc99cb076ede tempest-VolumesActionsTest-232912030 tempest-VolumesActionsTest-232912030-project] 10.222.0.76 "GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd" status: 404 len: 111 microversion: 2.1 time: 0.034238 Oct 27 10:31:50.862504 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2567/5333] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:50 2022] GET /compute/v2.1/servers/04130263-f7e6-4464-b5ff-01f166d477dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:31:51.054689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:51.064214 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46ea7899-0df8-401f-b19a-2325e0d1fbe9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1366 microversion: 2.1 time: 0.316237 Oct 27 10:31:51.069509 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2767/5334] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:50 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:51.576745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:51.577717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:51.597304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:51.598045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:51.598505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:51.599509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:51.600139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:51.605329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:51.688123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:51.689831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:51.707040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:51.707535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:51.712251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:51.718488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:51.721606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:51.722123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:52.111870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:52.117561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:52.139540 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a70f0fa8-5e12-4323-b2c4-aaa24f1e2673 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.455877 Oct 27 10:31:52.159815 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a56a2d37-57d3-46d0-b004-6c0c755c2c31 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1486 microversion: 2.1 time: 0.567018 Oct 27 10:31:52.159815 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2568/5335] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:51 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1486 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:52.162596 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2768/5336] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:51 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:52.167627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0005f67b-8b5f-48d3-8145-8cf0aa29ed83 req-3ca5816b-c336-4a3b-90ee-50983fe1dba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba912bf-5c13-4318-9f4b-e9af04d7e03b", "tag": "c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:52.197904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0005f67b-8b5f-48d3-8145-8cf0aa29ed83 req-3ca5816b-c336-4a3b-90ee-50983fe1dba3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:52.198725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0005f67b-8b5f-48d3-8145-8cf0aa29ed83 req-3ca5816b-c336-4a3b-90ee-50983fe1dba3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:52.199973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0005f67b-8b5f-48d3-8145-8cf0aa29ed83 req-3ca5816b-c336-4a3b-90ee-50983fe1dba3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:52.203946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:52.205605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:52.215814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:52.217638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:52.218234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:52.219136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:52.219747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:52.220427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:52.235890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0005f67b-8b5f-48d3-8145-8cf0aa29ed83 req-3ca5816b-c336-4a3b-90ee-50983fe1dba3 service nova] Creating event network-changed:c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b for instance aba912bf-5c13-4318-9f4b-e9af04d7e03b on n-h1-854663-10 Oct 27 10:31:52.251568 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0005f67b-8b5f-48d3-8145-8cf0aa29ed83 req-3ca5816b-c336-4a3b-90ee-50983fe1dba3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104157 Oct 27 10:31:52.252616 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2569/5337] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:52.274734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09f26b65-006f-473e-8a08-f3a45961ebbe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:52.276427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-09f26b65-006f-473e-8a08-f3a45961ebbe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:52.286226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f26b65-006f-473e-8a08-f3a45961ebbe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:52.286905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f26b65-006f-473e-8a08-f3a45961ebbe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:52.287560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f26b65-006f-473e-8a08-f3a45961ebbe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:52.288520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f26b65-006f-473e-8a08-f3a45961ebbe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:52.289252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f26b65-006f-473e-8a08-f3a45961ebbe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:52.289691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f26b65-006f-473e-8a08-f3a45961ebbe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:52.460431 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-09f26b65-006f-473e-8a08-f3a45961ebbe tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "POST /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118/action" status: 202 len: 0 microversion: 2.1 time: 0.204661 Oct 27 10:31:52.462373 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2570/5338] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:31:52 2022] POST /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:31:52.515683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-467b7505-77dc-49e3-b04e-1fe3ccddacf5 req-320d3199-fba7-496d-a7ce-d48360097c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6", "tag": "c9a469c2-6c4c-46e2-b410-6a754bd0f6cb"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:52.535192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-467b7505-77dc-49e3-b04e-1fe3ccddacf5 req-320d3199-fba7-496d-a7ce-d48360097c70 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:52.535675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-467b7505-77dc-49e3-b04e-1fe3ccddacf5 req-320d3199-fba7-496d-a7ce-d48360097c70 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:52.536153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-467b7505-77dc-49e3-b04e-1fe3ccddacf5 req-320d3199-fba7-496d-a7ce-d48360097c70 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:52.556753 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-467b7505-77dc-49e3-b04e-1fe3ccddacf5 req-320d3199-fba7-496d-a7ce-d48360097c70 service nova] Creating event network-changed:c9a469c2-6c4c-46e2-b410-6a754bd0f6cb for instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 on n-h1-854663-10 Oct 27 10:31:52.566429 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-467b7505-77dc-49e3-b04e-1fe3ccddacf5 req-320d3199-fba7-496d-a7ce-d48360097c70 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099934 Oct 27 10:31:52.567641 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2571/5339] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:52.578396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:52.579562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:52.590625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:52.591420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:52.592177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:52.593269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:52.593928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:52.594638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:53.014605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:53.036416 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f57bf06d-09b9-4fe0-b1ea-7ca209edacb6 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1494 microversion: 2.1 time: 0.462392 Oct 27 10:31:53.037340 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2572/5340] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:52 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1494 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:53.197858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:53.198660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:53.208360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:53.213186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:53.213929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:53.214954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:53.215954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:53.217228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:53.267580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:53.439248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:53.461187 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48a21c60-dbc2-482a-b174-1456d7a2a4b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1366 microversion: 2.1 time: 1.296086 Oct 27 10:31:53.462659 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2769/5341] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:52 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1366 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:53.851673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:53.867116 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-48026c62-9157-4f8a-968e-e612ad48f438 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.672811 Oct 27 10:31:53.870354 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2573/5342] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:53 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:54.068816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:54.069691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:54.081753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:54.092645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:54.093475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:54.094240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:54.098166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:54.099944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:54.100990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:54.488441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:54.490181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:54.509394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:54.514955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:54.515809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:54.516635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:54.517233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:54.521123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:54.612080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:54.627602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-561f6aaa-3941-4a6b-b6b1-d3f04643a82a tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1494 microversion: 2.1 time: 0.567823 Oct 27 10:31:54.629440 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2770/5343] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:54 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1494 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:54.891566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:54.892742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:54.906918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:54.909361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:54.912845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:54.914854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:54.920105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:54.921508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:54.925571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:54.939609 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d5f5a4b-9e90-4c46-bb00-b352126425bf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1366 microversion: 2.1 time: 0.453604 Oct 27 10:31:54.940258 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2574/5344] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:54 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:55.533964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:55.547480 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c9ee725-5ba0-478d-a296-67189da4601e tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.661307 Oct 27 10:31:55.550003 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2771/5345] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:54 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:55.658993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:55.659684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:55.676473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:55.677007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:55.677457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:55.678532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:55.678985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:55.694937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:55.697307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-eb7e9beb-c991-4b29-a3a9-5228127874a9 req-c87b9579-d27a-4ed9-a86b-54862ee89dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cfaccad-e931-4582-93dc-11816616d3f1", "name": "network-vif-plugged", "status": "completed", "tag": "1a6c37f5-f619-4d1f-9195-30e57a414413"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:55.722182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eb7e9beb-c991-4b29-a3a9-5228127874a9 req-c87b9579-d27a-4ed9-a86b-54862ee89dbb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:55.724047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eb7e9beb-c991-4b29-a3a9-5228127874a9 req-c87b9579-d27a-4ed9-a86b-54862ee89dbb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:55.724685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eb7e9beb-c991-4b29-a3a9-5228127874a9 req-c87b9579-d27a-4ed9-a86b-54862ee89dbb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:55.738440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:55.754458 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-eb7e9beb-c991-4b29-a3a9-5228127874a9 req-c87b9579-d27a-4ed9-a86b-54862ee89dbb service nova] Creating event network-vif-plugged:1a6c37f5-f619-4d1f-9195-30e57a414413 for instance 8cfaccad-e931-4582-93dc-11816616d3f1 on n-h2-854663-10 Oct 27 10:31:55.782939 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-eb7e9beb-c991-4b29-a3a9-5228127874a9 req-c87b9579-d27a-4ed9-a86b-54862ee89dbb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086347 Oct 27 10:31:55.789005 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2772/5346] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:31:55.968274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:55.969339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:55.990282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:56.011671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:56.012556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:56.017103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:56.025858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:56.026884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:56.134281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:56.149777 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-675a1103-be14-4f52-941c-8146d62b13a7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1500 microversion: 2.1 time: 0.497822 Oct 27 10:31:56.165408 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2575/5347] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:55 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1500 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:56.193732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:56.194634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:56.208547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:56.209471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:56.210150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:56.212007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:56.212755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:56.213461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:56.279755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:31:56.433489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:56.507630 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3e0293ef-24f8-46d9-8827-8a7e05027a5b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "DELETE /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 204 len: 0 microversion: 2.1 time: 0.315561 Oct 27 10:31:56.511423 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2576/5348] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:31:56 2022] DELETE /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:31:56.538276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:56.539191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:56.550058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:56.553499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:56.554147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:56.555320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:56.556269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:56.556454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:56.772551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:56.787568 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87eb1ea0-6992-49b9-b7ba-a6e831b52e20 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1366 microversion: 2.1 time: 0.823986 Oct 27 10:31:56.796019 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2773/5349] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:55 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1366 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:31:56.803393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:56.806523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:56.821895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:56.827911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:56.828595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:56.830004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:56.830624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:56.831203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:57.367484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:57.380416 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-922895e7-f906-45af-a201-29c4fa3ff094 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.859099 Oct 27 10:31:57.381364 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2577/5350] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:56 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:57.533348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:57.549982 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e286e98c-c441-4629-a8fe-3de6d9913838 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.750010 Oct 27 10:31:57.552352 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2774/5351] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:56 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:57.811693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:57.812584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:57.820481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:57.821121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:57.821757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:57.822627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:57.823236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:57.823828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:58.407562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:58.426101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:58.457679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:58.465192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:58.469269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:58.470444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:58.471297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:58.471978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:58.533739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:58.550172 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3533b902-b74b-4c8f-b3bc-03593c8bff03 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1366 microversion: 2.1 time: 0.742333 Oct 27 10:31:58.565471 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2578/5352] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:57 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1366 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:58.578714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:58.589767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:58.616829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:58.617799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:58.618418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:58.619320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:58.620126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:58.628135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:58.844932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:58.872338 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53a950bd-d2cc-40bc-8b0b-6221ddaa0761 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.465840 Oct 27 10:31:58.886864 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2775/5353] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:58 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:58.898666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:58.909541 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab236181-0bf6-4b2c-a2c4-d16bd111281b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.337101 Oct 27 10:31:58.911488 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2579/5354] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:58 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:59.578716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:59.579362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:59.589508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:59.592439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:59.593388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:59.594735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:59.595676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:59.596326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:59.746119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e68449e1-9267-4969-9582-4f937566444d req-bcd46740-3a49-432f-9135-966c44ddc0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6", "name": "network-vif-plugged", "status": "completed", "tag": "c9a469c2-6c4c-46e2-b410-6a754bd0f6cb"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:59.768569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e68449e1-9267-4969-9582-4f937566444d req-bcd46740-3a49-432f-9135-966c44ddc0d7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:59.769103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e68449e1-9267-4969-9582-4f937566444d req-bcd46740-3a49-432f-9135-966c44ddc0d7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:59.769582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e68449e1-9267-4969-9582-4f937566444d req-bcd46740-3a49-432f-9135-966c44ddc0d7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:59.833221 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e68449e1-9267-4969-9582-4f937566444d req-bcd46740-3a49-432f-9135-966c44ddc0d7 service nova] Creating event network-vif-plugged:c9a469c2-6c4c-46e2-b410-6a754bd0f6cb for instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 on n-h1-854663-10 Oct 27 10:31:59.855395 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e68449e1-9267-4969-9582-4f937566444d req-bcd46740-3a49-432f-9135-966c44ddc0d7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113391 Oct 27 10:31:59.863650 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2580/5355] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:31:59.904345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:59.907856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:59.935456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:59.939548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:59.942711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:59.944608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:59.946905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:59.949571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:59.959998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:59.981447 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac5dce40-1ea7-44ee-9b6a-54ec9f0563dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1366 microversion: 2.1 time: 0.407070 Oct 27 10:32:00.002815 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2776/5356] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:59 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:00.019737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:00.022234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:00.092022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:00.092534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:00.093006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:00.101030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:00.101966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:00.103112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:00.574365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:00.598433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:00.599740 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1506 microversion: 2.1 time: 0.702056 Oct 27 10:32:00.600361 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2581/5357] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:59 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1506 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:00.622481 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1317 microversion: 2.1 time: 0.614071 Oct 27 10:32:00.627694 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2777/5358] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:00 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:00.944999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:00.944999 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002673 Oct 27 10:32:00.944999 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2582/5359] 10.222.0.76 () {56 vars in 886 bytes} [Thu Oct 27 10:32:00 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 10:32:00.952251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:00.953840 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002147 Oct 27 10:32:00.955876 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2778/5360] 10.222.0.76 () {54 vars in 1035 bytes} [Thu Oct 27 10:32:00 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 27 10:32:00.968595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:00.971404 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d419c1ef-0a03-42e4-8743-c274835b16a0 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003772 Oct 27 10:32:00.973783 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2583/5361] 10.222.0.76 () {54 vars in 1041 bytes} [Thu Oct 27 10:32:00 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:00.983233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:00.984323 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58a7c922-723e-4c8a-baf3-9cb9c35f3633 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002571 Oct 27 10:32:00.984702 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2779/5362] 10.222.0.76 () {56 vars in 886 bytes} [Thu Oct 27 10:32:00 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 10:32:01.008701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:01.009995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:01.031792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:01.033592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:01.034996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:01.037978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:01.038485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:01.038931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:01.225265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-67712c81-98a4-47f7-b7e2-67d9392fae1a req-a003c2b4-4a0d-417a-8720-690a571e3dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a3bceb-d9c8-4318-891a-dd9eb199f118", "name": "network-vif-deleted", "tag": "ba6aac24-71ac-4ba8-bcea-b6b188187ad7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:01.239399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-67712c81-98a4-47f7-b7e2-67d9392fae1a req-a003c2b4-4a0d-417a-8720-690a571e3dee service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:01.240425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-67712c81-98a4-47f7-b7e2-67d9392fae1a req-a003c2b4-4a0d-417a-8720-690a571e3dee service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:01.241782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-67712c81-98a4-47f7-b7e2-67d9392fae1a req-a003c2b4-4a0d-417a-8720-690a571e3dee service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:01.263878 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-67712c81-98a4-47f7-b7e2-67d9392fae1a req-a003c2b4-4a0d-417a-8720-690a571e3dee service nova] Creating event network-vif-deleted:ba6aac24-71ac-4ba8-bcea-b6b188187ad7 for instance 29a3bceb-d9c8-4318-891a-dd9eb199f118 on n-h2-854663-10 Oct 27 10:32:01.270970 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-67712c81-98a4-47f7-b7e2-67d9392fae1a req-a003c2b4-4a0d-417a-8720-690a571e3dee service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050693 Oct 27 10:32:01.278429 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2780/5363] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:01.489308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:01.499639 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-954741ea-7058-4552-a6d8-3f16ab9c7fa1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1366 microversion: 2.1 time: 0.494979 Oct 27 10:32:01.501146 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2584/5364] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:01 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:01.623506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:01.625342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:01.635931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:01.637030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:01.637992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:01.638880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:01.639499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:01.640090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:01.651974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:01.653127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:01.688572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:01.691294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:01.693286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:01.696222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:01.697862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:01.700388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:01.702966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:01.704721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:01.705561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:01.707342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lazy-loading 'fault' on Instance uuid 29a3bceb-d9c8-4318-891a-dd9eb199f118 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:32:01.812654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:01.824135 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3fcbfeb9-be65-42c0-a353-2c0ba2133f45 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 200 len: 1304 microversion: 2.1 time: 0.203205 Oct 27 10:32:01.828703 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2781/5365] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:01 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 1304 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:01.998701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:02.009078 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8caa67a1-b497-4b31-bc5c-bcf117997a2b tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1506 microversion: 2.1 time: 0.365313 Oct 27 10:32:02.014625 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2585/5366] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:01 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:32:02.040156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32e9bc9d-03ab-4edd-a9ea-91c1c5e27fd0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:02.041063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32e9bc9d-03ab-4edd-a9ea-91c1c5e27fd0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:02.048355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e9bc9d-03ab-4edd-a9ea-91c1c5e27fd0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.048955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e9bc9d-03ab-4edd-a9ea-91c1c5e27fd0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.049614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e9bc9d-03ab-4edd-a9ea-91c1c5e27fd0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.050601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e9bc9d-03ab-4edd-a9ea-91c1c5e27fd0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.051416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e9bc9d-03ab-4edd-a9ea-91c1c5e27fd0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.052038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e9bc9d-03ab-4edd-a9ea-91c1c5e27fd0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.104129 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32e9bc9d-03ab-4edd-a9ea-91c1c5e27fd0 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1/ips" status: 200 len: 109 microversion: 2.1 time: 0.067794 Oct 27 10:32:02.115465 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2782/5367] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:32:02 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1/ips => generated 109 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:02.123879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80ca9fee-2f38-4d13-bafd-f96e81a19988 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:02.124590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80ca9fee-2f38-4d13-bafd-f96e81a19988 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:02.140775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ca9fee-2f38-4d13-bafd-f96e81a19988 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.142094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ca9fee-2f38-4d13-bafd-f96e81a19988 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.142548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ca9fee-2f38-4d13-bafd-f96e81a19988 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.143664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ca9fee-2f38-4d13-bafd-f96e81a19988 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.144158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ca9fee-2f38-4d13-bafd-f96e81a19988 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.144770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80ca9fee-2f38-4d13-bafd-f96e81a19988 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.192313 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80ca9fee-2f38-4d13-bafd-f96e81a19988 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1/ips" status: 200 len: 109 microversion: 2.1 time: 0.075371 Oct 27 10:32:02.193361 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2586/5368] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:32:02 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1/ips => generated 109 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:32:02.205866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9e0d949-1b2a-4db2-bc13-8e57372c050c tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:02.206357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9e0d949-1b2a-4db2-bc13-8e57372c050c tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:02.220824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e0d949-1b2a-4db2-bc13-8e57372c050c tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.221247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e0d949-1b2a-4db2-bc13-8e57372c050c tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.221874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e0d949-1b2a-4db2-bc13-8e57372c050c tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.222611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e0d949-1b2a-4db2-bc13-8e57372c050c tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.226924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e0d949-1b2a-4db2-bc13-8e57372c050c tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.227409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9e0d949-1b2a-4db2-bc13-8e57372c050c tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.286261 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9e0d949-1b2a-4db2-bc13-8e57372c050c tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1/ips/tempest-ServerAddressesTestJSON-1397132475-network" status: 200 len: 94 microversion: 2.1 time: 0.084350 Oct 27 10:32:02.287196 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2783/5369] 10.222.0.76 () {58 vars in 1401 bytes} [Thu Oct 27 10:32:02 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1/ips/tempest-ServerAddressesTestJSON-1397132475-network => generated 94 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:32:02.301964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:02.308060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:02.326489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.327908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.328623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.330704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.331762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.332647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.372939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:32:02.506960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee0188b4-680b-40e9-a6b6-80eb0ce7bc3f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 204 len: 0 microversion: 2.1 time: 0.209406 Oct 27 10:32:02.508221 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2587/5370] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:32:02 2022] DELETE /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:32:02.517795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:02.518501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:02.531209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.532078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.532922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.533920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.536557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.537676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:02.538233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.540791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:02.556598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.558142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.571470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:02.573598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:02.575833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:02.576961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:03.010477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:03.042049 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de1df625-920a-4148-b542-ee28a1ffe668 tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1512 microversion: 2.1 time: 0.528988 Oct 27 10:32:03.045142 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2784/5371] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:02 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1512 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:03.063580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:03.065452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 29a3bceb-d9c8-4318-891a-dd9eb199f118] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:03.081234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:03.082993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:03.083863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:03.085663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:03.087439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:03.091431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:03.120285 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] HTTP exception thrown: Instance 29a3bceb-d9c8-4318-891a-dd9eb199f118 could not be found. Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Request method failure captured: Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 HTTP/1.1 Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl2YRDIpXYErzH-0i9ZvXcwEFHIlecgMPq1HtVVmB4VGdWDNTHmi6TBC9iViu73fUEZE7vaYk3l0X9HwdPyovRXThEr22BjMjFcULe2d_-5wJwyYhXFDCMYxQ5GtO-0ggqV1VyJ0h9lP3IRPG1QFjRJ4lvgluwySTC4Q9ThJvlhMstw Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a76b3a0a8c7443edb88dcacd70e551ee Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueTestJSON-678060073 Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a76b3a0a8c7443edb88dcacd70e551ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a76b3a0a8c7443edb88dcacd70e551ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a76b3a0a8c7443edb88dcacd70e551ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a76b3a0a8c7443edb88dcacd70e551ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueTestJSON-678060073 Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a76b3a0a8c7443edb88dcacd70e551ee Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueTestJSON-678060073 Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerRescueTestJSON-678060073-project Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: acdcf812d2a543ee823947d22febb739 Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueTestJSON-678060073-project Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 29a3bceb-d9c8-4318-891a-dd9eb199f118 could not be found. Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '29a3bceb-d9c8-4318-891a-dd9eb199f118'} Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a3bceb-d9c8-4318-891a-dd9eb199f118 could not be found. Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a3bceb-d9c8-4318-891a-dd9eb199f118 could not be found. Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:32:03.122678 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a3bceb-d9c8-4318-891a-dd9eb199f118 could not be found. Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Returning 404 to user: Instance 29a3bceb-d9c8-4318-891a-dd9eb199f118 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3057ad0f-f9ed-4ebd-a59a-d42e78035502 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118" status: 404 len: 111 microversion: 2.1 time: 0.078801 Oct 27 10:32:03.127165 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2785/5372] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:03 2022] GET /compute/v2.1/servers/29a3bceb-d9c8-4318-891a-dd9eb199f118 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:32:03.148784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:03.149374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:03.156889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:03.157546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:03.158178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:03.159177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:03.159804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:03.160304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:03.240439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:32:03.273452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:03.288069 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-790a6be6-8c8d-4ab5-887b-ca23c0cb220b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1555 microversion: 2.1 time: 0.762908 Oct 27 10:32:03.290788 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2588/5373] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:02 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1555 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:03.321446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3232e315-9e28-4f6c-bd13-778c2c8bb548 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:03.323669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3232e315-9e28-4f6c-bd13-778c2c8bb548 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:03.335008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3232e315-9e28-4f6c-bd13-778c2c8bb548 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:03.337540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3232e315-9e28-4f6c-bd13-778c2c8bb548 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:03.339675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3232e315-9e28-4f6c-bd13-778c2c8bb548 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:03.344310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3232e315-9e28-4f6c-bd13-778c2c8bb548 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:03.347694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3232e315-9e28-4f6c-bd13-778c2c8bb548 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:03.348231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3232e315-9e28-4f6c-bd13-778c2c8bb548 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:03.492171 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-788dea91-e029-47e4-ab93-a0e1b39100b7 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "DELETE /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 204 len: 0 microversion: 2.1 time: 0.355406 Oct 27 10:32:03.497414 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2786/5374] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:32:03 2022] DELETE /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:32:03.502406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:03.503214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:03.509676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:03.510269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:03.510796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:03.511788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:03.512452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:03.512905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:03.626319 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3232e315-9e28-4f6c-bd13-778c2c8bb548 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.313739 Oct 27 10:32:03.635032 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2589/5375] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:32:03 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-interface => generated 284 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:32:03.807927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:03.820811 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4812c5cd-44e4-4675-bf9a-7353263f5d0b tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1492 microversion: 2.1 time: 0.322709 Oct 27 10:32:03.836140 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2787/5376] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:03 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1492 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:04.076293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:04.076976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:04.090828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:04.091839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:04.092502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:04.098398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:04.099602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:04.102360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:04.503993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:04.519011 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-61afcc81-bab2-4dc1-a4a5-3e252e56d9ae tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1512 microversion: 2.1 time: 0.445390 Oct 27 10:32:04.520895 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2590/5377] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:04 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1512 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:04.805975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:04.806507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:04.808698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:04.818651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:04.819154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:04.825504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:04.826393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:04.826927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:04.827359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:04.847866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:04.848951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:04.862806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:04.863588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:04.864189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:04.865123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:04.869735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:04.869735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:04.895356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:32:05.098508 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-245cfbed-96ab-43f8-8854-1600664d7646 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 204 len: 0 microversion: 2.42 time: 0.654629 Oct 27 10:32:05.100641 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2788/5378] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:32:04 2022] DELETE /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:32:05.109861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:05.111180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:05.130830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:05.131661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:05.132113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:05.133323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:05.133798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:05.134229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:05.322150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:05.346059 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86e19c1c-ada5-4122-95bf-5de3db34ce3f tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1492 microversion: 2.1 time: 0.502110 Oct 27 10:32:05.348649 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2591/5379] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:04 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1492 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:05.550509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:05.552419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:05.570827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:05.572286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:05.576349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:05.577904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:05.578646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:05.579681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:05.598820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:05.617553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:05.640783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:05.645462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:05.651581 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02348f3b-862f-468f-b037-6bd314562db4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2961 microversion: 2.42 time: 0.546266 Oct 27 10:32:05.664685 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2789/5380] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:05 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2961 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:05.896089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:05.911969 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-06d0e391-d34e-40e8-a279-9be1e919587f tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1512 microversion: 2.1 time: 0.373137 Oct 27 10:32:05.932955 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2592/5381] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:05 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:06.375328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:06.377090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:06.385752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:06.386647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:06.387307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:06.388602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:06.389298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:06.389942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:06.489659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-403f308e-2f89-473c-bade-a11454f7726b req-4256ab0b-a8f7-444f-b5af-af15491eced7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cfaccad-e931-4582-93dc-11816616d3f1", "name": "network-vif-deleted", "tag": "1a6c37f5-f619-4d1f-9195-30e57a414413"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:06.521876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-403f308e-2f89-473c-bade-a11454f7726b req-4256ab0b-a8f7-444f-b5af-af15491eced7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:06.522636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-403f308e-2f89-473c-bade-a11454f7726b req-4256ab0b-a8f7-444f-b5af-af15491eced7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:06.523315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-403f308e-2f89-473c-bade-a11454f7726b req-4256ab0b-a8f7-444f-b5af-af15491eced7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:06.544405 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-403f308e-2f89-473c-bade-a11454f7726b req-4256ab0b-a8f7-444f-b5af-af15491eced7 service nova] Creating event network-vif-deleted:1a6c37f5-f619-4d1f-9195-30e57a414413 for instance 8cfaccad-e931-4582-93dc-11816616d3f1 on n-h2-854663-10 Oct 27 10:32:06.570528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-403f308e-2f89-473c-bade-a11454f7726b req-4256ab0b-a8f7-444f-b5af-af15491eced7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091274 Oct 27 10:32:06.574418 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2593/5382] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:06.683240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:06.694431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:06.696498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:06.706463 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fde1a89d-9520-4b56-8b20-9041b1593464 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1492 microversion: 2.1 time: 0.338682 Oct 27 10:32:06.722100 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2790/5383] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:06 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1492 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:06.723020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:06.723794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:06.724435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:06.725699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:06.726349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:06.726988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:06.943334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:06.944067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:06.959729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:06.960233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:06.960767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:06.961432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:06.961893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:06.962324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:07.052014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:07.052962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:07.053678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:07.054992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lazy-loading 'fault' on Instance uuid 8cfaccad-e931-4582-93dc-11816616d3f1 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:32:07.145057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:07.160372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:07.161864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:07.163180 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ce0526a-f287-4104-b921-8fe16c6549f8 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2961 microversion: 2.42 time: 0.476311 Oct 27 10:32:07.163764 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2594/5384] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:06 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2961 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:32:07.250402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2093b3baf494d979c09addfc5e42ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e6808a3d624cd4b3d4f43256fbdac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:07.259617 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-88b8cf61-c6c8-446b-b468-d57ad6b47ebc tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 200 len: 1307 microversion: 2.1 time: 0.320892 Oct 27 10:32:07.265866 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2791/5385] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:06 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 1307 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:07.735882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:07.737861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:07.754225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:07.769228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:07.770107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:07.772545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:07.773820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:07.774533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:08.208927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:08.213603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:08.227408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:08.230814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:08.232104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:08.233922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:08.235877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:08.236396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:08.237591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:08.241240 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-238767f5-12a4-4045-a9de-62e584e460c4 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1492 microversion: 2.1 time: 0.512131 Oct 27 10:32:08.243053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:08.249782 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2595/5386] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:07 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1492 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:08.289360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:08.290305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] [instance: 8cfaccad-e931-4582-93dc-11816616d3f1] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:08.308219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:08.309004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:08.310224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:08.310377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:08.310715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:08.311152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:08.347588 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] HTTP exception thrown: Instance 8cfaccad-e931-4582-93dc-11816616d3f1 could not be found. Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Request method failure captured: Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 HTTP/1.1 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl4Jnn_m51it4cyt04wlMja3CNOpjKPVlQC6Aybv0uwJKWOff16yciwlrI1WwU11Geart03Ww2iBZNixaIQ_q_YDELh_E_WAtx4qUiPcrBoDhf3gq9zBk-kMXRqYU6LzkrBQlEjEjMj1E8q93CYCl5jICKQp_Y6EuIm3dOFYM5NQ2tQ Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 25e6808a3d624cd4b3d4f43256fbdac2 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerAddressesTestJSON-920312913 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25e6808a3d624cd4b3d4f43256fbdac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/25e6808a3d624cd4b3d4f43256fbdac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_25e6808a3d624cd4b3d4f43256fbdac2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/25e6808a3d624cd4b3d4f43256fbdac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerAddressesTestJSON-920312913 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 25e6808a3d624cd4b3d4f43256fbdac2 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerAddressesTestJSON-920312913 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerAddressesTestJSON-920312913-project Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: c2093b3baf494d979c09addfc5e42ad3 Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerAddressesTestJSON-920312913-project Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 8cfaccad-e931-4582-93dc-11816616d3f1 could not be found. Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '8cfaccad-e931-4582-93dc-11816616d3f1'} Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cfaccad-e931-4582-93dc-11816616d3f1 could not be found. Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cfaccad-e931-4582-93dc-11816616d3f1 could not be found. Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:32:08.349610 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:32:08.354208 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:32:08.354208 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:32:08.354208 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:32:08.354208 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:32:08.354208 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:32:08.354208 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cfaccad-e931-4582-93dc-11816616d3f1 could not be found. Oct 27 10:32:08.354208 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:32:08.355451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] Returning 404 to user: Instance 8cfaccad-e931-4582-93dc-11816616d3f1 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:32:08.356485 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3b1b24ad-8396-4331-93bb-41f55897c4ee tempest-ServerAddressesTestJSON-920312913 tempest-ServerAddressesTestJSON-920312913-project] 10.222.0.76 "GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1" status: 404 len: 111 microversion: 2.1 time: 0.072731 Oct 27 10:32:08.358262 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2596/5387] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:08 2022] GET /compute/v2.1/servers/8cfaccad-e931-4582-93dc-11816616d3f1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:32:08.635975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3140dd3e-22ae-4cd5-bda3-65f17b956a95 req-2b97c75b-30c7-4dfb-840b-f38e4a216d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6", "tag": "c9a469c2-6c4c-46e2-b410-6a754bd0f6cb"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:08.650313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3140dd3e-22ae-4cd5-bda3-65f17b956a95 req-2b97c75b-30c7-4dfb-840b-f38e4a216d5a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:08.661160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3140dd3e-22ae-4cd5-bda3-65f17b956a95 req-2b97c75b-30c7-4dfb-840b-f38e4a216d5a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:08.661779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3140dd3e-22ae-4cd5-bda3-65f17b956a95 req-2b97c75b-30c7-4dfb-840b-f38e4a216d5a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:08.677431 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3140dd3e-22ae-4cd5-bda3-65f17b956a95 req-2b97c75b-30c7-4dfb-840b-f38e4a216d5a service nova] Creating event network-changed:c9a469c2-6c4c-46e2-b410-6a754bd0f6cb for instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 on n-h1-854663-10 Oct 27 10:32:08.691810 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3140dd3e-22ae-4cd5-bda3-65f17b956a95 req-2b97c75b-30c7-4dfb-840b-f38e4a216d5a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059719 Oct 27 10:32:08.704322 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2597/5388] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:32:08.784004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:08.843259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:08.850449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:08.855762 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0eb12a82-33b6-4e1a-b8fa-30cc557c2757 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2961 microversion: 2.42 time: 0.659389 Oct 27 10:32:08.872698 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2792/5389] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:08 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2961 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:32:09.275432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:09.276124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:09.293163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:09.293928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:09.301449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:09.303037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:09.304826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:09.305471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:09.838794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:09.853449 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50144718-61c7-4476-a3b5-8088d9edcfe5 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1492 microversion: 2.1 time: 0.580901 Oct 27 10:32:09.856615 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2598/5390] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:09 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1492 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:09.898115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:09.899408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:09.920009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:09.921042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:09.922050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:09.924384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:09.925260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:09.925956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:10.882389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:10.883208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:10.898842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:10.899746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:10.901310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:10.902528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:10.906895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:10.911206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:11.193927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:11.211174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:11.233732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:11.240303 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-abdb19fc-77ab-4a0e-9615-ee165ba346ff tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2961 microversion: 2.42 time: 1.347961 Oct 27 10:32:11.246083 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2793/5391] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:09 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2961 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:11.682485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:11.698888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f02c10a-fd52-4744-903f-5e740bee9c84 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1492 microversion: 2.1 time: 0.818334 Oct 27 10:32:11.714261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2599/5392] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:10 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1492 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:32:12.278933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:12.279564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:12.300492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:12.301883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:12.303843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:12.306306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:12.307320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:12.309126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:12.695789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-280dd134-601f-4fe2-bc2f-4441a71f9f8a req-f94ff72b-95ce-4855-bc5b-6f72d72fd224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e3b9d4-a1a4-4e40-83d2-bed8f2596202", "name": "network-vif-deleted", "tag": "e72e84c9-c0a2-443b-ba78-e488172ffcd4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:12.732582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-280dd134-601f-4fe2-bc2f-4441a71f9f8a req-f94ff72b-95ce-4855-bc5b-6f72d72fd224 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:12.742173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-280dd134-601f-4fe2-bc2f-4441a71f9f8a req-f94ff72b-95ce-4855-bc5b-6f72d72fd224 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:12.748052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-280dd134-601f-4fe2-bc2f-4441a71f9f8a req-f94ff72b-95ce-4855-bc5b-6f72d72fd224 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:12.812764 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-280dd134-601f-4fe2-bc2f-4441a71f9f8a req-f94ff72b-95ce-4855-bc5b-6f72d72fd224 service nova] Creating event network-vif-deleted:e72e84c9-c0a2-443b-ba78-e488172ffcd4 for instance 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 on n-h1-854663-10 Oct 27 10:32:12.837092 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-280dd134-601f-4fe2-bc2f-4441a71f9f8a req-f94ff72b-95ce-4855-bc5b-6f72d72fd224 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145747 Oct 27 10:32:12.850436 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2600/5393] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:12.873955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:12.877575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:12.883512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:12.898485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:12.900587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:12.901330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:12.905366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:12.906786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:12.909763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:12.910446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:12.910816 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd60a589-f9ae-4ae1-95b0-d11235e93372 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2961 microversion: 2.42 time: 0.634682 Oct 27 10:32:12.911812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:12.912978 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2794/5394] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:12 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2961 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:13.010753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:13.011671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:13.013928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:13.014687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lazy-loading 'fault' on Instance uuid 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:32:13.178377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdcf812d2a543ee823947d22febb739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76b3a0a8c7443edb88dcacd70e551ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:13.200443 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1a51281e-459c-4ba5-a6d4-0b188781bf32 tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 200 len: 1304 microversion: 2.1 time: 0.348313 Oct 27 10:32:13.205013 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2601/5395] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:12 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 1304 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:13.613469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0333afd5-cf65-4468-8eb1-a68e7ab92d75 req-adb8ab45-4361-467a-87ce-e7a2d4f330dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-unplugged", "status": "completed", "tag": "0286aa77-bd3b-489b-9904-21ccf8dc4f03"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:13.644207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0333afd5-cf65-4468-8eb1-a68e7ab92d75 req-adb8ab45-4361-467a-87ce-e7a2d4f330dd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:13.645695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0333afd5-cf65-4468-8eb1-a68e7ab92d75 req-adb8ab45-4361-467a-87ce-e7a2d4f330dd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:13.649474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0333afd5-cf65-4468-8eb1-a68e7ab92d75 req-adb8ab45-4361-467a-87ce-e7a2d4f330dd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:13.682692 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0333afd5-cf65-4468-8eb1-a68e7ab92d75 req-adb8ab45-4361-467a-87ce-e7a2d4f330dd service nova] Creating event network-vif-unplugged:0286aa77-bd3b-489b-9904-21ccf8dc4f03 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:13.701647 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0333afd5-cf65-4468-8eb1-a68e7ab92d75 req-adb8ab45-4361-467a-87ce-e7a2d4f330dd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093866 Oct 27 10:32:13.706268 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2795/5396] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:13.956423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:13.957770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:13.974171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:13.975170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:13.979058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:13.980942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:13.981685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:13.982320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:14.231667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:14.232434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] [instance: 60e3b9d4-a1a4-4e40-83d2-bed8f2596202] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:14.244726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:14.245380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:14.245832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:14.249265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:14.249745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:14.250189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:14.288110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] HTTP exception thrown: Instance 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 could not be found. Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Request method failure captured: Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 HTTP/1.1 Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl2YRDIpXYErzH-0i9ZvXcwEFHIlecgMPq1HtVVmB4VGdWDNTHmi6TBC9iViu73fUEZE7vaYk3l0X9HwdPyovRXThEr22BjMjFcULe2d_-5wJwyYhXFDCMYxQ5GtO-0ggqV1VyJ0h9lP3IRPG1QFjRJ4lvgluwySTC4Q9ThJvlhMstw Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: a76b3a0a8c7443edb88dcacd70e551ee Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueTestJSON-678060073 Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a76b3a0a8c7443edb88dcacd70e551ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a76b3a0a8c7443edb88dcacd70e551ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a76b3a0a8c7443edb88dcacd70e551ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a76b3a0a8c7443edb88dcacd70e551ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueTestJSON-678060073 Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: a76b3a0a8c7443edb88dcacd70e551ee Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueTestJSON-678060073 Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerRescueTestJSON-678060073-project Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: acdcf812d2a543ee823947d22febb739 Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueTestJSON-678060073-project Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 could not be found. Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '60e3b9d4-a1a4-4e40-83d2-bed8f2596202'} Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 could not be found. Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 could not be found. Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:32:14.302298 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:14.307041 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:32:14.307041 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:32:14.307041 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:32:14.307041 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:32:14.307041 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:32:14.307041 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 could not be found. Oct 27 10:32:14.307041 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:32:14.309527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] Returning 404 to user: Instance 60e3b9d4-a1a4-4e40-83d2-bed8f2596202 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:32:14.313195 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-becea103-dff0-4824-9bf6-109bef75e8de tempest-ServerRescueTestJSON-678060073 tempest-ServerRescueTestJSON-678060073-project] 10.222.0.76 "GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202" status: 404 len: 111 microversion: 2.1 time: 0.084418 Oct 27 10:32:14.314492 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2796/5397] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:14 2022] GET /compute/v2.1/servers/60e3b9d4-a1a4-4e40-83d2-bed8f2596202 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:32:14.435428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:14.454061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:14.455853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:14.463407 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f74ca339-7bb7-4562-a1d3-9d52002488f9 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2940 microversion: 2.42 time: 0.510295 Oct 27 10:32:14.485813 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2602/5398] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:13 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2940 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:15.494137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:15.495138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:15.511591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:15.520689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:15.524949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:15.527668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:15.530741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:15.531673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:15.768816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e812c0b9-0daa-415c-8c4f-86c5b9642b65 req-5d4f422d-28ac-48cb-aca8-08120decd22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-unplugged", "status": "completed", "tag": "ae4d4470-a4f9-491d-b4cb-91c4398b832b"}, {"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-unplugged", "status": "completed", "tag": "2489d5fc-eae3-43ec-b706-bb225acfc6a5"}, {"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-unplugged", "status": "completed", "tag": "782e6f7a-0715-4c1e-b24d-1ac485672640"}, {"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-unplugged", "status": "completed", "tag": "5f638a13-8e41-4eb0-9395-0e98a33d43bd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:15.792564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e812c0b9-0daa-415c-8c4f-86c5b9642b65 req-5d4f422d-28ac-48cb-aca8-08120decd22d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:15.793344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e812c0b9-0daa-415c-8c4f-86c5b9642b65 req-5d4f422d-28ac-48cb-aca8-08120decd22d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:15.793955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e812c0b9-0daa-415c-8c4f-86c5b9642b65 req-5d4f422d-28ac-48cb-aca8-08120decd22d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:15.819719 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e812c0b9-0daa-415c-8c4f-86c5b9642b65 req-5d4f422d-28ac-48cb-aca8-08120decd22d service nova] Creating event network-vif-unplugged:ae4d4470-a4f9-491d-b4cb-91c4398b832b for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:15.820477 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e812c0b9-0daa-415c-8c4f-86c5b9642b65 req-5d4f422d-28ac-48cb-aca8-08120decd22d service nova] Creating event network-vif-unplugged:2489d5fc-eae3-43ec-b706-bb225acfc6a5 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:15.821210 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e812c0b9-0daa-415c-8c4f-86c5b9642b65 req-5d4f422d-28ac-48cb-aca8-08120decd22d service nova] Creating event network-vif-unplugged:782e6f7a-0715-4c1e-b24d-1ac485672640 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:15.821926 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e812c0b9-0daa-415c-8c4f-86c5b9642b65 req-5d4f422d-28ac-48cb-aca8-08120decd22d service nova] Creating event network-vif-unplugged:5f638a13-8e41-4eb0-9395-0e98a33d43bd for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:15.829571 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e812c0b9-0daa-415c-8c4f-86c5b9642b65 req-5d4f422d-28ac-48cb-aca8-08120decd22d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.064468 Oct 27 10:32:15.830927 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2603/5399] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:32:16.522730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:16.541929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:16.544820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:16.550417 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4d21aced-6fa3-4481-855e-b83fabf1c508 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2940 microversion: 2.42 time: 1.061227 Oct 27 10:32:16.553479 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2797/5400] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:15 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2940 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:17.587595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:17.588248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:17.610911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:17.611519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:17.611972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:17.616752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:17.617248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:17.617696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:18.086029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ab1d0469-7dc5-4ae1-aef7-e8ac0ae7a671 req-482ef5fd-c0d8-45ca-b026-aa6e04753e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b8708b4-e00c-4c04-aea0-e5d41c4d43c1"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:18.121104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ab1d0469-7dc5-4ae1-aef7-e8ac0ae7a671 req-482ef5fd-c0d8-45ca-b026-aa6e04753e6d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:18.122780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ab1d0469-7dc5-4ae1-aef7-e8ac0ae7a671 req-482ef5fd-c0d8-45ca-b026-aa6e04753e6d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:18.123225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ab1d0469-7dc5-4ae1-aef7-e8ac0ae7a671 req-482ef5fd-c0d8-45ca-b026-aa6e04753e6d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:18.159629 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ab1d0469-7dc5-4ae1-aef7-e8ac0ae7a671 req-482ef5fd-c0d8-45ca-b026-aa6e04753e6d service nova] Creating event network-vif-unplugged:4b8708b4-e00c-4c04-aea0-e5d41c4d43c1 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:18.174342 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ab1d0469-7dc5-4ae1-aef7-e8ac0ae7a671 req-482ef5fd-c0d8-45ca-b026-aa6e04753e6d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092693 Oct 27 10:32:18.178877 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2798/5401] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:32:18.779251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:18.802054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:18.804607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:18.821229 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b401c721-25a6-4bfc-9424-cdaa38a6e869 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2919 microversion: 2.42 time: 1.239485 Oct 27 10:32:18.825222 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2604/5402] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:17 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2919 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:19.856304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:19.858177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:19.873799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:19.874653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:19.876290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:19.879238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:19.893539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:19.894524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:20.216968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-fafe8cbb-8bab-4c20-98b4-062a5bd96c51 req-c26d3278-4523-4351-a99f-52b554f543bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-deleted", "tag": "2489d5fc-eae3-43ec-b706-bb225acfc6a5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:20.239941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:20.263912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fafe8cbb-8bab-4c20-98b4-062a5bd96c51 req-c26d3278-4523-4351-a99f-52b554f543bd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:20.266452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fafe8cbb-8bab-4c20-98b4-062a5bd96c51 req-c26d3278-4523-4351-a99f-52b554f543bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:20.270298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fafe8cbb-8bab-4c20-98b4-062a5bd96c51 req-c26d3278-4523-4351-a99f-52b554f543bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:20.303339 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-fafe8cbb-8bab-4c20-98b4-062a5bd96c51 req-c26d3278-4523-4351-a99f-52b554f543bd service nova] Creating event network-vif-deleted:2489d5fc-eae3-43ec-b706-bb225acfc6a5 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:20.320417 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-fafe8cbb-8bab-4c20-98b4-062a5bd96c51 req-c26d3278-4523-4351-a99f-52b554f543bd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107771 Oct 27 10:32:20.321637 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2605/5403] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:32:20.870316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:20.886468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:20.887911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:20.893499 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-329ba939-e266-4432-99ea-a4a4bf4feedc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2872 microversion: 2.42 time: 1.041487 Oct 27 10:32:20.898449 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2799/5404] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:19 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2872 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:21.931173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:21.932018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:21.955083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:21.956444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:21.957675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:21.958862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:21.959563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:21.961767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:22.734017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:22.757869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:22.763277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:22.767878 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21a4177b-996e-4045-bd45-6a0e7fd156bc tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2535 microversion: 2.42 time: 0.842295 Oct 27 10:32:22.773069 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2606/5405] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:21 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2535 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:22.846812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-08f6d221-490c-42ee-8fac-c90660b0c0c3 req-a717a643-fac8-4d18-8d76-21fb3acac43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-deleted", "tag": "5f638a13-8e41-4eb0-9395-0e98a33d43bd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:22.880597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-08f6d221-490c-42ee-8fac-c90660b0c0c3 req-a717a643-fac8-4d18-8d76-21fb3acac43c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:22.883106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-08f6d221-490c-42ee-8fac-c90660b0c0c3 req-a717a643-fac8-4d18-8d76-21fb3acac43c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:22.886063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-08f6d221-490c-42ee-8fac-c90660b0c0c3 req-a717a643-fac8-4d18-8d76-21fb3acac43c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:22.923708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-08f6d221-490c-42ee-8fac-c90660b0c0c3 req-a717a643-fac8-4d18-8d76-21fb3acac43c service nova] Creating event network-vif-deleted:5f638a13-8e41-4eb0-9395-0e98a33d43bd for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:22.941605 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-08f6d221-490c-42ee-8fac-c90660b0c0c3 req-a717a643-fac8-4d18-8d76-21fb3acac43c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106172 Oct 27 10:32:22.943602 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2800/5406] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:23.803364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:23.804531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:23.843062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:23.846911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:23.847381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:23.855579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:23.856084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:23.857298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:24.694360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5eda5ef-3c45-45d6-a5be-299627a1cef2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:24.695011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5eda5ef-3c45-45d6-a5be-299627a1cef2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:24.733804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5eda5ef-3c45-45d6-a5be-299627a1cef2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:24.744447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5eda5ef-3c45-45d6-a5be-299627a1cef2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:24.744948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5eda5ef-3c45-45d6-a5be-299627a1cef2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:24.745720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5eda5ef-3c45-45d6-a5be-299627a1cef2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:24.753191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5eda5ef-3c45-45d6-a5be-299627a1cef2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:24.757349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5eda5ef-3c45-45d6-a5be-299627a1cef2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:24.814711 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5eda5ef-3c45-45d6-a5be-299627a1cef2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/ips" status: 200 len: 151 microversion: 2.20 time: 0.124671 Oct 27 10:32:24.817384 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2801/5407] 10.222.0.76 () {60 vars in 1289 bytes} [Thu Oct 27 10:32:24 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/ips => generated 151 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:32:25.038799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ec79e336-d8c9-4e71-8b81-56a4dfb64933 req-8354f2b2-6aa7-4ae0-9c71-4bfc3e3f58aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-deleted", "tag": "782e6f7a-0715-4c1e-b24d-1ac485672640"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:25.078655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ec79e336-d8c9-4e71-8b81-56a4dfb64933 req-8354f2b2-6aa7-4ae0-9c71-4bfc3e3f58aa service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:25.082528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ec79e336-d8c9-4e71-8b81-56a4dfb64933 req-8354f2b2-6aa7-4ae0-9c71-4bfc3e3f58aa service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:25.083512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ec79e336-d8c9-4e71-8b81-56a4dfb64933 req-8354f2b2-6aa7-4ae0-9c71-4bfc3e3f58aa service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:25.137740 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ec79e336-d8c9-4e71-8b81-56a4dfb64933 req-8354f2b2-6aa7-4ae0-9c71-4bfc3e3f58aa service nova] Creating event network-vif-deleted:782e6f7a-0715-4c1e-b24d-1ac485672640 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:25.157109 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ec79e336-d8c9-4e71-8b81-56a4dfb64933 req-8354f2b2-6aa7-4ae0-9c71-4bfc3e3f58aa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121175 Oct 27 10:32:25.188442 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2802/5408] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:32:26.505341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:26.520122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:26.527788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:26.531018 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1308713d-7acf-4f0c-919b-d79f5f7718ee tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 2327 microversion: 2.42 time: 2.732326 Oct 27 10:32:26.537523 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2607/5409] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:23 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 2327 bytes in 2738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:27.256245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-258d2137-1856-48f4-9953-1b80a3d32956 req-e8bd0daa-a4a2-4862-9a9c-592e26a9c6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-deleted", "tag": "0286aa77-bd3b-489b-9904-21ccf8dc4f03"}, {"server_uuid": "5360435a-e659-40f3-ba47-38f2fb650eb5", "name": "network-vif-deleted", "tag": "4b8708b4-e00c-4c04-aea0-e5d41c4d43c1"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:27.287060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-258d2137-1856-48f4-9953-1b80a3d32956 req-e8bd0daa-a4a2-4862-9a9c-592e26a9c6a0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:27.288485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-258d2137-1856-48f4-9953-1b80a3d32956 req-e8bd0daa-a4a2-4862-9a9c-592e26a9c6a0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:27.291895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-258d2137-1856-48f4-9953-1b80a3d32956 req-e8bd0daa-a4a2-4862-9a9c-592e26a9c6a0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:27.329708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-258d2137-1856-48f4-9953-1b80a3d32956 req-e8bd0daa-a4a2-4862-9a9c-592e26a9c6a0 service nova] Creating event network-vif-deleted:0286aa77-bd3b-489b-9904-21ccf8dc4f03 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:27.330169 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-258d2137-1856-48f4-9953-1b80a3d32956 req-e8bd0daa-a4a2-4862-9a9c-592e26a9c6a0 service nova] Creating event network-vif-deleted:4b8708b4-e00c-4c04-aea0-e5d41c4d43c1 for instance 5360435a-e659-40f3-ba47-38f2fb650eb5 on n-h1-854663-10 Oct 27 10:32:27.350255 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-258d2137-1856-48f4-9953-1b80a3d32956 req-e8bd0daa-a4a2-4862-9a9c-592e26a9c6a0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098700 Oct 27 10:32:27.351381 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2803/5410] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:27.576446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:27.583483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:27.619800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:27.620302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:27.621248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:27.623055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:27.628251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:27.631099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:27.979264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:28.006136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:28.007594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:28.012753 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f3ba806b-fb00-4bff-9abc-858accab149d tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.446737 Oct 27 10:32:28.013585 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2608/5411] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:27 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:29.041971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:29.042683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:29.070426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:29.070938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:29.071386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:29.085756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:29.086260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:29.086702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:29.296553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c805a34-54a5-446b-8512-5e88b79c8824 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'create', calling method: .version_select at 0x7f6d5a9004c0>, body: {"keypair": {"name": "tempest-keypair-1160778429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvW8WAVtXNac1fdwcU0SWnsXbkERATeSwwmszQN5Qkbz9pnonubsLyGlX5hcDDbbDx48GWNaFfkJb1iG+O7o+MJVAE6sKQSjtRl15N1CMSX8ldpvDVkNrtoEiPraDcyWg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:29.347184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8c805a34-54a5-446b-8512-5e88b79c8824 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Getting quotas for project 177f03c2fe044ba39efb1861ed6dc4ee. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:32:29.354654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8c805a34-54a5-446b-8512-5e88b79c8824 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Getting quotas for user 809eac4d896042d39a2277386e511c3d and project 177f03c2fe044ba39efb1861ed6dc4ee. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:32:29.406744 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c805a34-54a5-446b-8512-5e88b79c8824 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.377627 Oct 27 10:32:29.407854 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2804/5412] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:32:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:29.420222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:29.455169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:29.456743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:29.458201 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60b16c73-f6cb-4cc3-bb44-06ddea161d81 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.421301 Oct 27 10:32:29.459297 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2609/5413] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:29 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:32:29.486308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:29.487380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:29.498312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:29.500011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:29.500011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:29.513015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:29.514080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:29.514655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:29.549359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lazy-loading 'flavor' on Instance uuid aba912bf-5c13-4318-9f4b-e9af04d7e03b {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:32:29.933227 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a4f1ad6-c655-49a2-8155-e5817895270b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/action" status: 202 len: 0 microversion: 2.20 time: 0.450804 Oct 27 10:32:29.943334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:29.944275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:29.953943 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2805/5414] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:32:29 2022] POST /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:32:29.958124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:29.958794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:29.959961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:29.962730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:29.964968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:29.965614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:30.492901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:30.493384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:30.506174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:30.516961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:30.519351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:30.522090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:30.523999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:30.527365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:30.706073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:30.719217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:30.723726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:30.727547 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-071a72cc-c968-4676-be3e-cba86fa888b4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.789028 Oct 27 10:32:30.749637 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2610/5415] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:29 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:30.865309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:30.880127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:30.886448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:30.888001 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffc191af-3e2c-4fb2-879d-4e5b840d54d6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.399898 Oct 27 10:32:30.902167 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2806/5416] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:30 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:31.753854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:31.754378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:31.787330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:31.790986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:31.793837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:31.794810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:31.797850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:31.800126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:31.923515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:31.924130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:31.939529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:31.940022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:31.940458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:31.941204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:31.941656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:31.942084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:32.246719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:32.256871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:32.265945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:32.271113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:32.272417 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a7b84de1-d4b9-455e-bfe2-2662db6ddf55 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.353240 Oct 27 10:32:32.276412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:32.281916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:32.287758 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2125b68-81b2-4e91-8713-ef1217f23499 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.538060 Oct 27 10:32:32.294051 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2611/5417] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:31 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:32.300950 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2807/5418] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:31 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:32:33.323304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:33.324730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:33.327117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:33.328003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:33.342611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:33.343379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:33.344195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:33.345542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:33.346238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:33.347517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:33.353159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:33.358290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:33.358868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:33.361821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:33.361982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:33.363631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:34.320001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:34.350043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:34.357018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:34.366633 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f815ee9c-20a0-417c-9de1-27acfa47bc97 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 1.046438 Oct 27 10:32:34.373851 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2612/5419] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:33 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:34.388832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-969875748", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e85818a-70f6-49da-8732-586e3ceedfda"}], "security_groups": [{"name": "tempest-securitygroup--563238431"}], "key_name": "tempest-keypair-1160778429", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:34.586051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:34.626583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:34.631071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:34.632567 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d18d3023-9df7-4b1f-b0c6-40a71ed4019f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 1.310742 Oct 27 10:32:34.635230 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2808/5420] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:33 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:34.735922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] validate_networks() for [('2e85818a-70f6-49da-8732-586e3ceedfda', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:32:35.413439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:35.414075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:35.430747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:35.436561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:35.437096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:35.437550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:35.438261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:35.438706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:35.440276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:35.513879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:35.637773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:35.670372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:35.678169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:35.679456 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3df753b-ff13-44f0-a35a-98cd217aa969 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.281049 Oct 27 10:32:35.696707 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2809/5421] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:35 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:35.703204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:35.705713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:35.736185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:35.737143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:35.738697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:35.739446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:35.740211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:35.740917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:36.194575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:32:36.195142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:32:36.195551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:32:36.196139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:32:36.196620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:32:36.247770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:36.248193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:36.248648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:36.251120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:36.254996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:36.256071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:36.325283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Getting quotas for project 177f03c2fe044ba39efb1861ed6dc4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:32:36.343389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Getting quotas for user 809eac4d896042d39a2277386e511c3d and project 177f03c2fe044ba39efb1861ed6dc4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:32:36.380497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:36.393151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:36.396984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:36.399002 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6769b3c3-2a8c-484e-9466-ad7d2be85d30 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.711418 Oct 27 10:32:36.399629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:32:36.400255 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2810/5422] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:35 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:36.404233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:32:36.553450 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c728ba8-b9fa-4e1f-adde-2ffb83a86808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.168652 Oct 27 10:32:36.554845 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2613/5423] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:32:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:32:36.569388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b063d570-e0e7-4206-a9ab-1279d4e75608 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:36.570323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b063d570-e0e7-4206-a9ab-1279d4e75608 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:36.717489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:36.719040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:36.732476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:36.733210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:36.734726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:36.737406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:36.740200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:36.741373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:36.882792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b063d570-e0e7-4206-a9ab-1279d4e75608 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:36.892552 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b063d570-e0e7-4206-a9ab-1279d4e75608 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1237 microversion: 2.1 time: 0.329918 Oct 27 10:32:36.896820 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2811/5424] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:36 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1237 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:36.956532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:36.972046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:36.981382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:36.982679 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee017ed6-7613-4e0e-a68b-f291d836510f tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.270199 Oct 27 10:32:36.983266 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2614/5425] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:36 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:32:37.432191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:37.433409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:37.458091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:37.458923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:37.463684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:37.464688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:37.473491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:37.477592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:37.849022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:37.873178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:37.876021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:37.877844 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a91be69-3b7c-4b58-8d93-8ef6b334ebfb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.450780 Oct 27 10:32:37.878514 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2812/5426] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:37 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:37.917444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:37.920200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:37.955762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:37.956266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:37.956867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:37.957443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:37.957897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:37.958323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:38.018455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:38.019231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:38.031842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:38.036467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:38.038126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:38.039639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:38.043486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:38.044250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:38.154640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:38.187848 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-29304fe3-8d88-4a04-89ab-3324802c62bf tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1233 microversion: 2.1 time: 0.271383 Oct 27 10:32:38.191726 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2615/5427] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:37 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1233 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:38.275256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:38.298279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:38.301439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:38.304387 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e497a69-a959-4840-872e-542b03f25458 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.291477 Oct 27 10:32:38.306340 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2813/5428] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:38 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:38.919600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:38.922699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:38.937271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:38.939767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:38.944916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:38.947050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:38.948366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:38.950338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:38.963779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:39.218669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:39.220723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:39.249433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:39.252813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:39.255642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:39.258362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:39.259116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:39.260359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:39.544439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:39.553584 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7710c026-6524-4070-8d2d-8aa03cbf7146 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1307 microversion: 2.1 time: 0.345429 Oct 27 10:32:39.554542 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2814/5429] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:39 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1307 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:39.560988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:39.562099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:39.570976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:39.571932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:39.572614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:39.573671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:39.574358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:39.575007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:39.759400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:39.778517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:39.785202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:39.786528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:39.787484 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8af27f96-6350-4c61-b002-8db8796e6f33 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.231034 Oct 27 10:32:39.789900 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2815/5430] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:39 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:39.814549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:39.815950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:39.817251 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-527e9609-b431-4674-a501-4eda7f579266 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.911424 Oct 27 10:32:39.827199 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2616/5431] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:38 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:40.584310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:40.584310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:40.599671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:40.600285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:40.602966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:40.602966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:40.602966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:40.602966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:40.745744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:40.756345 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92b4d951-ac87-489c-a93c-418799f0b931 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1295 microversion: 2.1 time: 0.178498 Oct 27 10:32:40.780558 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2816/5432] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:40 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1295 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:40.819953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:40.820581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:40.843668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:40.844300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:40.851473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:40.851962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:40.852396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:40.853133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:40.853972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:40.855791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:40.856289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:40.856759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:40.857467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:40.857912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:40.858340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:40.862931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:41.114533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:41.127585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:41.138871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:41.140109 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ebedd86-4d07-45ca-9140-b1ad5cc54bcd tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.324313 Oct 27 10:32:41.140742 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2617/5433] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:40 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:41.364245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:41.379563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:41.385543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:41.387256 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9fcdf275-813e-4263-836e-2218ab8810f7 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.547717 Oct 27 10:32:41.390379 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2817/5434] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:40 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:41.790448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:41.791209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:41.832125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:41.832756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:41.834486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:41.838784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:41.841394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:41.841876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:42.165431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:42.169550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:42.170269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:42.178832 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df39e14f-dfbb-4dfe-8917-c0ec3425f1a7 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1362 microversion: 2.1 time: 0.392622 Oct 27 10:32:42.179778 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2618/5435] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:41 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:42.201159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:42.202634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:42.203342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:42.204489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:42.205414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:42.206005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:42.296793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:42.307258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:42.314470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:42.317466 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c793c46c-1ca8-4368-9614-64be6028f4f1 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.151927 Oct 27 10:32:42.320791 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2818/5436] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:42 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:32:42.416790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:42.417737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:42.428020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:42.439865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:42.440575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:42.441597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:42.442222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:42.442834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:42.736959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:42.754819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:42.757008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:42.761119 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-56e2c7bb-fa9b-4a3f-b680-f33ca66c5de2 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.347522 Oct 27 10:32:42.764441 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2619/5437] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:42 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:43.100493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02f90d7c-3a4b-4766-a176-0631a7598339 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:43.101212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02f90d7c-3a4b-4766-a176-0631a7598339 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:43.111973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f90d7c-3a4b-4766-a176-0631a7598339 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:43.118016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f90d7c-3a4b-4766-a176-0631a7598339 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:43.123793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f90d7c-3a4b-4766-a176-0631a7598339 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:43.125018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f90d7c-3a4b-4766-a176-0631a7598339 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:43.125666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f90d7c-3a4b-4766-a176-0631a7598339 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:43.127927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f90d7c-3a4b-4766-a176-0631a7598339 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:43.204515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:43.205373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:43.224080 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02f90d7c-3a4b-4766-a176-0631a7598339 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/ips" status: 200 len: 149 microversion: 2.1 time: 0.125074 Oct 27 10:32:43.225976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:43.226784 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2819/5438] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:32:43 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/ips => generated 149 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:43.227652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:43.229210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:43.230077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:43.231549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:43.233517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:43.349051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:43.350852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:43.379640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:43.384374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:43.385113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:43.389244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:43.390111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:43.391317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:43.689820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:43.717900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:43.720164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:43.721975 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0649010d-c44f-488b-86ae-f09538ce907e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.378355 Oct 27 10:32:43.726898 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2820/5439] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:43 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:43.789115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:43.790111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:43.806837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:43.807356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:43.808300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:43.810671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:43.811321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:43.812965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:43.843019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:43.859262 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a87a92da-180e-4e7a-8839-ec23672b13ac tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1362 microversion: 2.1 time: 0.656417 Oct 27 10:32:43.859911 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2620/5440] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:43 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1362 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:44.284911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:44.324713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:44.334334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:44.337094 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2656b18-aacd-49b1-bd37-c46619760e1a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.551058 Oct 27 10:32:44.352142 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2821/5441] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:43 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:32:44.755901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:44.757166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:44.783016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:44.784998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:44.785623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:44.787005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:44.789056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:44.791306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:44.887741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:44.888759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:44.908012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:44.923020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:44.928820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:44.932242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:44.941341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:44.941765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:45.088560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:45.108458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:45.115151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:45.119929 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1daaae8-16f4-480c-9d04-7b8826f90c5a tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.368418 Oct 27 10:32:45.158315 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2621/5442] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:44 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:45.377601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:45.378535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:45.412377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:45.413693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:45.414825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:45.418102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:45.425258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:45.429477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:45.719392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:45.736108 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6baaf02-d4b3-47e0-b388-36674207de58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1362 microversion: 2.1 time: 0.853177 Oct 27 10:32:45.748954 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2822/5443] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:44 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1362 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:46.154768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:46.155400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:46.168389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:46.170254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:46.171458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:46.172467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:46.174781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:46.175441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:46.196296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:46.206770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:46.228950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:46.241090 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-362e2d0e-2508-4415-a8e8-e5cb23093a81 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.868183 Oct 27 10:32:46.245090 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2622/5444] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:45 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:46.537441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:46.556870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:46.589318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:46.591668 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f661767a-b256-4f9a-bf3b-81d04dd0b780 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.443596 Oct 27 10:32:46.599332 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2823/5445] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:46 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:46.779638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:46.781269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:46.783342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:46.784493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:46.818522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:46.821502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:46.822311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:46.828340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:46.828719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:46.830544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:47.270918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:47.271413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:47.273555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:47.289128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:47.292543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:47.294503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:47.299905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:47.301026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:47.303113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:48.205174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:48.232506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:48.234378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:48.235637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b2394a0-5d2d-442e-a079-c8562d6011db tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1744 microversion: 2.20 time: 0.970200 Oct 27 10:32:48.243190 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2824/5446] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:47 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1744 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:48.252974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:48.279547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:48.290971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:48.291749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:48.292463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:48.298608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:48.299353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:48.300031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:48.351340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:48.376842 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bbda9a73-effb-42f4-a03b-a64e7992c10a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1362 microversion: 2.1 time: 1.598393 Oct 27 10:32:48.408156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2623/5447] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:46 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1362 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:48.420592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be969d68-c564-4fcd-bbb5-3feb91884921 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1732aad-f9dd-4539-88c4-5dabe29d75ea"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:48.433889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be969d68-c564-4fcd-bbb5-3feb91884921 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:48.455895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be969d68-c564-4fcd-bbb5-3feb91884921 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:48.456439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be969d68-c564-4fcd-bbb5-3feb91884921 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:48.458506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be969d68-c564-4fcd-bbb5-3feb91884921 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:48.461165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be969d68-c564-4fcd-bbb5-3feb91884921 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:48.463658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be969d68-c564-4fcd-bbb5-3feb91884921 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:48.468130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be969d68-c564-4fcd-bbb5-3feb91884921 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:48.539133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:48.556019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:48.557530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:48.560575 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d616e0e4-ebc9-44de-a6cb-56065228dc5b tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.315933 Oct 27 10:32:48.586241 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2825/5448] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:48 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:48.947448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1631765166", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:49.075836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] validate_networks() for [('bd8d3bad-2b66-44f6-bda2-a8da9b9789bc', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:32:49.117914 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be969d68-c564-4fcd-bbb5-3feb91884921 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.704726 Oct 27 10:32:49.118575 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2624/5449] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:32:48 2022] POST /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:49.177679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f0a47dd0-273c-45c8-8168-9865c22d50e7 req-3e86a6cb-7c26-4d4f-b2cc-1927902469bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54262900-8cfa-46f1-9450-fba6c0b3290d", "tag": "b7a76215-ca7c-4fff-b3a3-3453340516e8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:49.221058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f0a47dd0-273c-45c8-8168-9865c22d50e7 req-3e86a6cb-7c26-4d4f-b2cc-1927902469bf service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:49.224686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f0a47dd0-273c-45c8-8168-9865c22d50e7 req-3e86a6cb-7c26-4d4f-b2cc-1927902469bf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:49.226255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f0a47dd0-273c-45c8-8168-9865c22d50e7 req-3e86a6cb-7c26-4d4f-b2cc-1927902469bf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:49.301743 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f0a47dd0-273c-45c8-8168-9865c22d50e7 req-3e86a6cb-7c26-4d4f-b2cc-1927902469bf service nova] Creating event network-changed:b7a76215-ca7c-4fff-b3a3-3453340516e8 for instance 54262900-8cfa-46f1-9450-fba6c0b3290d on n-h2-854663-10 Oct 27 10:32:49.325794 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f0a47dd0-273c-45c8-8168-9865c22d50e7 req-3e86a6cb-7c26-4d4f-b2cc-1927902469bf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198495 Oct 27 10:32:49.332070 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2625/5450] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:49.354891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:49.360650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:49.387045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:49.392568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:49.393246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:49.402923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:49.403522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:49.403972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:50.996944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:32:50.997382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:32:50.997834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:32:50.998402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:32:50.998824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:32:51.038232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:51.043041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:51.045714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:51.046653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:51.055145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:51.055656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:51.074662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:51.095090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:51.112372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:51.124732 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f7514c0-8a70-48cc-9f9d-1521af9031f1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 1.788535 Oct 27 10:32:51.129493 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2626/5451] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:49 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:51.152901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:51.153539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:51.179197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Getting quotas for project 6428d1fc07cb46fca78cbde55392c38b. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:32:51.191174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:51.199807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:51.202968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:51.203447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:51.209322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Getting quotas for user 3b36d6ed3964436aad85827f1f1e19fc and project 6428d1fc07cb46fca78cbde55392c38b. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:32:51.209911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:51.210410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:51.213006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:51.283342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:32:51.294330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:32:51.430844 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ebc9bd13-7d07-4de4-a9d4-e8a5bb9f576c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.842177 Oct 27 10:32:51.431564 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2826/5452] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:32:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:32:51.437386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:51.438832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:51.447143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:51.447706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:51.448146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:51.450806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:51.451565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:51.452170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:51.766628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:51.786308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:51.788248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:51.793390 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98dfd401-a46c-4d70-aee1-ebc427efc017 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.360288 Oct 27 10:32:51.795273 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2827/5453] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:51 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:51.810468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82974636-a423-41e7-b924-eb866169bbe5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:51.814516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82974636-a423-41e7-b924-eb866169bbe5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:51.995077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-82974636-a423-41e7-b924-eb866169bbe5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:52.005120 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82974636-a423-41e7-b924-eb866169bbe5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1223 microversion: 2.1 time: 0.206138 Oct 27 10:32:52.005757 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2828/5454] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:51 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:52.160419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:52.161152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:52.177927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:52.181414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:52.182017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:52.182848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:52.183324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:52.183756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:52.276800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:52.318269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:52.332879 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e2c8180-0691-46d5-8d78-9d5976eeb6d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1362 microversion: 2.1 time: 1.198187 Oct 27 10:32:52.335135 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2627/5455] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:51 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1362 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:52.343733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-03474708-ce5a-4853-9041-4254d0f524df req-a4a099a5-2b1b-4337-9086-9439a622fd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba912bf-5c13-4318-9f4b-e9af04d7e03b", "name": "network-vif-plugged", "status": "completed", "tag": "c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:52.361359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-03474708-ce5a-4853-9041-4254d0f524df req-a4a099a5-2b1b-4337-9086-9439a622fd9c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:52.362635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-03474708-ce5a-4853-9041-4254d0f524df req-a4a099a5-2b1b-4337-9086-9439a622fd9c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:52.363452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-03474708-ce5a-4853-9041-4254d0f524df req-a4a099a5-2b1b-4337-9086-9439a622fd9c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:52.405025 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-03474708-ce5a-4853-9041-4254d0f524df req-a4a099a5-2b1b-4337-9086-9439a622fd9c service nova] Creating event network-vif-plugged:c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b for instance aba912bf-5c13-4318-9f4b-e9af04d7e03b on n-h1-854663-10 Oct 27 10:32:52.418717 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-03474708-ce5a-4853-9041-4254d0f524df req-a4a099a5-2b1b-4337-9086-9439a622fd9c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081200 Oct 27 10:32:52.422986 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2628/5456] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:52.828475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:52.832363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:52.851870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:52.852930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:52.855672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:52.857818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:52.858880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:52.862391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:53.322661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:53.339375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:53.348582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:53.350198 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6d7eaee3-2bcd-4936-a71b-a65b54c7b3d4 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.527709 Oct 27 10:32:53.352512 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2629/5457] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:52 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:53.372201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:53.374651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:53.391711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:53.392604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:53.395090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:53.417206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:53.417732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:53.418179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:54.522332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:54.531621 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d30f1e15-75da-439a-bb4e-d40ab1b8c915 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1275 microversion: 2.1 time: 1.177665 Oct 27 10:32:54.540689 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2630/5458] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:53 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1275 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:54.547999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:54.548937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:54.562847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:54.571837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:54.572590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:54.573597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:54.574219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:54.574810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:54.680058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:54.694868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:54.696804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:54.698674 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc80749e-b283-4335-927f-742b146be442 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 2.543338 Oct 27 10:32:54.703088 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2829/5459] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:52 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 2548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:32:54.708353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:54.714448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:54.744702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:54.748140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:54.748914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:54.749975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:54.752975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:54.756069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:55.156154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:55.181342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:55.188892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:55.198964 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-acbf82de-78c6-4d47-bf28-6c96eccb217e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.494147 Oct 27 10:32:55.200978 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2830/5460] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:54 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:55.560368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:55.562049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:55.577360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:55.577882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:55.578520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:55.581756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:55.582237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:55.582706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:55.985915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:56.018131 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7620e3b8-b081-4141-ae56-8bbffee54322 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1362 microversion: 2.1 time: 1.475256 Oct 27 10:32:56.024265 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2631/5461] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:54 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1362 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:56.059257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:56.060748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:56.090928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:56.094161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:56.094683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:56.095447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:56.095918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:56.096354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:56.474251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:56.489269 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e39ed6b5-77bc-4060-ac70-b22ee8acbdcc tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1323 microversion: 2.1 time: 0.931115 Oct 27 10:32:56.489970 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2831/5462] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:55 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1323 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:32:56.501263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:56.501900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:56.516271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:56.516798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:56.517241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:56.521357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:56.536295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:56.536295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:56.837909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:56.840478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:56.856945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:56.861061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:56.861847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:56.867336 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2dbdf673-1b65-4b12-9eed-87ba6fa011ab tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 0.840609 Oct 27 10:32:56.873352 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2632/5463] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:56 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:56.885708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:56.885708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:56.885708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4d5eb5fd-7ba2-45e1-8081-c757ffbcb0a5 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1605 microversion: 2.42 time: 0.391140 Oct 27 10:32:56.885708 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2832/5464] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:56 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1605 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:57.043547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:57.044263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:57.061605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:57.069408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:57.070183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:57.071907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:57.076347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:57.082375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:57.441307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:57.456861 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25e5245c-4158-4868-b6ba-ba1878d69f51 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1362 microversion: 2.1 time: 0.414899 Oct 27 10:32:57.459037 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2633/5465] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:57 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:57.518695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:57.519317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:57.534977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:57.541115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:57.542010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:57.542990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:57.543727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:57.547311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:57.903672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:57.905367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:57.927332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:57.931890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:57.942396 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-534017f4-b7ee-4cf5-b94a-ea83576b71e3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1323 microversion: 2.1 time: 0.429148 Oct 27 10:32:57.945214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:57.947081 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2833/5466] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:57 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:57.948090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:57.949090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:57.951124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:57.957040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:57.965280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:57.978053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:58.006520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.007305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.008580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.009545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.011285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.011925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.100403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.101024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.103942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.105087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lazy-loading 'fault' on Instance uuid 5360435a-e659-40f3-ba47-38f2fb650eb5 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:32:58.326850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:58.338666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:58.343035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51871a8eed994b2785a872172d4bdc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f9cab7fe2840a590d692b91ff6de3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:58.344604 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58bd783f-b14c-4a5c-b770-5dcdfa48345e tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 200 len: 1610 microversion: 2.42 time: 0.394250 Oct 27 10:32:58.358041 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2834/5467] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:57 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 1610 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:32:58.447795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-71c6e1bd-12a9-43ad-95d8-0c0bda6b02d1 req-aa3e2c50-b29e-449a-8b13-5b8fb4467db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54262900-8cfa-46f1-9450-fba6c0b3290d", "name": "network-vif-plugged", "status": "completed", "tag": "b7a76215-ca7c-4fff-b3a3-3453340516e8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:58.471669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-71c6e1bd-12a9-43ad-95d8-0c0bda6b02d1 req-aa3e2c50-b29e-449a-8b13-5b8fb4467db0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.472488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-71c6e1bd-12a9-43ad-95d8-0c0bda6b02d1 req-aa3e2c50-b29e-449a-8b13-5b8fb4467db0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.475240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-71c6e1bd-12a9-43ad-95d8-0c0bda6b02d1 req-aa3e2c50-b29e-449a-8b13-5b8fb4467db0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.515521 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-71c6e1bd-12a9-43ad-95d8-0c0bda6b02d1 req-aa3e2c50-b29e-449a-8b13-5b8fb4467db0 service nova] Creating event network-vif-plugged:b7a76215-ca7c-4fff-b3a3-3453340516e8 for instance 54262900-8cfa-46f1-9450-fba6c0b3290d on n-h2-854663-10 Oct 27 10:32:58.530342 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-71c6e1bd-12a9-43ad-95d8-0c0bda6b02d1 req-aa3e2c50-b29e-449a-8b13-5b8fb4467db0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083269 Oct 27 10:32:58.534290 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2835/5468] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:58.582725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:58.583495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:58.621342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.626006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.626596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.629063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.635554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.636275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.802817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:58.834603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:58.839705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:58.861141 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-206b429f-a856-43d9-addf-b48ea4126f29 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 0.942991 Oct 27 10:32:58.862805 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2634/5469] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:32:57 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:32:58.876774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c3fbcf87-39c2-42b4-9f3b-fe97b363e1f6 req-9b459da3-f969-4cc0-b193-16c54874a525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b1d4e6-856c-481a-8a8a-58cd6b38e1cc", "tag": "7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:58.902544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c3fbcf87-39c2-42b4-9f3b-fe97b363e1f6 req-9b459da3-f969-4cc0-b193-16c54874a525 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.905006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c3fbcf87-39c2-42b4-9f3b-fe97b363e1f6 req-9b459da3-f969-4cc0-b193-16c54874a525 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.908174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c3fbcf87-39c2-42b4-9f3b-fe97b363e1f6 req-9b459da3-f969-4cc0-b193-16c54874a525 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.938429 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c3fbcf87-39c2-42b4-9f3b-fe97b363e1f6 req-9b459da3-f969-4cc0-b193-16c54874a525 service nova] Creating event network-changed:7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b for instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc on n-h1-854663-10 Oct 27 10:32:58.954390 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c3fbcf87-39c2-42b4-9f3b-fe97b363e1f6 req-9b459da3-f969-4cc0-b193-16c54874a525 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087687 Oct 27 10:32:58.955297 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2635/5470] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:32:58.971568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:58.972293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:58.989080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.989588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.990039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.990790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.995288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.996151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:00.053327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:00.086129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:00.099127 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6c915fe-0a97-4d77-b72b-4ce97eaf07c1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1323 microversion: 2.1 time: 1.129454 Oct 27 10:33:00.100309 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2636/5471] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:58 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1323 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:33:00.108416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:00.112380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:00.120449 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b35917d-a920-40c2-ac0a-fd75cf588922 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1362 microversion: 2.1 time: 1.547311 Oct 27 10:33:00.121627 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2836/5472] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:58 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1362 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:00.129747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:00.130541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:00.131165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:00.132058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:00.132689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:00.133279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:00.141746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:00.142381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:00.151935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:00.152653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:00.154438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:00.164909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:00.165834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:00.166455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:00.171963 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] HTTP exception thrown: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Request method failure captured: Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 HTTP/1.1 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzCAK0eErv899SUgxEfJNK_rOf2PMMdGweI3e0wSfoCJHAlzkyTYt2T3XcQEbxk7DpOyIEYr8wfQxKTpI_ovmBBRAibaFz4fPp2Abv2cTVf6CF8NqAdSNysnJ_hvRvLqKnQsPCDd_Q9zd6GWqmreLFGRmsVlLOV92iwKTQsE7EBqQ8 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 79f9cab7fe2840a590d692b91ff6de3a Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-364406744 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/79f9cab7fe2840a590d692b91ff6de3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/79f9cab7fe2840a590d692b91ff6de3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_79f9cab7fe2840a590d692b91ff6de3a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/79f9cab7fe2840a590d692b91ff6de3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TaggedBootDevicesTest_v242-364406744 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 79f9cab7fe2840a590d692b91ff6de3a Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-364406744 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TaggedBootDevicesTest_v242-364406744-project Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 51871a8eed994b2785a872172d4bdc76 Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TaggedBootDevicesTest_v242-364406744-project Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '5360435a-e659-40f3-ba47-38f2fb650eb5'} Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:00.174630 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:33:00.180531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:00.180531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:33:00.180531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:33:00.180531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:33:00.180531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:33:00.180531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:33:00.180531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:00.180531 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:00.189669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Returning 404 to user: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:33:00.191029 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9046e121-8623-4e19-bc4e-bec295db39d0 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 404 len: 111 microversion: 2.42 time: 0.089336 Oct 27 10:33:00.192825 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2637/5473] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:00 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:33:00.200880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac3367bf-2f2d-49ce-bbd5-d095674f4eda tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '.version_select at 0x7f6d63749820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:00.259593 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac3367bf-2f2d-49ce-bbd5-d095674f4eda tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001932277" status: 204 len: 0 microversion: 2.42 time: 0.062467 Oct 27 10:33:00.260872 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2638/5474] 10.222.0.76 () {60 vars in 1262 bytes} [Thu Oct 27 10:33:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001932277 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 10:33:00.932607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:00.948205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:00.949704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:00.950936 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-403a3b8f-bb26-49a9-976f-bdc93a6dd22a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 0.828137 Oct 27 10:33:00.964980 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2837/5475] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:00 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:01.124922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:01.126315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:01.146815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:01.147880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:01.149162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:01.149667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:01.149864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:01.153322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:01.159627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:01.160769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:01.161964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:01.169562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:01.174546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:01.178355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:01.181429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:01.182008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:01.182447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:02.000214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:03.220438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:03.236458 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-abf40047-fc87-46e2-832f-5c4af7fbd857 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1323 microversion: 2.1 time: 2.113354 Oct 27 10:33:03.242679 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2639/5476] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:01 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1323 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:03.251605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:03.254998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:03.276039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:03.287759 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78f8a3cd-54af-437f-a04d-10bc27866fd0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1548 microversion: 2.1 time: 2.142879 Oct 27 10:33:03.305222 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2838/5477] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:01 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1548 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:03.313117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:03.314309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:03.314944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:03.316422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:03.317100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:03.317709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:03.328303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc863e77-1a2d-4302-991f-e8a48cbe5460 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:03.329311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc863e77-1a2d-4302-991f-e8a48cbe5460 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:03.341011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc863e77-1a2d-4302-991f-e8a48cbe5460 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:03.348432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc863e77-1a2d-4302-991f-e8a48cbe5460 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:03.349163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc863e77-1a2d-4302-991f-e8a48cbe5460 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:03.350110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc863e77-1a2d-4302-991f-e8a48cbe5460 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:03.350730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc863e77-1a2d-4302-991f-e8a48cbe5460 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:03.351321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc863e77-1a2d-4302-991f-e8a48cbe5460 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:03.662966 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc863e77-1a2d-4302-991f-e8a48cbe5460 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.344163 Oct 27 10:33:03.664493 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2839/5478] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:33:03 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/os-interface => generated 285 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:03.854983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:03.874381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:03.876562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:03.878066 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bfac3d09-01fe-4595-97ac-01ec2af54520 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 0.634171 Oct 27 10:33:03.879157 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2640/5479] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:03 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:04.267711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:04.272622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:04.290895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:04.291614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:04.291802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:04.292713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:04.293321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:04.293896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:04.852625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:04.881602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc2c91e8-fe7c-4bd1-9413-b31074884a6f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1323 microversion: 2.1 time: 0.618182 Oct 27 10:33:04.887399 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2840/5480] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:04 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1323 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:04.914100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:04.915787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:04.951587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:04.973338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:04.980498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:04.981982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:04.983558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:04.987236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:05.911602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:05.912232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:05.945439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:05.951323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:05.952279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:05.952806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:05.955723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:05.958445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:05.961463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:06.763947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:06.788049 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-888a756f-da6f-4caf-ad29-3560d7ead255 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1323 microversion: 2.1 time: 0.879524 Oct 27 10:33:06.811888 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2841/5481] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:05 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1323 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:06.952000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:06.990003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:07.007319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:07.012216 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60da9a64-9583-44ff-97e1-c9df0829af78 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 2.104111 Oct 27 10:33:07.013708 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2641/5482] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:04 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:07.818944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:07.819584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:07.841141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:07.841692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:07.842086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:07.861526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:07.862156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:07.862600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:07.876590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-336084d0-3888-487a-9ba4-b8c240145aed req-eab73695-414a-4820-b0d2-728c9a2097af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54262900-8cfa-46f1-9450-fba6c0b3290d", "tag": "b7a76215-ca7c-4fff-b3a3-3453340516e8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:07.893284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-336084d0-3888-487a-9ba4-b8c240145aed req-eab73695-414a-4820-b0d2-728c9a2097af service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:07.898836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-336084d0-3888-487a-9ba4-b8c240145aed req-eab73695-414a-4820-b0d2-728c9a2097af service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:07.905685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-336084d0-3888-487a-9ba4-b8c240145aed req-eab73695-414a-4820-b0d2-728c9a2097af service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:07.962529 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-336084d0-3888-487a-9ba4-b8c240145aed req-eab73695-414a-4820-b0d2-728c9a2097af service nova] Creating event network-changed:b7a76215-ca7c-4fff-b3a3-3453340516e8 for instance 54262900-8cfa-46f1-9450-fba6c0b3290d on n-h2-854663-10 Oct 27 10:33:08.081286 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-336084d0-3888-487a-9ba4-b8c240145aed req-eab73695-414a-4820-b0d2-728c9a2097af service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198068 Oct 27 10:33:08.088242 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2642/5483] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:33:08.115669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:08.124005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:08.154348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:08.155064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:08.155669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:08.156466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:08.164151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:08.166715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:08.367269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:08.381846 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5c8b92d-3c93-4e11-abeb-97c0bd9da949 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1323 microversion: 2.1 time: 0.565661 Oct 27 10:33:08.384720 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2842/5484] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:07 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1323 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:08.629572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:08.670638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:08.677374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:08.683340 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d41f777-cf2f-4ecf-ac67-43c5264cd36a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 0.585028 Oct 27 10:33:08.686359 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2643/5485] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:08 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:08.719880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9be3bc87-46a1-4309-8393-23b70c6a9700 req-f0fc3d91-b8d5-4312-9afb-ae0af7590955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b1d4e6-856c-481a-8a8a-58cd6b38e1cc", "name": "network-vif-plugged", "status": "completed", "tag": "7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:08.746975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9be3bc87-46a1-4309-8393-23b70c6a9700 req-f0fc3d91-b8d5-4312-9afb-ae0af7590955 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:08.753823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9be3bc87-46a1-4309-8393-23b70c6a9700 req-f0fc3d91-b8d5-4312-9afb-ae0af7590955 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:08.758491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9be3bc87-46a1-4309-8393-23b70c6a9700 req-f0fc3d91-b8d5-4312-9afb-ae0af7590955 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:08.784602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9be3bc87-46a1-4309-8393-23b70c6a9700 req-f0fc3d91-b8d5-4312-9afb-ae0af7590955 service nova] Creating event network-vif-plugged:7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b for instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc on n-h1-854663-10 Oct 27 10:33:08.796215 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9be3bc87-46a1-4309-8393-23b70c6a9700 req-f0fc3d91-b8d5-4312-9afb-ae0af7590955 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080353 Oct 27 10:33:08.796876 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2843/5486] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:09.407218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:09.408191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:09.432927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:09.434739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:09.438658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:09.442766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:09.443283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:09.446957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:09.716687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:09.717491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:09.732815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:09.733361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:09.733801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:09.734509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:09.734959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:09.735380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:09.818697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:09.836761 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-450149cc-87f9-4d17-a37f-5f8b1da91e0f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1323 microversion: 2.1 time: 0.434080 Oct 27 10:33:09.838932 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2644/5487] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:09 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1323 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:10.156124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:10.165437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:10.166884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:10.168096 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-530dfd6c-b9ac-4343-87dc-c11dfba4a3a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 0.458328 Oct 27 10:33:10.180889 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2844/5488] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:09 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:10.866486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:10.867107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:10.885206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:10.885731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:10.888124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:10.893648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:10.894605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:10.895109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:11.200980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:11.201551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:11.213679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:11.220148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:11.220850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:11.221622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:11.222303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:11.222684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:11.264859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:11.284169 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f4603a1-0a1c-434f-94b0-652dc7d0dfa9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1323 microversion: 2.1 time: 0.421214 Oct 27 10:33:11.300749 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2645/5489] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:10 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1323 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:11.708016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:11.717052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:11.722366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:11.730182 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cdfce4e9-13e8-47ca-9bb2-3056fa777123 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 0.533310 Oct 27 10:33:11.731068 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2845/5490] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:11 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:33:12.311873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:12.313274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:12.327109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:12.328863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:12.330918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:12.331805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:12.335185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:12.336172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:12.587325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:12.607682 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43eafa86-50dd-47a2-8093-d11f917aec40 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1517 microversion: 2.1 time: 0.300116 Oct 27 10:33:12.612220 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2646/5491] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:12 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1517 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:12.634560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:12.642880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:12.650558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:12.651060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:12.651506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:12.652219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:12.652687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:12.653121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:12.758396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:12.759481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:12.768053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lazy-loading 'flavor' on Instance uuid 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:33:12.777371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:12.780019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:12.780953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:12.785561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:12.787211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:12.789025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:12.821009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:12.930287 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db777812-7dca-449f-b2ce-5408fcf1ad84 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action" status: 200 len: 32 microversion: 2.1 time: 0.299639 Oct 27 10:33:12.936211 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2846/5492] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:33:12 2022] POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:33:12.959123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:12.960384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:12.973496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:12.974735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:12.975413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:12.976423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:12.977165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:12.977837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:13.577289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:13.601900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:13.621058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:13.630944 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ecec36e3-6518-4c21-864a-ca524e7faf4a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 0.874705 Oct 27 10:33:13.633532 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2647/5493] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:12 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:33:13.785734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:13.809162 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b165f17-e462-4464-9103-e12295271e62 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.853632 Oct 27 10:33:13.833581 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2847/5494] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:12 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:14.144377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf5a64db-77fa-4fae-91ad-81f07671acff tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: .version_select at 0x7f6d5ab53c10>, body: {"keypair": {"name": "tempest-keypair-1909939776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIfWBN/iw76K6rSxIq5rUVgMo4fmNf3bWAsK4GqIVTtXzbhsKQubX4AFvizUoEmdZMfSrk3msXc/YNVMXmm9IxD5zzp3lFUuLI2tPIshce+umc/oibPyVQm8Lgk4uR/qA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:14.168553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-bf5a64db-77fa-4fae-91ad-81f07671acff tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for project 7e188614201142b089c88d6c819922df. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:33:14.193690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-bf5a64db-77fa-4fae-91ad-81f07671acff tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for user 258cd38b77cb4f63950f937ec3bdb134 and project 7e188614201142b089c88d6c819922df. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:33:14.269927 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bf5a64db-77fa-4fae-91ad-81f07671acff tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131073 Oct 27 10:33:14.277430 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2648/5495] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:33:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:14.663046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:14.663675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:14.682037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:14.682542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:14.682988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:14.683706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:14.684166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:14.684594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:14.841592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:14.843485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:14.859934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:14.876756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:14.881936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:14.883084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:14.886038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:14.887853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:15.627058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:15.642755 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ce00db2-6a2d-4158-ae09-6672bd658e80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.802617 Oct 27 10:33:15.645734 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2649/5496] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:14 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:15.727820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:15.740821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:15.745893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:15.747808 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1df51c09-12ef-4e5c-9ef2-d58d362df637 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 1.089776 Oct 27 10:33:15.764752 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2848/5497] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:14 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:16.295857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:16.296642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:16.306700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:16.307601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:16.308251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:16.312167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:16.312989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:16.313632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:16.332332 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] HTTP exception thrown: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Request method failure captured: Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 HTTP/1.1 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWlzCAK0eErv899SUgxEfJNK_rOf2PMMdGweI3e0wSfoCJHAlzkyTYt2T3XcQEbxk7DpOyIEYr8wfQxKTpI_ovmBBRAibaFz4fPp2Abv2cTVf6CF8NqAdSNysnJ_hvRvLqKnQsPCDd_Q9zd6GWqmreLFGRmsVlLOV92iwKTQsE7EBqQ8 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 79f9cab7fe2840a590d692b91ff6de3a Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-364406744 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/79f9cab7fe2840a590d692b91ff6de3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/79f9cab7fe2840a590d692b91ff6de3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_79f9cab7fe2840a590d692b91ff6de3a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/79f9cab7fe2840a590d692b91ff6de3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TaggedBootDevicesTest_v242-364406744 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 79f9cab7fe2840a590d692b91ff6de3a Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-364406744 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TaggedBootDevicesTest_v242-364406744-project Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 51871a8eed994b2785a872172d4bdc76 Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TaggedBootDevicesTest_v242-364406744-project Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '5360435a-e659-40f3-ba47-38f2fb650eb5'} Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:33:16.334417 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.339396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.341932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Returning 404 to user: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:33:16.343528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aed34d9b-a416-4725-8ba0-ab4d64a6f0f6 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 404 len: 111 microversion: 2.42 time: 0.051843 Oct 27 10:33:16.353301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:16.354375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] [instance: 5360435a-e659-40f3-ba47-38f2fb650eb5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:16.359913 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2650/5498] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:33:16 2022] DELETE /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:33:16.368360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:16.369710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:16.371243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:16.373292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:16.374067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:16.374845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:16.413211 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] HTTP exception thrown: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Request method failure captured: Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 HTTP/1.1 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWlzCAK0eErv899SUgxEfJNK_rOf2PMMdGweI3e0wSfoCJHAlzkyTYt2T3XcQEbxk7DpOyIEYr8wfQxKTpI_ovmBBRAibaFz4fPp2Abv2cTVf6CF8NqAdSNysnJ_hvRvLqKnQsPCDd_Q9zd6GWqmreLFGRmsVlLOV92iwKTQsE7EBqQ8 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 79f9cab7fe2840a590d692b91ff6de3a Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-364406744 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/79f9cab7fe2840a590d692b91ff6de3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/79f9cab7fe2840a590d692b91ff6de3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_79f9cab7fe2840a590d692b91ff6de3a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/79f9cab7fe2840a590d692b91ff6de3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TaggedBootDevicesTest_v242-364406744 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 79f9cab7fe2840a590d692b91ff6de3a Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-364406744 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TaggedBootDevicesTest_v242-364406744-project Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 51871a8eed994b2785a872172d4bdc76 Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TaggedBootDevicesTest_v242-364406744-project Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '5360435a-e659-40f3-ba47-38f2fb650eb5'} Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.416288 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:33:16.423009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.423009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:33:16.423009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:33:16.423009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:33:16.423009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:33:16.423009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:33:16.423009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. Oct 27 10:33:16.423009 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:33:16.426937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] Returning 404 to user: Instance 5360435a-e659-40f3-ba47-38f2fb650eb5 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:33:16.428412 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bad7afef-bb2c-497b-b352-09d63ecd7810 tempest-TaggedBootDevicesTest_v242-364406744 tempest-TaggedBootDevicesTest_v242-364406744-project] 10.222.0.76 "GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5" status: 404 len: 111 microversion: 2.42 time: 0.079378 Oct 27 10:33:16.446138 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2849/5499] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:16 2022] GET /compute/v2.1/servers/5360435a-e659-40f3-ba47-38f2fb650eb5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:33:16.669592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:16.670627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:16.683973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:16.684734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:16.688167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:16.689238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:16.691882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:16.692541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:16.785913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:16.796629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:16.822356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:16.824919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:16.827273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:16.831293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:16.832926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:16.836580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:18.407310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:18.430561 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-48c3e48a-fd30-4491-b0e6-62444860d9f1 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 1.764379 Oct 27 10:33:18.431753 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2651/5500] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:16 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:18.958761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:18.976296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:18.980135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:18.982935 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-876d16a0-06ee-49ba-b293-7a6ab5dc1cc5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1739 microversion: 2.20 time: 2.202846 Oct 27 10:33:18.986261 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2850/5501] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:16 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1739 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:33:19.461073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:19.463164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:19.471889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:19.478121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:19.478963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:19.483087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:19.485553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:19.486225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:19.938861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:19.957311 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ebfa4a87-924f-4cee-9c27-655091aff88c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.491551 Oct 27 10:33:19.958328 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2652/5502] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:19 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:20.015597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:20.016828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:20.037977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:20.038481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:20.038930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:20.039651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:20.040103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:20.040528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:20.980588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:20.981525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:21.001889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:21.002583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:21.003047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:21.003792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:21.004246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:21.006445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:21.285475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:21.315371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:21.324895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:21.335187 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cab79373-0a1b-4f73-8fd8-1a735485e254 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1721 microversion: 2.20 time: 1.319168 Oct 27 10:33:21.338350 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2851/5503] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:20 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1721 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:21.950922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:21.963728 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f2cb34b0-c089-44a1-af6c-be25d8267492 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.987253 Oct 27 10:33:21.972863 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2653/5504] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:20 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:33:22.312381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-617538964", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2b52e2f-b838-490c-bf1e-3da0faf47ab8"}], "security_groups": [{"name": "tempest-securitygroup--1380969423"}], "key_name": "tempest-keypair-1909939776", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:22.366161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:22.367777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:22.372212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:22.419660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:22.421460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:22.422843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:22.425246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:22.426826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:22.430009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:22.503425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:22.733596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] validate_networks() for [('a2b52e2f-b838-490c-bf1e-3da0faf47ab8', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:33:23.027677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:23.040888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:23.043247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:23.052950 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a6de8cb-c3a8-4c5e-b413-90a47a7b800e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1721 microversion: 2.20 time: 0.693011 Oct 27 10:33:23.073766 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2654/5505] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:22 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1721 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:23.088996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:23.090747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:23.107404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:23.108371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:23.110580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:23.111532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:23.112162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:23.114506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:23.622984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:23.640164 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f0d384f-dffe-42e1-b3b7-7ed0bfbd9812 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.563006 Oct 27 10:33:23.641177 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2655/5506] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:23 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:24.084288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:33:24.084971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:33:24.085206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:33:24.085618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:33:24.086031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:33:24.091230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:24.091855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:24.098818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:24.099306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:24.100532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:24.102915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:24.103370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:24.104145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:24.104612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:24.105072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:24.108717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:24.109546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:24.114321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:24.115980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:24.154433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for project 7e188614201142b089c88d6c819922df. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:33:24.167521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for user 258cd38b77cb4f63950f937ec3bdb134 and project 7e188614201142b089c88d6c819922df. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:33:24.208308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:33:24.210690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:33:24.228117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:24.292501 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57b3190c-3a3f-420f-ad2f-bfe5de092517 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.985068 Oct 27 10:33:24.294649 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2852/5507] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:33:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:33:24.301779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8d20b519-f8fd-4403-bd42-b68a13347577 req-017e6a04-ca67-4b77-a5db-60daa1b64040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba912bf-5c13-4318-9f4b-e9af04d7e03b", "name": "network-vif-unplugged", "status": "completed", "tag": "c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:24.328859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8d20b519-f8fd-4403-bd42-b68a13347577 req-017e6a04-ca67-4b77-a5db-60daa1b64040 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:24.330126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8d20b519-f8fd-4403-bd42-b68a13347577 req-017e6a04-ca67-4b77-a5db-60daa1b64040 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:24.330739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8d20b519-f8fd-4403-bd42-b68a13347577 req-017e6a04-ca67-4b77-a5db-60daa1b64040 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:24.356127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_external_events [req-8d20b519-f8fd-4403-bd42-b68a13347577 req-017e6a04-ca67-4b77-a5db-60daa1b64040 service nova] Unable to find a host for instance aba912bf-5c13-4318-9f4b-e9af04d7e03b. Dropping event network-vif-unplugged {{(pid=120720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 10:33:24.360573 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8d20b519-f8fd-4403-bd42-b68a13347577 req-017e6a04-ca67-4b77-a5db-60daa1b64040 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.062974 Oct 27 10:33:24.361830 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2853/5508] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 10:33:24.368009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f415170e-7fb5-4c72-b254-12dad2ab7b27 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:24.369195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f415170e-7fb5-4c72-b254-12dad2ab7b27 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:24.581382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f415170e-7fb5-4c72-b254-12dad2ab7b27 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:24.594722 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f415170e-7fb5-4c72-b254-12dad2ab7b27 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1241 microversion: 2.1 time: 0.231543 Oct 27 10:33:24.598851 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2854/5509] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:24 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1241 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:24.676504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:24.677502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:24.693381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:24.693902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:24.697479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:24.698540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:24.699272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:24.699958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:24.747729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:24.757466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:24.769746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:24.771043 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5b6ee2e6-98ab-4559-817d-a2faffc3fd9b tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1664 microversion: 2.20 time: 0.684539 Oct 27 10:33:24.797317 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2656/5510] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:24 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1664 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:24.813738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38ce6d43-fb97-469e-a858-a1c7ef1fcd42 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5ae14c1-5a59-447d-945b-7afd734106c3"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:24.818149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38ce6d43-fb97-469e-a858-a1c7ef1fcd42 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:24.831678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38ce6d43-fb97-469e-a858-a1c7ef1fcd42 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:24.833341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38ce6d43-fb97-469e-a858-a1c7ef1fcd42 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:24.833710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38ce6d43-fb97-469e-a858-a1c7ef1fcd42 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:24.834546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38ce6d43-fb97-469e-a858-a1c7ef1fcd42 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:24.835008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38ce6d43-fb97-469e-a858-a1c7ef1fcd42 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:24.837536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38ce6d43-fb97-469e-a858-a1c7ef1fcd42 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:25.187902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:25.202110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12578432-8171-482f-9a83-7cf837ec3b83 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.533096 Oct 27 10:33:25.205609 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2855/5511] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:24 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:25.533379 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38ce6d43-fb97-469e-a858-a1c7ef1fcd42 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.724118 Oct 27 10:33:25.540643 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2657/5512] 10.222.0.76 () {62 vars in 1364 bytes} [Thu Oct 27 10:33:24 2022] POST /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/os-volume_attachments => generated 188 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:33:25.621016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:25.621650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:25.641274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:25.642668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:25.643133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:25.643862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:25.644317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:25.644764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:25.797375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9fe840ed-7d86-49be-b1ad-6c1db983aaaa tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:25.798085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9fe840ed-7d86-49be-b1ad-6c1db983aaaa tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:25.811486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fe840ed-7d86-49be-b1ad-6c1db983aaaa tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:25.811945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fe840ed-7d86-49be-b1ad-6c1db983aaaa tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:25.812385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fe840ed-7d86-49be-b1ad-6c1db983aaaa tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:25.837354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fe840ed-7d86-49be-b1ad-6c1db983aaaa tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:25.838619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fe840ed-7d86-49be-b1ad-6c1db983aaaa tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:25.839215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fe840ed-7d86-49be-b1ad-6c1db983aaaa tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:25.946081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:25.956830 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4d951cf1-91b8-4aa3-9219-71799acd43b3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1245 microversion: 2.1 time: 0.339991 Oct 27 10:33:25.961785 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2856/5513] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:25 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1245 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:33:26.234434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:26.235067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:26.257265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:26.259027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:26.259550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:26.261077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:26.261547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:26.265232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:26.448093 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9fe840ed-7d86-49be-b1ad-6c1db983aaaa tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "DELETE /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/os-volume_attachments/c5ae14c1-5a59-447d-945b-7afd734106c3" status: 202 len: 0 microversion: 2.20 time: 0.656500 Oct 27 10:33:26.460253 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2658/5514] 10.222.0.76 () {60 vars in 1457 bytes} [Thu Oct 27 10:33:25 2022] DELETE /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/os-volume_attachments/c5ae14c1-5a59-447d-945b-7afd734106c3 => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:33:26.591868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:26.592790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:26.610647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:26.614978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:26.615566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:26.616434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:26.621751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:26.622355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:26.744241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120719) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 10:33:27.054864 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3fe9b8ef-70e0-4ca1-b1fa-77368569d515 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "POST /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/action" status: 202 len: 0 microversion: 2.20 time: 0.475271 Oct 27 10:33:27.057131 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2659/5515] 10.222.0.76 () {62 vars in 1319 bytes} [Thu Oct 27 10:33:26 2022] POST /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:33:27.064942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:27.065779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:27.075995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:27.076763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:27.077393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:27.079761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:27.080708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:27.081185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:27.242832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:27.266207 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d4d8892-6cb6-4f3f-a3ef-0c509bbb2ce9 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 1.040107 Oct 27 10:33:27.268543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:27.281712 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2857/5516] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:26 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:27.283999 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8db81305-b0c3-4471-9923-adc7b7d38021 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1311 microversion: 2.1 time: 0.223401 Oct 27 10:33:27.286603 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2660/5517] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:27 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1311 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:27.287838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:27.288471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:27.295234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:27.295772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:27.296206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:27.297351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:27.298560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:27.299157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:27.588697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:27.609651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:27.615421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:27.622232 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-802218b9-0961-4093-83f6-03fbb633be41 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1672 microversion: 2.20 time: 0.339267 Oct 27 10:33:27.637853 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2858/5518] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:27 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1672 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:28.296323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:28.297889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:28.310266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:28.310505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:28.311008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:28.313020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:28.314342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:28.315916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:28.317343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:28.318651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:28.334019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:28.334712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:28.335521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:28.336438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:28.337127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:28.337721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:28.602241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:28.618471 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c0878b7-007d-47dc-9995-8445c887e880 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1299 microversion: 2.1 time: 0.311886 Oct 27 10:33:28.620561 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2859/5519] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:28 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1299 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:33:28.658674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:28.659737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:28.670077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:28.670469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:28.671386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:28.672745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:28.678658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:28.679283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:28.941491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:28.955406 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d8de830-ca36-4b54-afc5-e9fc70558f2e tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.662234 Oct 27 10:33:28.958255 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2661/5520] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:28 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:29.151573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:29.161854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:29.163708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:29.165160 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-afcfd067-d36a-48e4-8cd2-3522a6f05121 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1674 microversion: 2.20 time: 0.514740 Oct 27 10:33:29.166379 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2860/5521] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:28 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1674 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:33:29.650612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:29.654944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:29.666034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:29.666806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:29.667612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:29.668783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:29.669428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:29.670024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:29.993705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:29.994935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:30.006123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:30.007532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:30.008388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:30.009578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:30.010265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:30.011369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:30.068196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:30.082554 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-45785bd1-55c2-419e-a643-574e05de3935 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1367 microversion: 2.1 time: 0.442810 Oct 27 10:33:30.084446 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2662/5522] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:29 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:30.199462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:30.200548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:30.211853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:30.212789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:30.214123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:30.217643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:30.218399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:30.219000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:30.649696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:30.658528 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4151ef0-62b5-41fb-b1cb-bc7b0d63b3d6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.676603 Oct 27 10:33:30.685842 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2861/5523] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:29 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:30.781027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:30.803984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:30.816869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:30.822200 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17090c0b-f62b-4155-a656-81c9ff64a1bd tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.631677 Oct 27 10:33:30.830027 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2663/5524] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:30 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:31.112782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:31.113511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:31.125953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:31.133415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:31.133957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:31.134785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:31.137319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:31.139541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:31.233629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:31.259750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-390e0f6c-a638-45d4-9cf1-5963e0267b36 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-90917317", "availability_zone": "foo_zone"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:31.335379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.aggregate [None req-390e0f6c-a638-45d4-9cf1-5963e0267b36 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Generated uuid 4931040f-9aad-4fb3-b02f-c46cddcfc88f for aggregate {{(pid=120720) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 10:33:31.399529 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-390e0f6c-a638-45d4-9cf1-5963e0267b36 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 0.712228 Oct 27 10:33:31.401003 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2862/5525] 10.222.0.76 () {60 vars in 1164 bytes} [Thu Oct 27 10:33:30 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:31.414560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7881de52-da4c-4541-8f22-0451caa4e3e2 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:31.480222 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7881de52-da4c-4541-8f22-0451caa4e3e2 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.070719 Oct 27 10:33:31.483985 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2863/5526] 10.222.0.76 () {60 vars in 1194 bytes} [Thu Oct 27 10:33:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:31.504015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1535dfc1-1d2f-44f4-a69c-2d2d52ba4728 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:31.507942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535dfc1-1d2f-44f4-a69c-2d2d52ba4728 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:31.515230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535dfc1-1d2f-44f4-a69c-2d2d52ba4728 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:31.515737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535dfc1-1d2f-44f4-a69c-2d2d52ba4728 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:31.516608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535dfc1-1d2f-44f4-a69c-2d2d52ba4728 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:31.517121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535dfc1-1d2f-44f4-a69c-2d2d52ba4728 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:31.517558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535dfc1-1d2f-44f4-a69c-2d2d52ba4728 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:31.569277 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1535dfc1-1d2f-44f4-a69c-2d2d52ba4728 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.069634 Oct 27 10:33:31.570734 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2864/5527] 10.222.0.76 () {58 vars in 1176 bytes} [Thu Oct 27 10:33:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:31.585391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07af7d23-78a2-4c73-8f97-b77c9ae9b538 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:31.599002 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-07af7d23-78a2-4c73-8f97-b77c9ae9b538 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.020325 Oct 27 10:33:31.600309 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2865/5528] 10.222.0.76 () {58 vars in 1143 bytes} [Thu Oct 27 10:33:31 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:33:31.626401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-918a01b7-8238-45a8-ae64-44f096c79bcd tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854663-10"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:31.658200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-918a01b7-8238-45a8-ae64-44f096c79bcd tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:31.658986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-918a01b7-8238-45a8-ae64-44f096c79bcd tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:31.659942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-918a01b7-8238-45a8-ae64-44f096c79bcd tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:31.812509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:31.821424 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-20177f53-3b4c-4c72-899f-d037cbba1e59 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1367 microversion: 2.1 time: 0.714330 Oct 27 10:33:31.825798 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2664/5529] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:31 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1367 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:31.849926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:31.852900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:31.870437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:31.872910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:31.873639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:31.877751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:31.878488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:31.879419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:31.934517 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-918a01b7-8238-45a8-ae64-44f096c79bcd tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.323353 Oct 27 10:33:31.938005 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2866/5530] 10.222.0.76 () {60 vars in 1194 bytes} [Thu Oct 27 10:33:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:31.954588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:31.957177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:31.968185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:31.969107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:31.969774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:31.971577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:31.972386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:31.973404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:32.303091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:32.314402 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2859a99e-1428-44f0-81bd-9fcd8156a678 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.484130 Oct 27 10:33:32.318418 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2665/5531] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:31 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:32.328167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:32.334044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9433588-11db-4478-aa66-436a07f7724b tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:32.351519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:32.353313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:32.354582 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7698905f-a0f3-4cf2-af99-b3b3af3569cc tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.414650 Oct 27 10:33:32.368299 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2867/5532] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:31 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:32.372888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d9433588-11db-4478-aa66-436a07f7724b tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.052773 Oct 27 10:33:32.374043 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2666/5533] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:33:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:32.393161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c29ebd8-4251-401b-b7ec-6df2ada8da3c tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-904591030", "availability_zone": "foo_zone"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:32.674271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:32.696543 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c29ebd8-4251-401b-b7ec-6df2ada8da3c tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.310290 Oct 27 10:33:32.704080 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2868/5534] 10.222.0.76 () {60 vars in 1173 bytes} [Thu Oct 27 10:33:32 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:32.716753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35157adb-1b87-4473-8afc-24dc41799e9d tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:32.782854 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35157adb-1b87-4473-8afc-24dc41799e9d tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.077626 Oct 27 10:33:32.784188 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2667/5535] 10.222.0.76 () {60 vars in 1194 bytes} [Thu Oct 27 10:33:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:33:32.796000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eff20504-1d88-446d-ae55-0752653006b1 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:32.805661 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eff20504-1d88-446d-ae55-0752653006b1 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.014017 Oct 27 10:33:32.824340 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2869/5536] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 27 10:33:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:33:32.827556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c18f825-b856-468f-8335-4fcbc0dad266 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854663-10"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:32.857177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:32.858943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:32.860848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c18f825-b856-468f-8335-4fcbc0dad266 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:32.861683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c18f825-b856-468f-8335-4fcbc0dad266 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:32.863412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c18f825-b856-468f-8335-4fcbc0dad266 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:32.894341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:32.895858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:32.896407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:32.898167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:32.899060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:32.900913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:33.336813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:33.340253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:33.372760 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8579fafa-16b9-4063-b31b-cd7dc8e74378 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1371 microversion: 2.1 time: 0.521811 Oct 27 10:33:33.373379 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2870/5537] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:32 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1371 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:33.397768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:33.398421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:33.435084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:33.437170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:33.438387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:33.441248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:33.457644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:33.458228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:33.755517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:33.766353 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c18f825-b856-468f-8335-4fcbc0dad266 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.944504 Oct 27 10:33:33.767058 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2668/5538] 10.222.0.76 () {60 vars in 1194 bytes} [Thu Oct 27 10:33:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:33:33.775389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e2fe4a1-9ce4-4f1d-95c8-5a50ea576ba3 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.382693 Oct 27 10:33:33.779649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:33.780466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:33.780984 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2871/5539] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:33 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:33.801669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-934244b7-fcdd-4601-aad2-f2503121c36d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:33.802948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-934244b7-fcdd-4601-aad2-f2503121c36d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:33.813945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-934244b7-fcdd-4601-aad2-f2503121c36d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:33.814873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-934244b7-fcdd-4601-aad2-f2503121c36d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:33.815494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-934244b7-fcdd-4601-aad2-f2503121c36d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:33.820244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-934244b7-fcdd-4601-aad2-f2503121c36d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:33.821006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-934244b7-fcdd-4601-aad2-f2503121c36d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:33.821606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-934244b7-fcdd-4601-aad2-f2503121c36d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:33.826043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:33.827331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:33.833800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:33.843472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:33.844286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:33.844928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:33.936961 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-934244b7-fcdd-4601-aad2-f2503121c36d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/ips" status: 200 len: 146 microversion: 2.1 time: 0.151856 Oct 27 10:33:33.943559 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2872/5540] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:33:33 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/ips => generated 146 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:33.952822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-049957a6-069a-4b86-bba2-628e60f125c1 req-31c2a9f1-b4fa-40fe-9f31-704035058b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66def8f6-88b2-4b5e-afb9-211a7b2408ce", "tag": "e0d3f00d-430a-4660-a30f-3824fd4c4607"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:33.966094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-049957a6-069a-4b86-bba2-628e60f125c1 req-31c2a9f1-b4fa-40fe-9f31-704035058b31 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:33.967562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-049957a6-069a-4b86-bba2-628e60f125c1 req-31c2a9f1-b4fa-40fe-9f31-704035058b31 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:33.968463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-049957a6-069a-4b86-bba2-628e60f125c1 req-31c2a9f1-b4fa-40fe-9f31-704035058b31 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:33.984333 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-049957a6-069a-4b86-bba2-628e60f125c1 req-31c2a9f1-b4fa-40fe-9f31-704035058b31 service nova] Creating event network-changed:e0d3f00d-430a-4660-a30f-3824fd4c4607 for instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce on n-h2-854663-10 Oct 27 10:33:34.009059 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-049957a6-069a-4b86-bba2-628e60f125c1 req-31c2a9f1-b4fa-40fe-9f31-704035058b31 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063315 Oct 27 10:33:34.010340 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2873/5541] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:34.017239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b465e0ec-a34e-42ca-a69a-698d37f842e4 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:34.088097 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b465e0ec-a34e-42ca-a69a-698d37f842e4 tempest-TestAggregatesBasicOps-2083796183 tempest-TestAggregatesBasicOps-2083796183-project-admin] 10.222.0.76 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.076103 Oct 27 10:33:34.088916 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2874/5542] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:33:34 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 10:33:34.400027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:34.402235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:34.421952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:34.425369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:34.426186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:34.427137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:34.428133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:34.441508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:34.592376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:34.647015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:34.658808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:34.670319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:34.671899 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-51b75b63-743f-423e-a41b-8d074c7d65a8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.897016 Oct 27 10:33:34.676394 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2669/5543] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:33 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:34.804030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:34.804919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:34.820936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:34.821985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:34.822576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:34.828139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:34.828861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:34.829415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:35.077495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:35.095323 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd8b79f5-0c71-4304-867b-690dc07c8440 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1367 microversion: 2.1 time: 0.699812 Oct 27 10:33:35.096118 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2875/5544] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:34 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1367 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:35.263777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:35.292218 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e472ef31-51ec-4d61-9c1d-49cf98b84681 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.492439 Oct 27 10:33:35.294120 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2670/5545] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:34 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:35.706302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:35.706870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:35.723912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:35.724404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:35.724903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:35.725639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:35.726111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:35.726631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:36.122383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:36.124237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:36.140946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:36.147674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:36.149150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:36.156996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:36.157841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:36.158497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:36.266761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:36.277009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:36.291481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:36.298128 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03cff0ba-b489-4345-8682-e03ff0d8527a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.596743 Oct 27 10:33:36.299015 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2876/5546] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:35 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:33:36.325112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:36.326331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:36.350864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:36.351957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:36.353680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:36.354515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:36.355053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:36.356697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:37.401368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:37.421668 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ca910b4a-3ec2-44c2-bacb-8ef5bb574ad4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1367 microversion: 2.1 time: 1.303138 Oct 27 10:33:37.428227 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2671/5547] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:36 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1367 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:33:37.454558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:37.467301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:37.488716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:37.489214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:37.489660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:37.490404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:37.490864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:37.491357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:37.615287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:37.647820 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-489f37d3-963d-4889-ac0f-6b5a15a5bd1c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 1.326260 Oct 27 10:33:37.648788 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2877/5548] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:36 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:38.457773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:38.458824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:38.488320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:38.491860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:38.496470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:38.502461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:38.503650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:38.510514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:39.742191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:39.766390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:39.770255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:39.774749 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0cf290a2-6e06-43f3-a3f7-9ddf22b07407 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 2.345303 Oct 27 10:33:39.777565 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2672/5549] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:37 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:39.790959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:39.791985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:39.809596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:39.810515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:39.811419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:39.812439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:39.813296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:39.813967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:40.095978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:40.111834 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4771d728-69dd-4c92-9f9e-825d65539849 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1367 microversion: 2.1 time: 1.667229 Oct 27 10:33:40.122377 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2878/5550] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:38 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1367 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:40.151086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08ac0aa5-c0ca-41cc-bbb5-3ecbe20f20d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d850eb2-c74c-49f8-b820-fe5fa34e5110"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:40.157214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08ac0aa5-c0ca-41cc-bbb5-3ecbe20f20d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:40.170842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ac0aa5-c0ca-41cc-bbb5-3ecbe20f20d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:40.172153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ac0aa5-c0ca-41cc-bbb5-3ecbe20f20d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:40.174370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ac0aa5-c0ca-41cc-bbb5-3ecbe20f20d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:40.175514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ac0aa5-c0ca-41cc-bbb5-3ecbe20f20d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:40.193141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ac0aa5-c0ca-41cc-bbb5-3ecbe20f20d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:40.194731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ac0aa5-c0ca-41cc-bbb5-3ecbe20f20d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:40.279129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:40.299527 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e677591-5c01-4e51-8fa0-90a359e74766 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 0.518993 Oct 27 10:33:40.300384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2673/5551] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:39 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:40.317128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e40eed07-b012-4875-ae29-23b1026342c8 req-060918a7-52f5-43b1-be5c-bbdc048785ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66def8f6-88b2-4b5e-afb9-211a7b2408ce", "name": "network-vif-plugged", "status": "completed", "tag": "e0d3f00d-430a-4660-a30f-3824fd4c4607"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:40.343787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e40eed07-b012-4875-ae29-23b1026342c8 req-060918a7-52f5-43b1-be5c-bbdc048785ad service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:40.344330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e40eed07-b012-4875-ae29-23b1026342c8 req-060918a7-52f5-43b1-be5c-bbdc048785ad service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:40.357241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e40eed07-b012-4875-ae29-23b1026342c8 req-060918a7-52f5-43b1-be5c-bbdc048785ad service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:40.378881 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e40eed07-b012-4875-ae29-23b1026342c8 req-060918a7-52f5-43b1-be5c-bbdc048785ad service nova] Creating event network-vif-plugged:e0d3f00d-430a-4660-a30f-3824fd4c4607 for instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce on n-h2-854663-10 Oct 27 10:33:40.393656 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e40eed07-b012-4875-ae29-23b1026342c8 req-060918a7-52f5-43b1-be5c-bbdc048785ad service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083351 Oct 27 10:33:40.395175 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2674/5552] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:40.775631 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08ac0aa5-c0ca-41cc-bbb5-3ecbe20f20d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647686 Oct 27 10:33:40.778988 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2879/5553] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:33:40 2022] POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/os-volume_attachments => generated 194 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:40.805394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:40.806714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:40.823178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:40.828565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:40.829409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:40.833558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:40.834219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:40.834915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:41.150296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:41.151097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:41.172109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:41.172795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:41.185018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:41.186605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:41.187478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:41.188182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:41.539380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:41.950705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:41.981333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:41.995061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:42.003221 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88ba6536-4ce8-4325-9dda-23e3f03908da tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 1.197854 Oct 27 10:33:42.007297 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2675/5554] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:40 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:42.040578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:42.044286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:42.079865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:42.085645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:42.091704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:42.092730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:42.102638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:42.104544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:42.428003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:42.450798 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-993a8b6d-83a5-4a8a-b2fd-719087c3be54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1367 microversion: 2.1 time: 1.305326 Oct 27 10:33:42.455154 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2880/5555] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:41 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1367 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:33:43.041254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:43.041897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:43.056423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:43.066112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:43.066660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:43.067433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:43.067910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:43.068338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:43.157226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:43.169317 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9d9940cd-8930-4bbe-b13e-6f1d5055a0d5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 1.155857 Oct 27 10:33:43.195035 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2676/5556] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:42 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:43.479759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:43.480719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:43.496832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:43.497526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:43.498165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:43.501323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:43.502038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:43.506313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:45.295872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:45.321926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:45.328310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:45.336795 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-358f179c-8939-44a0-8e9a-23a759e678ed tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 2.301229 Oct 27 10:33:45.339183 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2881/5557] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:43 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:45.361508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:45.362406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:45.381446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:45.383861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:45.386052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:45.387313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:45.389561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:45.391773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:45.468065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:45.490797 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7799d267-f232-4239-be65-5cd545f471f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1556 microversion: 2.1 time: 2.015857 Oct 27 10:33:45.494666 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2677/5558] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:43 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1556 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:33:45.534008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e903beb5-b7ef-4568-9e30-6ec4d7f062a8 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:45.535222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e903beb5-b7ef-4568-9e30-6ec4d7f062a8 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:45.564693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e903beb5-b7ef-4568-9e30-6ec4d7f062a8 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:45.568070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e903beb5-b7ef-4568-9e30-6ec4d7f062a8 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:45.574314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e903beb5-b7ef-4568-9e30-6ec4d7f062a8 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:45.582408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e903beb5-b7ef-4568-9e30-6ec4d7f062a8 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:45.583597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e903beb5-b7ef-4568-9e30-6ec4d7f062a8 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:45.587164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e903beb5-b7ef-4568-9e30-6ec4d7f062a8 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:46.439888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:46.448962 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98f2b5a6-5611-40b9-b48e-9f8d7d7ed2ce tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1523 microversion: 2.1 time: 1.107808 Oct 27 10:33:46.449558 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2882/5559] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:45 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1523 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:46.575932 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e903beb5-b7ef-4568-9e30-6ec4d7f062a8 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.060549 Oct 27 10:33:46.577564 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2678/5560] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:33:45 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce/os-interface => generated 284 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:33:46.582485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:46.583287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:46.598554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:46.613109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:46.613109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:46.613109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:46.613109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:46.613109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:46.895863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Calling method '.version_select at 0x7f6d5a0b20d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:46.897931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:46.898417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:46.898849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:46.944036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:46.944441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:46.949509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:46.980489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:46.986205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:46.987013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:47.007730 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ea903a6-dad9-47e2-8385-909b69a91271 tempest-PortsAdminExtendedAttrsTestJSON-2043496542 tempest-PortsAdminExtendedAttrsTestJSON-2043496542-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.552975 Oct 27 10:33:47.012164 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2883/5561] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:33:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:47.373070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:47.392795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:47.398625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:47.404740 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41015b86-d93f-40bc-a34d-8c47747dd190 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.824804 Oct 27 10:33:47.407063 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2679/5562] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:46 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:47.483022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:47.484883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:47.500778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:47.502790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:47.504388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:47.507618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:47.508128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:47.510007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:48.098084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:48.114298 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-07dc80ae-9997-4d7f-a6e1-5abf84bcb01b tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1503 microversion: 2.1 time: 0.635420 Oct 27 10:33:48.114945 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2884/5563] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:47 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1503 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:48.143241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9daab758-f605-41e0-b02f-53335aa97947 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Action: 'create', calling method: .version_select at 0x7f6d639075e0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-77787282", "description": "tempest-description-1080249051"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:48.438033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:48.439635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:48.475832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:48.476336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:48.476797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:48.478631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:48.479099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:48.484296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:49.211785 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9daab758-f605-41e0-b02f-53335aa97947 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.073353 Oct 27 10:33:49.214065 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2680/5564] 10.222.0.76 () {60 vars in 1180 bytes} [Thu Oct 27 10:33:48 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:49.227662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-77787282"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:49.228436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:49.247714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:49.248991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:49.249495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:49.253443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:49.253939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:49.254375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:49.509334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:49.551205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:49.555387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:49.560465 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29c52b65-9554-42ba-9dc2-7397fe0ba291 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 1.128745 Oct 27 10:33:49.582632 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2885/5565] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:48 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:33:49.680203 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.network.security_group_api [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Adding security group eb4be81b-e366-437f-a01b-2595f0f15bdd to port 7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b Oct 27 10:33:50.287548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-15c2215e-963f-4d66-ad30-a2f10d76789b req-97007756-4aa7-43ef-983e-8da7db6dd511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66def8f6-88b2-4b5e-afb9-211a7b2408ce", "tag": "e0d3f00d-430a-4660-a30f-3824fd4c4607"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:50.309222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-15c2215e-963f-4d66-ad30-a2f10d76789b req-97007756-4aa7-43ef-983e-8da7db6dd511 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:50.309899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-15c2215e-963f-4d66-ad30-a2f10d76789b req-97007756-4aa7-43ef-983e-8da7db6dd511 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:50.311239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-15c2215e-963f-4d66-ad30-a2f10d76789b req-97007756-4aa7-43ef-983e-8da7db6dd511 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:50.342106 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-15c2215e-963f-4d66-ad30-a2f10d76789b req-97007756-4aa7-43ef-983e-8da7db6dd511 service nova] Creating event network-changed:e0d3f00d-430a-4660-a30f-3824fd4c4607 for instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce on n-h2-854663-10 Oct 27 10:33:50.370330 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-15c2215e-963f-4d66-ad30-a2f10d76789b req-97007756-4aa7-43ef-983e-8da7db6dd511 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202323 Oct 27 10:33:50.370970 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2886/5566] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:33:50.595762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:50.596482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:50.606615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:50.607010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:50.607451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:50.608255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:50.609194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:50.609594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:51.004022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:51.055237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:51.060648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:51.062289 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6785b96a-47e1-42c1-944f-cbad6284552d tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action" status: 202 len: 0 microversion: 2.1 time: 1.839629 Oct 27 10:33:51.063597 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2681/5567] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:33:49 2022] POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action => generated 0 bytes in 1842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:33:51.065783 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d8ae506-7925-48d7-940b-59cbd5955036 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.476420 Oct 27 10:33:51.096634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-77787282"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:51.097993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:51.104280 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2887/5568] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:50 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:33:51.125212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9d400555-2e81-4bba-b918-cccacfd4107c req-ef7ebd93-738e-4fa2-b9ca-eb9f5f238a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b1d4e6-856c-481a-8a8a-58cd6b38e1cc", "tag": "7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:51.125709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:51.126647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:51.131206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:51.132515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:51.133525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:51.139666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:51.150038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9d400555-2e81-4bba-b918-cccacfd4107c req-ef7ebd93-738e-4fa2-b9ca-eb9f5f238a60 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:51.151277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9d400555-2e81-4bba-b918-cccacfd4107c req-ef7ebd93-738e-4fa2-b9ca-eb9f5f238a60 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:51.152044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9d400555-2e81-4bba-b918-cccacfd4107c req-ef7ebd93-738e-4fa2-b9ca-eb9f5f238a60 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:51.167250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9d400555-2e81-4bba-b918-cccacfd4107c req-ef7ebd93-738e-4fa2-b9ca-eb9f5f238a60 service nova] Creating event network-changed:7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b for instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc on n-h1-854663-10 Oct 27 10:33:51.174117 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9d400555-2e81-4bba-b918-cccacfd4107c req-ef7ebd93-738e-4fa2-b9ca-eb9f5f238a60 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065866 Oct 27 10:33:51.175451 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2888/5569] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:52.019533 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.network.security_group_api [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Removing security group eb4be81b-e366-437f-a01b-2595f0f15bdd from port 7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b Oct 27 10:33:52.098144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:52.100010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:52.111952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:52.112771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:52.113745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:52.114835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:52.115588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:52.116231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:52.145213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:52.587181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:52.600037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:52.601921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:52.603958 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38fd8714-4294-44da-8c86-b28e722f57bb tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.515515 Oct 27 10:33:52.605251 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2889/5570] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:52 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:52.920906 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3e0bee3f-3f9a-4050-96a9-28519ac84ed7 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action" status: 202 len: 0 microversion: 2.1 time: 1.829677 Oct 27 10:33:52.922478 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2682/5571] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:33:51 2022] POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action => generated 0 bytes in 1832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:33:52.934490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97306d44-e83a-4a56-bb94-ebd5976f733c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Action: 'create', calling method: .version_select at 0x7f6d5a9009d0>, body: {"pool": null} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:53.215600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8b0600b0-5f76-4418-a670-ca20f3a7168c req-60ed178d-b851-48cf-97c9-3a296055ab69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b1d4e6-856c-481a-8a8a-58cd6b38e1cc", "tag": "7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:53.234394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:53.261885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8b0600b0-5f76-4418-a670-ca20f3a7168c req-60ed178d-b851-48cf-97c9-3a296055ab69 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:53.263354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8b0600b0-5f76-4418-a670-ca20f3a7168c req-60ed178d-b851-48cf-97c9-3a296055ab69 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:53.264695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8b0600b0-5f76-4418-a670-ca20f3a7168c req-60ed178d-b851-48cf-97c9-3a296055ab69 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:53.303594 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8b0600b0-5f76-4418-a670-ca20f3a7168c req-60ed178d-b851-48cf-97c9-3a296055ab69 service nova] Creating event network-changed:7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b for instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc on n-h1-854663-10 Oct 27 10:33:53.314458 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8b0600b0-5f76-4418-a670-ca20f3a7168c req-60ed178d-b851-48cf-97c9-3a296055ab69 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105372 Oct 27 10:33:53.315741 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2683/5572] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:53.630349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:53.631156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:53.646707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:53.654640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:53.655513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:53.656440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:53.657040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:53.657711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:54.110107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:54.121920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:54.123811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:54.125524 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c8624d3-0c40-4a4b-8f9d-d22ee2360c58 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.500258 Oct 27 10:33:54.127599 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2684/5573] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:53 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:54.406811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a787aaa8-996f-41a4-944e-eaa7bff36f5b req-bf2884b1-020e-45e5-90da-819877a22b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba912bf-5c13-4318-9f4b-e9af04d7e03b", "name": "network-vif-plugged", "status": "completed", "tag": "c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:54.429396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a787aaa8-996f-41a4-944e-eaa7bff36f5b req-bf2884b1-020e-45e5-90da-819877a22b8d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:54.430215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a787aaa8-996f-41a4-944e-eaa7bff36f5b req-bf2884b1-020e-45e5-90da-819877a22b8d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:54.430833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a787aaa8-996f-41a4-944e-eaa7bff36f5b req-bf2884b1-020e-45e5-90da-819877a22b8d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:54.445385 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a787aaa8-996f-41a4-944e-eaa7bff36f5b req-bf2884b1-020e-45e5-90da-819877a22b8d service nova] Creating event network-vif-plugged:c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b for instance aba912bf-5c13-4318-9f4b-e9af04d7e03b on n-h1-854663-10 Oct 27 10:33:54.453917 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a787aaa8-996f-41a4-944e-eaa7bff36f5b req-bf2884b1-020e-45e5-90da-819877a22b8d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324736 Oct 27 10:33:54.457819 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2685/5574] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:55.154433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:55.155344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:55.169017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:55.169849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:55.172495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:55.173709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:55.174361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:55.175687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:55.920104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:55.929483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:55.930876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:55.932103 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef38ba25-2fba-4afa-be8f-439011bd38a4 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.782432 Oct 27 10:33:55.944784 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2686/5575] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:55 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:33:56.970258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:56.971836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:56.993621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:56.994043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:56.994552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:56.995256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:56.995960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:56.997759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:57.095971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:57.469612 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97306d44-e83a-4a56-bb94-ebd5976f733c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.541471 Oct 27 10:33:57.470241 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2890/5576] 10.222.0.76 () {60 vars in 1170 bytes} [Thu Oct 27 10:33:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:57.484682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fcee3a2c-7fde-4f42-9cdd-5366e07fbed6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:57.494563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcee3a2c-7fde-4f42-9cdd-5366e07fbed6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:57.495060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcee3a2c-7fde-4f42-9cdd-5366e07fbed6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:57.495607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcee3a2c-7fde-4f42-9cdd-5366e07fbed6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:57.526993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fcee3a2c-7fde-4f42-9cdd-5366e07fbed6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:33:57.627441 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fcee3a2c-7fde-4f42-9cdd-5366e07fbed6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/action" status: 202 len: 0 microversion: 2.1 time: 0.152407 Oct 27 10:33:57.637108 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2891/5577] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:33:57 2022] POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:33:57.648805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.187"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:57.663008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:57.675671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:57.676235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:57.676932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:57.677569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:57.678371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:57.678808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:57.741930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "refresh_cache-69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:33:57.743438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquired lock "refresh_cache-69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:33:57.934427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:57.950484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:57.954206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:57.956797 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a318551b-be51-4dee-8fb0-7f5e8c0e9a11 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1730 microversion: 2.20 time: 0.990332 Oct 27 10:33:57.957893 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2687/5578] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:56 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1730 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:33:57.963784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:57.964842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:57.980787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:57.982358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:57.984074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:57.990987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:57.994140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:57.995273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:58.519879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:58.534247 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62b27356-461e-4ff6-8ecb-062f063d5cbc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.574738 Oct 27 10:33:58.535245 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2688/5579] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:57 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:58.986347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:58.987358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:59.001998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:59.002511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:59.006166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:59.014297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:59.015918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:59.016553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:59.594981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:59.613721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:59.616255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:59.618182 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81418f09-c580-44ec-9018-543063f45fca tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1717 microversion: 2.20 time: 0.636333 Oct 27 10:33:59.619551 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2689/5580] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:33:58 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1717 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:33:59.626245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:59.627129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:59.641099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:59.642331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:59.643558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:59.644770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:59.645697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:59.647633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:00.674201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:00.700767 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-20856fe9-51be-43f5-af40-51ea371f763b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 1.079769 Oct 27 10:34:00.717747 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2690/5581] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:59 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:01.004902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Building network info cache for instance {{(pid=120720) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:34:01.018459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b5ce5c4a-8129-43b9-9d38-6855483b8715 req-a2bdcf2a-2260-4bd6-9358-ff23352bfbfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b1d4e6-856c-481a-8a8a-58cd6b38e1cc", "tag": "7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:01.038778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b5ce5c4a-8129-43b9-9d38-6855483b8715 req-a2bdcf2a-2260-4bd6-9358-ff23352bfbfd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:01.042456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b5ce5c4a-8129-43b9-9d38-6855483b8715 req-a2bdcf2a-2260-4bd6-9358-ff23352bfbfd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:01.047225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b5ce5c4a-8129-43b9-9d38-6855483b8715 req-a2bdcf2a-2260-4bd6-9358-ff23352bfbfd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:01.081891 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b5ce5c4a-8129-43b9-9d38-6855483b8715 req-a2bdcf2a-2260-4bd6-9358-ff23352bfbfd service nova] Creating event network-changed:7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b for instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc on n-h1-854663-10 Oct 27 10:34:01.110364 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b5ce5c4a-8129-43b9-9d38-6855483b8715 req-a2bdcf2a-2260-4bd6-9358-ff23352bfbfd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084787 Oct 27 10:34:01.114335 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2691/5582] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:01.725273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:01.725974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:01.735371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:01.736306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:01.737001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:01.739322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:01.740397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:01.741081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:02.831929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:02.853529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Updating instance_info_cache with network_info: [{"id": "7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b", "address": "fa:16:3e:b2:54:1d", "network": {"id": "bd8d3bad-2b66-44f6-bda2-a8da9b9789bc", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-324851412-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6428d1fc07cb46fca78cbde55392c38b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7c6afd81-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120720) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:34:02.855617 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f790f86f-3eea-425b-b68b-635385221e08 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 1.134518 Oct 27 10:34:02.864574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Releasing lock "refresh_cache-69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:34:02.868797 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0dbc4176-abf5-4519-a385-07863b526dd6 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action" status: 202 len: 0 microversion: 2.1 time: 5.230227 Oct 27 10:34:02.871320 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2892/5583] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:33:57 2022] POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action => generated 0 bytes in 5234 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 10:34:02.873002 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2692/5584] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:01 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:02.879294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.187"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:03.172091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:03.174656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:03.182617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:03.184516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:03.186379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:03.187568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:03.187921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:03.188352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:03.576151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "refresh_cache-69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 10:34:03.576954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquired lock "refresh_cache-69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 10:34:03.883189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:03.883807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:03.899304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:03.903499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:03.905315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:03.908462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:03.909202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:03.910804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:04.254736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:04.268791 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-335800b0-e9e8-47d3-b5e7-18f56663464b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.389999 Oct 27 10:34:04.270027 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2693/5585] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:03 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:04.688179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Building network info cache for instance {{(pid=120720) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 10:34:04.695722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-aaedb206-97bf-4d27-bed7-cc9c2edacec5 req-61797925-2c04-4fd6-88e5-495843645877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b1d4e6-856c-481a-8a8a-58cd6b38e1cc", "tag": "7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:04.717052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aaedb206-97bf-4d27-bed7-cc9c2edacec5 req-61797925-2c04-4fd6-88e5-495843645877 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:04.717540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aaedb206-97bf-4d27-bed7-cc9c2edacec5 req-61797925-2c04-4fd6-88e5-495843645877 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:04.723501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aaedb206-97bf-4d27-bed7-cc9c2edacec5 req-61797925-2c04-4fd6-88e5-495843645877 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:04.746903 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-aaedb206-97bf-4d27-bed7-cc9c2edacec5 req-61797925-2c04-4fd6-88e5-495843645877 service nova] Creating event network-changed:7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b for instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc on n-h1-854663-10 Oct 27 10:34:04.762576 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-aaedb206-97bf-4d27-bed7-cc9c2edacec5 req-61797925-2c04-4fd6-88e5-495843645877 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070694 Oct 27 10:34:04.763199 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2694/5586] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:05.295436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:05.296145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:05.305495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:05.306361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:05.307476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:05.308436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:05.309135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:05.309911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:05.635935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:05.655888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0247bbdf-2afc-430c-b8e6-69ec0d254fe9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.363914 Oct 27 10:34:05.657186 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2695/5587] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:05 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:05.789644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Updating instance_info_cache with network_info: [{"id": "7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b", "address": "fa:16:3e:b2:54:1d", "network": {"id": "bd8d3bad-2b66-44f6-bda2-a8da9b9789bc", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-324851412-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6428d1fc07cb46fca78cbde55392c38b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7c6afd81-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120720) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 10:34:05.813592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Releasing lock "refresh_cache-69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 10:34:05.815237 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9022aa4c-5652-473a-b0b5-811e61ad0f29 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action" status: 202 len: 0 microversion: 2.1 time: 2.939698 Oct 27 10:34:05.819732 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2893/5588] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:34:02 2022] POST /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc/action => generated 0 bytes in 2945 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 10:34:05.830196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf1f561b-bf9a-42e4-9cea-c595a4e3b95f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '.version_select at 0x7f6d5b4ee5e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:06.680485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:06.681146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:06.694115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:06.694619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:06.699779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:06.705367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:06.705961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:06.706435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:07.046435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:07.059380 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c99ff12-c0fa-41f6-b2d3-030f05616409 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.383620 Oct 27 10:34:07.060372 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2894/5589] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:06 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:07.297013 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bf1f561b-bf9a-42e4-9cea-c595a4e3b95f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "DELETE /compute/v2.1/os-floating-ips/c4fba79c-9873-488f-9ab8-6ce66a7540cb" status: 202 len: 0 microversion: 2.1 time: 1.471159 Oct 27 10:34:07.301524 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2696/5590] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:34:05 2022] DELETE /compute/v2.1/os-floating-ips/c4fba79c-9873-488f-9ab8-6ce66a7540cb => generated 0 bytes in 1475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:07.307119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c41154b2-e273-477b-a74d-a788f7a167e4 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '.version_select at 0x7f6d637a1e50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:07.453919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-504681570", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "98f5e2d5-a246-4bcc-9280-73bb1a0d432f"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:07.516588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] validate_networks() for [('98f5e2d5-a246-4bcc-9280-73bb1a0d432f', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:34:07.630331 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c41154b2-e273-477b-a74d-a788f7a167e4 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "DELETE /compute/v2.1/os-security-groups/eb4be81b-e366-437f-a01b-2595f0f15bdd" status: 202 len: 0 microversion: 2.1 time: 0.327357 Oct 27 10:34:07.632265 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2697/5591] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 10:34:07 2022] DELETE /compute/v2.1/os-security-groups/eb4be81b-e366-437f-a01b-2595f0f15bdd => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:07.642049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:07.642811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:07.654153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:07.655060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:07.655762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:07.656780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:07.657666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:07.659472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:07.726355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:34:07.845816 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6087bc2f-3b6f-453a-8bd9-d80ed0787c9f tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "DELETE /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 204 len: 0 microversion: 2.1 time: 0.209934 Oct 27 10:34:07.846423 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2698/5592] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:34:07 2022] DELETE /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:34:07.865673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:07.868431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:07.879086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:07.879086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:07.879086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:07.879086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:07.879086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:07.879086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:08.486937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:34:08.487542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:34:08.487899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:34:08.488284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:34:08.488644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:34:08.508062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:08.508914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:08.509938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:08.511018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:08.511480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:08.511905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:08.531670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Getting quotas for project 4dd20331b4d04c9c9e841cb31be672bb. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:34:08.538615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Getting quotas for user c7a61e5713524b559460b4e70d5922be and project 4dd20331b4d04c9c9e841cb31be672bb. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:34:08.543781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:08.554031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:34:08.556748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:34:08.572566 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-256da268-8419-407a-bea3-33156946a0f5 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1509 microversion: 2.1 time: 0.720892 Oct 27 10:34:08.584770 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2699/5593] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:07 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1509 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:08.629345 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e23dc07-832b-453d-b98c-bc07e6b3fb01 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.567304 Oct 27 10:34:08.630412 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2895/5594] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:34:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:34:08.635244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:08.635890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:08.643610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:08.644101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:08.644799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:08.645518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:08.645978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:08.646579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:08.835974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:08.845788 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4588ee58-1fae-4d60-9153-b0a8bd1fc97d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.214285 Oct 27 10:34:08.846923 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2896/5595] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:08 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:08.851892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e0b39ee0-d9bc-44f3-a01d-1418cf61730a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:08.852514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e0b39ee0-d9bc-44f3-a01d-1418cf61730a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:08.928738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e0b39ee0-d9bc-44f3-a01d-1418cf61730a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:08.931055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1f80bd37-67b4-49cb-8105-ecf6313d4a92 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Action: 'create', calling method: .version_select at 0x7f6d5a62aca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-996083378", "metadata": {"Type": "work"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:08.941005 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e0b39ee0-d9bc-44f3-a01d-1418cf61730a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1214 microversion: 2.1 time: 0.092268 Oct 27 10:34:08.950016 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2897/5596] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:08 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:09.383683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1f80bd37-67b4-49cb-8105-ecf6313d4a92 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.806862 Oct 27 10:34:09.386466 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2700/5597] 10.222.0.76 () {60 vars in 1156 bytes} [Thu Oct 27 10:34:08 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 811 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 10:34:09.399579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c988866-6d0f-4f30-bde4-ee54fcdd71c3 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Calling method '.version_select at 0x7f6d5a945670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:09.484449 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c988866-6d0f-4f30-bde4-ee54fcdd71c3 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26" status: 200 len: 352 microversion: 2.1 time: 0.088859 Oct 27 10:34:09.485071 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2898/5598] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:09 2022] GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:09.605151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:09.605869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:09.626661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:09.627173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:09.627638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:09.628357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:09.628848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:09.629465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:09.816064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:09.825913 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-20adfc77-c1ba-4b1b-be3e-19e259aeda80 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1509 microversion: 2.1 time: 0.225250 Oct 27 10:34:09.828152 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2701/5599] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:09 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:09.874043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:09.875198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:09.883605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:09.884096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:09.884827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:09.885836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:09.886526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:09.887238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:09.965573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:09.966746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:09.976894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:09.978635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:09.980203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:09.982659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:09.983397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:09.984103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:10.083412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:10.096061 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41a71b97-acf6-49bd-a117-d103b6a8dc27 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1266 microversion: 2.1 time: 0.131505 Oct 27 10:34:10.100781 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2702/5600] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:09 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:10.121446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:10.130644 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99820872-7838-42b7-a290-6b0142fe9443 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.261030 Oct 27 10:34:10.131798 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2899/5601] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:09 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:10.500925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-466ae6c8-a123-45cb-aead-ac61dfd3c5d0 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Calling method '.version_select at 0x7f6d637af160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:10.591309 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-466ae6c8-a123-45cb-aead-ac61dfd3c5d0 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26" status: 200 len: 352 microversion: 2.1 time: 0.096113 Oct 27 10:34:10.593556 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2703/5602] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:10 2022] GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:10.853295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:10.853883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:10.861790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:10.862299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:10.862741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:10.863463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:10.863923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:10.864546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:11.022877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:11.033601 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf70d234-c385-4ccc-9c86-a542e041506c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1509 microversion: 2.1 time: 0.186496 Oct 27 10:34:11.034526 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2900/5603] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:10 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:11.120888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:11.121599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:11.131450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:11.132452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:11.132928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:11.133771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:11.134230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:11.134829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:11.155759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:11.156680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:11.172823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:11.173598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:11.174223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:11.175103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:11.175728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:11.176319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:11.252679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:11.270027 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9d06a4e5-b19f-46c1-9fc3-6f4400a38712 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1272 microversion: 2.1 time: 0.153526 Oct 27 10:34:11.287517 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2704/5604] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:11 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:11.461548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:11.474660 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ac96aaa-a6e1-4a40-baeb-1bb6fd80ef27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.323081 Oct 27 10:34:11.481283 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2901/5605] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:11 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:11.608250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0228ce0-d9d8-4bd4-90f7-c862e3a18db4 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Calling method '.version_select at 0x7f6d5ba43550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:11.719950 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0228ce0-d9d8-4bd4-90f7-c862e3a18db4 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26" status: 200 len: 353 microversion: 2.1 time: 0.116767 Oct 27 10:34:11.720858 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2705/5606] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:11 2022] GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:11.736846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4090959-c240-43da-9d4f-5f242b01c816 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Calling method '.version_select at 0x7f6d5a9fe1f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:11.776521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4cfc99dc-767f-408f-ad63-2a93f1847572 req-f3c9e504-daf2-4f85-9672-d4729f402f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b1d4e6-856c-481a-8a8a-58cd6b38e1cc", "name": "network-vif-deleted", "tag": "7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:11.812407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4cfc99dc-767f-408f-ad63-2a93f1847572 req-f3c9e504-daf2-4f85-9672-d4729f402f37 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:11.813090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4cfc99dc-767f-408f-ad63-2a93f1847572 req-f3c9e504-daf2-4f85-9672-d4729f402f37 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:11.813611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4cfc99dc-767f-408f-ad63-2a93f1847572 req-f3c9e504-daf2-4f85-9672-d4729f402f37 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:11.848963 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4cfc99dc-767f-408f-ad63-2a93f1847572 req-f3c9e504-daf2-4f85-9672-d4729f402f37 service nova] Creating event network-vif-deleted:7c6afd81-4077-4ae8-9fcf-eaa1b80c9d0b for instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc on n-h1-854663-10 Oct 27 10:34:11.860873 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4cfc99dc-767f-408f-ad63-2a93f1847572 req-f3c9e504-daf2-4f85-9672-d4729f402f37 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098022 Oct 27 10:34:11.861812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2706/5607] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:11.867989 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4090959-c240-43da-9d4f-5f242b01c816 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26" status: 200 len: 353 microversion: 2.1 time: 0.136474 Oct 27 10:34:11.868567 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2902/5608] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:11 2022] GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:11.885901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e09acfd-89f0-486e-a6b1-5e4ee6c1decd tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Calling method '.version_select at 0x7f6d638d7d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:12.003845 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e09acfd-89f0-486e-a6b1-5e4ee6c1decd tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26" status: 202 len: 0 microversion: 2.1 time: 0.116782 Oct 27 10:34:12.015735 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2707/5609] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:34:11 2022] DELETE /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:12.022142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05fa792f-fc99-4e8b-9d1f-316c70334d26 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Calling method '.version_select at 0x7f6d5a889310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:12.068820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:12.069638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:12.092333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:12.096449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:12.097343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:12.098438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:12.099078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:12.099707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:12.113213 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05fa792f-fc99-4e8b-9d1f-316c70334d26 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26" status: 200 len: 352 microversion: 2.1 time: 0.103438 Oct 27 10:34:12.121604 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2903/5610] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:12 2022] GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:12.159896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:12.160466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:12.161012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:12.161482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lazy-loading 'fault' on Instance uuid 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:34:12.298692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:12.299865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:12.313770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:12.317337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:12.317997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:12.318923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:12.322890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:12.323531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:12.325511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b36d6ed3964436aad85827f1f1e19fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6428d1fc07cb46fca78cbde55392c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:12.338514 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b8ca93b4-f398-4321-973c-710752e1467c tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 200 len: 1313 microversion: 2.1 time: 0.282135 Oct 27 10:34:12.341452 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2708/5611] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:12 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:12.510626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:12.511601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:12.541769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:12.542886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:12.543723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:12.547172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:12.548261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:12.550103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:12.605015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:12.614114 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66b91020-bda8-49de-892f-24afbb6e8998 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1314 microversion: 2.1 time: 0.319687 Oct 27 10:34:12.614941 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2904/5612] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:12 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:12.973362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:12.985056 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50e6207d-c36d-460e-ae7a-5aa000f91c56 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.479999 Oct 27 10:34:13.000910 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2709/5613] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:12 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:13.128199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7c29485-1e3a-4a0f-b37c-8fd01dbaaa29 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Calling method '.version_select at 0x7f6d63845280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:13.235610 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7c29485-1e3a-4a0f-b37c-8fd01dbaaa29 tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26" status: 200 len: 352 microversion: 2.1 time: 0.111501 Oct 27 10:34:13.236332 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2905/5614] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:13 2022] GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:13.364565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:13.365569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] [instance: 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:13.377050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:13.379132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:13.383464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:13.385225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:13.386098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:13.386812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:13.406099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:13.425682 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] HTTP exception thrown: Instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc could not be found. Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Request method failure captured: Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc HTTP/1.1 Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl5PMWZfQHHjoPW-ws3BA6PLVVwXmuV_-0uDO7OAcF2JVEhjcraQ9_lepYANeN7kjqAHQbRp0D182yB26HNVWF2UgrXbyqNsgBHW9N799c_tmgduMwVmsx5tBgE91hIfsmEENgWCpXb_bR9bZx316LRuneSM51BhtG-DJbdNZrC9IwQ Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 6428d1fc07cb46fca78cbde55392c38b Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1311748439 Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6428d1fc07cb46fca78cbde55392c38b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6428d1fc07cb46fca78cbde55392c38b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6428d1fc07cb46fca78cbde55392c38b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6428d1fc07cb46fca78cbde55392c38b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1311748439 Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 6428d1fc07cb46fca78cbde55392c38b Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1311748439 Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerRescueTestJSONUnderV235-1311748439-project Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 3b36d6ed3964436aad85827f1f1e19fc Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1311748439-project Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc could not be found. Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '69b1d4e6-856c-481a-8a8a-58cd6b38e1cc'} Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc could not be found. Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc could not be found. Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:13.428494 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:13.433274 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:13.433274 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:13.433274 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:13.433274 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:13.433274 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:13.433274 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:13.433274 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc could not be found. Oct 27 10:34:13.433274 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:13.435308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] Returning 404 to user: Instance 69b1d4e6-856c-481a-8a8a-58cd6b38e1cc could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:13.436444 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c4a387f-633c-4485-a60e-4c5232b18755 tempest-ServerRescueTestJSONUnderV235-1311748439 tempest-ServerRescueTestJSONUnderV235-1311748439-project] 10.222.0.76 "GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc" status: 404 len: 111 microversion: 2.1 time: 0.076330 Oct 27 10:34:13.437872 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2710/5615] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:13 2022] GET /compute/v2.1/servers/69b1d4e6-856c-481a-8a8a-58cd6b38e1cc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:34:13.640705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:13.641793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:13.656294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:13.656970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:13.657659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:13.660526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:13.661489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:13.664128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:14.013183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:14.014167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:14.022296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:14.023362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:14.023974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:14.024997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:14.025631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:14.026260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:14.081746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:14.101182 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eafa4f3e-ec06-4ffe-ae13-c7a14d047b0d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1314 microversion: 2.1 time: 0.465230 Oct 27 10:34:14.110144 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2906/5616] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:13 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:14.213160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f508c5af-29f9-40ce-8a2e-a8b0bbd592b1 req-3100f0ed-d6a2-477d-847d-62a0ae602912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1029ec9d-7728-46b2-8231-2ad6cdc9386b", "tag": "5acc6612-4bce-4a91-852b-0620ccf06a9b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:14.238881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f508c5af-29f9-40ce-8a2e-a8b0bbd592b1 req-3100f0ed-d6a2-477d-847d-62a0ae602912 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:14.245336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f508c5af-29f9-40ce-8a2e-a8b0bbd592b1 req-3100f0ed-d6a2-477d-847d-62a0ae602912 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:14.246036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f508c5af-29f9-40ce-8a2e-a8b0bbd592b1 req-3100f0ed-d6a2-477d-847d-62a0ae602912 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:14.269796 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f508c5af-29f9-40ce-8a2e-a8b0bbd592b1 req-3100f0ed-d6a2-477d-847d-62a0ae602912 service nova] Creating event network-changed:5acc6612-4bce-4a91-852b-0620ccf06a9b for instance 1029ec9d-7728-46b2-8231-2ad6cdc9386b on n-h2-854663-10 Oct 27 10:34:14.281233 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f508c5af-29f9-40ce-8a2e-a8b0bbd592b1 req-3100f0ed-d6a2-477d-847d-62a0ae602912 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072099 Oct 27 10:34:14.296331 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2907/5617] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:14.315844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18785d4b-9e41-4b4e-98a8-b0a2b4e04f5b tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Calling method '.version_select at 0x7f6d5bc229d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:14.338315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:14.351348 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-44fe1e78-0f3a-41ab-8411-3d236414fefd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.345191 Oct 27 10:34:14.355068 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2711/5618] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:14 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:14.424167 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18785d4b-9e41-4b4e-98a8-b0a2b4e04f5b tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26" status: 200 len: 352 microversion: 2.1 time: 0.126138 Oct 27 10:34:14.424784 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2908/5619] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:14 2022] GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:15.137982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:15.139356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:15.147552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:15.148472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:15.149160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:15.150121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:15.150786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:15.151437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:15.383604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:15.385369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:15.394774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:15.395610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:15.396390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:15.397325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:15.397937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:15.398847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:15.788651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:15.798129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:15.807126 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0251df67-c51d-485b-a7e8-21e813493773 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1314 microversion: 2.1 time: 0.673243 Oct 27 10:34:15.807352 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f762a1b9-a79b-4c9b-9200-3aa6c1a7e1bb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.428922 Oct 27 10:34:15.808596 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2909/5620] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:15 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:15.823883 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2712/5621] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:15 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1314 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:15.826239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-adf4ae51-6495-4b1a-8779-03b79828b5ad tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Calling method '.version_select at 0x7f6d6381a670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:15.867844 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-adf4ae51-6495-4b1a-8779-03b79828b5ad tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] HTTP exception thrown: Volume eef02286-3bf1-4a69-86cd-0cfd51ecfe26 could not be found. Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-adf4ae51-6495-4b1a-8779-03b79828b5ad tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Request method failure captured: Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 HTTP/1.1 Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl6ffd6gQhxikOg6BFAQ50DT5acfQYh02KIk38dPnjG2dXK5ZHF_YQM9IfY-E2ARCuPXkLx3elP3UIChNmPsFxj6FVltvMCXB-vfcHZbU1wL6kDW2GBNmiId2UzLCIKU3DL9zviCyD5B8PIU_XQVZWc1WI2Bb4m4oTXUimxANu9dBcs Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: bf2da0939c464029822fd83b477ca8d3 Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesGetTestJSON-1290345129 Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf2da0939c464029822fd83b477ca8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bf2da0939c464029822fd83b477ca8d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bf2da0939c464029822fd83b477ca8d3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf2da0939c464029822fd83b477ca8d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesGetTestJSON-1290345129 Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: bf2da0939c464029822fd83b477ca8d3 Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesGetTestJSON-1290345129 Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesGetTestJSON-1290345129-project Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c155bcbd68e7458f8abc25852373f73f Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesGetTestJSON-1290345129-project Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: exception: Volume eef02286-3bf1-4a69-86cd-0cfd51ecfe26 could not be found. Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'eef02286-3bf1-4a69-86cd-0cfd51ecfe26'} Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eef02286-3bf1-4a69-86cd-0cfd51ecfe26 could not be found. (HTTP 404) (Request-ID: req-8c84c359-4147-4af7-b93e-f34e9eaa573c) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:34:15.871147 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eef02286-3bf1-4a69-86cd-0cfd51ecfe26 could not be found. Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eef02286-3bf1-4a69-86cd-0cfd51ecfe26 could not be found. Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eef02286-3bf1-4a69-86cd-0cfd51ecfe26 could not be found. Oct 27 10:34:15.875971 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:15.883214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-adf4ae51-6495-4b1a-8779-03b79828b5ad tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] Returning 404 to user: Volume eef02286-3bf1-4a69-86cd-0cfd51ecfe26 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:15.884434 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-adf4ae51-6495-4b1a-8779-03b79828b5ad tempest-VolumesGetTestJSON-1290345129 tempest-VolumesGetTestJSON-1290345129-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26" status: 404 len: 109 microversion: 2.1 time: 0.074498 Oct 27 10:34:15.885227 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2910/5622] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:15 2022] GET /compute/v2.1/os-volumes/eef02286-3bf1-4a69-86cd-0cfd51ecfe26 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:34:16.142541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d231bff3-c93f-4f6c-addb-220ddc7e61dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:16.143199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d231bff3-c93f-4f6c-addb-220ddc7e61dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:16.158594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d231bff3-c93f-4f6c-addb-220ddc7e61dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:16.159030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d231bff3-c93f-4f6c-addb-220ddc7e61dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:16.159486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d231bff3-c93f-4f6c-addb-220ddc7e61dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:16.161782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d231bff3-c93f-4f6c-addb-220ddc7e61dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:16.162274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d231bff3-c93f-4f6c-addb-220ddc7e61dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:16.162715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d231bff3-c93f-4f6c-addb-220ddc7e61dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:16.207555 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d231bff3-c93f-4f6c-addb-220ddc7e61dd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce/ips" status: 200 len: 149 microversion: 2.1 time: 0.069963 Oct 27 10:34:16.208846 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2713/5623] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:34:16 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce/ips => generated 149 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:16.222554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1732aad-f9dd-4539-88c4-5dabe29d75ea"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:16.227440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:16.243895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:16.245604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:16.246417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:16.249598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:16.253497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:16.256504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:16.720157 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Invalid volume: volume a1732aad-f9dd-4539-88c4-5dabe29d75ea is already attached to instances: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce/os-volume_attachments HTTP/1.1 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 74 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: {"volumeAttachment": {"volumeId": "a1732aad-f9dd-4539-88c4-5dabe29d75ea"}} Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid volume: volume a1732aad-f9dd-4539-88c4-5dabe29d75ea is already attached to instances: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': '66def8f6-88b2-4b5e-afb9-211a7b2408ce', 'body': {'volumeAttachment': {'volumeId': 'a1732aad-f9dd-4539-88c4-5dabe29d75ea'}}} Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a1732aad-f9dd-4539-88c4-5dabe29d75ea is already attached to instances: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:34:16.721898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a1732aad-f9dd-4539-88c4-5dabe29d75ea is already attached to instances: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a1732aad-f9dd-4539-88c4-5dabe29d75ea is already attached to instances: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 400 to user: Invalid volume: volume a1732aad-f9dd-4539-88c4-5dabe29d75ea is already attached to instances: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87e0b7c8-cc52-4be6-883b-72a993494a1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.507249 Oct 27 10:34:16.729056 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2911/5624] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:34:16 2022] POST /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce/os-volume_attachments => generated 174 bytes in 508 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:34:16.734628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:16.735249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:16.753982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:16.755188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:16.759850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:16.764237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:16.768427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:16.769759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:16.830658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:16.831504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:16.847100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:16.855592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:34:16.857571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:16.858049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:16.859032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:16.859669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:16.860289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:17.041092 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-57b4ef1b-8c80-482e-ab86-12bf0c1e2c2b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 204 len: 0 microversion: 2.1 time: 0.307763 Oct 27 10:34:17.044136 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2714/5625] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:34:16 2022] DELETE /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:34:17.062684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:17.064899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:17.074720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:17.075364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:17.075867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:17.093118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:17.093832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:17.094199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:17.299584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:17.304959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:17.317307 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c08ef9a-9bb6-42c2-9b49-66757ca04ea9 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1314 microversion: 2.1 time: 0.490647 Oct 27 10:34:17.329825 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2912/5626] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:16 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:17.340084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:17.341494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:17.351207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:17.352233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:17.353817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:17.355196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:17.356501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:17.357175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:17.858002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:17.877013 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-42dbc3c7-e995-4a2d-be2d-718d4023e399 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.828950 Oct 27 10:34:17.878357 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2715/5627] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:17 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:18.136185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:18.151114 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-85046b9c-5a39-4a85-8f90-a6a7c5958bea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1681 microversion: 2.1 time: 0.819993 Oct 27 10:34:18.174505 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2913/5628] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:17 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1681 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:18.345006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:18.345955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:18.387595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:18.388155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:18.401984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:18.403038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:18.403725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:18.404481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:18.908032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:18.909001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:18.912148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:18.927348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:18.929947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:18.932278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:18.933645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:18.937287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:18.938187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:18.939054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:19.088917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:19.107669 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-626f6799-1e0c-43de-8f6e-7082976fb710 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1314 microversion: 2.1 time: 0.767475 Oct 27 10:34:19.114252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2716/5629] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:18 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:19.195246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:19.198813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:19.217860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:19.226955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:19.228465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:19.230361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:19.232723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:19.233551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:19.692175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:19.718770 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b149e10e-0675-40c8-8bb3-245f71d0bffe tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.815659 Oct 27 10:34:19.730343 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2914/5630] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:18 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:20.137666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:20.138494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:20.152180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:20.156530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:20.157426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:20.158271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:20.159216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:20.159841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:20.160642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:20.165939 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52450b07-7f55-4d4f-a9e0-ad23a3192a43 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1681 microversion: 2.1 time: 0.981152 Oct 27 10:34:20.177335 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2717/5631] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:19 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1681 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:20.296435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1993fc26-018e-4348-b265-8a30781ede8f req-7427ffe0-4753-4ce1-a8ef-f3bb6a336ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1029ec9d-7728-46b2-8231-2ad6cdc9386b", "name": "network-vif-plugged", "status": "completed", "tag": "5acc6612-4bce-4a91-852b-0620ccf06a9b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:20.319424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1993fc26-018e-4348-b265-8a30781ede8f req-7427ffe0-4753-4ce1-a8ef-f3bb6a336ce0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:20.319911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1993fc26-018e-4348-b265-8a30781ede8f req-7427ffe0-4753-4ce1-a8ef-f3bb6a336ce0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:20.325874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1993fc26-018e-4348-b265-8a30781ede8f req-7427ffe0-4753-4ce1-a8ef-f3bb6a336ce0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:20.382514 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1993fc26-018e-4348-b265-8a30781ede8f req-7427ffe0-4753-4ce1-a8ef-f3bb6a336ce0 service nova] Creating event network-vif-plugged:5acc6612-4bce-4a91-852b-0620ccf06a9b for instance 1029ec9d-7728-46b2-8231-2ad6cdc9386b on n-h2-854663-10 Oct 27 10:34:20.398618 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1993fc26-018e-4348-b265-8a30781ede8f req-7427ffe0-4753-4ce1-a8ef-f3bb6a336ce0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106694 Oct 27 10:34:20.399558 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2718/5632] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:20.721655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:20.733979 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3cc616db-4f22-4886-80e9-51c6a7435f3a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1314 microversion: 2.1 time: 0.600601 Oct 27 10:34:20.734588 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2915/5633] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:20 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:20.760189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:20.761301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:20.775274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:20.775778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:20.776313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:20.777934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:20.779173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:20.781253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:20.968268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-061057be-8a5b-4503-8edd-c45d8673f0a9 req-4d6be83e-74d3-438f-b6ef-c90b7d58cc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66def8f6-88b2-4b5e-afb9-211a7b2408ce", "name": "network-vif-deleted", "tag": "e0d3f00d-430a-4660-a30f-3824fd4c4607"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:21.019510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-061057be-8a5b-4503-8edd-c45d8673f0a9 req-4d6be83e-74d3-438f-b6ef-c90b7d58cc50 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:21.020348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-061057be-8a5b-4503-8edd-c45d8673f0a9 req-4d6be83e-74d3-438f-b6ef-c90b7d58cc50 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:21.022126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-061057be-8a5b-4503-8edd-c45d8673f0a9 req-4d6be83e-74d3-438f-b6ef-c90b7d58cc50 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:21.057047 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-061057be-8a5b-4503-8edd-c45d8673f0a9 req-4d6be83e-74d3-438f-b6ef-c90b7d58cc50 service nova] Creating event network-vif-deleted:e0d3f00d-430a-4660-a30f-3824fd4c4607 for instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce on n-h2-854663-10 Oct 27 10:34:21.070671 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-061057be-8a5b-4503-8edd-c45d8673f0a9 req-4d6be83e-74d3-438f-b6ef-c90b7d58cc50 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116469 Oct 27 10:34:21.072676 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2916/5634] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:21.144432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:21.158834 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-309c9f44-8c87-4666-be4c-cd33a83b1914 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.403680 Oct 27 10:34:21.159558 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2719/5635] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:20 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:21.195353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:21.196331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:21.219082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:21.223110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:21.225657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:21.230184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:21.232173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:21.233009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:21.418984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:21.430807 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70d1cd31-e60e-4239-a139-dc060a430fd3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1326 microversion: 2.1 time: 0.240646 Oct 27 10:34:21.433809 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2917/5636] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:21 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1326 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:21.773498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:21.774879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:21.821361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:21.824404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:21.825947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:21.828364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:21.844422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:21.847225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:22.187947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:22.189186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:22.201781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:22.202597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:22.203030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:22.203916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:22.204547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:22.206342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:22.226895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:22.237118 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f4b8c79-88d2-4842-b6f2-ca9c00f154f3 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1314 microversion: 2.1 time: 0.478822 Oct 27 10:34:22.237765 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2720/5637] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:21 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:22.374000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5d48695-41a5-4738-83ba-feb925e3b07f tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d5ace8040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:22.441652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:22.456506 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-206b564e-d120-4bce-a6fd-f0c4456dafd9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1723 microversion: 2.1 time: 0.273451 Oct 27 10:34:22.457917 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2918/5638] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:22 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:22.463850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:22.464764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:22.473177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:22.477988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:22.478765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:22.479626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:22.480741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:22.481402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:22.525505 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5d48695-41a5-4738-83ba-feb925e3b07f tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/51264320-b494-4ead-9286-a892adc21eb1" status: 200 len: 349 microversion: 2.1 time: 0.156302 Oct 27 10:34:22.526332 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2721/5639] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:22 2022] GET /compute/v2.1/os-volumes/51264320-b494-4ead-9286-a892adc21eb1 => generated 349 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:22.553420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:22.553915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:22.554534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:22.555339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lazy-loading 'fault' on Instance uuid 66def8f6-88b2-4b5e-afb9-211a7b2408ce {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:34:22.641988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:22.653422 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b656bd06-0458-4ff0-8c37-c39c0aa3f948 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 200 len: 1331 microversion: 2.1 time: 0.194026 Oct 27 10:34:22.655528 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2919/5640] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:22 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 1331 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:23.260478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:23.261187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:23.270033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:23.270529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:23.270965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:23.271672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:23.272124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:23.272546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:23.482415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:23.484448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:23.497989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:23.500840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:23.501462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:23.505641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:23.507416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:23.509889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:23.544267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:23.557600 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1180abb-c1bb-45cc-8d2f-13ddd6d3c82f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1501 microversion: 2.1 time: 0.301764 Oct 27 10:34:23.558110 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2722/5641] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:23 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1501 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:23.582007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:23.582627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:23.593391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:23.595359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:23.595359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:23.595359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:23.595722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:23.595834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:23.944473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:23.956409 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ebdad17-dfe7-4043-8c08-352efde23878 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1700 microversion: 2.1 time: 0.478934 Oct 27 10:34:23.957043 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2920/5642] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:23 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1700 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:23.970486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:23.972007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:23.994830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:23.995073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:23.995335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:23.995774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:23.996489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:23.997004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:23.997835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.010654 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e00c3413-9764-42ed-aaa9-b05c7bb28216 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1501 microversion: 2.1 time: 0.432393 Oct 27 10:34:24.011261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2723/5643] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:23 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1501 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:24.017078 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce HTTP/1.1 Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '66def8f6-88b2-4b5e-afb9-211a7b2408ce'} Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:24.019303 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:24.024501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:24.024501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:24.024501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:24.024501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:24.024501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:24.024501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:34:24.024501 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:24.024501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:24.024501 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a00a8ff-9392-47db-8b75-a433a0191e1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 404 len: 111 microversion: 2.1 time: 0.060553 Oct 27 10:34:24.027025 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2921/5644] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:23 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:34:24.032347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9a49f7f-5398-4947-bbcf-d7bdb047f889 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:24.033626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0dcbd8c-c38b-4c29-a27d-32af07c7b5ea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '.version_select at 0x7f6d637e79d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:24.042009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:24.056416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9a49f7f-5398-4947-bbcf-d7bdb047f889 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:24.057342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9a49f7f-5398-4947-bbcf-d7bdb047f889 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:24.057971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9a49f7f-5398-4947-bbcf-d7bdb047f889 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.060155 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a0dcbd8c-c38b-4c29-a27d-32af07c7b5ea tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909939776" status: 202 len: 0 microversion: 2.1 time: 0.031427 Oct 27 10:34:24.061786 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2922/5645] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909939776 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:24.078735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:24.079675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:24.103567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:24.104399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:24.106141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.109459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d9a49f7f-5398-4947-bbcf-d7bdb047f889 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Going to try to start instance {{(pid=120719) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 10:34:24.114217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:24.114859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:24.115318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.146277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lazy-loading 'flavor' on Instance uuid 1029ec9d-7728-46b2-8231-2ad6cdc9386b {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:34:24.196983 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d9a49f7f-5398-4947-bbcf-d7bdb047f889 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/action" status: 202 len: 0 microversion: 2.1 time: 0.178689 Oct 27 10:34:24.197851 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2724/5646] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:34:24 2022] POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:24.207045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:24.207759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:24.232682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:24.233299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:24.233750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.234486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:24.234979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:24.235368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.286700 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6eeb33a9-6b29-4dfe-a490-a92458003e86 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "POST /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b/action" status: 202 len: 0 microversion: 2.1 time: 0.216431 Oct 27 10:34:24.289254 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2923/5647] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:34:24 2022] POST /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:24.297991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:24.299354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:24.308165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:24.308803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:24.309201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.309979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:24.310780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:24.311214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.692631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:24.695745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:24.707401 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-330384cc-02c0-41a9-9f24-f2a8eaa2246b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1709 microversion: 2.1 time: 0.503364 Oct 27 10:34:24.707401 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2725/5648] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:24 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1709 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:24.712390 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d014dc5-52ac-4c99-8f6d-e14a50292864 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1509 microversion: 2.1 time: 0.417274 Oct 27 10:34:24.727756 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2924/5649] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:24 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1509 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:25.229030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd172390-9c0b-437c-ac58-e91410c8dea4 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d637af310>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:25.294851 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bd172390-9c0b-437c-ac58-e91410c8dea4 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/76894328-de8e-4208-b7fe-b20c6ff115d1" status: 200 len: 351 microversion: 2.1 time: 0.069882 Oct 27 10:34:25.295797 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2726/5650] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:25 2022] GET /compute/v2.1/os-volumes/76894328-de8e-4208-b7fe-b20c6ff115d1 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:25.392984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:25.393776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:25.403048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.406459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.407194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:25.408167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.409399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.410495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:25.575210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lazy-loading 'services' on Instance uuid b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:34:25.697520 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3d6038d-5629-4a92-a86f-d475bf2561b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments/a1732aad-f9dd-4539-88c4-5dabe29d75ea" status: 202 len: 0 microversion: 2.1 time: 0.309103 Oct 27 10:34:25.698590 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2925/5651] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:34:25 2022] DELETE /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments/a1732aad-f9dd-4539-88c4-5dabe29d75ea => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:25.707886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-37d0ea70-165b-47da-87e9-020d51674a1a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:25.712471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-37d0ea70-165b-47da-87e9-020d51674a1a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:25.731960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:25.734771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:25.743545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37d0ea70-165b-47da-87e9-020d51674a1a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.744949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37d0ea70-165b-47da-87e9-020d51674a1a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.745894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37d0ea70-165b-47da-87e9-020d51674a1a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:25.747508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37d0ea70-165b-47da-87e9-020d51674a1a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.750591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.751126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37d0ea70-165b-47da-87e9-020d51674a1a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.751851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37d0ea70-165b-47da-87e9-020d51674a1a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:25.754842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.756986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:25.758675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.759672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.762545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:25.820758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:25.839177 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-37d0ea70-165b-47da-87e9-020d51674a1a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135982 Oct 27 10:34:25.844720 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2727/5652] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:25 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:25.858518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:25.859423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:25.868299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.869396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.870006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:25.870888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.871510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.872373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:26.312576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:26.326264 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e074f9a-6366-46fa-b10f-848617c6a25f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1492 microversion: 2.1 time: 0.485291 Oct 27 10:34:26.326969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2728/5653] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:25 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1492 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:26.336445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:26.353955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-addbefb2-b489-4dca-886d-24e53c40d18a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:26.354469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-addbefb2-b489-4dca-886d-24e53c40d18a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:26.359646 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6976f084-5b4b-46e2-a77f-e3e2a1446005 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1709 microversion: 2.1 time: 0.633025 Oct 27 10:34:26.360255 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2926/5654] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:25 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1709 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:26.385876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-addbefb2-b489-4dca-886d-24e53c40d18a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:26.386389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-addbefb2-b489-4dca-886d-24e53c40d18a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:26.386831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-addbefb2-b489-4dca-886d-24e53c40d18a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:26.387543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-addbefb2-b489-4dca-886d-24e53c40d18a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:26.388004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-addbefb2-b489-4dca-886d-24e53c40d18a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:26.388430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-addbefb2-b489-4dca-886d-24e53c40d18a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:26.525293 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-addbefb2-b489-4dca-886d-24e53c40d18a tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "POST /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b/action" status: 202 len: 0 microversion: 2.1 time: 0.175196 Oct 27 10:34:26.526225 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2729/5655] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:34:26 2022] POST /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:34:26.534912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:26.535823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:26.545631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:26.546194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:26.546631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:26.547353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:26.547807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:26.548232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:26.743396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:26.754419 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90e718ee-9de0-4188-b484-09ae1d9b3cdf tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1498 microversion: 2.1 time: 0.223718 Oct 27 10:34:26.755571 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2927/5656] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:26 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1498 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:26.854878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e27a602d-2ea2-4488-ad8b-36faacb83a7a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:26.863136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e27a602d-2ea2-4488-ad8b-36faacb83a7a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:26.876351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27a602d-2ea2-4488-ad8b-36faacb83a7a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:26.877163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27a602d-2ea2-4488-ad8b-36faacb83a7a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:26.877807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27a602d-2ea2-4488-ad8b-36faacb83a7a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:26.878805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27a602d-2ea2-4488-ad8b-36faacb83a7a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:26.880423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27a602d-2ea2-4488-ad8b-36faacb83a7a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:26.882110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27a602d-2ea2-4488-ad8b-36faacb83a7a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:26.935885 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e27a602d-2ea2-4488-ad8b-36faacb83a7a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087600 Oct 27 10:34:26.937101 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2730/5657] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:26 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:27.384000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:27.385077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:27.399592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:27.401098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:27.403019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:27.405154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:27.409266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:27.412471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:27.780237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:27.780910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:27.795801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:27.798517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:27.799021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:27.799465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:27.800181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:27.800631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:27.801080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:27.811443 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b7b79db-e83e-4ceb-a0c8-8c34d5e5872b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1713 microversion: 2.1 time: 0.431821 Oct 27 10:34:27.825139 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2928/5658] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:27 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1713 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:27.951860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3f1e773-e4a8-42f6-8454-7b2f09aa7330 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:27.956328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3f1e773-e4a8-42f6-8454-7b2f09aa7330 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:27.981944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f1e773-e4a8-42f6-8454-7b2f09aa7330 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:27.982476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f1e773-e4a8-42f6-8454-7b2f09aa7330 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:27.982929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f1e773-e4a8-42f6-8454-7b2f09aa7330 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:28.009445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f1e773-e4a8-42f6-8454-7b2f09aa7330 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:28.010677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f1e773-e4a8-42f6-8454-7b2f09aa7330 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:28.015046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3f1e773-e4a8-42f6-8454-7b2f09aa7330 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:28.024075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:28.065072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3f1e773-e4a8-42f6-8454-7b2f09aa7330 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119993 Oct 27 10:34:28.066647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2929/5659] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:27 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:28.113281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb37de05-ebe9-48b8-a78e-d559b1495fee tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d637e7280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:28.218440 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb37de05-ebe9-48b8-a78e-d559b1495fee tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/606a1af2-bffa-466a-8d0d-8d974014cb5f" status: 200 len: 350 microversion: 2.1 time: 0.112183 Oct 27 10:34:28.219351 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2930/5660] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:34:28 2022] GET /compute/v2.1/os-volumes/606a1af2-bffa-466a-8d0d-8d974014cb5f => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:28.236305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7888546-c7df-40ef-8bf2-0de8e827bb1c tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d5a9e6f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:28.345242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:28.380107 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f4dc816-a085-4164-9f70-4b41ada6523f tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1498 microversion: 2.1 time: 0.605867 Oct 27 10:34:28.412884 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2731/5661] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:27 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1498 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:28.413918 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7888546-c7df-40ef-8bf2-0de8e827bb1c tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.182078 Oct 27 10:34:28.414822 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2931/5662] 10.222.0.76 () {58 vars in 1134 bytes} [Thu Oct 27 10:34:28 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:28.433090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc9f5e45-271b-4f5c-b9ba-8a0d802170c4 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d5acbfe50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:29.081550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e13f5098-81c9-486f-858a-0c8356e27663 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:29.089340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e13f5098-81c9-486f-858a-0c8356e27663 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:29.114627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e13f5098-81c9-486f-858a-0c8356e27663 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:29.115348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e13f5098-81c9-486f-858a-0c8356e27663 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:29.116804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e13f5098-81c9-486f-858a-0c8356e27663 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:29.120053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e13f5098-81c9-486f-858a-0c8356e27663 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:29.120688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e13f5098-81c9-486f-858a-0c8356e27663 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:29.121250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e13f5098-81c9-486f-858a-0c8356e27663 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:29.125057 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc9f5e45-271b-4f5c-b9ba-8a0d802170c4 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.699137 Oct 27 10:34:29.136139 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2732/5663] 10.222.0.76 () {58 vars in 1149 bytes} [Thu Oct 27 10:34:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:29.143261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b9762fa-9fd7-40b3-8e63-22067bbcdbda tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d5a8909d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:29.223530 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e13f5098-81c9-486f-858a-0c8356e27663 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142279 Oct 27 10:34:29.228542 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2932/5664] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:29 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:29.408930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:29.409616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:29.425350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:29.429430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:29.434167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:29.435228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:29.435753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:29.436251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:29.760623 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3b9762fa-9fd7-40b3-8e63-22067bbcdbda tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.622127 Oct 27 10:34:29.761249 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2733/5665] 10.222.0.76 () {58 vars in 1134 bytes} [Thu Oct 27 10:34:29 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:29.774697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4103ea64-8dc5-4f45-bf5c-8d470ec83024 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d5abbd0d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:29.812254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:29.822682 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5021ff64-9dd5-4010-ac66-3eba95d1c2b6 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1498 microversion: 2.1 time: 0.415934 Oct 27 10:34:29.823344 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2933/5666] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:29 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1498 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:29.990215 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4103ea64-8dc5-4f45-bf5c-8d470ec83024 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.219311 Oct 27 10:34:29.992768 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2734/5667] 10.222.0.76 () {58 vars in 1167 bytes} [Thu Oct 27 10:34:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:30.009004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea7571b2-278b-4165-a437-aceeb4c33034 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d5a889b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:30.160211 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea7571b2-278b-4165-a437-aceeb4c33034 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.157444 Oct 27 10:34:30.162067 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2934/5668] 10.222.0.76 () {58 vars in 1170 bytes} [Thu Oct 27 10:34:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:30.175980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91c7d9a8-c289-450d-9bdf-d7e3f562a126 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d5ad15430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:30.237304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8df50a61-884e-4e75-a97b-42d7fe0c42e7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:30.241779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8df50a61-884e-4e75-a97b-42d7fe0c42e7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:30.252043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df50a61-884e-4e75-a97b-42d7fe0c42e7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:30.252946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df50a61-884e-4e75-a97b-42d7fe0c42e7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:30.253637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df50a61-884e-4e75-a97b-42d7fe0c42e7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:30.254705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df50a61-884e-4e75-a97b-42d7fe0c42e7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:30.255417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df50a61-884e-4e75-a97b-42d7fe0c42e7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:30.256041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df50a61-884e-4e75-a97b-42d7fe0c42e7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:30.294038 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8df50a61-884e-4e75-a97b-42d7fe0c42e7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062239 Oct 27 10:34:30.295364 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2935/5669] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:30 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:30.374580 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91c7d9a8-c289-450d-9bdf-d7e3f562a126 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.197592 Oct 27 10:34:30.375746 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2735/5670] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:34:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:30.407117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b755639-3a7e-49e3-9cb4-fafdb7ce80c4 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d5a9feaf0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:30.526217 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b755639-3a7e-49e3-9cb4-fafdb7ce80c4 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.140340 Oct 27 10:34:30.526812 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2936/5671] 10.222.0.76 () {58 vars in 1188 bytes} [Thu Oct 27 10:34:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:30.542739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5051036d-4f8a-471f-883c-e9b4b4bf65c3 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] Calling method '.version_select at 0x7f6d5a5fd790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:30.679735 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5051036d-4f8a-471f-883c-e9b4b4bf65c3 tempest-VolumesTestJSON-2025773358 tempest-VolumesTestJSON-2025773358-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.142862 Oct 27 10:34:30.680974 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2736/5672] 10.222.0.76 () {58 vars in 1155 bytes} [Thu Oct 27 10:34:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:30.852381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:30.853406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:30.863485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:30.867504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:30.868822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:30.873704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:30.874560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:30.875249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.308584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47bf2542-d948-4248-8fb6-4fff744f3496 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:31.311546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-47bf2542-d948-4248-8fb6-4fff744f3496 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:31.333416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47bf2542-d948-4248-8fb6-4fff744f3496 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.333914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47bf2542-d948-4248-8fb6-4fff744f3496 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.336033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47bf2542-d948-4248-8fb6-4fff744f3496 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.338100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47bf2542-d948-4248-8fb6-4fff744f3496 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.342337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47bf2542-d948-4248-8fb6-4fff744f3496 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.343029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47bf2542-d948-4248-8fb6-4fff744f3496 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.429107 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-47bf2542-d948-4248-8fb6-4fff744f3496 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122921 Oct 27 10:34:31.432413 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2737/5673] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:31 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:31.568549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:31.578989 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffbf9643-b148-4996-bf6e-6211b8dba557 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1501 microversion: 2.1 time: 0.731294 Oct 27 10:34:31.601987 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2937/5674] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:30 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1501 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:31.609607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:31.610540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:31.623762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.627173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.627922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.630001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.632647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.634539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.687874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lazy-loading 'flavor' on Instance uuid 1029ec9d-7728-46b2-8231-2ad6cdc9386b {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:34:31.837736 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-875c9198-7d56-4698-b292-ac69a729f57d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "POST /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b/action" status: 202 len: 0 microversion: 2.1 time: 0.234183 Oct 27 10:34:31.843384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2738/5675] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:34:31 2022] POST /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:31.855658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:31.858410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:31.874589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.882831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.883734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.884803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.885919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.886517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.952198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21191e45-fe41-47d9-9353-278936ab5305 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:31.955199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21191e45-fe41-47d9-9353-278936ab5305 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:31.962157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21191e45-fe41-47d9-9353-278936ab5305 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.962936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21191e45-fe41-47d9-9353-278936ab5305 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.963575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21191e45-fe41-47d9-9353-278936ab5305 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.964548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21191e45-fe41-47d9-9353-278936ab5305 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.965252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21191e45-fe41-47d9-9353-278936ab5305 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.965899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21191e45-fe41-47d9-9353-278936ab5305 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:32.000014 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21191e45-fe41-47d9-9353-278936ab5305 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052546 Oct 27 10:34:32.007970 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2739/5676] 10.222.0.76 () {60 vars in 1343 bytes} [Thu Oct 27 10:34:31 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:32.122844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:32.123426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:32.137099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:32.138842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:32.142066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:32.143154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:32.144574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:32.154038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:32.159102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:32.168286 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d630659-8d6b-46d6-89a0-73addb6fcc0b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1509 microversion: 2.1 time: 0.318344 Oct 27 10:34:32.181768 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2938/5677] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:31 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:32.238755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:34:32.393053 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cafdd226-10a6-4445-bcf3-c709c2561c6a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "DELETE /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 204 len: 0 microversion: 2.20 time: 0.274874 Oct 27 10:34:32.393720 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2740/5678] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:34:32 2022] DELETE /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 10:34:32.402526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:32.403286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:32.412236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:32.414362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:32.414919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:32.433798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:32.435029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:32.435029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:32.443969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb1a1458-2650-46c7-817d-cbd4b75bc06d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:32.446621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb1a1458-2650-46c7-817d-cbd4b75bc06d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:32.461267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb1a1458-2650-46c7-817d-cbd4b75bc06d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:32.476121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb1a1458-2650-46c7-817d-cbd4b75bc06d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:32.478694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb1a1458-2650-46c7-817d-cbd4b75bc06d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:32.480153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb1a1458-2650-46c7-817d-cbd4b75bc06d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:32.483202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb1a1458-2650-46c7-817d-cbd4b75bc06d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:32.483968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb1a1458-2650-46c7-817d-cbd4b75bc06d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:32.582784 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb1a1458-2650-46c7-817d-cbd4b75bc06d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143179 Oct 27 10:34:32.584199 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2741/5679] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:32 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:33.200137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:33.200940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:33.215744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.216413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.219107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:33.222895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.225146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.225620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:33.259155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:33.288841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:33.299843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:33.304479 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4cab7b09-9cc9-4610-aeb7-e433c381893e tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.903973 Oct 27 10:34:33.330097 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2939/5680] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:34:32 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:34:33.596389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf55193a-988b-499a-804e-bb54cd53767b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:33.599614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf55193a-988b-499a-804e-bb54cd53767b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:33.613491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:33.616339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf55193a-988b-499a-804e-bb54cd53767b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.619997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf55193a-988b-499a-804e-bb54cd53767b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.625520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:33.633611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf55193a-988b-499a-804e-bb54cd53767b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:33.635013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf55193a-988b-499a-804e-bb54cd53767b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.635509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf55193a-988b-499a-804e-bb54cd53767b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.639553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf55193a-988b-499a-804e-bb54cd53767b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:33.643913 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-696b33f7-f59d-4e1c-ae43-9db435d29901 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1492 microversion: 2.1 time: 0.445248 Oct 27 10:34:33.647791 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2742/5681] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:33 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1492 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:33.677866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0256d386-df2e-470c-9b0b-34f55328bf3c tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:33.685544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0256d386-df2e-470c-9b0b-34f55328bf3c tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:33.710895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0256d386-df2e-470c-9b0b-34f55328bf3c tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.716572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0256d386-df2e-470c-9b0b-34f55328bf3c tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.717091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0256d386-df2e-470c-9b0b-34f55328bf3c tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:33.719566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0256d386-df2e-470c-9b0b-34f55328bf3c tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.724175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0256d386-df2e-470c-9b0b-34f55328bf3c tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.724969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0256d386-df2e-470c-9b0b-34f55328bf3c tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:33.777171 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf55193a-988b-499a-804e-bb54cd53767b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185464 Oct 27 10:34:33.788726 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2940/5682] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:33 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:33.916747 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0256d386-df2e-470c-9b0b-34f55328bf3c tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "POST /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b/action" status: 202 len: 0 microversion: 2.1 time: 0.248609 Oct 27 10:34:33.934543 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2743/5683] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:34:33 2022] POST /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:33.943779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:33.944722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:33.958313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.960611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.961103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:33.961860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.962329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.962760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:34.338654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:34.339364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:34.351822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:34.352618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:34.358666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:34.359627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:34.360281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:34.360908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:34.411009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:34.634172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:34.647001 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a5133b0-0e04-4323-972b-02a037f5a11d tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1498 microversion: 2.1 time: 0.707475 Oct 27 10:34:34.661955 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2941/5684] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:33 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1498 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:34.801606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-abcca03d-1534-4bf2-bb18-73751ca4c73c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:34.805025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-abcca03d-1534-4bf2-bb18-73751ca4c73c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:34.824198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abcca03d-1534-4bf2-bb18-73751ca4c73c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:34.834400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abcca03d-1534-4bf2-bb18-73751ca4c73c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:34.837346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abcca03d-1534-4bf2-bb18-73751ca4c73c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:34.837726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:34.838999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abcca03d-1534-4bf2-bb18-73751ca4c73c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:34.844192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abcca03d-1534-4bf2-bb18-73751ca4c73c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:34.845950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abcca03d-1534-4bf2-bb18-73751ca4c73c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:34.851591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:34.854641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:34.855928 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73ddefc4-db3c-48d8-85cf-b1bd020e944f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.522357 Oct 27 10:34:34.858309 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2744/5685] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:34:34 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:34:34.918221 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-abcca03d-1534-4bf2-bb18-73751ca4c73c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122237 Oct 27 10:34:34.924745 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2942/5686] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:34 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:35.686229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:35.686848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:35.706875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:35.707685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:35.708282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:35.712146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:35.713042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:35.713719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:35.887615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:35.888544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:35.896723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:35.897938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:35.898883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:35.900164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:35.901379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:35.902066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:36.405734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:36.419985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:36.421704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:36.425918 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a27bfe2e-3c90-4b45-9be6-7dbf5bdc4552 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1723 microversion: 2.20 time: 0.543654 Oct 27 10:34:36.426522 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2943/5687] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:34:35 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1723 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:34:36.453815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd89c596-118f-42ad-a1b3-40a5946d0e81 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:36.464677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd89c596-118f-42ad-a1b3-40a5946d0e81 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:36.472907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd89c596-118f-42ad-a1b3-40a5946d0e81 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:36.474037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd89c596-118f-42ad-a1b3-40a5946d0e81 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:36.474672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd89c596-118f-42ad-a1b3-40a5946d0e81 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:36.476327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd89c596-118f-42ad-a1b3-40a5946d0e81 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:36.476998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd89c596-118f-42ad-a1b3-40a5946d0e81 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:36.477624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd89c596-118f-42ad-a1b3-40a5946d0e81 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:36.548006 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd89c596-118f-42ad-a1b3-40a5946d0e81 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099412 Oct 27 10:34:36.549382 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2944/5688] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:34:36 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:34:36.649817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:36.650338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:36.664845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:36.665374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:36.665823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:36.666546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:36.670232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:36.671343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:36.740072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:34:36.939909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:36.961801 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc435186-d4f9-435e-aa70-3a70951dd99b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1498 microversion: 2.1 time: 1.272748 Oct 27 10:34:36.970110 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2745/5689] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:35 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1498 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:37.050650 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-776c3d85-038a-4dde-a5a2-1140b244ec26 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 204 len: 0 microversion: 2.1 time: 0.405024 Oct 27 10:34:37.055054 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2945/5690] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:34:36 2022] DELETE /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:34:37.070308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:37.071170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:37.115880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:37.118944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:37.120586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:37.125928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:37.127216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:37.131486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:37.456375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:37.457530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:37.472306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:37.475093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:37.475681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:37.477451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:37.479153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:37.479817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:37.662804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:37.677654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:37.680021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:37.683254 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd39610f-30a0-44dd-9dcc-c28cdf6c898f tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1655 microversion: 2.20 time: 0.231318 Oct 27 10:34:37.687752 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2946/5691] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:34:37 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1655 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 10:34:37.828729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:37.847031 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-97d65795-4fcb-4796-8923-eeddcc43d554 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1680 microversion: 2.1 time: 0.781665 Oct 27 10:34:37.847870 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2746/5692] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:37 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1680 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:37.987780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a15d18db-b971-4e4c-ace4-e59338ef9150 req-5a0a33ad-0add-4d7f-9a53-b1fafef96b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba912bf-5c13-4318-9f4b-e9af04d7e03b", "name": "network-vif-deleted", "tag": "c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:37.998147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:37.999310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:38.025064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a15d18db-b971-4e4c-ace4-e59338ef9150 req-5a0a33ad-0add-4d7f-9a53-b1fafef96b9d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:38.025625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a15d18db-b971-4e4c-ace4-e59338ef9150 req-5a0a33ad-0add-4d7f-9a53-b1fafef96b9d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:38.026003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a15d18db-b971-4e4c-ace4-e59338ef9150 req-5a0a33ad-0add-4d7f-9a53-b1fafef96b9d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:38.030185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:38.030790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:38.031102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:38.031830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:38.032361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:38.043774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:38.085319 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a15d18db-b971-4e4c-ace4-e59338ef9150 req-5a0a33ad-0add-4d7f-9a53-b1fafef96b9d service nova] Creating event network-vif-deleted:c5fe4d44-ceb4-46d0-8d2f-eacdc47d402b for instance aba912bf-5c13-4318-9f4b-e9af04d7e03b on n-h1-854663-10 Oct 27 10:34:38.095739 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a15d18db-b971-4e4c-ace4-e59338ef9150 req-5a0a33ad-0add-4d7f-9a53-b1fafef96b9d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111619 Oct 27 10:34:38.099728 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2947/5693] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:38.491859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:38.500975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-702c830f-b390-4085-b076-2a4ef1f95c44 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1501 microversion: 2.1 time: 0.507105 Oct 27 10:34:38.513493 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2747/5694] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:37 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1501 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:38.544097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:38.544810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:38.560190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:38.565271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:38.566058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:38.568276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:38.569227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:38.570497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:38.684397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:34:38.693129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:38.715328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:38.716260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:38.760630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:38.762491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:38.769395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:38.773610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:38.776064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:38.777811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:38.849008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:38.849715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:38.882852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:38.884001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lazy-loading 'fault' on Instance uuid aba912bf-5c13-4318-9f4b-e9af04d7e03b {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:34:38.968714 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d9b0b71-ceba-4d9d-82f4-e5c19803c793 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 204 len: 0 microversion: 2.1 time: 0.430616 Oct 27 10:34:38.970047 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2948/5695] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:34:38 2022] DELETE /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:34:38.982380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:38.985391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:39.004403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:39.004929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:39.005371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:39.009021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:39.009508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:39.009940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:39.056170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:39.071814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:39.077835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '742c83e928b64f588265112ea7f4c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac83c84f1234dea80c2b074896559c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:39.080980 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d1fe38e-91b3-43d5-882b-9879f98ec0d0 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 200 len: 1371 microversion: 2.20 time: 0.373273 Oct 27 10:34:39.081567 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2748/5696] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:34:38 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 10:34:39.098874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:39.100729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:39.117593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:39.119186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:39.131679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:39.134906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:39.135625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:39.136303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:39.892162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:39.902937 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03ba2dae-d559-4006-9d77-8bd515b2302c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1680 microversion: 2.1 time: 0.929771 Oct 27 10:34:39.910426 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2949/5697] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:38 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1680 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:40.021560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:40.035646 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b217332-ed57-4134-add5-969f923291de tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1507 microversion: 2.1 time: 0.946997 Oct 27 10:34:40.038512 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2749/5698] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:39 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1507 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:40.112490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:40.113141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:40.132393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:40.134273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:40.134889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:40.135787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:40.136404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:40.137403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:40.170461 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] HTTP exception thrown: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Request method failure captured: Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b HTTP/1.1 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl0M9aep192vrh8vl0CuTrVUlGgRv_AffJmkjgTXD_8O-lz_F1FWGr2iqRtKJ6FR6zizWijlmifwzUgfjYZg_5NgxXhfOO1gX1SYoKDczh-ni_jqu577BxWN_cUiIxfLAtBpcJ1F-OYpSSGUxjBXlLyJXbuwAAqJaf8RYs3rFgZ1-dU Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2ac83c84f1234dea80c2b074896559c8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 742c83e928b64f588265112ea7f4c3c9 Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'aba912bf-5c13-4318-9f4b-e9af04d7e03b'} Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:40.173606 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:40.179504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:40.179504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:40.179504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:40.179504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:40.179504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:40.179504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:40.179504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:40.179504 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:40.187013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Returning 404 to user: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:40.188143 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bec24717-975e-44a9-a635-bca680fd55d5 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 404 len: 111 microversion: 2.20 time: 0.080651 Oct 27 10:34:40.200997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-431684ce-ab72-48a7-89fb-0f7dad69762a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '.version_select at 0x7f6d5a613430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:40.205040 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2950/5699] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:34:40 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:34:40.241623 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-431684ce-ab72-48a7-89fb-0f7dad69762a tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-926289581" status: 204 len: 0 microversion: 2.20 time: 0.044645 Oct 27 10:34:40.247345 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2750/5700] 10.222.0.76 () {60 vars in 1259 bytes} [Thu Oct 27 10:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-926289581 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 10:34:40.938870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:40.940233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:40.951530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:40.962860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:40.963331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:40.964175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:40.964700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:40.965196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:41.065800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:41.066477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:41.086639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:41.087139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:41.087588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:41.088305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:41.088803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:41.089235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:41.764244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:41.784880 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dead3e7e-609b-49bd-b63a-b718354ca84b tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1507 microversion: 2.1 time: 0.713024 Oct 27 10:34:41.786156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2751/5701] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:41 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1507 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:41.797319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:41.806261 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e456636-c129-41d5-a163-570a0d209ccd tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1680 microversion: 2.1 time: 0.876030 Oct 27 10:34:41.817299 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2951/5702] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:40 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1680 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:42.816184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:42.817105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:42.836036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:42.842947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:42.843762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:42.849224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:42.849992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:42.853430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:42.857741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:42.859492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:42.866983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:42.868583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:42.890421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:42.895305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:42.896266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:42.899017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:43.359757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a61e5713524b559460b4e70d5922be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd20331b4d04c9c9e841cb31be672bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:43.390243 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d5ba3e0-62ff-4347-b9df-9360b58f30f5 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 200 len: 1465 microversion: 2.1 time: 0.576461 Oct 27 10:34:43.392741 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2752/5703] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:42 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 1465 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:43.407563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:43.431466 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5f7c518-062a-4eb8-8d8f-fe6a01c2ecf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 200 len: 1613 microversion: 2.1 time: 0.580366 Oct 27 10:34:43.434245 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2952/5704] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:42 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 1613 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:43.440147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b1085572-aa3c-46fa-b39f-16ba1130a6d8 req-af0bc4a1-b07f-4793-b796-3f30f3a1475d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1029ec9d-7728-46b2-8231-2ad6cdc9386b", "name": "network-vif-deleted", "tag": "5acc6612-4bce-4a91-852b-0620ccf06a9b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:43.472535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b1085572-aa3c-46fa-b39f-16ba1130a6d8 req-af0bc4a1-b07f-4793-b796-3f30f3a1475d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:43.483792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b1085572-aa3c-46fa-b39f-16ba1130a6d8 req-af0bc4a1-b07f-4793-b796-3f30f3a1475d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:43.485252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b1085572-aa3c-46fa-b39f-16ba1130a6d8 req-af0bc4a1-b07f-4793-b796-3f30f3a1475d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:43.532786 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b1085572-aa3c-46fa-b39f-16ba1130a6d8 req-af0bc4a1-b07f-4793-b796-3f30f3a1475d service nova] Creating event network-vif-deleted:5acc6612-4bce-4a91-852b-0620ccf06a9b for instance 1029ec9d-7728-46b2-8231-2ad6cdc9386b on n-h2-854663-10 Oct 27 10:34:43.557126 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b1085572-aa3c-46fa-b39f-16ba1130a6d8 req-af0bc4a1-b07f-4793-b796-3f30f3a1475d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153599 Oct 27 10:34:43.557126 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2753/5705] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:44.421998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:44.423898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] [instance: 1029ec9d-7728-46b2-8231-2ad6cdc9386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:44.446787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:44.450563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:44.451251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:44.452335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:44.452836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:44.460247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:44.461010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:44.470215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:44.499807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:44.500425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:44.513464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:44.514558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:44.515054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:44.520144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:44.541098 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] HTTP exception thrown: Instance 1029ec9d-7728-46b2-8231-2ad6cdc9386b could not be found. Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Request method failure captured: Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b HTTP/1.1 Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl6abYDsr1gJFktcqJqDKbX0kfRbcfE0ECR6i2HwGsFUcYIa9YX6TKxB_i17LNPSmtc9TI1Kf66HRFNEqELWHvCshV_BCoA19U5bNGLi0djvovQwnU3r6fMYkTWQsOEvcicGhSYptABr2lCplQ9tV2h5c4jGUjWyMUmgRAMaQRfBm6I Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 4dd20331b4d04c9c9e841cb31be672bb Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestServerAdvancedOps-2132963484 Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4dd20331b4d04c9c9e841cb31be672bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4dd20331b4d04c9c9e841cb31be672bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4dd20331b4d04c9c9e841cb31be672bb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4dd20331b4d04c9c9e841cb31be672bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestServerAdvancedOps-2132963484 Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 4dd20331b4d04c9c9e841cb31be672bb Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestServerAdvancedOps-2132963484 Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestServerAdvancedOps-2132963484-project Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c7a61e5713524b559460b4e70d5922be Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestServerAdvancedOps-2132963484-project Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 1029ec9d-7728-46b2-8231-2ad6cdc9386b could not be found. Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1029ec9d-7728-46b2-8231-2ad6cdc9386b'} Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1029ec9d-7728-46b2-8231-2ad6cdc9386b could not be found. Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1029ec9d-7728-46b2-8231-2ad6cdc9386b could not be found. Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:44.542706 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.547887 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:44.547887 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:44.547887 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:44.547887 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:44.547887 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:44.547887 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1029ec9d-7728-46b2-8231-2ad6cdc9386b could not be found. Oct 27 10:34:44.547887 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.547887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] Returning 404 to user: Instance 1029ec9d-7728-46b2-8231-2ad6cdc9386b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:44.547887 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6d8d6db-d6e9-4c79-a7b4-a65185545c72 tempest-TestServerAdvancedOps-2132963484 tempest-TestServerAdvancedOps-2132963484-project] 10.222.0.76 "GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b" status: 404 len: 111 microversion: 2.1 time: 0.127359 Oct 27 10:34:44.559913 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2953/5706] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:44 2022] GET /compute/v2.1/servers/1029ec9d-7728-46b2-8231-2ad6cdc9386b => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:34:44.582800 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 HTTP/1.1 Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6'} Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:44.590743 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.597702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:44.597702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:44.597702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:44.597702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:44.597702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:44.597702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:34:44.597702 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:44.602445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:44.609264 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93cb42fb-b667-4613-be7c-62179631bd0b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 404 len: 111 microversion: 2.1 time: 0.153926 Oct 27 10:34:44.610672 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2754/5707] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:44 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:34:44.620891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-821ca173-9a8c-45b2-b3aa-4486363126be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '.version_select at 0x7f6d5a9fec10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:44.660395 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-821ca173-9a8c-45b2-b3aa-4486363126be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763209385" status: 202 len: 0 microversion: 2.1 time: 0.044612 Oct 27 10:34:44.664910 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2954/5708] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:34:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763209385 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:45.651597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-748b0390-cc82-46fd-b8b7-03f838a2dfd9 req-12e08228-2777-4ed8-8d5e-7b5e26c7adc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6", "name": "network-vif-deleted", "tag": "c9a469c2-6c4c-46e2-b410-6a754bd0f6cb"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:45.674235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-748b0390-cc82-46fd-b8b7-03f838a2dfd9 req-12e08228-2777-4ed8-8d5e-7b5e26c7adc9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:45.677278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-748b0390-cc82-46fd-b8b7-03f838a2dfd9 req-12e08228-2777-4ed8-8d5e-7b5e26c7adc9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:45.677922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-748b0390-cc82-46fd-b8b7-03f838a2dfd9 req-12e08228-2777-4ed8-8d5e-7b5e26c7adc9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:45.728295 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-748b0390-cc82-46fd-b8b7-03f838a2dfd9 req-12e08228-2777-4ed8-8d5e-7b5e26c7adc9 service nova] Creating event network-vif-deleted:c9a469c2-6c4c-46e2-b410-6a754bd0f6cb for instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 on n-h1-854663-10 Oct 27 10:34:45.756879 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-748b0390-cc82-46fd-b8b7-03f838a2dfd9 req-12e08228-2777-4ed8-8d5e-7b5e26c7adc9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107932 Oct 27 10:34:45.760983 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2755/5709] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:48.738886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:48.739703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:48.770067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:48.776453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:48.777565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:48.783897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:48.786446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:48.789572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:48.861449 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] HTTP exception thrown: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Request method failure captured: Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b HTTP/1.1 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl0M9aep192vrh8vl0CuTrVUlGgRv_AffJmkjgTXD_8O-lz_F1FWGr2iqRtKJ6FR6zizWijlmifwzUgfjYZg_5NgxXhfOO1gX1SYoKDczh-ni_jqu577BxWN_cUiIxfLAtBpcJ1F-OYpSSGUxjBXlLyJXbuwAAqJaf8RYs3rFgZ1-dU Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2ac83c84f1234dea80c2b074896559c8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 742c83e928b64f588265112ea7f4c3c9 Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'aba912bf-5c13-4318-9f4b-e9af04d7e03b'} Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:48.889095 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:48.895149 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:48.914435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Returning 404 to user: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:48.920727 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f1a8bc4-6949-4095-ae0e-7da5c10097b8 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "DELETE /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 404 len: 111 microversion: 2.20 time: 0.185833 Oct 27 10:34:48.925934 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2955/5710] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:34:48 2022] DELETE /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:34:48.931295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:48.931995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: aba912bf-5c13-4318-9f4b-e9af04d7e03b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:48.968722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:48.969442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:48.969888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:48.970646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:48.971096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:48.974905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:49.052009 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] HTTP exception thrown: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Request method failure captured: Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b HTTP/1.1 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl0M9aep192vrh8vl0CuTrVUlGgRv_AffJmkjgTXD_8O-lz_F1FWGr2iqRtKJ6FR6zizWijlmifwzUgfjYZg_5NgxXhfOO1gX1SYoKDczh-ni_jqu577BxWN_cUiIxfLAtBpcJ1F-OYpSSGUxjBXlLyJXbuwAAqJaf8RYs3rFgZ1-dU Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2ac83c84f1234dea80c2b074896559c8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 742c83e928b64f588265112ea7f4c3c9 Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'aba912bf-5c13-4318-9f4b-e9af04d7e03b'} Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:49.057202 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:49.062396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:49.062396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:49.062396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:49.062396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:49.062396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:49.062396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:49.062396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. Oct 27 10:34:49.062396 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:49.072141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Returning 404 to user: Instance aba912bf-5c13-4318-9f4b-e9af04d7e03b could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:49.081879 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5fc41a00-0099-4c5d-932f-dcffa1afcf4d tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b" status: 404 len: 111 microversion: 2.20 time: 0.154519 Oct 27 10:34:49.092468 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2756/5711] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:34:48 2022] GET /compute/v2.1/servers/aba912bf-5c13-4318-9f4b-e9af04d7e03b => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:34:49.815394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79d7c1a0-01d2-436c-8f5b-d6abb53355a1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: .version_select at 0x7f6d5be831f0>, body: {"keypair": {"name": "tempest-keypair-1949127924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPY6PTrjKLC+n0KR68CmXL5wKAiDEr8djvPRuSpkb9PF+zSKHICnUcAh5PPlfuaMHqRKUCWMEqUHssMNk9Agpv8uCoOR2+R/p8gGZCoxWpk4C2+HhzJzUwLuKAHlASVGRQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:49.886706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-79d7c1a0-01d2-436c-8f5b-d6abb53355a1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for project 7e188614201142b089c88d6c819922df. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:34:49.913670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-79d7c1a0-01d2-436c-8f5b-d6abb53355a1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for user 258cd38b77cb4f63950f937ec3bdb134 and project 7e188614201142b089c88d6c819922df. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:34:49.990292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79d7c1a0-01d2-436c-8f5b-d6abb53355a1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179556 Oct 27 10:34:49.991271 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2956/5712] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:34:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:56.006701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1898534975", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "f72bec83-aaec-4c68-a41a-e647210e89ab"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:56.025687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:56.105136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1181463124", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2b52e2f-b838-490c-bf1e-3da0faf47ab8"}], "security_groups": [{"name": "tempest-securitygroup--342489310"}], "key_name": "tempest-keypair-1949127924", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:56.163796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] validate_networks() for [('f72bec83-aaec-4c68-a41a-e647210e89ab', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:34:56.429610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] validate_networks() for [('a2b52e2f-b838-490c-bf1e-3da0faf47ab8', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:34:57.612113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:34:57.612737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:34:57.613226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:34:57.613676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:34:57.614291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:34:57.635577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:57.642655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:57.644294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:57.648383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:57.649131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:57.651699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:57.666101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:34:57.667400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:34:57.667886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:34:57.668527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:34:57.669266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:34:57.702681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:57.706283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:57.706936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:57.710330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:57.711976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:57.714004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:57.732041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Getting quotas for project 2f52cd188c674356adeb79809d4230f0. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:34:57.743052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Getting quotas for user be74fa8da9634b2f95cf7818583f52c8 and project 2f52cd188c674356adeb79809d4230f0. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:34:57.766622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for project 7e188614201142b089c88d6c819922df. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:34:57.781421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:34:57.787217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:34:57.794745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for user 258cd38b77cb4f63950f937ec3bdb134 and project 7e188614201142b089c88d6c819922df. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:34:57.834817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:34:57.839325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:34:57.914200 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93d7d526-57f5-4f54-a911-a4b2053e7ee4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.386765 Oct 27 10:34:57.917838 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2757/5713] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:34:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:34:57.927619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:57.934399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:57.953463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:57.954484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:57.957669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:57.958959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:57.960308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:57.968362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:58.004888 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f13582f-d2bf-4019-b39b-6380bf06b00d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.901500 Oct 27 10:34:58.008560 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2957/5714] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:34:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:34:58.013913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb77589b-dc96-4e62-add8-5c754219fc42 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:58.028431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb77589b-dc96-4e62-add8-5c754219fc42 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:58.036229 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] HTTP exception thrown: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Request method failure captured: Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 HTTP/1.1 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl0M9aep192vrh8vl0CuTrVUlGgRv_AffJmkjgTXD_8O-lz_F1FWGr2iqRtKJ6FR6zizWijlmifwzUgfjYZg_5NgxXhfOO1gX1SYoKDczh-ni_jqu577BxWN_cUiIxfLAtBpcJ1F-OYpSSGUxjBXlLyJXbuwAAqJaf8RYs3rFgZ1-dU Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2ac83c84f1234dea80c2b074896559c8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 742c83e928b64f588265112ea7f4c3c9 Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39'} Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:58.041655 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.049132 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.055392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Returning 404 to user: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:58.057288 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5530b0dd-53ef-4f34-b183-76933c8fdb52 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 404 len: 111 microversion: 2.20 time: 0.137348 Oct 27 10:34:58.068289 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2758/5715] 10.222.0.76 () {60 vars in 1280 bytes} [Thu Oct 27 10:34:57 2022] DELETE /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:34:58.073717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d88a50d-9877-4467-8956-21ec78b714d2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:58.075396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d88a50d-9877-4467-8956-21ec78b714d2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:58.415295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb77589b-dc96-4e62-add8-5c754219fc42 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:58.425457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb77589b-dc96-4e62-add8-5c754219fc42 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1228 microversion: 2.1 time: 0.415443 Oct 27 10:34:58.442875 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2958/5716] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:58 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1228 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:58.464057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:58.465037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] [instance: b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:58.483514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:58.484467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:58.485231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:58.487056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:58.487657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:58.488384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:58.495802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d88a50d-9877-4467-8956-21ec78b714d2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:58.510302 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] HTTP exception thrown: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Request method failure captured: Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 HTTP/1.1 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl0M9aep192vrh8vl0CuTrVUlGgRv_AffJmkjgTXD_8O-lz_F1FWGr2iqRtKJ6FR6zizWijlmifwzUgfjYZg_5NgxXhfOO1gX1SYoKDczh-ni_jqu577BxWN_cUiIxfLAtBpcJ1F-OYpSSGUxjBXlLyJXbuwAAqJaf8RYs3rFgZ1-dU Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2ac83c84f1234dea80c2b074896559c8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2ac83c84f1234dea80c2b074896559c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2ac83c84f1234dea80c2b074896559c8 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730832010 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 742c83e928b64f588265112ea7f4c3c9 Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730832010-project Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39'} Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.512508 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:58.518151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.518151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:58.518151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:58.518151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:58.518151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:58.518151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:58.518151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. Oct 27 10:34:58.518151 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:34:58.518151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] Returning 404 to user: Instance b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:58.519596 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82b5669a-4f90-4bc6-9464-3338162e1ae1 tempest-AttachVolumeShelveTestJSON-730832010 tempest-AttachVolumeShelveTestJSON-730832010-project] 10.222.0.76 "GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39" status: 404 len: 111 microversion: 2.20 time: 0.075432 Oct 27 10:34:58.519944 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d88a50d-9877-4467-8956-21ec78b714d2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1242 microversion: 2.1 time: 0.447519 Oct 27 10:34:58.524943 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2959/5717] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 27 10:34:58 2022] GET /compute/v2.1/servers/b61e71ed-b5e6-4cbd-8bff-78a4de3e8d39 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:34:58.525684 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2759/5718] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:58 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1242 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:59.466126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:59.467154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:59.496492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:59.497012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:59.497451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:59.498327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:59.498782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:59.499209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:59.548764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:59.549434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:59.558787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:59.559280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:59.559718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:59.560557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:59.560971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:59.561402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:59.692787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:59.702988 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-965ea421-d6d6-46e3-ba6a-6890f79edf8d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1224 microversion: 2.1 time: 0.253549 Oct 27 10:34:59.707246 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2960/5719] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:59 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1224 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:59.780489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:59.792276 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-180f6197-d00e-4472-9791-435fe62e77f9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1238 microversion: 2.1 time: 0.248003 Oct 27 10:34:59.801790 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2760/5720] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:59 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1238 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:00.419688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:00.420577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:00.437635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:00.438650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:00.439095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:00.440049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:00.440680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:00.441270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:00.648609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lazy-loading 'services' on Instance uuid 54262900-8cfa-46f1-9450-fba6c0b3290d {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:35:00.730486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:00.731803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:00.740171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:00.741060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:00.741796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:00.742686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:00.743373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:00.743970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:00.828823 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-546a376c-6974-4f99-b067-36d8b007f99f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "DELETE /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/os-volume_attachments/8d850eb2-c74c-49f8-b820-fe5fa34e5110" status: 202 len: 0 microversion: 2.1 time: 0.413794 Oct 27 10:35:00.829769 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2961/5721] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:35:00 2022] DELETE /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/os-volume_attachments/8d850eb2-c74c-49f8-b820-fe5fa34e5110 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:35:00.846507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:00.849790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:00.867929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:00.868806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:00.869801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:00.872200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:00.875062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:00.875802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:00.896928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:00.907171 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b54df9c4-8e4f-46ea-a5ff-7dc3a4984b5f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1280 microversion: 2.1 time: 0.182476 Oct 27 10:35:00.914977 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2761/5722] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:00 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:00.980548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:00.990536 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db360738-88bc-4920-9698-a4f0062c961e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1300 microversion: 2.1 time: 0.157687 Oct 27 10:35:01.004267 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2962/5723] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:00 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:01.943504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:01.944111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:01.968931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:01.969436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:01.969875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:01.970601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:01.971058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:01.971482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:02.020356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:02.021006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:02.043420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:02.043912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:02.044345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:02.045174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:02.045627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:02.046046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:02.129176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:02.138621 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-833c45c9-4f53-408f-a1e7-c37647ab0275 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1286 microversion: 2.1 time: 0.198759 Oct 27 10:35:02.139349 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2762/5724] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:01 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1286 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:02.182859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:02.196344 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e01699cc-7904-4693-a036-25e741602d17 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1300 microversion: 2.1 time: 0.179881 Oct 27 10:35:02.197182 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2963/5725] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:02 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:03.163931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:03.164926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:03.196775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:03.197310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:03.197824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:03.202783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:03.203285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:03.203735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:03.222401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:03.223037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:03.240063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:03.240560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:03.241025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:03.241738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:03.242184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:03.242601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:03.485054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:03.493004 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6e4c460-b883-4c42-8673-e2d21b43c241 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1286 microversion: 2.1 time: 0.333388 Oct 27 10:35:03.493596 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2763/5726] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:03 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1286 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:03.519190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:03.543216 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12a5797e-c1c7-4d9a-aae8-294f52d167f7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1300 microversion: 2.1 time: 0.324986 Oct 27 10:35:03.543858 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2964/5727] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:03 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1300 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:04.519770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:04.521121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:04.539814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:04.541547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:04.542155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:04.543945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:04.550379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:04.553134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:04.571810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:04.573363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:04.584843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:04.609034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:04.610134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:04.610806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:04.613323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:04.614282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:04.614971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:04.639661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=85 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:04.759617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:04.772109 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b342f406-c28a-463b-959e-8353baff5424 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1286 microversion: 2.1 time: 0.257457 Oct 27 10:35:04.775901 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2764/5728] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:04 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1286 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:04.940528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:04.953656 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2858d4f-b51b-4085-941d-25c40204b198 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1367 microversion: 2.1 time: 0.385783 Oct 27 10:35:04.954756 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2965/5729] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:04 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:05.803209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:05.804267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:05.832962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:05.837890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:05.841009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:05.847455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:05.848223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:05.852447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:05.981334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:05.982286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:05.991328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:05.992243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:05.992957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:05.994705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:05.995479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:05.996179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:06.995078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:07.010232 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f39e9c2-82c3-4993-b3a8-68035ab3ae39 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1328 microversion: 2.1 time: 1.209285 Oct 27 10:35:07.015296 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2765/5730] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:05 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1328 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:07.082563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:07.096384 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5812978e-919a-45b4-acb8-30f4015ad055 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1367 microversion: 2.1 time: 1.120323 Oct 27 10:35:07.112408 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2966/5731] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:05 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1367 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:07.214581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-79e5420d-e19f-42aa-80b5-a5f9e0fa0542 req-f6ce2824-26de-4d34-8f2e-5b951fd18fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf11cf55-8f04-467b-814f-de51ffa32347", "tag": "6a2b2f26-7286-44b4-8ce4-97645c85fd47"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:07.240528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-79e5420d-e19f-42aa-80b5-a5f9e0fa0542 req-f6ce2824-26de-4d34-8f2e-5b951fd18fa3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:07.241034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-79e5420d-e19f-42aa-80b5-a5f9e0fa0542 req-f6ce2824-26de-4d34-8f2e-5b951fd18fa3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:07.245229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-79e5420d-e19f-42aa-80b5-a5f9e0fa0542 req-f6ce2824-26de-4d34-8f2e-5b951fd18fa3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:07.275427 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-79e5420d-e19f-42aa-80b5-a5f9e0fa0542 req-f6ce2824-26de-4d34-8f2e-5b951fd18fa3 service nova] Creating event network-changed:6a2b2f26-7286-44b4-8ce4-97645c85fd47 for instance cf11cf55-8f04-467b-814f-de51ffa32347 on n-h1-854663-10 Oct 27 10:35:07.289830 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-79e5420d-e19f-42aa-80b5-a5f9e0fa0542 req-f6ce2824-26de-4d34-8f2e-5b951fd18fa3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078791 Oct 27 10:35:07.292474 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2766/5732] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:08.038947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:08.039588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:08.041874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:08.065227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:08.071392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:08.071966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:08.072771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:08.073258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:08.073688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:08.122524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:08.128079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:08.128895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:08.143162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:08.143643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:08.144077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:08.144813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:08.145271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:08.145681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:08.423058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:08.514364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:09.137402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:09.140286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:09.149512 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-931cdf02-a1b8-44be-864e-d9602b5b35d3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1328 microversion: 2.1 time: 1.114377 Oct 27 10:35:09.152803 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2967/5733] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:08 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1328 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:09.167514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:09.177748 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34bf5bb9-9ac7-49bd-bad5-a1a21ac4db61 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1367 microversion: 2.1 time: 1.056130 Oct 27 10:35:09.183944 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2767/5734] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:08 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1367 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:09.323474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-40958737-00a6-4084-ab31-da7a5ded01d9 req-99b8d478-6d36-45c3-b1c8-21a29f4ead91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3393975-8788-44ff-a248-260af4b31def", "tag": "4cec72ee-9c2e-44c7-bcf1-bba5d378d940"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:09.367137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-40958737-00a6-4084-ab31-da7a5ded01d9 req-99b8d478-6d36-45c3-b1c8-21a29f4ead91 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:09.367706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-40958737-00a6-4084-ab31-da7a5ded01d9 req-99b8d478-6d36-45c3-b1c8-21a29f4ead91 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:09.368208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-40958737-00a6-4084-ab31-da7a5ded01d9 req-99b8d478-6d36-45c3-b1c8-21a29f4ead91 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:09.384677 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-40958737-00a6-4084-ab31-da7a5ded01d9 req-99b8d478-6d36-45c3-b1c8-21a29f4ead91 service nova] Creating event network-changed:4cec72ee-9c2e-44c7-bcf1-bba5d378d940 for instance f3393975-8788-44ff-a248-260af4b31def on n-h1-854663-10 Oct 27 10:35:09.390307 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-40958737-00a6-4084-ab31-da7a5ded01d9 req-99b8d478-6d36-45c3-b1c8-21a29f4ead91 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071518 Oct 27 10:35:09.408300 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2968/5735] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:10.174856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:10.182756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:10.213631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:10.215103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:10.241662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:10.243674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:10.247475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:10.251537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:10.251725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:10.254689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:10.255723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:10.258660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:10.258987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:10.259701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:10.260324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:10.260972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:10.767332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:10.775625 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d357bed-601b-4b9d-bf66-2c2a68a099b2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1367 microversion: 2.1 time: 0.567944 Oct 27 10:35:10.783549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:10.788786 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2969/5736] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:10 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:10.797565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72980963-7506-4002-89aa-8ce384397b65 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:10.808427 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bb1b34ae-f805-4ab2-84a1-3bdf8bd92837 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1328 microversion: 2.1 time: 0.638355 Oct 27 10:35:10.809697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2768/5737] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:10 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1328 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:10.814361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72980963-7506-4002-89aa-8ce384397b65 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:10.815305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72980963-7506-4002-89aa-8ce384397b65 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:10.815863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72980963-7506-4002-89aa-8ce384397b65 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:10.844904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-72980963-7506-4002-89aa-8ce384397b65 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:35:10.907907 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72980963-7506-4002-89aa-8ce384397b65 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/action" status: 202 len: 0 microversion: 2.1 time: 0.115554 Oct 27 10:35:10.909083 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2970/5738] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:35:10 2022] POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:35:10.923074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:10.923780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:10.934283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:10.934749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:10.935507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:10.936553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:10.937178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:10.937742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:11.256251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:11.267398 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2cccc3f9-14a1-4cfc-a6a5-064329bfa708 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1677 microversion: 2.1 time: 0.351893 Oct 27 10:35:11.268872 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2769/5739] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:10 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1677 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:11.814982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:11.816206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:11.823870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:11.824543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:11.825017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:11.825865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:11.826371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:11.826907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:11.839518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:11.840136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:11.850065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:11.850561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:11.851033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:11.851839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:11.852289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:11.863118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:12.146104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:12.156371 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5cf0fbc-4e98-4dd2-9dc0-22139913da53 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1367 microversion: 2.1 time: 0.345605 Oct 27 10:35:12.156969 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2971/5740] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:11 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:12.191531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:12.202753 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9be2a19d-d73c-4e56-8a2f-38aae9a99747 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1328 microversion: 2.1 time: 0.367070 Oct 27 10:35:12.217803 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2770/5741] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:11 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1328 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:12.291519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:12.292433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:12.318870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:12.318870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:12.318870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:12.318870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:12.318870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:12.318870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:12.582186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:12.600505 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33833bd8-c52b-4a51-b64f-0b0a22ac1877 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1677 microversion: 2.1 time: 0.312764 Oct 27 10:35:12.605061 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2972/5742] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:12 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1677 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:13.181223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:13.181858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:13.203171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:13.203809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:13.204257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:13.205067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:13.205794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:13.206417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:13.226823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:13.227583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:13.239504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:13.241542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:13.242314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:13.243056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:13.244570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:13.245739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:13.547565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:13.557703 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d2a812b-13d4-4e2e-a69c-09eabac253aa tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1367 microversion: 2.1 time: 0.381321 Oct 27 10:35:13.558312 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2771/5743] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:13 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:13.576925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:13.586689 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae830c02-c5f2-4c3e-b5da-f01b13a2cd43 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1328 microversion: 2.1 time: 0.364488 Oct 27 10:35:13.603440 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2973/5744] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:13 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1328 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:13.627717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:13.628757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:13.643308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:13.644399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:13.645304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:13.646303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:13.646972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:13.647502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:13.823601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:13.832431 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15830a87-5737-44a3-a52a-3c02eb880d01 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1677 microversion: 2.1 time: 0.209743 Oct 27 10:35:13.833262 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2772/5745] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:13 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:14.283077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-31325cc0-c055-41d9-8668-28388d5de4c3 req-bfaaa0c3-a3f4-4cd7-ac75-7a303b5c4f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf11cf55-8f04-467b-814f-de51ffa32347", "name": "network-vif-plugged", "status": "completed", "tag": "6a2b2f26-7286-44b4-8ce4-97645c85fd47"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:14.297593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-31325cc0-c055-41d9-8668-28388d5de4c3 req-bfaaa0c3-a3f4-4cd7-ac75-7a303b5c4f66 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:14.298663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-31325cc0-c055-41d9-8668-28388d5de4c3 req-bfaaa0c3-a3f4-4cd7-ac75-7a303b5c4f66 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:14.299094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-31325cc0-c055-41d9-8668-28388d5de4c3 req-bfaaa0c3-a3f4-4cd7-ac75-7a303b5c4f66 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:14.315213 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-31325cc0-c055-41d9-8668-28388d5de4c3 req-bfaaa0c3-a3f4-4cd7-ac75-7a303b5c4f66 service nova] Creating event network-vif-plugged:6a2b2f26-7286-44b4-8ce4-97645c85fd47 for instance cf11cf55-8f04-467b-814f-de51ffa32347 on n-h1-854663-10 Oct 27 10:35:14.321107 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-31325cc0-c055-41d9-8668-28388d5de4c3 req-bfaaa0c3-a3f4-4cd7-ac75-7a303b5c4f66 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044055 Oct 27 10:35:14.322477 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2974/5746] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:14.582547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:14.583116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:14.594219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:14.594634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:14.597899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:14.598666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:14.599131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:14.599576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:14.612271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:14.613136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:14.626212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:14.638813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:14.649132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:14.650132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:14.650528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:14.651328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:15.070491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:15.085311 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0df2bc15-8d3d-4a64-922d-97c1818a6cdb tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1367 microversion: 2.1 time: 0.507025 Oct 27 10:35:15.086401 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2773/5747] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:14 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1367 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:15.091272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:15.092056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:15.104082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:15.104573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:15.105063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:15.105751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:15.106196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:15.112381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:15.143369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:15.160391 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8e8f3d68-1021-4ff1-9005-6ad03076a137 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1328 microversion: 2.1 time: 0.552336 Oct 27 10:35:15.175512 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2975/5748] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:14 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1328 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:15.295780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:15.306721 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bcfcf293-2441-46e2-aaca-818cf33c6c5b tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1677 microversion: 2.1 time: 0.218748 Oct 27 10:35:15.307996 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2774/5749] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:15 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:16.112455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:16.113892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:16.127299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:16.128139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:16.128597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:16.131437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:16.134327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:16.134721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:16.187306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:16.187925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:16.203035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:16.206346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:16.209047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:16.210394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:16.211358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:16.212161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:16.454123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:16.463296 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-37bab746-f5cb-4bab-bc09-9aebc48a02b4 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1328 microversion: 2.1 time: 0.280594 Oct 27 10:35:16.467886 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2775/5750] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:16 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1328 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:16.475975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:16.486917 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53dff411-ac53-49ac-8f34-1e733b21be36 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1556 microversion: 2.1 time: 0.380850 Oct 27 10:35:16.489479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:16.490346 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2976/5751] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:16 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1556 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:16.492855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:16.498413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-37cbe916-7564-4940-bfc7-0f3a7cc99bbe req-b8926dab-81ca-4849-a634-1c474c940803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3393975-8788-44ff-a248-260af4b31def", "name": "network-vif-plugged", "status": "completed", "tag": "4cec72ee-9c2e-44c7-bcf1-bba5d378d940"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:16.506500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:16.507059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:16.512393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:16.513233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:16.513763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:16.514183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:16.525329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-37cbe916-7564-4940-bfc7-0f3a7cc99bbe req-b8926dab-81ca-4849-a634-1c474c940803 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:16.525831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-37cbe916-7564-4940-bfc7-0f3a7cc99bbe req-b8926dab-81ca-4849-a634-1c474c940803 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:16.526264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-37cbe916-7564-4940-bfc7-0f3a7cc99bbe req-b8926dab-81ca-4849-a634-1c474c940803 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:16.557366 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-37cbe916-7564-4940-bfc7-0f3a7cc99bbe req-b8926dab-81ca-4849-a634-1c474c940803 service nova] Creating event network-vif-plugged:4cec72ee-9c2e-44c7-bcf1-bba5d378d940 for instance f3393975-8788-44ff-a248-260af4b31def on n-h1-854663-10 Oct 27 10:35:16.571882 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-37cbe916-7564-4940-bfc7-0f3a7cc99bbe req-b8926dab-81ca-4849-a634-1c474c940803 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077517 Oct 27 10:35:16.590083 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2977/5752] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:16.602767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fe7ec2d-fb18-4b5f-8181-9fc9f8ccdc39 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:16.603522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fe7ec2d-fb18-4b5f-8181-9fc9f8ccdc39 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:16.619265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fe7ec2d-fb18-4b5f-8181-9fc9f8ccdc39 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:16.620109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fe7ec2d-fb18-4b5f-8181-9fc9f8ccdc39 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:16.624998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fe7ec2d-fb18-4b5f-8181-9fc9f8ccdc39 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:16.626834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fe7ec2d-fb18-4b5f-8181-9fc9f8ccdc39 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:16.627389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fe7ec2d-fb18-4b5f-8181-9fc9f8ccdc39 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:16.628430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fe7ec2d-fb18-4b5f-8181-9fc9f8ccdc39 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:16.810517 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fe7ec2d-fb18-4b5f-8181-9fc9f8ccdc39 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.218693 Oct 27 10:35:16.811359 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2978/5753] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:35:16 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:16.905950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:16.914683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f22ad441-e2f4-4360-8ca6-b93e72497eec tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1677 microversion: 2.1 time: 0.445472 Oct 27 10:35:16.933166 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2776/5754] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:16 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1677 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:17.488504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:17.489779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:17.498670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:17.499356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:17.500018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:17.500969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:17.502161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:17.502935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:17.811715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:17.824934 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4d579cc-fc5b-418c-ae47-70083be0f8e3 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1328 microversion: 2.1 time: 0.341620 Oct 27 10:35:17.825813 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2979/5755] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:17 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1328 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:17.942428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:17.944112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:17.957768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:17.958402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:17.959606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:17.960850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:17.961517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:17.962133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:18.252873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c95b05fb-9a67-4315-937b-4c9fce170050 req-348d2bb2-19cd-476d-b5ec-e6dca9429e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf11cf55-8f04-467b-814f-de51ffa32347", "tag": "6a2b2f26-7286-44b4-8ce4-97645c85fd47"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:18.277345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c95b05fb-9a67-4315-937b-4c9fce170050 req-348d2bb2-19cd-476d-b5ec-e6dca9429e61 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:18.277957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c95b05fb-9a67-4315-937b-4c9fce170050 req-348d2bb2-19cd-476d-b5ec-e6dca9429e61 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:18.278936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:18.280397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c95b05fb-9a67-4315-937b-4c9fce170050 req-348d2bb2-19cd-476d-b5ec-e6dca9429e61 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:18.287646 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce4cdb81-e14a-4f7f-bc2b-2d374b224ffb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1677 microversion: 2.1 time: 0.349476 Oct 27 10:35:18.288387 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2777/5756] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:17 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1677 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:18.308627 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c95b05fb-9a67-4315-937b-4c9fce170050 req-348d2bb2-19cd-476d-b5ec-e6dca9429e61 service nova] Creating event network-changed:6a2b2f26-7286-44b4-8ce4-97645c85fd47 for instance cf11cf55-8f04-467b-814f-de51ffa32347 on n-h1-854663-10 Oct 27 10:35:18.323572 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c95b05fb-9a67-4315-937b-4c9fce170050 req-348d2bb2-19cd-476d-b5ec-e6dca9429e61 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074706 Oct 27 10:35:18.326308 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2980/5757] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:35:18.849320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:18.850778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:18.864245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:18.865981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:18.867182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:18.868971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:18.871045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:18.874803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:19.228638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:19.237100 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b650c8d2-cb4b-4193-8bd7-07b521283f5e tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1528 microversion: 2.1 time: 0.392754 Oct 27 10:35:19.240482 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2778/5758] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:18 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1528 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:19.274715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:19.276242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:19.298110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:19.298615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:19.302098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:19.304361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:19.306101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:19.306559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:19.315817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:19.317122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:19.342508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:19.347959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:19.350075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:19.358474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:19.360540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:19.361346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:19.742706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:19.753538 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e8a5161-6dbd-4b88-89c5-2d89c1c5f0d6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1677 microversion: 2.1 time: 0.441486 Oct 27 10:35:19.754140 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2779/5759] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:19 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1677 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:19.760950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:19.775492 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52223b58-e2f9-448d-976a-74fdf84c0b4f tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1528 microversion: 2.1 time: 0.508863 Oct 27 10:35:19.779390 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2981/5760] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:19 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1528 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:20.120811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:20.121473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:20.136471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.137726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.138245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.138967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.146749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.147254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.171380 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] HTTP exception thrown: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Request method failure captured: Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def HTTP/1.1 Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl7Pifr4yTM5XeGbe4izZRxoa5JBQgjSj_p5v5grC4MOS5Grw5X61h3RrQnTuYN6Or6HeJWICvn9KS1zmzYRP_pXZXAeMH1WvaxvpFSUmtCZALogXfkmUteoCGRWZIl-L6EudR_Vgs8phjuLZz7XXuZ7WDW3EsSfebBn9yH3Dlg5erQ Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2639b8a575374ed58fbed68ba3baeb8b Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1087744244 Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2639b8a575374ed58fbed68ba3baeb8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2639b8a575374ed58fbed68ba3baeb8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2639b8a575374ed58fbed68ba3baeb8b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2639b8a575374ed58fbed68ba3baeb8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1087744244 Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2639b8a575374ed58fbed68ba3baeb8b Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1087744244 Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1087744244-project Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: ac2a07fb5e314fe38ef2f0a23995f583 Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1087744244-project Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f3393975-8788-44ff-a248-260af4b31def'} Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:35:20.173607 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Returning 404 to user: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-137c2563-f8aa-4691-8075-682933c841d9 tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 404 len: 111 microversion: 2.1 time: 0.376297 Oct 27 10:35:20.176634 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2780/5761] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:35:19 2022] DELETE /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 111 bytes in 377 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:35:20.189831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:20.190573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:20.197928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.198510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.199023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.199765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.200222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.200836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.355633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:20.365375 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec4175e3-29f8-4604-968f-de5b1b8e9c1a tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1528 microversion: 2.1 time: 0.181823 Oct 27 10:35:20.381090 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2982/5762] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:20 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1528 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:20.392549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Action: 'update', calling method: >, body: {"server": {"name": "f3393975-8788-44ff-a248-260af4b31def_new"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:20.395508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:20.402268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.402754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.403188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.403948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.404593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.405054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.421816 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] HTTP exception thrown: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Request method failure captured: Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: request: PUT /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def HTTP/1.1 Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 64 Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl7Pifr4yTM5XeGbe4izZRxoa5JBQgjSj_p5v5grC4MOS5Grw5X61h3RrQnTuYN6Or6HeJWICvn9KS1zmzYRP_pXZXAeMH1WvaxvpFSUmtCZALogXfkmUteoCGRWZIl-L6EudR_Vgs8phjuLZz7XXuZ7WDW3EsSfebBn9yH3Dlg5erQ Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2639b8a575374ed58fbed68ba3baeb8b Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1087744244 Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2639b8a575374ed58fbed68ba3baeb8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2639b8a575374ed58fbed68ba3baeb8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2639b8a575374ed58fbed68ba3baeb8b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2639b8a575374ed58fbed68ba3baeb8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1087744244 Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2639b8a575374ed58fbed68ba3baeb8b Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1087744244 Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1087744244-project Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: ac2a07fb5e314fe38ef2f0a23995f583 Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1087744244-project Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: {"server": {"name": "f3393975-8788-44ff-a248-260af4b31def_new"}} Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f3393975-8788-44ff-a248-260af4b31def', 'body': {'server': {'name': 'f3393975-8788-44ff-a248-260af4b31def_new'}}} Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:35:20.423700 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:20.427474 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:35:20.429773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] Returning 404 to user: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:35:20.430178 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-89e79c84-83c3-44f1-aeae-5b1cf168587d tempest-ServersNegativeTestMultiTenantJSON-1087744244 tempest-ServersNegativeTestMultiTenantJSON-1087744244-project] 10.222.0.76 "PUT /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 404 len: 111 microversion: 2.1 time: 0.041880 Oct 27 10:35:20.431282 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2781/5763] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 10:35:20 2022] PUT /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:35:20.441893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:20.442487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:20.451741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.452246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.452712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.454005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.455184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.455754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.493031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:35:20.587361 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ebbae66-9918-4b18-8af6-95a8ef294aba tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 204 len: 0 microversion: 2.1 time: 0.150058 Oct 27 10:35:20.588411 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2983/5764] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:35:20 2022] DELETE /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:35:20.599026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:20.599901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:20.608364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.609043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.609779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.610720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.611527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.612023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.781272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:20.782341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:20.790485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.791223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.791851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.792883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:20.793518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:20.794276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:20.819140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:20.822040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:20.837051 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3cff055f-7886-4ddd-8a51-65756fdc0824 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1534 microversion: 2.1 time: 0.243546 Oct 27 10:35:20.841394 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2782/5765] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:20 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1534 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:21.013844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:21.016757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:21.023545 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b7b4d93-6c23-4689-afa7-76756122520e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1677 microversion: 2.1 time: 0.247570 Oct 27 10:35:21.024353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2984/5766] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:20 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:21.864631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:21.865432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:21.875106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:21.875584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:21.876419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:21.877345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:21.878506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:21.879241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:22.057869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:22.061173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:22.081510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:22.082149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:22.083466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:22.085420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:22.086056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:22.087821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:22.210690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:22.219522 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c852fbec-cf46-49af-b7be-22e70689a031 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1534 microversion: 2.1 time: 0.359916 Oct 27 10:35:22.220713 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2783/5767] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:21 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1534 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:22.432412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:22.464216 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c50f421c-a1b6-4f03-94b8-b51af27f0395 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1654 microversion: 2.1 time: 0.405802 Oct 27 10:35:22.467526 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2985/5768] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:22 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1654 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:22.490701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-263711d5-0037-45d1-90b2-6f41456cfa47 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:22.508019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-263711d5-0037-45d1-90b2-6f41456cfa47 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:22.508927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-263711d5-0037-45d1-90b2-6f41456cfa47 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:22.511872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-263711d5-0037-45d1-90b2-6f41456cfa47 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:22.570620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-263711d5-0037-45d1-90b2-6f41456cfa47 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Going to try to start instance {{(pid=120719) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 10:35:22.648597 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-263711d5-0037-45d1-90b2-6f41456cfa47 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/action" status: 202 len: 0 microversion: 2.1 time: 0.163829 Oct 27 10:35:22.658921 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2784/5769] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:35:22 2022] POST /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:35:22.666481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:22.667479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:22.679941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:22.680441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:22.681481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:22.682840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:22.683264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:22.683692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:23.194327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:23.204389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6d670c0-aee8-4c8b-9a47-1b3ca9559401 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1663 microversion: 2.1 time: 0.542511 Oct 27 10:35:23.209423 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2986/5770] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:22 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1663 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:23.246397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:23.248241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:23.264065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:23.264555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:23.265139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:23.266011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:23.266473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:23.266906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:23.595826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:23.620556 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-813fb097-b597-4973-a578-e5fa8edba977 tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1534 microversion: 2.1 time: 0.381409 Oct 27 10:35:23.621240 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2785/5771] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:23 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1534 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:23.933107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cd8ced7f-d9a7-4d5a-862a-2517a64471e5 req-17e2a2a9-6b63-4267-a67e-3d5ad5b13990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3393975-8788-44ff-a248-260af4b31def", "name": "network-vif-deleted", "tag": "4cec72ee-9c2e-44c7-bcf1-bba5d378d940"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:23.961569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cd8ced7f-d9a7-4d5a-862a-2517a64471e5 req-17e2a2a9-6b63-4267-a67e-3d5ad5b13990 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:23.963683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cd8ced7f-d9a7-4d5a-862a-2517a64471e5 req-17e2a2a9-6b63-4267-a67e-3d5ad5b13990 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:23.964288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cd8ced7f-d9a7-4d5a-862a-2517a64471e5 req-17e2a2a9-6b63-4267-a67e-3d5ad5b13990 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:24.002823 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cd8ced7f-d9a7-4d5a-862a-2517a64471e5 req-17e2a2a9-6b63-4267-a67e-3d5ad5b13990 service nova] Creating event network-vif-deleted:4cec72ee-9c2e-44c7-bcf1-bba5d378d940 for instance f3393975-8788-44ff-a248-260af4b31def on n-h1-854663-10 Oct 27 10:35:24.017903 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cd8ced7f-d9a7-4d5a-862a-2517a64471e5 req-17e2a2a9-6b63-4267-a67e-3d5ad5b13990 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089355 Oct 27 10:35:24.021094 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2987/5772] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:35:24.239753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:24.240899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:24.251371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:24.252609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:24.253572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:24.254481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:24.255852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:24.256438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:24.556387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:24.568954 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd38fc2c-ab25-4c97-a763-1afbd4d8174f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1663 microversion: 2.1 time: 0.333995 Oct 27 10:35:24.573624 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2786/5773] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:24 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1663 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:24.645784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:24.647079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:24.664912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:24.668015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:24.671403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:24.673440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:24.673950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:24.676589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:24.737515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:24.738162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:24.738907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:24.739625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lazy-loading 'fault' on Instance uuid f3393975-8788-44ff-a248-260af4b31def {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:35:24.936361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be74fa8da9634b2f95cf7818583f52c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f52cd188c674356adeb79809d4230f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:24.944888 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-627a35bb-2263-408b-8eaf-149eda174f4d tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 200 len: 1318 microversion: 2.1 time: 0.303898 Oct 27 10:35:24.967764 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2988/5774] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:24 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:25.608360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:25.610137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:25.633782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:25.634283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:25.634729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:25.635447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:25.635904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:25.636329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:25.977530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:25.978166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] [instance: f3393975-8788-44ff-a248-260af4b31def] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:25.990491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:25.994729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:25.995465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:25.996912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:25.999907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:26.000549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:26.047670 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] HTTP exception thrown: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Request method failure captured: Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def HTTP/1.1 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl693_aqYXbTRGDHO-qu7xis58AhTPECLCLt0TZY2LwE-GwQ8j8P7HwsVzABA1jOTI7Ef_S5kSzubz-nAgTE-SCAOpGzL90hFliJL5sOi0etxQT7qjvpMR_btcrZbRyfZXwOKUi26NvHTPnM3NFYWsROPqN427U4KJlOagfG9pYTLwc Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2f52cd188c674356adeb79809d4230f0 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1324065447 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2f52cd188c674356adeb79809d4230f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2f52cd188c674356adeb79809d4230f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2f52cd188c674356adeb79809d4230f0", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2f52cd188c674356adeb79809d4230f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1324065447 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2f52cd188c674356adeb79809d4230f0 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1324065447 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1324065447-project Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: be74fa8da9634b2f95cf7818583f52c8 Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1324065447-project Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'f3393975-8788-44ff-a248-260af4b31def'} Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:26.049851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:35:26.053743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:35:26.053743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:35:26.053743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:35:26.053743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:35:26.053743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:35:26.053743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:35:26.053743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:35:26.053743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. Oct 27 10:35:26.053743 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:35:26.056591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Returning 404 to user: Instance f3393975-8788-44ff-a248-260af4b31def could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:35:26.059252 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def" status: 404 len: 111 microversion: 2.1 time: 0.087241 Oct 27 10:35:26.060212 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2989/5775] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:25 2022] GET /compute/v2.1/servers/f3393975-8788-44ff-a248-260af4b31def => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:35:26.436128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:26.446309 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2907ab95-8e88-44db-9d53-f24c12982fee tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1667 microversion: 2.1 time: 0.844672 Oct 27 10:35:26.465776 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2787/5776] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:25 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1667 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:48.874376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:48.876454 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b75e91d0-028e-48f5-9b5a-32422929cbbe tempest-ServersNegativeTestMultiTenantJSON-1324065447 tempest-ServersNegativeTestMultiTenantJSON-1324065447-project] 10.222.0.76 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002439 Oct 27 10:35:48.877285 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2990/5777] 10.222.0.76 () {56 vars in 886 bytes} [Thu Oct 27 10:35:48 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 10:35:54.998701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f2bc017b-65dc-4ef3-8be0-421a4b1ee6fc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:55.002133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2bc017b-65dc-4ef3-8be0-421a4b1ee6fc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:55.013317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:55.020625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:55.022659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2bc017b-65dc-4ef3-8be0-421a4b1ee6fc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:55.023380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2bc017b-65dc-4ef3-8be0-421a4b1ee6fc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:55.024077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2bc017b-65dc-4ef3-8be0-421a4b1ee6fc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:55.025027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2bc017b-65dc-4ef3-8be0-421a4b1ee6fc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:55.028530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2bc017b-65dc-4ef3-8be0-421a4b1ee6fc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:55.029406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2bc017b-65dc-4ef3-8be0-421a4b1ee6fc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:55.126139 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f2bc017b-65dc-4ef3-8be0-421a4b1ee6fc tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129755 Oct 27 10:35:55.132307 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2788/5778] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:35:54 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:35:55.289503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:55.290076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:55.293942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:55.294821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=25 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:55.307748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:55.317544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:55.318690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:55.321173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:55.322525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:55.323488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:55.417433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:35:55.708174 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c0cb4a4-87a5-44e9-a927-9e264185a077 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "DELETE /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 204 len: 0 microversion: 2.1 time: 0.423393 Oct 27 10:35:55.712197 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2991/5779] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:35:55 2022] DELETE /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:35:55.719124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:55.720654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:55.736261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:55.737281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:55.737748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:55.738486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:55.741272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:55.743400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:56.139716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:56.162147 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76aa6e6e-938b-4f6c-84b4-81f1e80cadea tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1673 microversion: 2.1 time: 0.446092 Oct 27 10:35:56.167917 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2789/5780] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:55 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1673 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:56.252928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02d62dde-a42e-45fb-b54f-3fe20808a461 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:56.253526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02d62dde-a42e-45fb-b54f-3fe20808a461 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:56.263061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02d62dde-a42e-45fb-b54f-3fe20808a461 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:56.263680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02d62dde-a42e-45fb-b54f-3fe20808a461 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:56.264158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02d62dde-a42e-45fb-b54f-3fe20808a461 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:56.271300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02d62dde-a42e-45fb-b54f-3fe20808a461 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:56.272119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02d62dde-a42e-45fb-b54f-3fe20808a461 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:56.274941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02d62dde-a42e-45fb-b54f-3fe20808a461 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:56.342999 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02d62dde-a42e-45fb-b54f-3fe20808a461 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/ips" status: 200 len: 149 microversion: 2.1 time: 0.094455 Oct 27 10:35:56.345078 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2992/5781] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:35:56 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:57.195618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:57.197439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:57.212525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:57.217206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:57.218058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:57.219016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:57.221262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:57.221905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:58.032854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:58.044045 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7202385a-e1c7-4de6-88c9-75793ba430d3 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1673 microversion: 2.1 time: 0.854396 Oct 27 10:35:58.046084 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2790/5782] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:57 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1673 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:58.828466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c62b8e0-0b2b-4ae4-b6d6-f14ac2ab2c70 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] Calling method '.version_select at 0x7f6d5bab1e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:58.946406 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c62b8e0-0b2b-4ae4-b6d6-f14ac2ab2c70 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.499189 Oct 27 10:35:58.947511 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2993/5783] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:35:58 2022] GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f/defaults => generated 371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:58.976265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9cb78dbb-b3d1-4bb5-aaf5-ddb86872dde0 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] Calling method '.version_select at 0x7f6d5ba1c1f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:59.081542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:59.082177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:59.104772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:59.107284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:59.110727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:59.111926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:59.113693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:59.114366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:59.196899 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9cb78dbb-b3d1-4bb5-aaf5-ddb86872dde0 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f" status: 200 len: 371 microversion: 2.1 time: 0.234283 Oct 27 10:35:59.207274 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2791/5784] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 10:35:58 2022] GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f => generated 371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:59.221821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d685f9c8-ae4d-42a7-9e19-8fde34460d5f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:59.224433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d685f9c8-ae4d-42a7-9e19-8fde34460d5f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:59.242614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d685f9c8-ae4d-42a7-9e19-8fde34460d5f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:59.243321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d685f9c8-ae4d-42a7-9e19-8fde34460d5f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:59.243909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d685f9c8-ae4d-42a7-9e19-8fde34460d5f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:59.244816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d685f9c8-ae4d-42a7-9e19-8fde34460d5f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:59.245421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d685f9c8-ae4d-42a7-9e19-8fde34460d5f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:59.246196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d685f9c8-ae4d-42a7-9e19-8fde34460d5f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:59.343241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:59.357036 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20ef4e6d-316f-4e1d-ac04-f10b7eae4d02 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1606 microversion: 2.1 time: 0.288831 Oct 27 10:35:59.357661 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2994/5785] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:59 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1606 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:59.367931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b8952ed-c783-4421-80c5-5621c31f6fa1 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] Calling method '.version_select at 0x7f6d5bab18b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:59.478511 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b8952ed-c783-4421-80c5-5621c31f6fa1 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.119191 Oct 27 10:35:59.494677 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2995/5786] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:35:59 2022] GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f/defaults => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:59.526612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96885cd8-888e-403b-b6c1-dd2c06e191e4 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] Calling method '.version_select at 0x7f6d639679d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:59.685949 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96885cd8-888e-403b-b6c1-dd2c06e191e4 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f" status: 200 len: 371 microversion: 2.1 time: 0.168273 Oct 27 10:35:59.688172 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2996/5787] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 10:35:59 2022] GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f => generated 371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:59.703246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-27d114a6-e5f8-48bf-9fa6-32e7b01e32a4 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] Calling method '.version_select at 0x7f6d5bafd3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:59.803808 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d685f9c8-ae4d-42a7-9e19-8fde34460d5f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.595095 Oct 27 10:35:59.806884 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2792/5788] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:35:59 2022] POST /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 194 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:35:59.901296 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-27d114a6-e5f8-48bf-9fa6-32e7b01e32a4 tempest-QuotasTestJSON-1838655248 tempest-QuotasTestJSON-1838655248-project] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f?user_id=f4327f29b73c4e358c38957f66191665" status: 200 len: 371 microversion: 2.1 time: 0.202242 Oct 27 10:35:59.903217 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2997/5789] 10.222.0.76 () {58 vars in 1323 bytes} [Thu Oct 27 10:35:59 2022] GET /compute/v2.1/os-quota-sets/528a5dfb19a44e9fa0ce233d1828d82f?user_id=f4327f29b73c4e358c38957f66191665 => generated 371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:00.386698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:00.387474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:00.424615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:00.430617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:00.431280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:00.433344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:00.445028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:00.448263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:00.517964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c728445d-bea1-43ab-b40b-06dad9762fb3 req-934ec309-dc61-49f9-944b-ff15b06dfd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54262900-8cfa-46f1-9450-fba6c0b3290d", "name": "network-vif-deleted", "tag": "b7a76215-ca7c-4fff-b3a3-3453340516e8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:00.538323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c728445d-bea1-43ab-b40b-06dad9762fb3 req-934ec309-dc61-49f9-944b-ff15b06dfd51 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:00.540439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c728445d-bea1-43ab-b40b-06dad9762fb3 req-934ec309-dc61-49f9-944b-ff15b06dfd51 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:00.541745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c728445d-bea1-43ab-b40b-06dad9762fb3 req-934ec309-dc61-49f9-944b-ff15b06dfd51 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:00.572827 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c728445d-bea1-43ab-b40b-06dad9762fb3 req-934ec309-dc61-49f9-944b-ff15b06dfd51 service nova] Creating event network-vif-deleted:b7a76215-ca7c-4fff-b3a3-3453340516e8 for instance 54262900-8cfa-46f1-9450-fba6c0b3290d on n-h2-854663-10 Oct 27 10:36:00.594445 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c728445d-bea1-43ab-b40b-06dad9762fb3 req-934ec309-dc61-49f9-944b-ff15b06dfd51 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080073 Oct 27 10:36:00.595722 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2998/5790] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:00.643970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:00.662217 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5666c02-a41d-4c24-9f1f-f66b7139d7ad tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 200 len: 1606 microversion: 2.1 time: 0.281056 Oct 27 10:36:00.663208 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2793/5791] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:00 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 1606 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:01.692492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:01.693223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:01.716286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:01.717310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:01.720878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:01.724570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:01.725414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:01.726775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:01.770638 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] HTTP exception thrown: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Request method failure captured: Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d HTTP/1.1 Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl48MeonzuvrJ4l5gQ8Fzoi4OR2-AUTVhQ3to3tyHw6Igfw6Q9J6pF83lM6w1KVA2yEMEvUQkhwqhcuAf0JPMsalnf2Vv1ownF-gfWGFqY4Nk6TTkaq6_4RYYIF0pF85SwR9pVk7mVDR6RsVSqBWnzbw8ZOJCsbbUhK77sLOMK4Zoj0 Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_177f03c2fe044ba39efb1861ed6dc4ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 809eac4d896042d39a2277386e511c3d Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '54262900-8cfa-46f1-9450-fba6c0b3290d'} Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:01.772939 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:01.776418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:01.776418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:01.776418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:01.776418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:36:01.776418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:36:01.776418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:36:01.776418 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:01.777925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Returning 404 to user: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:01.779788 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e7d81ef-4390-4f4b-845a-1e08babb80f6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 404 len: 111 microversion: 2.1 time: 0.092523 Oct 27 10:36:01.781137 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2999/5792] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:01 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:36:01.790624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-805c8e11-a005-43fd-a8e7-35e42c0de56e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '.version_select at 0x7f6d5a62ab80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:01.828578 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-805c8e11-a005-43fd-a8e7-35e42c0de56e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160778429" status: 202 len: 0 microversion: 2.1 time: 0.043032 Oct 27 10:36:01.829675 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2794/5793] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160778429 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:36:03.589073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-63f5c20b-17d1-4314-bb28-27d397cc4c68 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'create', calling method: .version_select at 0x7f6d5a198d30>, body: {"keypair": {"name": "tempest-keypair-1331417826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOVscXf6fEtG+tP6ZR7t+Ls64yvpm2U+rTjI7rHlVPOua5NJEf8gBRxEmYJl6JGUteg8OoQhVPa3la0611pM1zSHpME7LKrGgc2nmSM2jfr84OaHw5/QUvaep1p/CL1vg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:03.658384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-63f5c20b-17d1-4314-bb28-27d397cc4c68 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Getting quotas for project 177f03c2fe044ba39efb1861ed6dc4ee. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:36:03.680756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-63f5c20b-17d1-4314-bb28-27d397cc4c68 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Getting quotas for user 809eac4d896042d39a2277386e511c3d and project 177f03c2fe044ba39efb1861ed6dc4ee. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:36:03.695328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a84025f5-e379-48ba-acb5-3b6a99e58dd7 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Action: 'create', calling method: .version_select at 0x7f6d5bab1670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-691842340", "metadata": {"Type": "work"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a84025f5-e379-48ba-acb5-3b6a99e58dd7 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Request method failure captured: Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 121 Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl8TMRi6lPMtHXth_p06rqdhel0j9NOXbSsXLK_O0k3bXlgs__1uFyNGTx9ZOSZHDCFAyGoNJPRiS1R9LKTL_IZd2eCCVpkPhQvKnEwarYn_L8HjlE2oWjEj8SKlqNsDhauzVOAGiD5tsgBMgUf7A8ra3lQlxAvfeVWpY-JhP8MGkrw Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_608a087a5f134bea849c628ee8d3be7f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 87bab721cc54416c9b10d8db788c7322 Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-691842340", "metadata": {"Type": "work"}}} Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-691842340', 'metadata': {'Type': 'work'}}}} Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '#$%' Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:36:03.700262 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 10:36:03.703820 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.712651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a84025f5-e379-48ba-acb5-3b6a99e58dd7 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:03.714878 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a84025f5-e379-48ba-acb5-3b6a99e58dd7 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.346752 Oct 27 10:36:03.721201 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3000/5794] 10.222.0.76 () {60 vars in 1156 bytes} [Thu Oct 27 10:36:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 353 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:36:03.731073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25aafdba-8f72-49f4-9c2b-22fdf7909ba8 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Action: 'create', calling method: .version_select at 0x7f6d5ae29e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1685817015", "metadata": {"Type": "work"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:03.762539 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-63f5c20b-17d1-4314-bb28-27d397cc4c68 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178739 Oct 27 10:36:03.763986 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2795/5795] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:36:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25aafdba-8f72-49f4-9c2b-22fdf7909ba8 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Request method failure captured: Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 120 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl8TMRi6lPMtHXth_p06rqdhel0j9NOXbSsXLK_O0k3bXlgs__1uFyNGTx9ZOSZHDCFAyGoNJPRiS1R9LKTL_IZd2eCCVpkPhQvKnEwarYn_L8HjlE2oWjEj8SKlqNsDhauzVOAGiD5tsgBMgUf7A8ra3lQlxAvfeVWpY-JhP8MGkrw Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_608a087a5f134bea849c628ee8d3be7f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 87bab721cc54416c9b10d8db788c7322 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1685817015", "metadata": {"Type": "work"}}} Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1685817015', 'metadata': {'Type': 'work'}}}} Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '0' Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:36:03.776900 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25aafdba-8f72-49f4-9c2b-22fdf7909ba8 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:03.781790 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25aafdba-8f72-49f4-9c2b-22fdf7909ba8 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.056876 Oct 27 10:36:03.789391 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3001/5796] 10.222.0.76 () {60 vars in 1156 bytes} [Thu Oct 27 10:36:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:36:03.799401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f3ec15e-a8ac-492f-9f86-f4be49316eea tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Action: 'create', calling method: .version_select at 0x7f6d5a2f5700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-580722126", "metadata": {"Type": "work"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f3ec15e-a8ac-492f-9f86-f4be49316eea tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Request method failure captured: Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 118 Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl8TMRi6lPMtHXth_p06rqdhel0j9NOXbSsXLK_O0k3bXlgs__1uFyNGTx9ZOSZHDCFAyGoNJPRiS1R9LKTL_IZd2eCCVpkPhQvKnEwarYn_L8HjlE2oWjEj8SKlqNsDhauzVOAGiD5tsgBMgUf7A8ra3lQlxAvfeVWpY-JhP8MGkrw Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_608a087a5f134bea849c628ee8d3be7f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 87bab721cc54416c9b10d8db788c7322 Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-580722126", "metadata": {"Type": "work"}}} Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-580722126', 'metadata': {'Type': 'work'}}}} Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '' Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:36:03.805527 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 10:36:03.810214 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.811993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f3ec15e-a8ac-492f-9f86-f4be49316eea tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:03.813068 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f3ec15e-a8ac-492f-9f86-f4be49316eea tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022293 Oct 27 10:36:03.814144 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2796/5797] 10.222.0.76 () {60 vars in 1156 bytes} [Thu Oct 27 10:36:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:36:03.823469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b591073b-782e-4acd-b163-f46400e3adb7 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Calling method '.version_select at 0x7f6d5a900040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:03.876598 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-b591073b-782e-4acd-b163-f46400e3adb7 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] HTTP exception thrown: Volume tempest-invalid-1595289014 could not be found. Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b591073b-782e-4acd-b163-f46400e3adb7 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Request method failure captured: Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1595289014 HTTP/1.1 Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl8TMRi6lPMtHXth_p06rqdhel0j9NOXbSsXLK_O0k3bXlgs__1uFyNGTx9ZOSZHDCFAyGoNJPRiS1R9LKTL_IZd2eCCVpkPhQvKnEwarYn_L8HjlE2oWjEj8SKlqNsDhauzVOAGiD5tsgBMgUf7A8ra3lQlxAvfeVWpY-JhP8MGkrw Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_608a087a5f134bea849c628ee8d3be7f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 87bab721cc54416c9b10d8db788c7322 Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: exception: Volume tempest-invalid-1595289014 could not be found. Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'tempest-invalid-1595289014'} Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1595289014 could not be found. (HTTP 404) (Request-ID: req-06defeb6-d3e5-4668-8210-59e649526183) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:36:03.878677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1595289014 could not be found. Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1595289014 could not be found. Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1595289014 could not be found. Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b591073b-782e-4acd-b163-f46400e3adb7 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Returning 404 to user: Volume tempest-invalid-1595289014 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b591073b-782e-4acd-b163-f46400e3adb7 tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1595289014" status: 404 len: 99 microversion: 2.1 time: 0.060719 Oct 27 10:36:03.887068 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3002/5798] 10.222.0.76 () {58 vars in 1218 bytes} [Thu Oct 27 10:36:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1595289014 => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 10:36:03.896453 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1cb0cb31-fcdb-457e-9ac4-e719fc3703bc tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004065 Oct 27 10:36:03.902107 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2797/5799] 10.222.0.76 () {58 vars in 1140 bytes} [Thu Oct 27 10:36:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 10:36:03.908370 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c49df887-5f11-4c1b-9fdb-a345e8f6a2cf tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005278 Oct 27 10:36:03.909244 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3003/5800] 10.222.0.76 () {58 vars in 1137 bytes} [Thu Oct 27 10:36:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 27 10:36:03.919659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65e9dbf5-f405-4989-961a-af4c01f1ce0b tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Calling method '.version_select at 0x7f6d5a6744c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:04.047680 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-65e9dbf5-f405-4989-961a-af4c01f1ce0b tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] HTTP exception thrown: Volume 39e26b08-8be5-4dad-ba14-1eddefc68484 could not be found. Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65e9dbf5-f405-4989-961a-af4c01f1ce0b tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Request method failure captured: Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-volumes/39e26b08-8be5-4dad-ba14-1eddefc68484 HTTP/1.1 Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl8TMRi6lPMtHXth_p06rqdhel0j9NOXbSsXLK_O0k3bXlgs__1uFyNGTx9ZOSZHDCFAyGoNJPRiS1R9LKTL_IZd2eCCVpkPhQvKnEwarYn_L8HjlE2oWjEj8SKlqNsDhauzVOAGiD5tsgBMgUf7A8ra3lQlxAvfeVWpY-JhP8MGkrw Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_608a087a5f134bea849c628ee8d3be7f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 87bab721cc54416c9b10d8db788c7322 Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: exception: Volume 39e26b08-8be5-4dad-ba14-1eddefc68484 could not be found. Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '39e26b08-8be5-4dad-ba14-1eddefc68484'} Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39e26b08-8be5-4dad-ba14-1eddefc68484 could not be found. (HTTP 404) (Request-ID: req-4d352126-ab7b-4bbf-84b5-6381f729c449) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:36:04.089070 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39e26b08-8be5-4dad-ba14-1eddefc68484 could not be found. Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39e26b08-8be5-4dad-ba14-1eddefc68484 could not be found. Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39e26b08-8be5-4dad-ba14-1eddefc68484 could not be found. Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65e9dbf5-f405-4989-961a-af4c01f1ce0b tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Returning 404 to user: Volume 39e26b08-8be5-4dad-ba14-1eddefc68484 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65e9dbf5-f405-4989-961a-af4c01f1ce0b tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/39e26b08-8be5-4dad-ba14-1eddefc68484" status: 404 len: 109 microversion: 2.1 time: 0.175549 Oct 27 10:36:04.093849 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2798/5801] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:36:03 2022] DELETE /compute/v2.1/os-volumes/39e26b08-8be5-4dad-ba14-1eddefc68484 => generated 109 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:36:04.105516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a90f52-b0d7-4489-88a0-624bb249486e tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Calling method '.version_select at 0x7f6d5a8c9b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:04.179742 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-48a90f52-b0d7-4489-88a0-624bb249486e tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] HTTP exception thrown: Volume 90c59aad-b65c-40a8-af0d-41381408e628 could not be found. Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a90f52-b0d7-4489-88a0-624bb249486e tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Request method failure captured: Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/os-volumes/90c59aad-b65c-40a8-af0d-41381408e628 HTTP/1.1 Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl8TMRi6lPMtHXth_p06rqdhel0j9NOXbSsXLK_O0k3bXlgs__1uFyNGTx9ZOSZHDCFAyGoNJPRiS1R9LKTL_IZd2eCCVpkPhQvKnEwarYn_L8HjlE2oWjEj8SKlqNsDhauzVOAGiD5tsgBMgUf7A8ra3lQlxAvfeVWpY-JhP8MGkrw Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_608a087a5f134bea849c628ee8d3be7f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/608a087a5f134bea849c628ee8d3be7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 608a087a5f134bea849c628ee8d3be7f Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-27325418 Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 87bab721cc54416c9b10d8db788c7322 Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-27325418-project Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: exception: Volume 90c59aad-b65c-40a8-af0d-41381408e628 could not be found. Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '90c59aad-b65c-40a8-af0d-41381408e628'} Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90c59aad-b65c-40a8-af0d-41381408e628 could not be found. (HTTP 404) (Request-ID: req-794f1098-0e8c-440c-8fee-a57d43bb1f26) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:36:04.183898 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90c59aad-b65c-40a8-af0d-41381408e628 could not be found. Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90c59aad-b65c-40a8-af0d-41381408e628 could not be found. Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90c59aad-b65c-40a8-af0d-41381408e628 could not be found. Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a90f52-b0d7-4489-88a0-624bb249486e tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] Returning 404 to user: Volume 90c59aad-b65c-40a8-af0d-41381408e628 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48a90f52-b0d7-4489-88a0-624bb249486e tempest-VolumesNegativeTest-27325418 tempest-VolumesNegativeTest-27325418-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/90c59aad-b65c-40a8-af0d-41381408e628" status: 404 len: 109 microversion: 2.1 time: 0.085257 Oct 27 10:36:04.187594 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3004/5802] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:36:04 2022] GET /compute/v2.1/os-volumes/90c59aad-b65c-40a8-af0d-41381408e628 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:36:07.568087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-32542154", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e85818a-70f6-49da-8732-586e3ceedfda"}], "security_groups": [{"name": "tempest-securitygroup--1820033261"}], "key_name": "tempest-keypair-1331417826", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:08.125097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] validate_networks() for [('2e85818a-70f6-49da-8732-586e3ceedfda', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:36:08.852636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:36:08.853231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:36:08.854062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:36:08.854549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:36:08.855069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:36:08.877119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:08.878690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:08.881353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:08.885195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:08.885863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:08.888110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:08.947668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Getting quotas for project 177f03c2fe044ba39efb1861ed6dc4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:36:08.963185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Getting quotas for user 809eac4d896042d39a2277386e511c3d and project 177f03c2fe044ba39efb1861ed6dc4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:36:08.996600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:36:09.004216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:36:09.141835 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-971ea56c-80d0-47b2-84e7-c639974c66b6 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.574286 Oct 27 10:36:09.150014 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2799/5803] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:36:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:36:09.165913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a3d0cb5-8109-4769-affc-90b68bf8197e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:09.166552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a3d0cb5-8109-4769-affc-90b68bf8197e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:09.418381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a3d0cb5-8109-4769-affc-90b68bf8197e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:09.428194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a3d0cb5-8109-4769-affc-90b68bf8197e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1236 microversion: 2.1 time: 0.277847 Oct 27 10:36:09.432917 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3005/5804] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:09 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1236 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:10.452701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:10.454109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:10.460589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:10.461184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:10.461762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:10.462472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:10.462919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:10.463341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:10.550886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:10.576393 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e457182-25a4-46e6-a217-0cb9118f4d41 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1232 microversion: 2.1 time: 0.128687 Oct 27 10:36:10.584309 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2800/5805] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:10 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1232 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:11.599521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:11.601015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:11.613075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:11.613935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:11.614577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:11.615497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:11.617115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:11.617787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:11.733410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:11.746186 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1df9e4a-afb2-436c-aa69-5eddd3995b29 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1294 microversion: 2.1 time: 0.150574 Oct 27 10:36:11.748959 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3006/5806] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:11 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1294 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:12.771028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:12.771638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:12.781513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:12.787646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:12.788132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:12.789599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:12.790065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:12.791756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:12.921772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:12.935477 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-688402e3-8a59-4a08-8a2d-72278caeb9fd tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1294 microversion: 2.1 time: 0.167228 Oct 27 10:36:12.936608 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2801/5807] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:12 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1294 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:36:13.959589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:13.960651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:13.977749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:13.981621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:13.985756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:13.988216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:13.988793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:13.990447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:14.259569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:14.270183 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e191aaa1-3e58-461e-813d-3f570e0feda8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1362 microversion: 2.1 time: 0.314593 Oct 27 10:36:14.270781 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3007/5808] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:13 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:15.297718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:15.298994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:15.326830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:15.327569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:15.329869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:15.330660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:15.331132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:15.331562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:15.644050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:15.658045 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3def6c1-e940-488e-b30d-c3de4cdfcf58 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1362 microversion: 2.1 time: 0.366589 Oct 27 10:36:15.661366 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2802/5809] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:15 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:15.687240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:15.689882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:15.697502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:15.698063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:15.698561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:15.699387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:15.699969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:15.700454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:15.796903 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Invalid volume: volume d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe is already attached to instances: cf11cf55-8f04-467b-814f-de51ffa32347 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments HTTP/1.1 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 74 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: {"volumeAttachment": {"volumeId": "d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe"}} Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: exception: Invalid volume: volume d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe is already attached to instances: cf11cf55-8f04-467b-814f-de51ffa32347 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': 'cf11cf55-8f04-467b-814f-de51ffa32347', 'body': {'volumeAttachment': {'volumeId': 'd9a97ed4-0dfa-42b2-9a2e-6881d51a06fe'}}} Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe is already attached to instances: cf11cf55-8f04-467b-814f-de51ffa32347 Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:36:15.798624 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe is already attached to instances: cf11cf55-8f04-467b-814f-de51ffa32347 Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe is already attached to instances: cf11cf55-8f04-467b-814f-de51ffa32347 Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 400 to user: Invalid volume: volume d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe is already attached to instances: cf11cf55-8f04-467b-814f-de51ffa32347 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1531d1d9-d642-47dc-b12f-f8c584b89f57 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117096 Oct 27 10:36:15.802199 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3008/5810] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:36:15 2022] POST /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:36:15.873712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:15.874628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:15.881135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:15.881691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:15.882189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:15.883228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:15.883914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:15.884402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:15.981719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lazy-loading 'services' on Instance uuid cf11cf55-8f04-467b-814f-de51ffa32347 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:36:16.085307 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f67e59cb-cc8d-4fef-a58d-952dfa221049 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments/d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe" status: 202 len: 0 microversion: 2.1 time: 0.213961 Oct 27 10:36:16.089719 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2803/5811] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:36:15 2022] DELETE /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments/d9a97ed4-0dfa-42b2-9a2e-6881d51a06fe => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:36:16.096617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f455f440-76ca-4212-8941-100f7f7281d6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:16.098942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f455f440-76ca-4212-8941-100f7f7281d6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:16.108327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f455f440-76ca-4212-8941-100f7f7281d6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:16.109022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f455f440-76ca-4212-8941-100f7f7281d6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:16.109546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f455f440-76ca-4212-8941-100f7f7281d6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:16.110320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f455f440-76ca-4212-8941-100f7f7281d6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:16.110873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f455f440-76ca-4212-8941-100f7f7281d6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:16.115240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f455f440-76ca-4212-8941-100f7f7281d6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:16.165762 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f455f440-76ca-4212-8941-100f7f7281d6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073471 Oct 27 10:36:16.166835 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3009/5812] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:36:16 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:16.503407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5f030534-1a12-4400-a29e-669c881ec485 req-3cf99011-8f6e-4e11-b3d8-e4238c6d77f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7b99b5-44f0-4d33-8c86-3d974eaa8f66", "tag": "90186411-fcb7-4c8c-8c05-e49488a87519"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:16.525091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5f030534-1a12-4400-a29e-669c881ec485 req-3cf99011-8f6e-4e11-b3d8-e4238c6d77f9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:16.527895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5f030534-1a12-4400-a29e-669c881ec485 req-3cf99011-8f6e-4e11-b3d8-e4238c6d77f9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:16.528787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5f030534-1a12-4400-a29e-669c881ec485 req-3cf99011-8f6e-4e11-b3d8-e4238c6d77f9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:16.558625 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5f030534-1a12-4400-a29e-669c881ec485 req-3cf99011-8f6e-4e11-b3d8-e4238c6d77f9 service nova] Creating event network-changed:90186411-fcb7-4c8c-8c05-e49488a87519 for instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 on n-h2-854663-10 Oct 27 10:36:16.568525 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5f030534-1a12-4400-a29e-669c881ec485 req-3cf99011-8f6e-4e11-b3d8-e4238c6d77f9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070396 Oct 27 10:36:16.572791 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2804/5813] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:36:16.685081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:16.686335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:16.694744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:16.695948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:16.697791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:16.711287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:16.712175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:16.713596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:17.017120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:17.029698 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4d475659-69f4-4561-857e-542cd4ca12c2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1362 microversion: 2.1 time: 0.350511 Oct 27 10:36:17.031862 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3010/5814] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:16 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:17.182960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d79ab758-e577-412d-a83f-67dde664587e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:17.191645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d79ab758-e577-412d-a83f-67dde664587e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:17.215759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79ab758-e577-412d-a83f-67dde664587e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:17.219039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79ab758-e577-412d-a83f-67dde664587e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:17.221706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79ab758-e577-412d-a83f-67dde664587e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:17.224163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79ab758-e577-412d-a83f-67dde664587e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:17.226676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79ab758-e577-412d-a83f-67dde664587e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:17.227348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79ab758-e577-412d-a83f-67dde664587e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:17.311945 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d79ab758-e577-412d-a83f-67dde664587e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136868 Oct 27 10:36:17.319631 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2805/5815] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:36:17 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:18.055061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:18.056473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:18.076037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:18.076910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:18.077538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:18.079260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:18.082677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:18.083389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:18.325229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df9445c4-06e2-4990-90df-cef4774b02a9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:18.327436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df9445c4-06e2-4990-90df-cef4774b02a9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:18.342588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df9445c4-06e2-4990-90df-cef4774b02a9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:18.345155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df9445c4-06e2-4990-90df-cef4774b02a9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:18.345796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df9445c4-06e2-4990-90df-cef4774b02a9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:18.349549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df9445c4-06e2-4990-90df-cef4774b02a9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:18.350361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df9445c4-06e2-4990-90df-cef4774b02a9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:18.351119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df9445c4-06e2-4990-90df-cef4774b02a9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:18.416474 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df9445c4-06e2-4990-90df-cef4774b02a9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095426 Oct 27 10:36:18.422643 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2806/5816] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:36:18 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:18.426445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:18.438082 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8d80623-6968-471a-995f-fd0213104463 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1362 microversion: 2.1 time: 0.387330 Oct 27 10:36:18.438981 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3011/5817] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:18 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:36:19.431057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd0651ba-3f6d-4be1-9cf1-ebcdbfb10ddf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:19.434202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd0651ba-3f6d-4be1-9cf1-ebcdbfb10ddf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:19.442330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:19.445496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:19.449261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd0651ba-3f6d-4be1-9cf1-ebcdbfb10ddf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:19.450123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd0651ba-3f6d-4be1-9cf1-ebcdbfb10ddf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:19.451430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd0651ba-3f6d-4be1-9cf1-ebcdbfb10ddf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:19.452348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd0651ba-3f6d-4be1-9cf1-ebcdbfb10ddf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:19.453197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd0651ba-3f6d-4be1-9cf1-ebcdbfb10ddf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:19.454739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd0651ba-3f6d-4be1-9cf1-ebcdbfb10ddf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:19.462867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:19.464468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:19.483592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:19.489255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:19.491548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:19.493328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:19.496126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:19.498748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:19.499802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:19.565690 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd0651ba-3f6d-4be1-9cf1-ebcdbfb10ddf tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138053 Oct 27 10:36:19.574586 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2807/5818] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:36:19 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:20.614086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1fdfc4c9-f92e-403e-9f4b-464c669b41a6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:20.621941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1fdfc4c9-f92e-403e-9f4b-464c669b41a6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:20.666549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fdfc4c9-f92e-403e-9f4b-464c669b41a6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:20.669339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fdfc4c9-f92e-403e-9f4b-464c669b41a6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:20.672801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fdfc4c9-f92e-403e-9f4b-464c669b41a6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:20.676085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fdfc4c9-f92e-403e-9f4b-464c669b41a6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:20.676586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fdfc4c9-f92e-403e-9f4b-464c669b41a6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:20.677056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fdfc4c9-f92e-403e-9f4b-464c669b41a6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:20.746673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:20.749983 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1fdfc4c9-f92e-403e-9f4b-464c669b41a6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168635 Oct 27 10:36:20.750795 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2808/5819] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:36:20 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:20.759991 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd59fd23-f3b0-4399-ab86-1d059708d549 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1362 microversion: 2.1 time: 1.301233 Oct 27 10:36:20.768986 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3012/5820] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:19 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1362 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:21.765663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-558d2fc0-925e-47c6-8818-812c468d54b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:21.770824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-558d2fc0-925e-47c6-8818-812c468d54b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:21.783100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-558d2fc0-925e-47c6-8818-812c468d54b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:21.783817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-558d2fc0-925e-47c6-8818-812c468d54b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:21.784362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-558d2fc0-925e-47c6-8818-812c468d54b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:21.785197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-558d2fc0-925e-47c6-8818-812c468d54b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:21.785714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-558d2fc0-925e-47c6-8818-812c468d54b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:21.786206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-558d2fc0-925e-47c6-8818-812c468d54b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:21.794441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:21.796027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:21.818935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:21.819853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:21.821696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:21.824149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:21.826054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:21.826703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:21.828094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:21.832860 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-558d2fc0-925e-47c6-8818-812c468d54b9 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073426 Oct 27 10:36:21.834267 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2809/5821] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:36:21 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:22.068169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:22.080012 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9a39b9e-b988-4da4-afb2-b8811c9c73de tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1362 microversion: 2.1 time: 0.292981 Oct 27 10:36:22.081761 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3013/5822] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:21 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:22.734464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b481f915-bf72-4813-b4b9-a08d8e9fc362 req-edc01501-99ff-4acb-8653-10a8de757d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7b99b5-44f0-4d33-8c86-3d974eaa8f66", "name": "network-vif-plugged", "status": "completed", "tag": "90186411-fcb7-4c8c-8c05-e49488a87519"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:22.761397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b481f915-bf72-4813-b4b9-a08d8e9fc362 req-edc01501-99ff-4acb-8653-10a8de757d2a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:22.765697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b481f915-bf72-4813-b4b9-a08d8e9fc362 req-edc01501-99ff-4acb-8653-10a8de757d2a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:22.766873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b481f915-bf72-4813-b4b9-a08d8e9fc362 req-edc01501-99ff-4acb-8653-10a8de757d2a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:22.805954 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b481f915-bf72-4813-b4b9-a08d8e9fc362 req-edc01501-99ff-4acb-8653-10a8de757d2a service nova] Creating event network-vif-plugged:90186411-fcb7-4c8c-8c05-e49488a87519 for instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 on n-h2-854663-10 Oct 27 10:36:22.817484 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b481f915-bf72-4813-b4b9-a08d8e9fc362 req-edc01501-99ff-4acb-8653-10a8de757d2a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087355 Oct 27 10:36:22.820473 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2810/5823] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:22.850047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-510fa715-33fd-4c93-918d-5f2a6634efde tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:22.853369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-510fa715-33fd-4c93-918d-5f2a6634efde tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:22.886192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-510fa715-33fd-4c93-918d-5f2a6634efde tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:22.888307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-510fa715-33fd-4c93-918d-5f2a6634efde tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:22.889239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-510fa715-33fd-4c93-918d-5f2a6634efde tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:22.891331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-510fa715-33fd-4c93-918d-5f2a6634efde tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:22.892298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-510fa715-33fd-4c93-918d-5f2a6634efde tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:22.895624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-510fa715-33fd-4c93-918d-5f2a6634efde tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:22.971200 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-510fa715-33fd-4c93-918d-5f2a6634efde tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126693 Oct 27 10:36:22.979204 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3014/5824] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:36:22 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:23.109991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:23.116557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:23.139276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:23.140060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:23.142177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:23.143148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:23.147082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:23.148071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:23.582699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:23.604325 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e4bce73-62b8-4dd4-8891-d145ea529ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1362 microversion: 2.1 time: 0.501263 Oct 27 10:36:23.604988 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2811/5825] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:23 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:23.986159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd0af985-fbbb-4eaa-ad2c-767ae1712476 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:23.988620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd0af985-fbbb-4eaa-ad2c-767ae1712476 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:24.017950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd0af985-fbbb-4eaa-ad2c-767ae1712476 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:24.021247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd0af985-fbbb-4eaa-ad2c-767ae1712476 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:24.021888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd0af985-fbbb-4eaa-ad2c-767ae1712476 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:24.022787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd0af985-fbbb-4eaa-ad2c-767ae1712476 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:24.023402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd0af985-fbbb-4eaa-ad2c-767ae1712476 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:24.024688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd0af985-fbbb-4eaa-ad2c-767ae1712476 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:24.075663 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd0af985-fbbb-4eaa-ad2c-767ae1712476 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093822 Oct 27 10:36:24.076543 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3015/5826] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:36:23 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:24.632264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:24.632927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:24.640075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:24.640553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:24.643641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:24.644939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:24.645563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:24.646327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:24.838327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:24.848650 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ef9070c-9b33-47a3-bd44-91d5e8cfdb6a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1548 microversion: 2.1 time: 0.220025 Oct 27 10:36:24.858548 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2812/5827] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:24 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1548 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:24.874818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23dee2d7-66b0-48ae-9bea-87b29ff6c9c5 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:24.875320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23dee2d7-66b0-48ae-9bea-87b29ff6c9c5 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:24.884499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23dee2d7-66b0-48ae-9bea-87b29ff6c9c5 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:24.885341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23dee2d7-66b0-48ae-9bea-87b29ff6c9c5 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:24.886248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23dee2d7-66b0-48ae-9bea-87b29ff6c9c5 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:24.886967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23dee2d7-66b0-48ae-9bea-87b29ff6c9c5 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:24.893629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23dee2d7-66b0-48ae-9bea-87b29ff6c9c5 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:24.894469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23dee2d7-66b0-48ae-9bea-87b29ff6c9c5 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:25.019022 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23dee2d7-66b0-48ae-9bea-87b29ff6c9c5 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151206 Oct 27 10:36:25.019948 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3016/5828] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:36:24 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:25.092488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5d613a96-88a6-49b5-b79c-2ee8178fcdf5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:25.094952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5d613a96-88a6-49b5-b79c-2ee8178fcdf5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:25.097005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:25.103709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d613a96-88a6-49b5-b79c-2ee8178fcdf5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:25.104431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d613a96-88a6-49b5-b79c-2ee8178fcdf5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:25.105068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d613a96-88a6-49b5-b79c-2ee8178fcdf5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:25.105987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d613a96-88a6-49b5-b79c-2ee8178fcdf5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:25.106588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d613a96-88a6-49b5-b79c-2ee8178fcdf5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:25.107159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d613a96-88a6-49b5-b79c-2ee8178fcdf5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:25.167681 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5d613a96-88a6-49b5-b79c-2ee8178fcdf5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080974 Oct 27 10:36:25.169878 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2813/5829] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:36:25 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 10:36:25.270470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:25.270910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:25.285205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:25.286381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:25.287074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:25.287872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:25.290983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:25.294055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:25.333628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:36:25.343115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:25.459331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:25.509876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb743745-bb41-4560-9411-8e9a8b39047b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 204 len: 0 microversion: 2.1 time: 0.242562 Oct 27 10:36:25.511701 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3017/5830] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:36:25 2022] DELETE /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:36:25.521292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:25.522387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:25.534594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:25.535278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:25.537444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:25.538341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:25.539923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:25.542027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:25.777462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:25.793812 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef82f330-dd9a-4b0a-8d07-03d6ee26245d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1681 microversion: 2.1 time: 0.275773 Oct 27 10:36:25.796605 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2814/5831] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:25 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:26.795161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-324e2ab0-e427-4bd0-8bee-ec312658359b req-d5cd2636-cd00-4c74-ae58-d41f9ba199f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7b99b5-44f0-4d33-8c86-3d974eaa8f66", "tag": "90186411-fcb7-4c8c-8c05-e49488a87519"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:26.819556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-324e2ab0-e427-4bd0-8bee-ec312658359b req-d5cd2636-cd00-4c74-ae58-d41f9ba199f6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:26.822485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-324e2ab0-e427-4bd0-8bee-ec312658359b req-d5cd2636-cd00-4c74-ae58-d41f9ba199f6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:26.824001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-324e2ab0-e427-4bd0-8bee-ec312658359b req-d5cd2636-cd00-4c74-ae58-d41f9ba199f6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:26.834123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:26.835526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:26.851334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:26.854980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:26.855686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:26.857270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:26.857992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:26.858653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:26.859421 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-324e2ab0-e427-4bd0-8bee-ec312658359b req-d5cd2636-cd00-4c74-ae58-d41f9ba199f6 service nova] Creating event network-changed:90186411-fcb7-4c8c-8c05-e49488a87519 for instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 on n-h2-854663-10 Oct 27 10:36:26.870865 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-324e2ab0-e427-4bd0-8bee-ec312658359b req-d5cd2636-cd00-4c74-ae58-d41f9ba199f6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080060 Oct 27 10:36:26.876269 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3018/5832] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:27.461428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:27.471280 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e22bbfc0-87d7-4bba-aecc-198e8b15e329 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1681 microversion: 2.1 time: 0.653443 Oct 27 10:36:27.477246 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2815/5833] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:26 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1681 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:28.505998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:28.510542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:28.547583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:28.549446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:28.551730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:28.553548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:28.555914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:28.556569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:29.218408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:29.232151 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87bf5c59-9768-408d-914b-4dcf23ad69f6 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1681 microversion: 2.1 time: 0.730919 Oct 27 10:36:29.233807 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3019/5834] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:28 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1681 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:30.263235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:30.263913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:30.317948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:30.320845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:30.321303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:30.323390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:30.323869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:30.324307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:30.665150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3ca9fe10-c3da-4f04-a381-cdf60dda2cf0 req-8c2bec69-7141-4612-bd44-6cf550a21c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf11cf55-8f04-467b-814f-de51ffa32347", "name": "network-vif-deleted", "tag": "6a2b2f26-7286-44b4-8ce4-97645c85fd47"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:30.681065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3ca9fe10-c3da-4f04-a381-cdf60dda2cf0 req-8c2bec69-7141-4612-bd44-6cf550a21c4e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:30.681797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3ca9fe10-c3da-4f04-a381-cdf60dda2cf0 req-8c2bec69-7141-4612-bd44-6cf550a21c4e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:30.686455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3ca9fe10-c3da-4f04-a381-cdf60dda2cf0 req-8c2bec69-7141-4612-bd44-6cf550a21c4e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:30.706326 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3ca9fe10-c3da-4f04-a381-cdf60dda2cf0 req-8c2bec69-7141-4612-bd44-6cf550a21c4e service nova] Creating event network-vif-deleted:6a2b2f26-7286-44b4-8ce4-97645c85fd47 for instance cf11cf55-8f04-467b-814f-de51ffa32347 on n-h1-854663-10 Oct 27 10:36:30.727047 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3ca9fe10-c3da-4f04-a381-cdf60dda2cf0 req-8c2bec69-7141-4612-bd44-6cf550a21c4e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061242 Oct 27 10:36:30.728272 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3020/5835] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:36:30.806008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:30.819807 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb28b631-b95b-44c3-ba0c-b83aad78577c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 200 len: 1614 microversion: 2.1 time: 0.562740 Oct 27 10:36:30.825251 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2816/5836] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:30 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 1614 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:31.847986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:31.848902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:31.862573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:31.863065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:31.863503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:31.865556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:31.866079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:31.866488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:31.896608 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 HTTP/1.1 Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'cf11cf55-8f04-467b-814f-de51ffa32347'} Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:31.898769 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:31.903851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:31.903851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:31.903851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:31.903851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:36:31.903851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:36:31.903851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:36:31.903851 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:36:31.905284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:31.906346 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf2c5f48-0fc3-4073-ada9-a37153cb176f tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 404 len: 111 microversion: 2.1 time: 0.062590 Oct 27 10:36:31.910751 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3021/5837] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:31 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:36:31.916705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54d52fa5-d10e-4c8d-8b3b-8b33e028b785 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '.version_select at 0x7f6d5b750e50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:31.961263 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54d52fa5-d10e-4c8d-8b3b-8b33e028b785 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949127924" status: 202 len: 0 microversion: 2.1 time: 0.049079 Oct 27 10:36:31.962110 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2817/5838] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:36:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949127924 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:36:33.820634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41e3393e-7bf5-495a-bbed-bb4ceb4c1ebe tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: .version_select at 0x7f6d5a889790>, body: {"keypair": {"name": "tempest-keypair-1717825523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngFlRCkwgvZWwgWedGpP7fKh2S5rLQ7pqV/oekd5JLN1cRQFVNI4JMGc/tJJX7AS4SPiKSRvU2TMHaxZTEDbOkIV3dfyxpwnC6cSjazox4OXRY10LhBybJeVY3p9mVxw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:33.896476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-41e3393e-7bf5-495a-bbed-bb4ceb4c1ebe tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for project 7e188614201142b089c88d6c819922df. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:36:33.914578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-41e3393e-7bf5-495a-bbed-bb4ceb4c1ebe tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for user 258cd38b77cb4f63950f937ec3bdb134 and project 7e188614201142b089c88d6c819922df. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:36:33.983069 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41e3393e-7bf5-495a-bbed-bb4ceb4c1ebe tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167536 Oct 27 10:36:33.995439 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3022/5839] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:36:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:37.538757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1181530556", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2b52e2f-b838-490c-bf1e-3da0faf47ab8"}], "security_groups": [{"name": "tempest-securitygroup--1053233296"}], "key_name": "tempest-keypair-1717825523", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:37.696469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] validate_networks() for [('a2b52e2f-b838-490c-bf1e-3da0faf47ab8', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:36:38.157768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:36:38.158202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:36:38.159169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:36:38.159591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:36:38.160007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:36:38.173752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:38.174481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:38.175073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:38.176053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:38.176677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:38.177362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:38.210773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for project 7e188614201142b089c88d6c819922df. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:36:38.216464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Getting quotas for user 258cd38b77cb4f63950f937ec3bdb134 and project 7e188614201142b089c88d6c819922df. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:36:38.234702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:36:38.237348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:36:38.308967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ac8c933-86b0-4a5c-98aa-cfc55b5eda86 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.787018 Oct 27 10:36:38.313842 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2818/5840] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:36:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:36:38.322006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b6af5c6-faea-4812-9c89-3c8102b393da tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:38.322635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b6af5c6-faea-4812-9c89-3c8102b393da tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:38.443064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b6af5c6-faea-4812-9c89-3c8102b393da tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:38.454166 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b6af5c6-faea-4812-9c89-3c8102b393da tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1242 microversion: 2.1 time: 0.136288 Oct 27 10:36:38.470830 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3023/5841] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:38 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1242 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:39.479698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:39.481204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:39.493981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:39.496126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:39.497189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:39.499267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:39.500877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:39.505262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:39.627930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:39.641291 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af43d9e3-20ca-438d-bf9c-0583e0f322ac tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1238 microversion: 2.1 time: 0.166277 Oct 27 10:36:39.648082 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2819/5842] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:39 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1238 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:40.668246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:40.669039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:40.675845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:40.682180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:40.682745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:40.683573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:40.686453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:40.687069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:40.805162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:40.817564 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77ccd7ed-7e72-40f0-9cc0-05f7f76a684d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1300 microversion: 2.1 time: 0.153082 Oct 27 10:36:40.818201 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3024/5843] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:40 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1300 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:41.843383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:41.844172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:41.859112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:41.859611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:41.860048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:41.860806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:41.861263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:41.861690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:42.047866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:42.063126 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cdffd4f9-713d-442d-8b1b-fedf7226a2b7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1300 microversion: 2.1 time: 0.225007 Oct 27 10:36:42.064239 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2820/5844] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:41 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1300 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:43.088684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:43.090957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:43.108014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:43.108712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:43.109320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:43.116335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:43.117062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:43.117815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:43.918032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:43.927364 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8aed85a0-a09c-4c6b-b733-fa479d4e475a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1368 microversion: 2.1 time: 0.844211 Oct 27 10:36:43.936883 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3025/5845] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:43 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1368 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:44.962705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:44.964471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:44.979268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:44.980058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:44.980793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:44.981686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:44.982319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:44.982889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:45.009177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-24be58a6-c12f-42d8-bca1-5971288311eb req-4b18a43a-74ab-4b7a-b2fb-53fb101b1162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb", "tag": "833183ba-bac8-467d-9009-d1ec45d61006"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:45.045563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-24be58a6-c12f-42d8-bca1-5971288311eb req-4b18a43a-74ab-4b7a-b2fb-53fb101b1162 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:45.046426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-24be58a6-c12f-42d8-bca1-5971288311eb req-4b18a43a-74ab-4b7a-b2fb-53fb101b1162 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:45.050497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-24be58a6-c12f-42d8-bca1-5971288311eb req-4b18a43a-74ab-4b7a-b2fb-53fb101b1162 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:45.088855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-24be58a6-c12f-42d8-bca1-5971288311eb req-4b18a43a-74ab-4b7a-b2fb-53fb101b1162 service nova] Creating event network-changed:833183ba-bac8-467d-9009-d1ec45d61006 for instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb on n-h1-854663-10 Oct 27 10:36:45.100999 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-24be58a6-c12f-42d8-bca1-5971288311eb req-4b18a43a-74ab-4b7a-b2fb-53fb101b1162 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095803 Oct 27 10:36:45.102389 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3026/5846] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:45.269601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:45.281436 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8285f7dc-0a9b-4f71-82e2-46426f39bf1c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1368 microversion: 2.1 time: 0.322045 Oct 27 10:36:45.283195 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2821/5847] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:44 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1368 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:46.308157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:46.309911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:46.322914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:46.323882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:46.324540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:46.327802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:46.328535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:46.329267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:46.609965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:46.619192 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5629485d-562c-4c40-9d5d-b334d6cacbc4 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1368 microversion: 2.1 time: 0.315863 Oct 27 10:36:46.620319 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3027/5848] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:46 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:47.649200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:47.649947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:47.676322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:47.676870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:47.677323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:47.678070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:47.683412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:47.684390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:48.192139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:48.198945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:48.205354 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ef86f4e-bf74-4372-a203-14ce23a9b59a tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1368 microversion: 2.1 time: 0.562776 Oct 27 10:36:48.207772 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2822/5849] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:47 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1368 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:49.236612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:49.238263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:49.251352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:49.256356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:49.258078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:49.261515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:49.265178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:49.265941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:49.266574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:49.548469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:49.571602 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e0b188b-0d95-497c-bb08-a92cf23dac6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1368 microversion: 2.1 time: 0.341843 Oct 27 10:36:49.582078 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3028/5850] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:49 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:50.607417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:50.608746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:50.623196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:50.631125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:50.632984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:50.637038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:50.638120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:50.641083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:50.645183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:50.713812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f8e272d5-1fdb-44ae-9910-01d3269b8097 req-1e8a0148-5890-4d38-bb03-c3a6bcc13e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb", "name": "network-vif-plugged", "status": "completed", "tag": "833183ba-bac8-467d-9009-d1ec45d61006"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:50.749239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f8e272d5-1fdb-44ae-9910-01d3269b8097 req-1e8a0148-5890-4d38-bb03-c3a6bcc13e07 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:50.752701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f8e272d5-1fdb-44ae-9910-01d3269b8097 req-1e8a0148-5890-4d38-bb03-c3a6bcc13e07 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:50.753669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f8e272d5-1fdb-44ae-9910-01d3269b8097 req-1e8a0148-5890-4d38-bb03-c3a6bcc13e07 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:50.780405 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f8e272d5-1fdb-44ae-9910-01d3269b8097 req-1e8a0148-5890-4d38-bb03-c3a6bcc13e07 service nova] Creating event network-vif-plugged:833183ba-bac8-467d-9009-d1ec45d61006 for instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb on n-h1-854663-10 Oct 27 10:36:50.787305 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f8e272d5-1fdb-44ae-9910-01d3269b8097 req-1e8a0148-5890-4d38-bb03-c3a6bcc13e07 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077274 Oct 27 10:36:50.788012 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3029/5851] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:51.104707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:51.120183 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-615093b9-36da-4847-822f-f8525f433c3c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1368 microversion: 2.1 time: 0.517942 Oct 27 10:36:51.120879 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2823/5852] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:50 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1368 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:52.146804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:52.147833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:52.161228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:52.162167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:52.164145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:52.167680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:52.169170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:52.169844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:52.610501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:52.623263 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4541925-4efb-4440-bbe5-16a01ebb3c42 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1368 microversion: 2.1 time: 0.483513 Oct 27 10:36:52.624488 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3030/5853] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:52 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1368 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:53.651298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:53.651920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:53.662199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:53.662709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:53.663157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:53.663885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:53.664345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:53.665160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:53.670231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=71 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:54.572944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:54.589470 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0abd2229-4a11-475f-83af-add23f19634e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1558 microversion: 2.1 time: 0.942975 Oct 27 10:36:54.590454 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2824/5854] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:53 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1558 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:54.612103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52fac21e-96cf-46a9-9217-496f46b933c3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:54.613247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52fac21e-96cf-46a9-9217-496f46b933c3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:54.620809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fac21e-96cf-46a9-9217-496f46b933c3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:54.622081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fac21e-96cf-46a9-9217-496f46b933c3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:54.623218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fac21e-96cf-46a9-9217-496f46b933c3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:54.624171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fac21e-96cf-46a9-9217-496f46b933c3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:54.625051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fac21e-96cf-46a9-9217-496f46b933c3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:54.625743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fac21e-96cf-46a9-9217-496f46b933c3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:54.814864 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52fac21e-96cf-46a9-9217-496f46b933c3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206603 Oct 27 10:36:54.825872 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3031/5855] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 10:36:54 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:57.021893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b318e567-4ebb-4c5d-9ec6-c0de68f94e3c req-a2cebfbc-ea47-4601-856f-2b765a9d3f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb", "tag": "833183ba-bac8-467d-9009-d1ec45d61006"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:57.055376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:57.064290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b318e567-4ebb-4c5d-9ec6-c0de68f94e3c req-a2cebfbc-ea47-4601-856f-2b765a9d3f89 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:57.065521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b318e567-4ebb-4c5d-9ec6-c0de68f94e3c req-a2cebfbc-ea47-4601-856f-2b765a9d3f89 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:57.066062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b318e567-4ebb-4c5d-9ec6-c0de68f94e3c req-a2cebfbc-ea47-4601-856f-2b765a9d3f89 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:57.112913 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b318e567-4ebb-4c5d-9ec6-c0de68f94e3c req-a2cebfbc-ea47-4601-856f-2b765a9d3f89 service nova] Creating event network-changed:833183ba-bac8-467d-9009-d1ec45d61006 for instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb on n-h1-854663-10 Oct 27 10:36:57.138105 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b318e567-4ebb-4c5d-9ec6-c0de68f94e3c req-a2cebfbc-ea47-4601-856f-2b765a9d3f89 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120146 Oct 27 10:36:57.139458 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2825/5856] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:00.563485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30d6e543-7161-4677-8c7a-f6fbcd6e62cb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:00.564048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30d6e543-7161-4677-8c7a-f6fbcd6e62cb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:00.576511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:00.578099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d6e543-7161-4677-8c7a-f6fbcd6e62cb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:00.578601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d6e543-7161-4677-8c7a-f6fbcd6e62cb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:00.579033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d6e543-7161-4677-8c7a-f6fbcd6e62cb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:00.581270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d6e543-7161-4677-8c7a-f6fbcd6e62cb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:00.593474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d6e543-7161-4677-8c7a-f6fbcd6e62cb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:00.594182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30d6e543-7161-4677-8c7a-f6fbcd6e62cb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:00.597935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:00.641974 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30d6e543-7161-4677-8c7a-f6fbcd6e62cb tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/ips" status: 200 len: 145 microversion: 2.1 time: 0.082347 Oct 27 10:37:00.648223 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3032/5857] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:37:00 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/ips => generated 145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:03.525948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5497c96b-592a-498b-93ee-46845d865808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a90eff10-3fb6-439f-957b-62576d9d6f56"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:37:03.536911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5497c96b-592a-498b-93ee-46845d865808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:03.579358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5497c96b-592a-498b-93ee-46845d865808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:03.581758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5497c96b-592a-498b-93ee-46845d865808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:03.587817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5497c96b-592a-498b-93ee-46845d865808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:03.593843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5497c96b-592a-498b-93ee-46845d865808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:03.595326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5497c96b-592a-498b-93ee-46845d865808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:03.596122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5497c96b-592a-498b-93ee-46845d865808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:04.143781 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5497c96b-592a-498b-93ee-46845d865808 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624226 Oct 27 10:37:04.145602 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2826/5858] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:37:03 2022] POST /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:20.063611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5959f34c-7cc4-4ee0-a457-315b547f6254 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:20.067638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5959f34c-7cc4-4ee0-a457-315b547f6254 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:20.078417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5959f34c-7cc4-4ee0-a457-315b547f6254 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:20.079296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5959f34c-7cc4-4ee0-a457-315b547f6254 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:20.080152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5959f34c-7cc4-4ee0-a457-315b547f6254 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:20.081150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5959f34c-7cc4-4ee0-a457-315b547f6254 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:20.081860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5959f34c-7cc4-4ee0-a457-315b547f6254 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:20.082509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5959f34c-7cc4-4ee0-a457-315b547f6254 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:20.144920 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5959f34c-7cc4-4ee0-a457-315b547f6254 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092051 Oct 27 10:37:20.146157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3033/5859] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:37:20 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:20.156003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:20.156959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:20.161693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9499b88-c860-4e29-8bac-ff7b5a7e369f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:20.166106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d9499b88-c860-4e29-8bac-ff7b5a7e369f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:20.186871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9499b88-c860-4e29-8bac-ff7b5a7e369f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:20.187812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9499b88-c860-4e29-8bac-ff7b5a7e369f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:20.189097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9499b88-c860-4e29-8bac-ff7b5a7e369f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:20.190107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9499b88-c860-4e29-8bac-ff7b5a7e369f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:20.190736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9499b88-c860-4e29-8bac-ff7b5a7e369f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:20.191337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9499b88-c860-4e29-8bac-ff7b5a7e369f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:20.266793 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d9499b88-c860-4e29-8bac-ff7b5a7e369f tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/a90eff10-3fb6-439f-957b-62576d9d6f56" status: 200 len: 194 microversion: 2.1 time: 0.112834 Oct 27 10:37:20.268177 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2827/5860] 10.222.0.76 () {58 vars in 1413 bytes} [Thu Oct 27 10:37:20 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/a90eff10-3fb6-439f-957b-62576d9d6f56 => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:23.073745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-129a9234-c79f-47c4-99d2-defeb96b32df tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7406f46c-59d8-4cbe-9bfe-f0468d2a6761"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:37:23.076732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-129a9234-c79f-47c4-99d2-defeb96b32df tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:23.107616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129a9234-c79f-47c4-99d2-defeb96b32df tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:23.108179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129a9234-c79f-47c4-99d2-defeb96b32df tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:23.109556 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129a9234-c79f-47c4-99d2-defeb96b32df tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:23.110506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129a9234-c79f-47c4-99d2-defeb96b32df tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:23.111128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129a9234-c79f-47c4-99d2-defeb96b32df tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:23.111715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-129a9234-c79f-47c4-99d2-defeb96b32df tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:23.687457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-129a9234-c79f-47c4-99d2-defeb96b32df tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "POST /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620498 Oct 27 10:37:23.715236 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3034/5861] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:37:23 2022] POST /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:31.916108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-541c6606-00db-49e5-b3b5-422a3d05bc4d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:31.916652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-541c6606-00db-49e5-b3b5-422a3d05bc4d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:31.942611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:31.943611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:31.952105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541c6606-00db-49e5-b3b5-422a3d05bc4d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:31.953177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541c6606-00db-49e5-b3b5-422a3d05bc4d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:31.953827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541c6606-00db-49e5-b3b5-422a3d05bc4d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:31.954773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541c6606-00db-49e5-b3b5-422a3d05bc4d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:31.955440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541c6606-00db-49e5-b3b5-422a3d05bc4d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:31.956068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-541c6606-00db-49e5-b3b5-422a3d05bc4d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:32.021332 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-541c6606-00db-49e5-b3b5-422a3d05bc4d tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/ips" status: 200 len: 150 microversion: 2.1 time: 0.109113 Oct 27 10:37:32.040300 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2828/5862] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:37:31 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/ips => generated 150 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:35.028941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:35.030010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:35.040035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a87c7673-5a73-40da-ac3d-07401e5d4c28 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c927b20-1766-479a-80ab-cc90440788e2"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:37:35.044400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a87c7673-5a73-40da-ac3d-07401e5d4c28 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:35.066207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87c7673-5a73-40da-ac3d-07401e5d4c28 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:35.066722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87c7673-5a73-40da-ac3d-07401e5d4c28 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:35.067145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87c7673-5a73-40da-ac3d-07401e5d4c28 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:35.067868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87c7673-5a73-40da-ac3d-07401e5d4c28 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:35.077464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87c7673-5a73-40da-ac3d-07401e5d4c28 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:35.078158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a87c7673-5a73-40da-ac3d-07401e5d4c28 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:35.722092 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a87c7673-5a73-40da-ac3d-07401e5d4c28 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "POST /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695413 Oct 27 10:37:35.751875 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3035/5863] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:37:35 2022] POST /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:39.637786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24666d41-d336-45e6-b2d1-177d2ea91204 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:39.641618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-24666d41-d336-45e6-b2d1-177d2ea91204 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:39.677276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24666d41-d336-45e6-b2d1-177d2ea91204 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:39.678271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24666d41-d336-45e6-b2d1-177d2ea91204 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:39.678934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24666d41-d336-45e6-b2d1-177d2ea91204 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:39.680217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24666d41-d336-45e6-b2d1-177d2ea91204 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:39.681169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24666d41-d336-45e6-b2d1-177d2ea91204 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:39.681847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24666d41-d336-45e6-b2d1-177d2ea91204 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:39.751842 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-24666d41-d336-45e6-b2d1-177d2ea91204 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.120757 Oct 27 10:37:39.753211 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2829/5864] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:37:39 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:39.902894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8fc05cbd-b5d4-40d5-82d9-54ab52a12a25 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:39.903552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8fc05cbd-b5d4-40d5-82d9-54ab52a12a25 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:39.914173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc05cbd-b5d4-40d5-82d9-54ab52a12a25 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:39.915339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc05cbd-b5d4-40d5-82d9-54ab52a12a25 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:39.915966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc05cbd-b5d4-40d5-82d9-54ab52a12a25 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:39.917168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc05cbd-b5d4-40d5-82d9-54ab52a12a25 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:39.917963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc05cbd-b5d4-40d5-82d9-54ab52a12a25 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:39.918575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc05cbd-b5d4-40d5-82d9-54ab52a12a25 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:40.017788 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8fc05cbd-b5d4-40d5-82d9-54ab52a12a25 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/a90eff10-3fb6-439f-957b-62576d9d6f56" status: 200 len: 194 microversion: 2.1 time: 0.126645 Oct 27 10:37:40.024232 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3036/5865] 10.222.0.76 () {58 vars in 1413 bytes} [Thu Oct 27 10:37:39 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/a90eff10-3fb6-439f-957b-62576d9d6f56 => generated 194 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:40.032434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:40.033459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:40.052429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:40.059938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:40.061329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:40.065780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:40.066280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:40.070131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:40.296828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lazy-loading 'services' on Instance uuid 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:37:40.540962 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67f302e7-2da7-42d6-87a0-b787b6007d8e tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/a90eff10-3fb6-439f-957b-62576d9d6f56" status: 202 len: 0 microversion: 2.1 time: 0.515120 Oct 27 10:37:40.542105 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2830/5866] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:37:40 2022] DELETE /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/a90eff10-3fb6-439f-957b-62576d9d6f56 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:37:47.123387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Calling method '.version_select at 0x7f6d63915dc0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:47.125950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:47.126443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:47.126911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:47.154458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:47.155208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:47.155800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:47.170796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:47.171673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:47.173760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:47.182732 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-778fa08a-2328-4f2d-aea9-cd91ff9fed4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349164292-project-admin] 10.222.0.76 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.315355 Oct 27 10:37:47.183863 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3037/5867] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 10:37:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:49.204049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16b8c03f-af62-454e-9eb2-3e8fa2b5b33d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:49.205025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16b8c03f-af62-454e-9eb2-3e8fa2b5b33d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:49.229378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b8c03f-af62-454e-9eb2-3e8fa2b5b33d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:49.230202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b8c03f-af62-454e-9eb2-3e8fa2b5b33d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:49.231018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b8c03f-af62-454e-9eb2-3e8fa2b5b33d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:49.234378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b8c03f-af62-454e-9eb2-3e8fa2b5b33d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:49.235808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b8c03f-af62-454e-9eb2-3e8fa2b5b33d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:49.236261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b8c03f-af62-454e-9eb2-3e8fa2b5b33d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:49.336476 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16b8c03f-af62-454e-9eb2-3e8fa2b5b33d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/7406f46c-59d8-4cbe-9bfe-f0468d2a6761" status: 200 len: 194 microversion: 2.1 time: 0.138406 Oct 27 10:37:49.344045 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2831/5868] 10.222.0.76 () {58 vars in 1413 bytes} [Thu Oct 27 10:37:49 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/7406f46c-59d8-4cbe-9bfe-f0468d2a6761 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:49.352683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:49.353276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:49.370221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:49.371309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:49.372526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:49.375827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:49.377057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:49.380314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:49.568977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lazy-loading 'services' on Instance uuid 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:37:49.723566 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-755de875-0a6c-4ab4-9b44-2bf996454f1a tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/7406f46c-59d8-4cbe-9bfe-f0468d2a6761" status: 202 len: 0 microversion: 2.1 time: 0.377456 Oct 27 10:37:49.724895 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3038/5869] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:37:49 2022] DELETE /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments/7406f46c-59d8-4cbe-9bfe-f0468d2a6761 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:38:01.691979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:01.692477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:01.715575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:01.724024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:01.727418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:01.727958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:01.737399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:01.738236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:01.739001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:01.739671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:02.158979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lazy-loading 'services' on Instance uuid b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:38:02.414672 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4ae68a9-9bed-4d1b-8e17-fc4b4fbcc83b tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments/6c927b20-1766-479a-80ab-cc90440788e2" status: 202 len: 0 microversion: 2.1 time: 0.725501 Oct 27 10:38:02.419165 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2832/5870] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:38:01 2022] DELETE /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments/6c927b20-1766-479a-80ab-cc90440788e2 => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:38:02.429778 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:38:02.430683 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 10:38:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments (ip 10.222.0.76) !!! Oct 27 10:38:02.434094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:02.435277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:02.450757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5dc34e58-ffc1-4ba3-a866-fb73c33fade7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:02.479370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5dc34e58-ffc1-4ba3-a866-fb73c33fade7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:02.534136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc34e58-ffc1-4ba3-a866-fb73c33fade7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:02.534658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc34e58-ffc1-4ba3-a866-fb73c33fade7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:02.535288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc34e58-ffc1-4ba3-a866-fb73c33fade7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:02.538027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc34e58-ffc1-4ba3-a866-fb73c33fade7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:02.538685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc34e58-ffc1-4ba3-a866-fb73c33fade7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:02.539114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dc34e58-ffc1-4ba3-a866-fb73c33fade7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:02.718263 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5dc34e58-ffc1-4ba3-a866-fb73c33fade7 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.293461 Oct 27 10:38:02.729188 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3039/5871] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:02 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:03.737269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed9bd11d-0f93-4cb5-9875-2395515cd5a2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:03.739812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ed9bd11d-0f93-4cb5-9875-2395515cd5a2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:03.765935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9bd11d-0f93-4cb5-9875-2395515cd5a2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:03.766493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9bd11d-0f93-4cb5-9875-2395515cd5a2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:03.767000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9bd11d-0f93-4cb5-9875-2395515cd5a2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:03.771132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9bd11d-0f93-4cb5-9875-2395515cd5a2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:03.771691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9bd11d-0f93-4cb5-9875-2395515cd5a2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:03.772140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed9bd11d-0f93-4cb5-9875-2395515cd5a2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:03.897377 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed9bd11d-0f93-4cb5-9875-2395515cd5a2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167678 Oct 27 10:38:03.912366 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2833/5872] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:03 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:04.912968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0db1c8c9-9508-4d96-b187-75df21e9b007 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:04.923855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0db1c8c9-9508-4d96-b187-75df21e9b007 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:04.953913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0db1c8c9-9508-4d96-b187-75df21e9b007 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:04.954407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0db1c8c9-9508-4d96-b187-75df21e9b007 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:04.954845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0db1c8c9-9508-4d96-b187-75df21e9b007 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:04.955720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0db1c8c9-9508-4d96-b187-75df21e9b007 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:04.956188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0db1c8c9-9508-4d96-b187-75df21e9b007 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:04.956746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0db1c8c9-9508-4d96-b187-75df21e9b007 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:05.047742 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0db1c8c9-9508-4d96-b187-75df21e9b007 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141589 Oct 27 10:38:05.062157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3040/5873] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:04 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:06.071872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce2cb641-9b7d-4677-bd3e-4289b74b6701 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:06.078028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce2cb641-9b7d-4677-bd3e-4289b74b6701 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:06.101056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2cb641-9b7d-4677-bd3e-4289b74b6701 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:06.106594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2cb641-9b7d-4677-bd3e-4289b74b6701 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:06.107897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2cb641-9b7d-4677-bd3e-4289b74b6701 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:06.109383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2cb641-9b7d-4677-bd3e-4289b74b6701 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:06.110954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2cb641-9b7d-4677-bd3e-4289b74b6701 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:06.111390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2cb641-9b7d-4677-bd3e-4289b74b6701 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:06.300083 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce2cb641-9b7d-4677-bd3e-4289b74b6701 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.234432 Oct 27 10:38:06.300707 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2834/5874] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:06 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:07.313263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9df0cf99-9f2a-47cd-b292-c7d26b5b3d14 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:07.316865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9df0cf99-9f2a-47cd-b292-c7d26b5b3d14 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:07.342855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9df0cf99-9f2a-47cd-b292-c7d26b5b3d14 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:07.343757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9df0cf99-9f2a-47cd-b292-c7d26b5b3d14 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:07.344429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9df0cf99-9f2a-47cd-b292-c7d26b5b3d14 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:07.345434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9df0cf99-9f2a-47cd-b292-c7d26b5b3d14 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:07.346603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9df0cf99-9f2a-47cd-b292-c7d26b5b3d14 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:07.347916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9df0cf99-9f2a-47cd-b292-c7d26b5b3d14 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:07.420955 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9df0cf99-9f2a-47cd-b292-c7d26b5b3d14 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111469 Oct 27 10:38:07.421833 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3041/5875] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:07 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:08.434652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31e94870-ebca-4660-9c49-1497f9554581 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:08.436934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31e94870-ebca-4660-9c49-1497f9554581 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:08.451361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e94870-ebca-4660-9c49-1497f9554581 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:08.456911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e94870-ebca-4660-9c49-1497f9554581 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:08.457358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e94870-ebca-4660-9c49-1497f9554581 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:08.458290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e94870-ebca-4660-9c49-1497f9554581 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:08.458927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e94870-ebca-4660-9c49-1497f9554581 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:08.459510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e94870-ebca-4660-9c49-1497f9554581 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:08.539373 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31e94870-ebca-4660-9c49-1497f9554581 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109160 Oct 27 10:38:08.543613 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2835/5876] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:08 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:08.720081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2580fbc3-4c12-4201-95b8-347b140cf94d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:08.723060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2580fbc3-4c12-4201-95b8-347b140cf94d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:08.774172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2580fbc3-4c12-4201-95b8-347b140cf94d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:08.774827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2580fbc3-4c12-4201-95b8-347b140cf94d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:08.775308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2580fbc3-4c12-4201-95b8-347b140cf94d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:08.784225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2580fbc3-4c12-4201-95b8-347b140cf94d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:08.785013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2580fbc3-4c12-4201-95b8-347b140cf94d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:08.785499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2580fbc3-4c12-4201-95b8-347b140cf94d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:08.933836 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2580fbc3-4c12-4201-95b8-347b140cf94d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.219248 Oct 27 10:38:08.934454 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3042/5877] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:08 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments => generated 25 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:38:09.133575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00e81840-1147-4550-b300-4ef127e867c4 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:09.136014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-00e81840-1147-4550-b300-4ef127e867c4 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:09.152142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00e81840-1147-4550-b300-4ef127e867c4 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:09.152654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00e81840-1147-4550-b300-4ef127e867c4 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:09.153123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00e81840-1147-4550-b300-4ef127e867c4 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:09.153850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00e81840-1147-4550-b300-4ef127e867c4 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:09.154306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00e81840-1147-4550-b300-4ef127e867c4 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:09.154733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00e81840-1147-4550-b300-4ef127e867c4 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:09.223747 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00e81840-1147-4550-b300-4ef127e867c4 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094348 Oct 27 10:38:09.225986 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2836/5878] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:09 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 10:38:09.314885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:09.315785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:09.332438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:09.333584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:09.334322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:09.335356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:09.336030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:09.336697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:09.394439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:38:09.556395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-987c6a03-8ba0-421b-aa43-5721424d4d93 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:09.560332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-987c6a03-8ba0-421b-aa43-5721424d4d93 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:09.591200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-987c6a03-8ba0-421b-aa43-5721424d4d93 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:09.592880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-987c6a03-8ba0-421b-aa43-5721424d4d93 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:09.593391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-987c6a03-8ba0-421b-aa43-5721424d4d93 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:09.595717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-987c6a03-8ba0-421b-aa43-5721424d4d93 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:09.596837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-987c6a03-8ba0-421b-aa43-5721424d4d93 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:09.597632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-987c6a03-8ba0-421b-aa43-5721424d4d93 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:09.605919 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6696772c-e7ff-48f9-84a8-520ac92624d9 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 204 len: 0 microversion: 2.1 time: 0.294649 Oct 27 10:38:09.608326 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3043/5879] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:38:09 2022] DELETE /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:38:09.622022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:09.625617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:09.643589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:09.644378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:09.646062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:09.648027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:09.651056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:09.654854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:09.690255 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-987c6a03-8ba0-421b-aa43-5721424d4d93 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139093 Oct 27 10:38:09.694322 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2837/5880] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:09 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:38:10.506660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:10.514982 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4de4edb0-2d52-409f-8221-14c465aaf5d0 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1672 microversion: 2.1 time: 0.902335 Oct 27 10:38:10.515569 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3044/5881] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:09 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1672 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:10.702795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ff13c3f-036d-4b22-bb3a-5dea821fb0f2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:10.705936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ff13c3f-036d-4b22-bb3a-5dea821fb0f2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:10.721186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ff13c3f-036d-4b22-bb3a-5dea821fb0f2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:10.723228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ff13c3f-036d-4b22-bb3a-5dea821fb0f2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:10.723945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ff13c3f-036d-4b22-bb3a-5dea821fb0f2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:10.725426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ff13c3f-036d-4b22-bb3a-5dea821fb0f2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:10.727065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ff13c3f-036d-4b22-bb3a-5dea821fb0f2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:10.727840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ff13c3f-036d-4b22-bb3a-5dea821fb0f2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:10.821386 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ff13c3f-036d-4b22-bb3a-5dea821fb0f2 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122728 Oct 27 10:38:10.826550 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2838/5882] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:10 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:11.539800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:11.540416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:11.555478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:11.555985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:11.556569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:11.557390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:11.558068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:11.558504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:11.797500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:11.812352 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29f3784a-c749-4e31-ab80-bde1071e7ed2 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1672 microversion: 2.1 time: 0.276616 Oct 27 10:38:11.813184 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3045/5883] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:11 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1672 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:11.839663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-28fcee23-fa21-49c9-a43a-69a71b19954c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:11.842741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-28fcee23-fa21-49c9-a43a-69a71b19954c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:11.859342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fcee23-fa21-49c9-a43a-69a71b19954c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:11.867330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fcee23-fa21-49c9-a43a-69a71b19954c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:11.868050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fcee23-fa21-49c9-a43a-69a71b19954c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:11.869185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fcee23-fa21-49c9-a43a-69a71b19954c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:11.871279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fcee23-fa21-49c9-a43a-69a71b19954c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:11.871918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fcee23-fa21-49c9-a43a-69a71b19954c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:11.927485 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-28fcee23-fa21-49c9-a43a-69a71b19954c tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092341 Oct 27 10:38:11.946051 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2839/5884] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:11 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:12.838335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:12.838988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:12.847481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:12.878615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:12.884081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:12.886524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:12.896445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:12.897480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:12.954205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f36edfb6-c572-43f1-bb59-5efbfb5f3171 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:12.957313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f36edfb6-c572-43f1-bb59-5efbfb5f3171 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:12.974472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36edfb6-c572-43f1-bb59-5efbfb5f3171 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:12.975334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36edfb6-c572-43f1-bb59-5efbfb5f3171 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:12.976161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36edfb6-c572-43f1-bb59-5efbfb5f3171 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:12.979003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36edfb6-c572-43f1-bb59-5efbfb5f3171 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:12.979851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36edfb6-c572-43f1-bb59-5efbfb5f3171 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:12.981331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36edfb6-c572-43f1-bb59-5efbfb5f3171 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:13.059490 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f36edfb6-c572-43f1-bb59-5efbfb5f3171 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106928 Oct 27 10:38:13.062460 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2840/5885] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:12 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:38:13.428632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:13.447887 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b232d1f-8783-470f-be8b-c7c5e039f742 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1672 microversion: 2.1 time: 0.613281 Oct 27 10:38:13.451501 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3046/5886] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:12 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1672 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:14.074039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e7e42548-cc1e-4cda-baf5-f7927af547e3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:14.076448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e7e42548-cc1e-4cda-baf5-f7927af547e3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:14.084097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e42548-cc1e-4cda-baf5-f7927af547e3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:14.085240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e42548-cc1e-4cda-baf5-f7927af547e3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:14.085864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e42548-cc1e-4cda-baf5-f7927af547e3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:14.087144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e42548-cc1e-4cda-baf5-f7927af547e3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:14.088312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e42548-cc1e-4cda-baf5-f7927af547e3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:14.089713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7e42548-cc1e-4cda-baf5-f7927af547e3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:14.126821 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e7e42548-cc1e-4cda-baf5-f7927af547e3 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057005 Oct 27 10:38:14.128393 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2841/5887] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:14 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:14.479728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:14.481356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:14.504435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:14.506082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:14.506543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:14.507289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:14.507754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:14.513525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:14.967335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809eac4d896042d39a2277386e511c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177f03c2fe044ba39efb1861ed6dc4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:14.978155 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e50dd15-60eb-4b60-a94f-162303b09d27 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 200 len: 1604 microversion: 2.1 time: 0.506207 Oct 27 10:38:14.985296 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3047/5888] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:14 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 1604 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:15.141556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb73bbc2-5465-41a3-9530-7fb11c9ad486 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:15.144208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb73bbc2-5465-41a3-9530-7fb11c9ad486 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:15.162443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb73bbc2-5465-41a3-9530-7fb11c9ad486 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:15.164364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb73bbc2-5465-41a3-9530-7fb11c9ad486 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:15.167194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb73bbc2-5465-41a3-9530-7fb11c9ad486 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:15.168065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb73bbc2-5465-41a3-9530-7fb11c9ad486 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:15.171824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb73bbc2-5465-41a3-9530-7fb11c9ad486 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:15.172957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb73bbc2-5465-41a3-9530-7fb11c9ad486 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:15.241785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-caa87b8c-9768-45ee-af70-7950535703f6 req-a5835b1f-7e54-4288-af8e-550a77030e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7b99b5-44f0-4d33-8c86-3d974eaa8f66", "name": "network-vif-deleted", "tag": "90186411-fcb7-4c8c-8c05-e49488a87519"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:15.262812 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb73bbc2-5465-41a3-9530-7fb11c9ad486 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118114 Oct 27 10:38:15.266041 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2842/5889] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 10:38:15 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:38:15.269522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-caa87b8c-9768-45ee-af70-7950535703f6 req-a5835b1f-7e54-4288-af8e-550a77030e49 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:15.270038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-caa87b8c-9768-45ee-af70-7950535703f6 req-a5835b1f-7e54-4288-af8e-550a77030e49 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:15.270484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-caa87b8c-9768-45ee-af70-7950535703f6 req-a5835b1f-7e54-4288-af8e-550a77030e49 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:15.297253 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-caa87b8c-9768-45ee-af70-7950535703f6 req-a5835b1f-7e54-4288-af8e-550a77030e49 service nova] Creating event network-vif-deleted:90186411-fcb7-4c8c-8c05-e49488a87519 for instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 on n-h2-854663-10 Oct 27 10:38:15.310033 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-caa87b8c-9768-45ee-af70-7950535703f6 req-a5835b1f-7e54-4288-af8e-550a77030e49 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072490 Oct 27 10:38:15.313661 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3048/5890] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:38:15.387011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:15.387624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:15.400104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:15.406801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:15.407544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:15.411642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:15.412403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:15.414628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:15.515032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:38:15.733305 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa52c0a5-c569-4bc0-a41c-97220e230300 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 204 len: 0 microversion: 2.1 time: 0.351118 Oct 27 10:38:15.733917 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2843/5891] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:38:15 2022] DELETE /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:38:15.743486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:15.745228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:15.758010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:15.765420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:15.766120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:15.767154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:15.767831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:15.768509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:16.009852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:16.010661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:16.025495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:16.036071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:16.037126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:16.038130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:16.038786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:16.043720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:16.071668 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] HTTP exception thrown: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Request method failure captured: Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 HTTP/1.1 Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl48MeonzuvrJ4l5gQ8Fzoi4OR2-AUTVhQ3to3tyHw6Igfw6Q9J6pF83lM6w1KVA2yEMEvUQkhwqhcuAf0JPMsalnf2Vv1ownF-gfWGFqY4Nk6TTkaq6_4RYYIF0pF85SwR9pVk7mVDR6RsVSqBWnzbw8ZOJCsbbUhK77sLOMK4Zoj0 Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_177f03c2fe044ba39efb1861ed6dc4ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 809eac4d896042d39a2277386e511c3d Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '0c7b99b5-44f0-4d33-8c86-3d974eaa8f66'} Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:16.073639 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:16.077585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:16.077585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:16.077585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:16.077585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:16.077585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:16.077585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:16.077585 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:16.081058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Returning 404 to user: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:16.082176 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f91a05e-0cd0-43d8-ab5b-a6c4b03d12b1 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 404 len: 111 microversion: 2.1 time: 0.076880 Oct 27 10:38:16.083256 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2844/5892] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:16 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:38:16.093274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71a92451-2889-4d94-9191-85245720715d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '.version_select at 0x7f6d5a152940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:16.126042 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71a92451-2889-4d94-9191-85245720715d tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331417826" status: 202 len: 0 microversion: 2.1 time: 0.037479 Oct 27 10:38:16.129881 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2845/5893] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:38:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331417826 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:38:16.275424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:16.286892 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-432679a0-5f92-4cb6-8a37-cdf4c57c5c4e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1683 microversion: 2.1 time: 0.548359 Oct 27 10:38:16.293009 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3049/5894] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:15 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1683 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:17.321275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:17.322538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:17.333954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:17.334710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:17.335477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:17.336371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:17.337020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:17.338259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:17.829063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:17.839780 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83d05b99-8251-4c88-a67d-67653ca1e580 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1683 microversion: 2.1 time: 0.523690 Oct 27 10:38:17.854469 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2846/5895] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:17 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1683 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:18.898343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:18.899002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:18.936050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:18.936720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:18.937193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:18.937971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:18.938436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:18.938869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:19.426959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:19.453094 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f03b2f8e-3bc3-45b4-a957-b0075653d8b5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1683 microversion: 2.1 time: 0.589159 Oct 27 10:38:19.470925 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3050/5896] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:18 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1683 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:20.487937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:20.488583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:20.508408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:20.509251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:20.511922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:20.513538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:20.514227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:20.515890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:20.692444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:20.696247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:20.702137 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0afb6ca8-8a95-4a2a-8e78-01d126a58a6e tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1615 microversion: 2.1 time: 0.220631 Oct 27 10:38:20.712868 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2847/5897] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:20 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1615 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:21.734999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:21.736197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:21.743487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:21.744161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:21.744893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:21.746118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:21.746728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:21.747314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:21.853631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cd38b77cb4f63950f937ec3bdb134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e188614201142b089c88d6c819922df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:21.885793 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15184591-d864-4d7d-a2af-62e514218dc5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 200 len: 1615 microversion: 2.1 time: 0.149805 Oct 27 10:38:21.886700 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3051/5898] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:21 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 1615 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:21.939233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-52b8018c-942c-4776-b1d9-7ea5d5cd15c8 req-3bbf42d3-0430-43d9-aad6-55f82d94395c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb", "name": "network-vif-deleted", "tag": "833183ba-bac8-467d-9009-d1ec45d61006"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:21.965155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-52b8018c-942c-4776-b1d9-7ea5d5cd15c8 req-3bbf42d3-0430-43d9-aad6-55f82d94395c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:21.965914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-52b8018c-942c-4776-b1d9-7ea5d5cd15c8 req-3bbf42d3-0430-43d9-aad6-55f82d94395c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:21.966490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-52b8018c-942c-4776-b1d9-7ea5d5cd15c8 req-3bbf42d3-0430-43d9-aad6-55f82d94395c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:21.986034 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-52b8018c-942c-4776-b1d9-7ea5d5cd15c8 req-3bbf42d3-0430-43d9-aad6-55f82d94395c service nova] Creating event network-vif-deleted:833183ba-bac8-467d-9009-d1ec45d61006 for instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb on n-h1-854663-10 Oct 27 10:38:22.001983 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-52b8018c-942c-4776-b1d9-7ea5d5cd15c8 req-3bbf42d3-0430-43d9-aad6-55f82d94395c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067276 Oct 27 10:38:22.011746 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2848/5899] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:22.913733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:22.914340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:22.941368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:22.941984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:22.943936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:22.946572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:22.947225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:22.947882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:23.005281 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb HTTP/1.1 Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb'} Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:23.007685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:23.013086 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:23.013086 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:23.013086 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:23.013086 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:23.013086 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:23.013086 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:23.013086 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:23.016269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:23.018235 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca274ab6-0294-4e53-99b3-b40fefda4965 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 404 len: 111 microversion: 2.1 time: 0.109701 Oct 27 10:38:23.021823 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3052/5900] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:22 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:23.033460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d6b27486-8cac-4862-b1b6-8ea89f8c4c54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '.version_select at 0x7f6d5a1610d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:23.124323 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d6b27486-8cac-4862-b1b6-8ea89f8c4c54 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717825523" status: 202 len: 0 microversion: 2.1 time: 0.097681 Oct 27 10:38:23.126425 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2849/5901] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 10:38:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717825523 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:38:30.332333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:30.332926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:30.346410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:30.349221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:30.349511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:30.351366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:30.352832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:30.354266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:30.402880 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] HTTP exception thrown: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Request method failure captured: Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 HTTP/1.1 Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl48MeonzuvrJ4l5gQ8Fzoi4OR2-AUTVhQ3to3tyHw6Igfw6Q9J6pF83lM6w1KVA2yEMEvUQkhwqhcuAf0JPMsalnf2Vv1ownF-gfWGFqY4Nk6TTkaq6_4RYYIF0pF85SwR9pVk7mVDR6RsVSqBWnzbw8ZOJCsbbUhK77sLOMK4Zoj0 Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_177f03c2fe044ba39efb1861ed6dc4ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 809eac4d896042d39a2277386e511c3d Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '0c7b99b5-44f0-4d33-8c86-3d974eaa8f66'} Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:30.405367 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.409104 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.411810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Returning 404 to user: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:30.418712 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3dbd503f-0d28-4501-b3ed-fb96da9281d8 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 404 len: 111 microversion: 2.1 time: 0.090632 Oct 27 10:38:30.419945 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3053/5902] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:38:30 2022] DELETE /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:30.428930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:30.430781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:30.453795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:30.457859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:30.460545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:30.462983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:30.464497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:30.466158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:30.499697 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] HTTP exception thrown: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Request method failure captured: Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 HTTP/1.1 Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl48MeonzuvrJ4l5gQ8Fzoi4OR2-AUTVhQ3to3tyHw6Igfw6Q9J6pF83lM6w1KVA2yEMEvUQkhwqhcuAf0JPMsalnf2Vv1ownF-gfWGFqY4Nk6TTkaq6_4RYYIF0pF85SwR9pVk7mVDR6RsVSqBWnzbw8ZOJCsbbUhK77sLOMK4Zoj0 Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_177f03c2fe044ba39efb1861ed6dc4ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 809eac4d896042d39a2277386e511c3d Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '0c7b99b5-44f0-4d33-8c86-3d974eaa8f66'} Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:30.502371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.506156 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:30.506156 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:30.506156 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:30.506156 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:30.506156 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:30.506156 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. Oct 27 10:38:30.506156 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:30.506156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Returning 404 to user: Instance 0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:30.517451 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9eca2b66-5075-4e2e-b027-fc6416eb7172 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66" status: 404 len: 111 microversion: 2.1 time: 0.093327 Oct 27 10:38:30.518072 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2850/5903] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:30 2022] GET /compute/v2.1/servers/0c7b99b5-44f0-4d33-8c86-3d974eaa8f66 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:32.342969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:32.344089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:32.357140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:32.361883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:32.362600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:32.364227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:32.368649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:32.369500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:32.414825 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb HTTP/1.1 Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb'} Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:32.421772 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.426220 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.427980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:32.429628 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9554ad99-5b99-48b7-ba91-cab900b07540 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 404 len: 111 microversion: 2.1 time: 0.091344 Oct 27 10:38:32.436357 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3054/5904] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:38:32 2022] DELETE /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:32.444555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:32.445450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:32.449135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:32.501156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:32.501791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:32.502261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:32.508637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:32.509350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:32.510299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:32.542524 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb HTTP/1.1 Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb'} Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:32.549845 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.554397 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:32.554397 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:32.554397 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:32.554397 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:32.554397 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:32.554397 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. Oct 27 10:38:32.554397 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:32.557199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:32.558278 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3486a20d-7c99-4a19-9a8e-bc8cc88ce7e1 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb" status: 404 len: 111 microversion: 2.1 time: 0.117973 Oct 27 10:38:32.566217 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2851/5905] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:32 2022] GET /compute/v2.1/servers/b8492fb9-b7ff-48a7-a5f4-be8dd7a458eb => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:37.458239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:37.459321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:37.466102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:37.477499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:37.478246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:37.491675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:37.492473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:37.492979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:37.493409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:37.529183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:37.542439 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] HTTP exception thrown: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Request method failure captured: Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d HTTP/1.1 Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl48MeonzuvrJ4l5gQ8Fzoi4OR2-AUTVhQ3to3tyHw6Igfw6Q9J6pF83lM6w1KVA2yEMEvUQkhwqhcuAf0JPMsalnf2Vv1ownF-gfWGFqY4Nk6TTkaq6_4RYYIF0pF85SwR9pVk7mVDR6RsVSqBWnzbw8ZOJCsbbUhK77sLOMK4Zoj0 Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_177f03c2fe044ba39efb1861ed6dc4ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 809eac4d896042d39a2277386e511c3d Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '54262900-8cfa-46f1-9450-fba6c0b3290d'} Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:37.544509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Returning 404 to user: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:37.549082 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f1fb6a0-2e2c-408d-8abb-19f036f7f964 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "DELETE /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 404 len: 111 microversion: 2.1 time: 0.092810 Oct 27 10:38:37.551522 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3055/5906] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:38:37 2022] DELETE /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:37.555937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:37.557626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] [instance: 54262900-8cfa-46f1-9450-fba6c0b3290d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:37.572112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:37.574143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:37.575309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:37.576904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:37.577759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:37.578348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:37.594083 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] HTTP exception thrown: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Request method failure captured: Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d HTTP/1.1 Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl48MeonzuvrJ4l5gQ8Fzoi4OR2-AUTVhQ3to3tyHw6Igfw6Q9J6pF83lM6w1KVA2yEMEvUQkhwqhcuAf0JPMsalnf2Vv1ownF-gfWGFqY4Nk6TTkaq6_4RYYIF0pF85SwR9pVk7mVDR6RsVSqBWnzbw8ZOJCsbbUhK77sLOMK4Zoj0 Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_177f03c2fe044ba39efb1861ed6dc4ee", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/177f03c2fe044ba39efb1861ed6dc4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 177f03c2fe044ba39efb1861ed6dc4ee Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-953392069 Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 809eac4d896042d39a2277386e511c3d Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-953392069-project Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '54262900-8cfa-46f1-9450-fba6c0b3290d'} Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:37.597402 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.601964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:37.601964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:37.601964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:37.601964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:37.601964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:37.601964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. Oct 27 10:38:37.601964 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:37.603593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] Returning 404 to user: Instance 54262900-8cfa-46f1-9450-fba6c0b3290d could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:37.605898 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1086fc81-54d4-4960-980d-c3af21d30244 tempest-AttachVolumeTestJSON-953392069 tempest-AttachVolumeTestJSON-953392069-project] 10.222.0.76 "GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d" status: 404 len: 111 microversion: 2.1 time: 0.054459 Oct 27 10:38:37.608500 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2852/5907] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:37 2022] GET /compute/v2.1/servers/54262900-8cfa-46f1-9450-fba6c0b3290d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:39.421906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:39.422414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:39.447442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:39.447958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:39.450335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:39.454958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:39.456529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:39.459149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:39.502265 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 HTTP/1.1 Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'cf11cf55-8f04-467b-814f-de51ffa32347'} Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:39.504484 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.509082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:39.515859 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9008d0b7-912b-4873-b78a-243d37c8faf0 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 404 len: 111 microversion: 2.1 time: 0.096750 Oct 27 10:38:39.515859 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3056/5908] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:38:39 2022] DELETE /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:39.523287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:39.524015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: cf11cf55-8f04-467b-814f-de51ffa32347] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:39.550378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:39.550986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:39.552748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:39.553581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:39.556246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:39.556848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:39.602165 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 HTTP/1.1 Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'cf11cf55-8f04-467b-814f-de51ffa32347'} Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:39.604301 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.609205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.609205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:39.609205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:39.609205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:39.609205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:39.609205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. Oct 27 10:38:39.609205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.610742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance cf11cf55-8f04-467b-814f-de51ffa32347 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:39.611833 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bf7f6b7e-7d1c-4f2b-bbcb-a08bb080bc23 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347" status: 404 len: 111 microversion: 2.1 time: 0.092768 Oct 27 10:38:39.613034 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2853/5909] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:39 2022] GET /compute/v2.1/servers/cf11cf55-8f04-467b-814f-de51ffa32347 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:39.621370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:39.622390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:39.634635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:39.652079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:39.654584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:39.656241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:39.656916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:39.657499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:39.678063 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce HTTP/1.1 Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '66def8f6-88b2-4b5e-afb9-211a7b2408ce'} Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:39.679980 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.684712 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.688191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:39.689340 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-633df556-f6b4-4976-9784-d62e441bda96 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 404 len: 111 microversion: 2.1 time: 0.072711 Oct 27 10:38:39.690091 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3057/5910] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:38:39 2022] DELETE /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:38:39.700964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:39.701703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: 66def8f6-88b2-4b5e-afb9-211a7b2408ce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:39.714795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:39.717955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:39.719533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:39.721574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:39.724112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:39.725607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:39.755999 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce HTTP/1.1 Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '66def8f6-88b2-4b5e-afb9-211a7b2408ce'} Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:39.757841 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.761982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:39.761982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:39.761982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:39.761982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:39.761982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:39.761982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. Oct 27 10:38:39.761982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:39.761982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance 66def8f6-88b2-4b5e-afb9-211a7b2408ce could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:39.761982 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c078f0c-8984-4fed-9ba7-89c379abb5be tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce" status: 404 len: 111 microversion: 2.1 time: 0.064886 Oct 27 10:38:39.764054 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2854/5911] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:39 2022] GET /compute/v2.1/servers/66def8f6-88b2-4b5e-afb9-211a7b2408ce => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:46.710035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:46.711602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:46.725894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:46.726392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:46.726827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:46.733742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:46.742115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:46.743783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:46.786095 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 HTTP/1.1 Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6'} Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:46.796076 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.800819 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.805825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:46.808703 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdc6fb7b-1c6f-43a7-992f-045750bde2f5 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 404 len: 111 microversion: 2.1 time: 0.103228 Oct 27 10:38:46.817129 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3058/5912] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:38:46 2022] DELETE /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:46.826409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:46.827587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] [instance: b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:46.836020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:46.836518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:46.837008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:46.837720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:46.838801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:46.839447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:46.873860 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] HTTP exception thrown: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Request method failure captured: Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 HTTP/1.1 Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl4GVDcFcZz568SabI17Nk9-mifJfMw1QVYpH0sUpQT9EWeuR6a8TAtj1-NDDsbnPCOQMZjqHdlrHZ6mD_VdeRLGLCrYWpB-1jENUUj7DdU52qzOY8Ia0CRsqZ77WUOf91xXl_4s-EDd_CZak6ugAoyGem5jfHx2vgV4Y0p5p7MKdzE Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e188614201142b089c88d6c819922df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e188614201142b089c88d6c819922df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e188614201142b089c88d6c819922df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 7e188614201142b089c88d6c819922df Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-612325762 Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 258cd38b77cb4f63950f937ec3bdb134 Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-612325762-project Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6'} Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:46.875412 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] Returning 404 to user: Instance b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3af95927-15c4-4e67-8576-77cd49dcaf32 tempest-AttachVolumeNegativeTest-612325762 tempest-AttachVolumeNegativeTest-612325762-project] 10.222.0.76 "GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6" status: 404 len: 111 microversion: 2.1 time: 0.055957 Oct 27 10:38:46.879232 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2855/5913] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:46 2022] GET /compute/v2.1/servers/b3ef2e31-40f2-46bd-ac43-d8c8c4e766a6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:52.015593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c736ce6e-a309-4ac4-957b-e7baa9895f83 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Action: 'create', calling method: .version_select at 0x7f6d5bae15e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1619621756"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:52.577332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c736ce6e-a309-4ac4-957b-e7baa9895f83 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.851268 Oct 27 10:38:52.585698 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3059/5914] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Oct 27 10:38:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 853 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 10:38:52.592711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-14ba0b6f-2795-4b53-a856-74e6d13f3e22 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a148d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:52.690682 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-14ba0b6f-2795-4b53-a856-74e6d13f3e22 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 200 len: 345 microversion: 2.1 time: 0.103397 Oct 27 10:38:52.691267 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2856/5915] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:38:52 2022] GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:53.706371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-feee67cb-1d95-4e2d-99ca-e6ce2e4cbef7 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d6377af70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:53.797504 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-feee67cb-1d95-4e2d-99ca-e6ce2e4cbef7 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 200 len: 345 microversion: 2.1 time: 0.095590 Oct 27 10:38:53.801616 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3060/5916] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:38:53 2022] GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:54.814009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3efdae95-b8ff-4aff-b21e-cff501902a30 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5ba43940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:54.949475 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3efdae95-b8ff-4aff-b21e-cff501902a30 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 200 len: 346 microversion: 2.1 time: 0.139810 Oct 27 10:38:54.950429 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2857/5917] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:38:54 2022] GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 346 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:54.963429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54a76a4b-98c1-4d89-8497-2cda1c6a640b tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Action: 'create', calling method: .version_select at 0x7f6d5bab13a0>, body: {"snapshot": {"volume_id": "20518f45-9443-4c31-bfd6-3f3bc5b235ce", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1429253160"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:55.304916 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54a76a4b-98c1-4d89-8497-2cda1c6a640b tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.345588 Oct 27 10:38:55.306999 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3061/5918] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 27 10:38:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:55.318555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2eb506fd-a16c-4ed7-9cb1-b90465ce7e68 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a148c10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:55.405627 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2eb506fd-a16c-4ed7-9cb1-b90465ce7e68 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 200 len: 287 microversion: 2.1 time: 0.091614 Oct 27 10:38:55.406541 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2858/5919] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:38:55 2022] GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:55.418092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-facecf4a-ebd4-4b29-a1f8-0acef840793c tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a7f6af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:55.493045 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-facecf4a-ebd4-4b29-a1f8-0acef840793c tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.078755 Oct 27 10:38:55.493662 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3062/5920] 10.222.0.76 () {58 vars in 1140 bytes} [Thu Oct 27 10:38:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:55.506111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9fc4f95d-6146-4f9c-bee1-a53dcc337b51 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a85e310>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:55.564498 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9fc4f95d-6146-4f9c-bee1-a53dcc337b51 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 200 len: 287 microversion: 2.1 time: 0.062992 Oct 27 10:38:55.565256 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2859/5921] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:38:55 2022] GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:56.590099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1526af96-6f7a-4c3c-abed-a0b9ea6e5dab tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a7f6ca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:56.669372 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1526af96-6f7a-4c3c-abed-a0b9ea6e5dab tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 200 len: 287 microversion: 2.1 time: 0.094602 Oct 27 10:38:56.671705 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3063/5922] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:38:56 2022] GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:57.684018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=9 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:57.686759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=14 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:57.693425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae031797-0aaf-49c4-a0bd-6fcfcd34df8c tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a1988b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:57.766467 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae031797-0aaf-49c4-a0bd-6fcfcd34df8c tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 200 len: 287 microversion: 2.1 time: 0.086881 Oct 27 10:38:57.767812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2860/5923] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:38:57 2022] GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:58.780144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd275dfb-ee6a-4cc9-af5a-bc9d1a47ada5 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5bab1940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:58.786889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=7 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:58.789026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=7 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:58.873674 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd275dfb-ee6a-4cc9-af5a-bc9d1a47ada5 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 200 len: 288 microversion: 2.1 time: 0.097652 Oct 27 10:38:58.876150 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3064/5924] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:38:58 2022] GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:58.887425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01519845-0dd6-428e-82dc-708eebf64ea0 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d6386bdc0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:58.990134 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01519845-0dd6-428e-82dc-708eebf64ea0 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 202 len: 0 microversion: 2.1 time: 0.106901 Oct 27 10:38:58.994207 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2861/5925] 10.222.0.76 () {58 vars in 1254 bytes} [Thu Oct 27 10:38:58 2022] DELETE /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:38:59.002582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3217fc41-355e-4f61-a005-4b443978d528 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a86c3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:59.059419 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3217fc41-355e-4f61-a005-4b443978d528 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 200 len: 287 microversion: 2.1 time: 0.060832 Oct 27 10:38:59.065022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3065/5926] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:38:58 2022] GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:39:00.072625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9f0bab2-b07a-4f85-8fa5-8226e9361a66 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a164820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:00.160164 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9f0bab2-b07a-4f85-8fa5-8226e9361a66 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 200 len: 287 microversion: 2.1 time: 0.092361 Oct 27 10:39:00.161060 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2862/5927] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:39:00 2022] GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:39:01.174387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df3b386b-f70a-4c70-b71d-bd0456aaf03a tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5baf3b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:01.287050 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df3b386b-f70a-4c70-b71d-bd0456aaf03a tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 200 len: 287 microversion: 2.1 time: 0.117910 Oct 27 10:39:01.292386 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3066/5928] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:39:01 2022] GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:39:02.310499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42ae330d-608d-479f-b6b9-35a1ece3f015 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a85e550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:02.384297 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-42ae330d-608d-479f-b6b9-35a1ece3f015 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] HTTP exception thrown: Snapshot 8c01a590-c078-4b36-823a-7e3b9db9782d could not be found. Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42ae330d-608d-479f-b6b9-35a1ece3f015 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Request method failure captured: Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d HTTP/1.1 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl-7fmokElfom4XVjmcRMuHFFEm6D9Xo58WDE4EMVsTpr6PICmApO4_7N_2C68_9JBVNa-rxGRk3olB6UDDTIqI4sDAQ65bnto2b4zb2kdoM3NdL_Y1gDEMa2-cwPiB8q27WREAf-f1ZNN2Y-xS6_87z8FBCP3dBCo9QxgKT8yBU824 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f10bccb289a04e5e816c2206bc5ce996 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f10bccb289a04e5e816c2206bc5ce996", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f10bccb289a04e5e816c2206bc5ce996 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotsTestJSON-1697178782-project Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 74d707edde534a3c97c9f8093e7c2e2d Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1697178782-project Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: exception: Snapshot 8c01a590-c078-4b36-823a-7e3b9db9782d could not be found. Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '8c01a590-c078-4b36-823a-7e3b9db9782d'} Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8c01a590-c078-4b36-823a-7e3b9db9782d could not be found. (HTTP 404) (Request-ID: req-4d4dae79-8487-4346-8fb9-354d02953e2b) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:39:02.395707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8c01a590-c078-4b36-823a-7e3b9db9782d could not be found. Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8c01a590-c078-4b36-823a-7e3b9db9782d could not be found. Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8c01a590-c078-4b36-823a-7e3b9db9782d could not be found. Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42ae330d-608d-479f-b6b9-35a1ece3f015 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Returning 404 to user: Snapshot 8c01a590-c078-4b36-823a-7e3b9db9782d could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:39:02.399707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-42ae330d-608d-479f-b6b9-35a1ece3f015 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d" status: 404 len: 111 microversion: 2.1 time: 0.101827 Oct 27 10:39:02.403203 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2863/5929] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 10:39:02 2022] GET /compute/v2.1/os-snapshots/8c01a590-c078-4b36-823a-7e3b9db9782d => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:39:02.417881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22dd92d4-d762-4122-8278-26a9573b15ce tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5baf3280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:02.637319 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22dd92d4-d762-4122-8278-26a9573b15ce tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 202 len: 0 microversion: 2.1 time: 0.232945 Oct 27 10:39:02.641170 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3067/5930] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:39:02 2022] DELETE /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:39:02.649904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d61ea7c9-2b94-4880-ac1c-6696de062cc5 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5acd5ee0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:02.768716 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d61ea7c9-2b94-4880-ac1c-6696de062cc5 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 200 len: 345 microversion: 2.1 time: 0.125092 Oct 27 10:39:02.776586 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2864/5931] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:39:02 2022] GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:39:03.784383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-796fe40d-e643-4593-bd96-4e0842dee53b tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a7f6280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:03.919159 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-796fe40d-e643-4593-bd96-4e0842dee53b tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 200 len: 345 microversion: 2.1 time: 0.139380 Oct 27 10:39:03.920349 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3068/5932] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:39:03 2022] GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:39:04.935267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe5a186c-7d9d-46a0-b867-c752d9172a44 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a164940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:05.068057 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe5a186c-7d9d-46a0-b867-c752d9172a44 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 200 len: 345 microversion: 2.1 time: 0.137485 Oct 27 10:39:05.069353 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2865/5933] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:39:04 2022] GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:39:06.084377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e425078f-b89b-4685-8273-eb29dd3c9215 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5bafd3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:06.188703 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e425078f-b89b-4685-8273-eb29dd3c9215 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 200 len: 345 microversion: 2.1 time: 0.108876 Oct 27 10:39:06.196121 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3069/5934] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:39:06 2022] GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:39:07.205013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8764cac-47b3-4f4f-a7b1-9155b7d9057e tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a1639d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:07.269178 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-d8764cac-47b3-4f4f-a7b1-9155b7d9057e tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] HTTP exception thrown: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8764cac-47b3-4f4f-a7b1-9155b7d9057e tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Request method failure captured: Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce HTTP/1.1 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl-7fmokElfom4XVjmcRMuHFFEm6D9Xo58WDE4EMVsTpr6PICmApO4_7N_2C68_9JBVNa-rxGRk3olB6UDDTIqI4sDAQ65bnto2b4zb2kdoM3NdL_Y1gDEMa2-cwPiB8q27WREAf-f1ZNN2Y-xS6_87z8FBCP3dBCo9QxgKT8yBU824 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f10bccb289a04e5e816c2206bc5ce996 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f10bccb289a04e5e816c2206bc5ce996", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f10bccb289a04e5e816c2206bc5ce996 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotsTestJSON-1697178782-project Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 74d707edde534a3c97c9f8093e7c2e2d Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1697178782-project Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: exception: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '20518f45-9443-4c31-bfd6-3f3bc5b235ce'} Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. (HTTP 404) (Request-ID: req-defb83a7-77c2-40a3-b873-a98f7f31355c) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:39:07.274442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.279028 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.288518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8764cac-47b3-4f4f-a7b1-9155b7d9057e tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Returning 404 to user: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:39:07.289503 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8764cac-47b3-4f4f-a7b1-9155b7d9057e tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 404 len: 109 microversion: 2.1 time: 0.089615 Oct 27 10:39:07.291083 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2866/5935] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:39:07 2022] GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:39:07.301287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8552b57e-0f6a-4b07-a14f-bb2e6c907e16 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a86c670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:07.351934 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-8552b57e-0f6a-4b07-a14f-bb2e6c907e16 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] HTTP exception thrown: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8552b57e-0f6a-4b07-a14f-bb2e6c907e16 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Request method failure captured: Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce HTTP/1.1 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWl-7fmokElfom4XVjmcRMuHFFEm6D9Xo58WDE4EMVsTpr6PICmApO4_7N_2C68_9JBVNa-rxGRk3olB6UDDTIqI4sDAQ65bnto2b4zb2kdoM3NdL_Y1gDEMa2-cwPiB8q27WREAf-f1ZNN2Y-xS6_87z8FBCP3dBCo9QxgKT8yBU824 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: f10bccb289a04e5e816c2206bc5ce996 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f10bccb289a04e5e816c2206bc5ce996", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: f10bccb289a04e5e816c2206bc5ce996 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotsTestJSON-1697178782-project Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 74d707edde534a3c97c9f8093e7c2e2d Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1697178782-project Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: method: Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: exception: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '20518f45-9443-4c31-bfd6-3f3bc5b235ce'} Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. (HTTP 404) (Request-ID: req-b322882c-4014-4514-8fef-1793d23cded6) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:39:07.355633 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8552b57e-0f6a-4b07-a14f-bb2e6c907e16 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Returning 404 to user: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8552b57e-0f6a-4b07-a14f-bb2e6c907e16 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 404 len: 109 microversion: 2.1 time: 0.060925 Oct 27 10:39:07.359754 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3070/5936] 10.222.0.76 () {58 vars in 1248 bytes} [Thu Oct 27 10:39:07 2022] DELETE /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:39:07.367361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9265f81-84f7-491f-afc3-2944784ff811 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Calling method '.version_select at 0x7f6d5a1681f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:07.422021 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b9265f81-84f7-491f-afc3-2944784ff811 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] HTTP exception thrown: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9265f81-84f7-491f-afc3-2944784ff811 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Request method failure captured: Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce HTTP/1.1 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWl-7fmokElfom4XVjmcRMuHFFEm6D9Xo58WDE4EMVsTpr6PICmApO4_7N_2C68_9JBVNa-rxGRk3olB6UDDTIqI4sDAQ65bnto2b4zb2kdoM3NdL_Y1gDEMa2-cwPiB8q27WREAf-f1ZNN2Y-xS6_87z8FBCP3dBCo9QxgKT8yBU824 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: f10bccb289a04e5e816c2206bc5ce996 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f10bccb289a04e5e816c2206bc5ce996", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f10bccb289a04e5e816c2206bc5ce996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: f10bccb289a04e5e816c2206bc5ce996 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1697178782 Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotsTestJSON-1697178782-project Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 74d707edde534a3c97c9f8093e7c2e2d Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1697178782-project Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: method: Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: exception: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '20518f45-9443-4c31-bfd6-3f3bc5b235ce'} Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. (HTTP 404) (Request-ID: req-a67e6c60-ffe1-4afe-bd43-c8ee572d63bb) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 10:39:07.425371 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9265f81-84f7-491f-afc3-2944784ff811 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] Returning 404 to user: Volume 20518f45-9443-4c31-bfd6-3f3bc5b235ce could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b9265f81-84f7-491f-afc3-2944784ff811 tempest-VolumesSnapshotsTestJSON-1697178782 tempest-VolumesSnapshotsTestJSON-1697178782-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce" status: 404 len: 109 microversion: 2.1 time: 0.064201 Oct 27 10:39:07.429715 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2867/5937] 10.222.0.76 () {58 vars in 1245 bytes} [Thu Oct 27 10:39:07 2022] GET /compute/v2.1/os-volumes/20518f45-9443-4c31-bfd6-3f3bc5b235ce => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:40:33.165327 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:40:33.165952 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 10:40:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Oct 27 10:40:33.559758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-674790136", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "5bad97c6-3dc2-4fcc-8657-18c7109eccfe"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:40:33.669359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] validate_networks() for [('5bad97c6-3dc2-4fcc-8657-18c7109eccfe', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:40:36.066977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:40:36.068085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:40:36.068818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:40:36.069604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:40:36.070360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:40:36.090313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:36.091233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:36.092074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:36.094793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:36.102385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:36.103278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:36.153414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Getting quotas for project 46c92676ee574f25bce1b406db41de31. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:40:36.169015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Getting quotas for user 24e1e30765f24938a43ade416717a8c0 and project 46c92676ee574f25bce1b406db41de31. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:40:36.209751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:40:36.217906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:40:36.364072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75aafef0-942a-49c1-b7f1-f9da264e0e07 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.204154 Oct 27 10:40:36.365705 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3071/5938] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:40:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:40:36.378401 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3317bcd0-7139-4b6a-a168-7c5e11e5c085] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:40:36.381556 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:40:36.382221 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 10:40:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 (ip 10.222.0.76) !!! Oct 27 10:40:36.393865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9569b135-5372-4610-88a3-8d56c34bcb5c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:36.398881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9569b135-5372-4610-88a3-8d56c34bcb5c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:36.696388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9569b135-5372-4610-88a3-8d56c34bcb5c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:36.709040 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9569b135-5372-4610-88a3-8d56c34bcb5c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1213 microversion: 2.1 time: 0.332927 Oct 27 10:40:36.713157 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2868/5939] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:36 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1213 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:37.739954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:37.740586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:37.761024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:37.761565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:37.762015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:37.762765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:37.763213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:37.763652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:38.073241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:38.096880 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79113970-c397-4288-bb6c-3b872caa2e57 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1217 microversion: 2.1 time: 0.361050 Oct 27 10:40:38.097489 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3072/5940] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:37 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1217 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:39.126217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:39.128766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:39.162143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:39.162895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:39.165002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:39.172148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:39.172953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:39.173555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:39.215649 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [3317bcd0-7139-4b6a-a168-7c5e11e5c085] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 54412. Oct 27 10:40:39.447168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:39.461599 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8774df73-45af-4a12-a465-4894fe36bbe1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1265 microversion: 2.1 time: 0.339509 Oct 27 10:40:39.472698 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2869/5941] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:39 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1265 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:40.487810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:40.488706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:40.503676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:40.508000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:40.509086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:40.510413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:40.513384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:40.513954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:40.709196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:40.734028 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9153c164-94ad-4d27-8b0b-81b41243674f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1271 microversion: 2.1 time: 0.250741 Oct 27 10:40:40.740034 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3073/5942] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:40 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:41.769303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:41.772524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:41.799945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:41.802237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:41.804409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:41.809180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:41.816718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:41.818632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:42.176238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:42.197484 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d92abb8-2315-40e5-a677-71944d701aff tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1271 microversion: 2.1 time: 0.437101 Oct 27 10:40:42.212782 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2870/5943] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:41 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1271 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:43.224217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:43.226546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:43.246948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:43.247699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:43.251792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:43.252703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:43.253274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:43.255917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:44.567753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:44.581987 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39547c3c-7848-4ce8-b7a9-27474bc649a4 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 1.361807 Oct 27 10:40:44.596981 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3074/5944] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:43 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:45.611872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:45.614130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:45.628453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:45.629619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:45.630145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:45.630891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:45.631353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:45.631784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:46.035175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:46.048850 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5043038-27a6-47bd-ade1-868835f2c040 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 0.440480 Oct 27 10:40:46.051776 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2871/5945] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:45 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:46.989981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:40:46.990562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:40:47.076333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:47.077691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:47.089699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:40:47.094561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:47.096629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:47.097174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:47.097953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:47.101297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:47.102811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:47.299563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-be56a0c4-71d1-462b-ab48-78338eb41d65 req-2ad8814b-f3b6-40c4-ad08-9c101cb5346c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3", "tag": "8bfda48a-253b-4b46-9cb6-954f82a7f123"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:40:47.322612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be56a0c4-71d1-462b-ab48-78338eb41d65 req-2ad8814b-f3b6-40c4-ad08-9c101cb5346c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:47.325701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be56a0c4-71d1-462b-ab48-78338eb41d65 req-2ad8814b-f3b6-40c4-ad08-9c101cb5346c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:47.326168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be56a0c4-71d1-462b-ab48-78338eb41d65 req-2ad8814b-f3b6-40c4-ad08-9c101cb5346c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:47.361229 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-be56a0c4-71d1-462b-ab48-78338eb41d65 req-2ad8814b-f3b6-40c4-ad08-9c101cb5346c service nova] Creating event network-changed:8bfda48a-253b-4b46-9cb6-954f82a7f123 for instance bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 on n-h1-854663-10 Oct 27 10:40:47.376169 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-be56a0c4-71d1-462b-ab48-78338eb41d65 req-2ad8814b-f3b6-40c4-ad08-9c101cb5346c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393203 Oct 27 10:40:47.377265 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3075/5946] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:40:47.967268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:47.977286 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0286860-9bca-449d-b722-048b6825a153 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 0.905036 Oct 27 10:40:47.992831 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2872/5947] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:47 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:40:49.004565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:49.005331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:49.027806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:49.032150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:49.033040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:49.034646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:49.035343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:49.036079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:49.439336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:49.452084 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57d40d7b-dfb1-4df4-a629-93971214335a tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 0.451852 Oct 27 10:40:49.456905 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3076/5948] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:48 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:50.480561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:50.481599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:50.500424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:50.501941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:50.511912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:50.512902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:50.514076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:50.516181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:51.778530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:51.789644 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-69604621-0b5c-4566-aec0-b22b01ab7339 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 1.313311 Oct 27 10:40:51.792849 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2873/5949] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:50 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:52.838314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:52.841549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:52.873680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:52.875629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:52.879292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:52.883269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:52.884055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:52.889340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:53.392359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:53.418081 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e34b1df5-9fbc-4cb3-afb7-60e595cc8b77 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 0.606250 Oct 27 10:40:53.429643 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3077/5950] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:52 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:54.453132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:54.453826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:54.464289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:54.464817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:54.474130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:54.474833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:54.475317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:54.475750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:54.989376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:55.005040 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e3d54c27-75f9-4aac-b145-67e7163ede5f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 0.554788 Oct 27 10:40:55.007364 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2874/5951] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:54 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:56.038044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:56.038715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:56.064742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:56.065984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:56.068025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:56.069357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:56.076949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:56.078530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:56.494299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:56.506781 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea6e77c8-9e8e-47c5-b6ae-e726c93a5c2f tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 0.476928 Oct 27 10:40:56.507614 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3078/5952] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:56 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:57.368472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-92f50640-67f5-432f-863d-9f7265f126bc req-a2b5d257-b7d2-4cfd-bb0e-0be0c34120fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3", "name": "network-vif-plugged", "status": "completed", "tag": "8bfda48a-253b-4b46-9cb6-954f82a7f123"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:40:57.405334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-92f50640-67f5-432f-863d-9f7265f126bc req-a2b5d257-b7d2-4cfd-bb0e-0be0c34120fc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:57.405807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-92f50640-67f5-432f-863d-9f7265f126bc req-a2b5d257-b7d2-4cfd-bb0e-0be0c34120fc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:57.406242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-92f50640-67f5-432f-863d-9f7265f126bc req-a2b5d257-b7d2-4cfd-bb0e-0be0c34120fc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:57.452548 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-92f50640-67f5-432f-863d-9f7265f126bc req-a2b5d257-b7d2-4cfd-bb0e-0be0c34120fc service nova] Creating event network-vif-plugged:8bfda48a-253b-4b46-9cb6-954f82a7f123 for instance bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 on n-h1-854663-10 Oct 27 10:40:57.469142 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-92f50640-67f5-432f-863d-9f7265f126bc req-a2b5d257-b7d2-4cfd-bb0e-0be0c34120fc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.645765 Oct 27 10:40:57.471475 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2875/5953] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:40:57.533203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:57.533980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:57.550865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:57.551360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:57.555363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:57.556798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:57.557418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:57.557990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:57.910032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:57.918550 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8f76a30-0367-49ae-a7e5-cd63063a5071 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 0.389211 Oct 27 10:40:57.945004 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3079/5954] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:57 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:40:58.961581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:40:58.962400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:40:58.986384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:58.993028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:58.993604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:58.994371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:40:58.996361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:40:58.996857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:40:59.344708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:40:59.355450 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d709033-3dbb-48e2-bb6b-98ac4b311dab tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1313 microversion: 2.1 time: 0.407509 Oct 27 10:40:59.356703 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2876/5955] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:40:58 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:41:00.382814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:00.384124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:00.391358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:00.392095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:00.392668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:00.393438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:00.393892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:00.394357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:00.867237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:00.880205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b461efb0-781a-4b30-900e-708c4209c8c8 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1496 microversion: 2.1 time: 0.501073 Oct 27 10:41:00.880971 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3080/5956] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:00 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1496 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:05.954102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:05.955297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:05.971952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:05.972443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:05.981279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:05.982232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:05.982874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:05.983308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:06.039284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:41:06.210934 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0454977-137a-487f-8774-6b11ddbbf6a1 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "DELETE /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 204 len: 0 microversion: 2.1 time: 0.260208 Oct 27 10:41:06.224339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:06.224961 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2877/5957] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:41:05 2022] DELETE /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:41:06.227037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:06.251895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:06.260648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:06.262809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:06.267186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:06.268137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:06.269060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:06.271059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:06.341042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=53 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:06.708709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:06.719573 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe92ab82-8db3-473c-b75d-97f7c4d48af2 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1502 microversion: 2.1 time: 0.501845 Oct 27 10:41:06.721483 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3081/5958] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:06 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1502 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:41:07.747492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:07.749414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:07.762072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:07.768459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:07.769058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:07.770893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:07.775857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:07.776575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:07.777125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:07.797359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:08.289018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:08.299540 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c3cefd6-4488-48d0-bcd4-d524ddfc5afe tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1502 microversion: 2.1 time: 0.557612 Oct 27 10:41:08.304790 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2878/5959] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:07 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1502 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:09.334667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:09.336429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:09.354781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:09.357497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:09.359930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:09.364372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:09.365124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:09.365797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:10.525078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:10.535755 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13773621-3db4-4d1c-9211-bfeb4474fbe6 tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1502 microversion: 2.1 time: 1.207893 Oct 27 10:41:10.542900 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3082/5960] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:09 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1502 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:10.840617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5c65199f-d23b-42a8-9a2e-b0966f10f153 req-274f1d32-3c1b-4f09-9972-a013489d04b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3", "name": "network-vif-deleted", "tag": "8bfda48a-253b-4b46-9cb6-954f82a7f123"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:41:10.864343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5c65199f-d23b-42a8-9a2e-b0966f10f153 req-274f1d32-3c1b-4f09-9972-a013489d04b6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:10.864872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5c65199f-d23b-42a8-9a2e-b0966f10f153 req-274f1d32-3c1b-4f09-9972-a013489d04b6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:10.865308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5c65199f-d23b-42a8-9a2e-b0966f10f153 req-274f1d32-3c1b-4f09-9972-a013489d04b6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:10.893104 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5c65199f-d23b-42a8-9a2e-b0966f10f153 req-274f1d32-3c1b-4f09-9972-a013489d04b6 service nova] Creating event network-vif-deleted:8bfda48a-253b-4b46-9cb6-954f82a7f123 for instance bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 on n-h1-854663-10 Oct 27 10:41:10.903187 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5c65199f-d23b-42a8-9a2e-b0966f10f153 req-274f1d32-3c1b-4f09-9972-a013489d04b6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066471 Oct 27 10:41:10.908376 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2879/5961] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:41:11.572009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:11.573433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:11.581803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:11.584302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:11.585363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:11.586928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:11.590026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:11.591235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:11.641119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:11.642072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:11.642782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:11.643494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lazy-loading 'fault' on Instance uuid bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:41:11.725797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1e30765f24938a43ade416717a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c92676ee574f25bce1b406db41de31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:11.737686 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74b312db-868b-492e-ab8c-cacd08bdd72c tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 200 len: 1303 microversion: 2.1 time: 0.170861 Oct 27 10:41:11.758785 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3083/5962] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:11 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 1303 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:12.768345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:12.769875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] [instance: bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:12.780606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:12.781496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:12.782239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:12.783680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:12.784450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:12.785096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:12.803711 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] HTTP exception thrown: Instance bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 could not be found. Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Request method failure captured: Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 HTTP/1.1 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmAcZCIjAEQVVIun7KQgLO09WhD88pRqnbz_Bb1V33xVXDOOOsFuXyb7_5bP8MqGHRl6vD-q2tHBSJqI8XJMawMbBsRnLyypbAFkbwhI2_K3ZBTLvp1VxwqpXgC8Bvva91aR0pl5ktYJ_vR8YKp0Kq7TRar6cMzMEUKjNwTQoM1YYzY Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 46c92676ee574f25bce1b406db41de31 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesActionsTest-1680753496 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/46c92676ee574f25bce1b406db41de31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/46c92676ee574f25bce1b406db41de31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_46c92676ee574f25bce1b406db41de31", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/46c92676ee574f25bce1b406db41de31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesActionsTest-1680753496 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 46c92676ee574f25bce1b406db41de31 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesActionsTest-1680753496 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesActionsTest-1680753496-project Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 24e1e30765f24938a43ade416717a8c0 Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesActionsTest-1680753496-project Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 could not be found. Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3'} Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 could not be found. Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 could not be found. Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:41:12.807347 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:41:12.815146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:41:12.815146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:41:12.815146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:41:12.815146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:41:12.815146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:41:12.815146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 could not be found. Oct 27 10:41:12.815146 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:41:12.817956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] Returning 404 to user: Instance bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:41:12.819349 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9d462bbd-57b5-49a9-8d1c-988875ea84ba tempest-VolumesActionsTest-1680753496 tempest-VolumesActionsTest-1680753496-project] 10.222.0.76 "GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3" status: 404 len: 111 microversion: 2.1 time: 0.057479 Oct 27 10:41:12.820958 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2880/5963] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:12 2022] GET /compute/v2.1/servers/bcc7cb8a-a27f-4d0e-99cd-65a2a8846fc3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:41:39.280503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1499255566", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "159ba0f5-a353-4bcb-9a64-19da58bab282", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0264043c-59ac-40f6-8b89-4caf5f646c28"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:41:39.329206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=7 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:39.333291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=19 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:39.451520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] validate_networks() for [('0264043c-59ac-40f6-8b89-4caf5f646c28', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:41:40.639871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:41:40.640458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:41:40.640808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:41:40.641432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:41:40.641875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:41:40.658178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:40.658676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:40.659124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:40.659870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:40.660330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:40.660789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:40.682908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:41:40.688545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for user 6e16c7669eb34fa49714040f728210e4 and project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:41:40.781170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:41:40.783681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='159ba0f5-a353-4bcb-9a64-19da58bab282',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:41:41.037708 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0278a5ee-f43a-4b70-85ec-0e9e0bb20b6a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.766376 Oct 27 10:41:41.038711 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3084/5964] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:41:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:41:41.050694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0cafff04-8607-4dc1-8fb5-2f0695ef8d8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:41.051315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0cafff04-8607-4dc1-8fb5-2f0695ef8d8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:41.055818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:41.057467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=9 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:41.184011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0cafff04-8607-4dc1-8fb5-2f0695ef8d8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:41.192960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0cafff04-8607-4dc1-8fb5-2f0695ef8d8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1057 microversion: 2.1 time: 0.146397 Oct 27 10:41:41.208688 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2881/5965] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:41 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1057 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:42.220812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:42.221870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:42.242529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:42.244860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:42.247222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:42.252071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:42.252780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:42.254677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:43.019168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:43.032803 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4beea209-d618-4c2a-833b-82858e4bf56f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1099 microversion: 2.1 time: 0.816772 Oct 27 10:41:43.033793 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3085/5966] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:42 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1099 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:44.060442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:44.060442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:44.080830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:44.081322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:44.081762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:44.082484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:44.082917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:44.083336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:44.252442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:44.277444 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3217951f-d50f-4efa-a78e-f88c7274d3b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1173 microversion: 2.1 time: 0.221631 Oct 27 10:41:44.281406 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2882/5967] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:44 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1173 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:45.308541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:45.309809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:45.323274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:45.323922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:45.325748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:45.328605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:45.332125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:45.332706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:45.549440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:45.577191 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2a724d6-50a9-4b17-b9e7-eb562be58159 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1173 microversion: 2.1 time: 0.270399 Oct 27 10:41:45.582053 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3086/5968] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:45 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1173 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:46.602228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:46.604120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:46.617870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:46.621413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:46.623216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:46.623216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:46.623216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:46.623491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:47.129992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:47.139654 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-42efd486-4d44-4532-b14a-35474541a9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1215 microversion: 2.1 time: 0.541708 Oct 27 10:41:47.140274 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2883/5969] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:46 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1215 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:48.166077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:48.167431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:48.188531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:48.189362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:48.191771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:48.196964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:48.198737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:48.200929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:48.646046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:48.662178 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-89315e51-3f2b-42c6-a326-1784a20b1a65 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1215 microversion: 2.1 time: 0.501100 Oct 27 10:41:48.686377 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3087/5970] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:48 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1215 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:49.703958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:49.704614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:49.713362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:49.714222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:49.717733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:49.718891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:49.719720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:49.720498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:49.775193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4c8c4dcb-0d8d-4bbc-953b-a033059f995a req-6b180988-fff7-47da-9f56-a1f5775b60b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4928ac-7e10-4bcb-af94-8c7ea4a4618b", "tag": "c74b528b-7035-4f36-8fdc-dedda9f53d6d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:41:49.810157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c8c4dcb-0d8d-4bbc-953b-a033059f995a req-6b180988-fff7-47da-9f56-a1f5775b60b1 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:49.810638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c8c4dcb-0d8d-4bbc-953b-a033059f995a req-6b180988-fff7-47da-9f56-a1f5775b60b1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:49.811060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c8c4dcb-0d8d-4bbc-953b-a033059f995a req-6b180988-fff7-47da-9f56-a1f5775b60b1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:49.834095 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4c8c4dcb-0d8d-4bbc-953b-a033059f995a req-6b180988-fff7-47da-9f56-a1f5775b60b1 service nova] Creating event network-changed:c74b528b-7035-4f36-8fdc-dedda9f53d6d for instance 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b on n-h1-854663-10 Oct 27 10:41:49.854372 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4c8c4dcb-0d8d-4bbc-953b-a033059f995a req-6b180988-fff7-47da-9f56-a1f5775b60b1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082891 Oct 27 10:41:49.855470 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3088/5971] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:41:50.339257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:50.351551 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab3c5896-890a-4b54-88c5-7620baf8c9ba tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1215 microversion: 2.1 time: 0.660033 Oct 27 10:41:50.372519 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2884/5972] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:49 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1215 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:51.374506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:51.376032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:51.382489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:51.386464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:51.409798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:51.410582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:51.411191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:51.412136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:51.412997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:51.413592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:52.094887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:52.105075 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7fa8b9c-63a4-49c5-9b08-46e771b68f23 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1215 microversion: 2.1 time: 0.732549 Oct 27 10:41:52.120725 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3089/5973] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:51 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1215 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:53.136316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:53.136991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:53.139868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:53.163911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:53.167903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:53.169127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:53.171196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:53.179067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:53.179896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:54.466033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:54.481420 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1aacd9a7-ad6f-4184-b348-058e3d0145ee tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1215 microversion: 2.1 time: 1.349867 Oct 27 10:41:54.484835 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2885/5974] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:53 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1215 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:55.520261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:55.522600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:55.532716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:55.533598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:55.539528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:55.540786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:55.541508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:55.542193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:56.133726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:56.146684 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c39f2d1e-5f59-48bc-bfae-c3dbe8acfb7c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1203 microversion: 2.1 time: 0.636748 Oct 27 10:41:56.147615 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3090/5975] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:55 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1203 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:57.170749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:57.171715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:57.194534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:57.195036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:57.195485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:57.196186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:57.196640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:57.202215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:57.702455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:57.716946 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a0c03c4-bf7d-4e00-8c9e-4069fa29f4c7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1203 microversion: 2.1 time: 0.549974 Oct 27 10:41:57.721232 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2886/5976] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:57 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1203 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:58.750858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:58.751673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:58.774616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:58.780171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:58.780874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:58.781770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:58.782376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:58.782915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:59.309936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:59.320035 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33d9e8a3-1ae6-4ef5-a396-310f26910016 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1203 microversion: 2.1 time: 0.573178 Oct 27 10:41:59.329061 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3091/5977] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:58 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1203 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:00.353555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:00.354794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:00.367345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:00.368113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:00.374475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:00.375723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:00.376380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:00.377027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:00.811139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:00.821822 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-242c2582-9a2f-46b4-aa33-6b1400376b06 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1203 microversion: 2.1 time: 0.472208 Oct 27 10:42:00.841245 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2887/5978] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:00 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1203 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:01.844885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:01.846252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:01.872838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:01.873419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:01.874217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:01.877687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:01.878414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:01.879420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:02.941639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:02.955569 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5287a86-5cc1-4767-96f6-0c91d45ff635 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1203 microversion: 2.1 time: 1.113831 Oct 27 10:42:02.959119 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3092/5979] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:01 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1203 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:03.985464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:03.987383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:04.005037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:04.005636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:04.007562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:04.012042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:04.012802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:04.013573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:04.526165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:04.551399 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f00b2e94-72c8-425e-817b-d0af1d11cf1f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1203 microversion: 2.1 time: 0.569851 Oct 27 10:42:04.554359 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2888/5980] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:03 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1203 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:05.575731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:05.576388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:05.587625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:05.592093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:05.594107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:05.596517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:05.602480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:05.605343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:05.984034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0e0bdca6-7201-4144-ad7f-b41da36bf639 req-5627b178-8cfb-4b4b-9726-ecd88c40d8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4928ac-7e10-4bcb-af94-8c7ea4a4618b", "name": "network-vif-plugged", "status": "completed", "tag": "c74b528b-7035-4f36-8fdc-dedda9f53d6d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:06.008419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0e0bdca6-7201-4144-ad7f-b41da36bf639 req-5627b178-8cfb-4b4b-9726-ecd88c40d8cb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:06.008971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0e0bdca6-7201-4144-ad7f-b41da36bf639 req-5627b178-8cfb-4b4b-9726-ecd88c40d8cb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:06.009411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0e0bdca6-7201-4144-ad7f-b41da36bf639 req-5627b178-8cfb-4b4b-9726-ecd88c40d8cb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:06.023009 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0e0bdca6-7201-4144-ad7f-b41da36bf639 req-5627b178-8cfb-4b4b-9726-ecd88c40d8cb service nova] Creating event network-vif-plugged:c74b528b-7035-4f36-8fdc-dedda9f53d6d for instance 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b on n-h1-854663-10 Oct 27 10:42:06.029459 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0e0bdca6-7201-4144-ad7f-b41da36bf639 req-5627b178-8cfb-4b4b-9726-ecd88c40d8cb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049541 Oct 27 10:42:06.030088 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2889/5981] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:42:06.423930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:06.438728 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-395bfacf-e4b4-4ada-a750-bf008c965a20 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1203 microversion: 2.1 time: 0.867001 Oct 27 10:42:06.452986 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3093/5982] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:05 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1203 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:07.473649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:07.474625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:07.490128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:07.491025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:07.491739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:07.493149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:07.494968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:07.495993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:07.857935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:07.877709 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b311896-d2c1-45cf-b268-c17c8d962a44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1203 microversion: 2.1 time: 0.406768 Oct 27 10:42:07.890060 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2890/5983] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:07 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1203 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:08.903155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:08.903766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:08.912939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:08.915341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:08.917823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:08.920189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:08.922204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:08.924082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:09.381271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:09.384731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=57 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:09.406000 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67babf17-40d7-40e9-9dde-34e90e69e921 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1389 microversion: 2.1 time: 0.506581 Oct 27 10:42:09.409670 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3094/5984] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:08 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1389 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:09.431189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:09.440710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:09.463758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:09.472283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:09.472925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:09.475854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:09.476459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:09.488429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:10.399179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:10.413381 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05ee970e-8325-4059-a4ca-4cee95cb1ab6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1389 microversion: 2.1 time: 0.987167 Oct 27 10:42:10.414668 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2891/5985] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:09 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1389 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:10.436494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:10.437225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:10.439966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:10.453003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:10.453497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:10.453935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:10.465314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:10.465859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:10.466317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:10.784812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:10.796104 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d81585ee-a7aa-427a-a172-fe6dfcd0517d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1389 microversion: 2.1 time: 0.361035 Oct 27 10:42:10.797067 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3095/5986] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:10 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1389 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:10.823079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:10.824079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:10.830633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:10.831403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:10.832074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:10.833034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:10.834183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:10.834959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:10.885806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:42:11.084207 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-243bae9d-7a8d-4b0c-b0a7-f89057dc00e4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 204 len: 0 microversion: 2.1 time: 0.265075 Oct 27 10:42:11.088381 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3096/5987] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:42:10 2022] DELETE /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:42:11.094033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:11.095113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:11.102044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:11.102503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:11.103161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:11.104263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:11.105057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:11.105825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:11.169212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c3f9dfe8-18a6-4fa1-8e4b-7b34262979e0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'create', calling method: .version_select at 0x7f6d5a168b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-950209419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACGpUWF2nq/aty7xq8ax9Q4TZ9bAQYsrGDGB2gHRZHPfiVaYjTkG1DLDghRW7HffEu+h/S6kBNJ2zCAnJVmaqci8wqm47Z9WveVL6vWll3myUurv3AbTvaU3eqgVBOzTA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:11.174942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=25 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:11.202025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c3f9dfe8-18a6-4fa1-8e4b-7b34262979e0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:42:11.213242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c3f9dfe8-18a6-4fa1-8e4b-7b34262979e0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for user 5263c34954a94017b2d5095e391ceffc and project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:42:11.245702 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c3f9dfe8-18a6-4fa1-8e4b-7b34262979e0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:42:11.331291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:11.347490 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60d705c0-c262-4d86-9279-08bce0578a1d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1395 microversion: 2.1 time: 0.257000 Oct 27 10:42:11.353282 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3097/5988] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:11 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1395 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:12.265312 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-c3f9dfe8-18a6-4fa1-8e4b-7b34262979e0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 56072. Oct 27 10:42:12.292270 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c3f9dfe8-18a6-4fa1-8e4b-7b34262979e0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.630332 Oct 27 10:42:12.293353 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2892/5989] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:42:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:42:12.388518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:12.392987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:12.414573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:12.418156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:12.421155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:12.424754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:12.427694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:12.428473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:12.727898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:12.739214 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8056d2b1-3ecd-4c8a-ba51-be49a1d54ffe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1395 microversion: 2.1 time: 0.366249 Oct 27 10:42:12.744814 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3098/5990] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:12 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1395 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:13.768778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:13.770989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:13.779938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:13.781542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:13.782228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:13.784154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:13.784879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:13.785561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:13.793044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=57 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:14.130965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:14.142816 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fddb898a-bddf-49ab-9994-eb4bc9a7b03b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1395 microversion: 2.1 time: 0.378626 Oct 27 10:42:14.143732 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2893/5991] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:13 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1395 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:14.379020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3b6be022-63c3-4f6f-951e-ef23916b271a req-d73c5592-e140-4b58-8cfe-1650151cbe2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4928ac-7e10-4bcb-af94-8c7ea4a4618b", "name": "network-vif-deleted", "tag": "c74b528b-7035-4f36-8fdc-dedda9f53d6d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:14.393150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3b6be022-63c3-4f6f-951e-ef23916b271a req-d73c5592-e140-4b58-8cfe-1650151cbe2b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:14.393983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3b6be022-63c3-4f6f-951e-ef23916b271a req-d73c5592-e140-4b58-8cfe-1650151cbe2b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:14.394604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3b6be022-63c3-4f6f-951e-ef23916b271a req-d73c5592-e140-4b58-8cfe-1650151cbe2b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:14.423268 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3b6be022-63c3-4f6f-951e-ef23916b271a req-d73c5592-e140-4b58-8cfe-1650151cbe2b service nova] Creating event network-vif-deleted:c74b528b-7035-4f36-8fdc-dedda9f53d6d for instance 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b on n-h1-854663-10 Oct 27 10:42:14.433441 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3b6be022-63c3-4f6f-951e-ef23916b271a req-d73c5592-e140-4b58-8cfe-1650151cbe2b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059535 Oct 27 10:42:14.434849 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3099/5992] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:42:15.170011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:15.170737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:15.202453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:15.202964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:15.203414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:15.205949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:15.206461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:15.206891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:15.360307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:15.372324 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5df8678f-92e4-470a-b03c-bb7b75af852d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1188 microversion: 2.1 time: 0.209858 Oct 27 10:42:15.375013 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2894/5993] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:15 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1188 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:16.403225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:16.403952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:16.415311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:16.420238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:16.420942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:16.422604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:16.433530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:16.434335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:16.547128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:16.556984 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ad525f8-101d-447d-b3f0-582d632cb05e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1188 microversion: 2.1 time: 0.159056 Oct 27 10:42:16.576686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3100/5994] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:16 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1188 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:17.590324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:17.591559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:17.610327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:17.614426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:17.615256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:17.619338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:17.620020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:17.620646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:18.049662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:18.063435 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d317a6d-f95f-4ad3-a5ce-7fa8d92f0379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1188 microversion: 2.1 time: 0.477967 Oct 27 10:42:18.066024 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2895/5995] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:17 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1188 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:19.090771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:19.091559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:19.104101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:19.106234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:19.106799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:19.107674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:19.111034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:19.111605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:19.208283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:19.220929 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75995d44-f7ea-4d5c-b6d2-fc12e82d6917 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1188 microversion: 2.1 time: 0.134135 Oct 27 10:42:19.222047 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3101/5996] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:19 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1188 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:20.255304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:20.256867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:20.291556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:20.297806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:20.298758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:20.299930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:20.300954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:20.302789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:20.451111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:20.484910 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30bc7bf9-8c4b-43b4-b9b8-107dd73f0ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 200 len: 1188 microversion: 2.1 time: 0.235218 Oct 27 10:42:20.505195 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2896/5997] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:20 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 1188 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:21.512297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:21.513860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:21.533298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:21.533791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:21.534561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:21.535471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:21.536486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:21.537201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:21.572518 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b could not be found. Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b HTTP/1.1 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b could not be found. Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '1a4928ac-7e10-4bcb-af94-8c7ea4a4618b'} Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b could not be found. Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b could not be found. Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:42:21.576268 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:42:21.583636 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:42:21.583636 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:42:21.583636 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:42:21.583636 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:42:21.583636 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:42:21.583636 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b could not be found. Oct 27 10:42:21.583636 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:42:21.585623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 1a4928ac-7e10-4bcb-af94-8c7ea4a4618b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:42:21.587059 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1c54c5a-ba23-4ef1-98c4-0dd9e2c4ff66 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b" status: 404 len: 111 microversion: 2.1 time: 0.079475 Oct 27 10:42:21.617298 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3102/5998] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:21 2022] GET /compute/v2.1/servers/1a4928ac-7e10-4bcb-af94-8c7ea4a4618b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:42:31.373539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1718511965", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "901d7092-6103-4a71-9555-2f9c3c208252"}], "key_name": "tempest-TestNetworkAdvancedServerOps-950209419", "security_groups": [{"name": "tempest-secgroup-smoke-488379036"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:31.418816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:31.428202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:31.433204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=23 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:31.783409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] validate_networks() for [('901d7092-6103-4a71-9555-2f9c3c208252', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:42:33.303580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2076523628", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5703eeeb-f32e-4eaf-ae41-11cb08afe4b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0264043c-59ac-40f6-8b89-4caf5f646c28"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:33.328002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:33.329444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:33.465734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] validate_networks() for [('0264043c-59ac-40f6-8b89-4caf5f646c28', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:42:34.354011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:42:34.355121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:42:34.356293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:42:34.356766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:42:34.357194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:42:34.417388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:34.417888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:34.418331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:34.419885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:34.420351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:34.420842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:34.452360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:42:34.460196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for user 5263c34954a94017b2d5095e391ceffc and project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:42:34.482835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:42:34.485766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:42:34.551897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fadd0445-23ba-4fc6-8afb-984ec31885c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.183546 Oct 27 10:42:34.552905 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2897/5999] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:42:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 3185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:42:34.581507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-735a6566-e496-4601-994d-fee3bb64ddcc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:34.582919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-735a6566-e496-4601-994d-fee3bb64ddcc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:35.053516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-735a6566-e496-4601-994d-fee3bb64ddcc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:35.062967 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-735a6566-e496-4601-994d-fee3bb64ddcc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1266 microversion: 2.1 time: 0.485585 Oct 27 10:42:35.067300 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2898/6000] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:34 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1266 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:35.812561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:42:35.813807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:42:35.814536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:42:35.815669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:42:35.816286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:42:35.878723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:35.879221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:35.879684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:35.886175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:35.888835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:35.890961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:35.927448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:42:35.946468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for user 6e16c7669eb34fa49714040f728210e4 and project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:42:36.052360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:42:36.056050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5703eeeb-f32e-4eaf-ae41-11cb08afe4b4',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:42:36.093550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:36.094177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:36.120978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:36.121606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:36.122232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:36.123367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:36.124023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:36.126453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:36.244553 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5efbebf2-d5be-4abf-ae6f-722bf63a7170 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.946005 Oct 27 10:42:36.247571 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3103/6001] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:42:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:42:36.258964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0ae63b8-4f4e-40a5-9245-9c7b81556725 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:36.283003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0ae63b8-4f4e-40a5-9245-9c7b81556725 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:36.417538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:36.440914 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-021351b0-20a6-4c75-b12e-a9a8ee2f209e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1318 microversion: 2.1 time: 0.351808 Oct 27 10:42:36.456631 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2899/6002] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:36 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:36.489771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0ae63b8-4f4e-40a5-9245-9c7b81556725 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:36.501539 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0ae63b8-4f4e-40a5-9245-9c7b81556725 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1057 microversion: 2.1 time: 0.247197 Oct 27 10:42:36.511803 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3104/6003] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:36 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1057 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:37.464792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:37.465598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:37.476062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:37.489103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:37.489818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:37.491916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:37.493334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:37.496858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:37.527125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:37.527938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:37.544483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:37.549412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:37.552097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:37.553277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:37.557029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:37.557588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:38.011432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:38.019689 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-08599c26-126e-4497-bc9e-b9763dc8631c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1324 microversion: 2.1 time: 0.558857 Oct 27 10:42:38.020371 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2900/6004] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:37 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:38.034473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:38.054187 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63a32ea9-bdf5-4226-ae29-0c1fd1253a97 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1099 microversion: 2.1 time: 0.529866 Oct 27 10:42:38.057958 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3105/6005] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:37 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1099 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:39.046257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:39.046872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:39.061506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:39.063841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:39.064486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:39.067697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:39.068400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:39.068880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:39.082633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:39.084457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:39.099796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:39.100308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:39.100782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:39.101529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:39.101975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:39.105246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:39.732008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:39.740618 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b2a0d1a-f60d-4b2c-b3ba-30fadfbf01ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1173 microversion: 2.1 time: 0.663013 Oct 27 10:42:39.744753 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3106/6006] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:39 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1173 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:39.866143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:39.875377 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80cd04fe-13eb-40f4-a5eb-ee3f2aacc3a6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1391 microversion: 2.1 time: 0.832935 Oct 27 10:42:39.876718 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2901/6007] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:39 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1391 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:40.772754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:40.785973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:40.825028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:40.833354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:40.833807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:40.834596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:40.835066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:40.835491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:40.900379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:40.900991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:40.909807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:40.916052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:40.918275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:40.919119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:40.919607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:40.920046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:41.563024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:41.574939 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae628621-f436-4f07-9ad6-8e4bcb5ff58b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1391 microversion: 2.1 time: 0.679044 Oct 27 10:42:41.576994 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2902/6008] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:40 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1391 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:41.839693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:41.856579 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82e97e7d-9fba-4730-b6aa-a43209759133 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1215 microversion: 2.1 time: 1.089046 Oct 27 10:42:41.859549 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3107/6009] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:40 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1215 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:42.599139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:42.599946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:42.618456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:42.619139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:42.619596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:42.621486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:42.621953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:42.622384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:42.791894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5986c13c-9998-4137-9539-740000538d49 req-19b65142-58b3-45d3-b6d2-342c42645bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52863b3d-eea8-4b52-8649-c3b54f842f2f", "tag": "edc15bb8-b1b2-40d9-98cb-001fb44e1f24"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:42.808265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5986c13c-9998-4137-9539-740000538d49 req-19b65142-58b3-45d3-b6d2-342c42645bf2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:42.809460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5986c13c-9998-4137-9539-740000538d49 req-19b65142-58b3-45d3-b6d2-342c42645bf2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:42.810084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5986c13c-9998-4137-9539-740000538d49 req-19b65142-58b3-45d3-b6d2-342c42645bf2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:42.848614 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5986c13c-9998-4137-9539-740000538d49 req-19b65142-58b3-45d3-b6d2-342c42645bf2 service nova] Creating event network-changed:edc15bb8-b1b2-40d9-98cb-001fb44e1f24 for instance 52863b3d-eea8-4b52-8649-c3b54f842f2f on n-h1-854663-10 Oct 27 10:42:42.882210 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5986c13c-9998-4137-9539-740000538d49 req-19b65142-58b3-45d3-b6d2-342c42645bf2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105682 Oct 27 10:42:42.885010 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3108/6010] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:42:42.906609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:42.920557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:42.921721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:42.923020 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-51b8bd38-a14b-4fd0-9f89-bd9c547ac696 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1391 microversion: 2.1 time: 0.327965 Oct 27 10:42:42.928711 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2903/6011] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:42 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1391 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:42.941577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:42.943533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:42.945844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:42.947860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:42.949909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:42.950420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:43.493083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:43.502849 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e42f949f-3798-4600-9827-5ac234eac3f8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1215 microversion: 2.1 time: 0.616206 Oct 27 10:42:43.503451 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3109/6012] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:42 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1215 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:43.951460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:43.954050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:43.970899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:43.974563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:43.977053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:43.979113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:43.981859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:43.983913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:44.354039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:44.369383 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55ab4ab3-f1f1-458c-aede-bed432a212d4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1391 microversion: 2.1 time: 0.421759 Oct 27 10:42:44.376229 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2904/6013] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:43 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1391 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:44.529537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:44.530169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:44.585028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:44.586066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:44.586739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:44.587707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:44.588373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:44.589084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:45.084804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:45.099797 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7f7b620-f72f-4a58-ae64-48f67108d5a4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1215 microversion: 2.1 time: 0.572012 Oct 27 10:42:45.105983 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3110/6014] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:44 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1215 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:45.413727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:45.414352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:45.437380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:45.439118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:45.445434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:45.446326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:45.448164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:45.450383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:45.451707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:45.454110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:45.792136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a2be20c0-658e-4f5e-b854-78b678f5cc7e req-1384610e-99c9-4ba0-b03e-b97434f87f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed8221c-cbca-4946-be74-69aa9d7d386b", "tag": "27539a98-ea6a-4ba7-a82f-f978c37557aa"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:45.814645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a2be20c0-658e-4f5e-b854-78b678f5cc7e req-1384610e-99c9-4ba0-b03e-b97434f87f10 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:45.820642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a2be20c0-658e-4f5e-b854-78b678f5cc7e req-1384610e-99c9-4ba0-b03e-b97434f87f10 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:45.820800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:45.821133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a2be20c0-658e-4f5e-b854-78b678f5cc7e req-1384610e-99c9-4ba0-b03e-b97434f87f10 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:45.831701 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5a18eb84-cf4c-4617-a66a-dcb5877d7b24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1391 microversion: 2.1 time: 0.431079 Oct 27 10:42:45.834125 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2905/6015] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:45 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1391 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:45.880753 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a2be20c0-658e-4f5e-b854-78b678f5cc7e req-1384610e-99c9-4ba0-b03e-b97434f87f10 service nova] Creating event network-changed:27539a98-ea6a-4ba7-a82f-f978c37557aa for instance 5ed8221c-cbca-4946-be74-69aa9d7d386b on n-h2-854663-10 Oct 27 10:42:45.891865 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a2be20c0-658e-4f5e-b854-78b678f5cc7e req-1384610e-99c9-4ba0-b03e-b97434f87f10 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140608 Oct 27 10:42:45.893472 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3111/6016] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:42:46.128550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:46.130190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:46.141688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:46.145786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:46.146504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:46.147349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:46.147939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:46.152377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:46.557471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:46.573571 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6374875d-0df0-417c-bb4a-1eaa8ac999fa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1215 microversion: 2.1 time: 0.447608 Oct 27 10:42:46.574975 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2906/6017] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:46 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1215 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:46.856843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:46.857840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:46.866913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:46.867736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:46.894366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:46.901413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:46.902403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:46.903509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:46.904207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:46.905373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:47.569670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:47.606016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:47.607335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:47.615133 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-032500c2-d7dc-4b3c-9a77-b5289609d0ab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1391 microversion: 2.1 time: 0.759238 Oct 27 10:42:47.618108 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3112/6018] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:46 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1391 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:47.635463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:47.636320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:47.637103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:47.638157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:47.638972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:47.639646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:48.171776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:48.181311 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c01d1f65-64fe-44e4-8322-defeae721ec4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1215 microversion: 2.1 time: 0.581324 Oct 27 10:42:48.196336 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2907/6019] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:47 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1215 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:48.645180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:48.645798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:48.653951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:48.654438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:48.655010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:48.655825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:48.656275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:48.656908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:48.982733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:48.996041 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-73d8d0b9-c4ba-414b-a3bc-5a6fc125a424 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1391 microversion: 2.1 time: 0.355142 Oct 27 10:42:49.001635 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3113/6020] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:48 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1391 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:49.203655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:49.204272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:49.211365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:49.212089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:49.212710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:49.213850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:49.214473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:49.215051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:49.497868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:49.511854 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7ea7eae-b400-4c9c-b39c-bff7518fea73 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1203 microversion: 2.1 time: 0.309674 Oct 27 10:42:49.516565 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2908/6021] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:49 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1203 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:50.026704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:50.027437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:50.035308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:50.035926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:50.036625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:50.037573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:50.038897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:50.039543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:50.329514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:50.354951 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7fd280c-9ee0-4ceb-8972-4ea070746fa6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1391 microversion: 2.1 time: 0.332056 Oct 27 10:42:50.356176 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3114/6022] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:50 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1391 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:50.541420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8ac836fe-8b2d-470b-85f2-b1d01e99b9d0 req-62ccb404-0828-4bf2-b3ac-b30f27f968a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52863b3d-eea8-4b52-8649-c3b54f842f2f", "name": "network-vif-plugged", "status": "completed", "tag": "edc15bb8-b1b2-40d9-98cb-001fb44e1f24"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:50.544919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:50.545604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:50.568098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:50.569297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:50.570864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:50.572361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:50.572572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:50.581607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8ac836fe-8b2d-470b-85f2-b1d01e99b9d0 req-62ccb404-0828-4bf2-b3ac-b30f27f968a0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:50.582094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8ac836fe-8b2d-470b-85f2-b1d01e99b9d0 req-62ccb404-0828-4bf2-b3ac-b30f27f968a0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:50.584375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8ac836fe-8b2d-470b-85f2-b1d01e99b9d0 req-62ccb404-0828-4bf2-b3ac-b30f27f968a0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:50.588489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:50.634996 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8ac836fe-8b2d-470b-85f2-b1d01e99b9d0 req-62ccb404-0828-4bf2-b3ac-b30f27f968a0 service nova] Creating event network-vif-plugged:edc15bb8-b1b2-40d9-98cb-001fb44e1f24 for instance 52863b3d-eea8-4b52-8649-c3b54f842f2f on n-h1-854663-10 Oct 27 10:42:50.663661 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8ac836fe-8b2d-470b-85f2-b1d01e99b9d0 req-62ccb404-0828-4bf2-b3ac-b30f27f968a0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132026 Oct 27 10:42:50.664290 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2909/6023] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:42:51.083882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:51.096028 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22031ab9-2cd4-4657-8241-72b6e10c2a7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1203 microversion: 2.1 time: 0.559116 Oct 27 10:42:51.097305 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3115/6024] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:50 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1203 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:51.378847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:51.379673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:51.391392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:51.398340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:51.399756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:51.403306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:51.404109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:51.415010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:52.097587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:52.106441 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16172ae4-3d26-472f-a51f-a01fc7bcbb10 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1391 microversion: 2.1 time: 0.731797 Oct 27 10:42:52.121912 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2910/6025] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:51 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1391 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:52.122046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:52.122046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:52.142491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:52.143017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:52.149686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:52.149686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:52.156400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:52.157511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:52.668562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:52.696361 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42e430f2-e715-485e-95e3-7436b3391514 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1203 microversion: 2.1 time: 0.580764 Oct 27 10:42:52.701744 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3116/6026] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:52 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1203 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:53.135565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:53.136196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:53.143553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:53.144413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:53.145269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:53.146406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:53.147098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:53.147731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:53.724627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:53.726590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:53.741739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:53.742239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:53.742914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:53.744646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:53.745494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:53.755839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:54.114542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:54.129704 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f3a83ef0-7c4e-49ee-b110-6577c04d8b5e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1564 microversion: 2.1 time: 0.990928 Oct 27 10:42:54.145183 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2911/6027] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:53 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1564 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:54.153852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:54.154484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:54.165245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:54.165872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:54.166432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:54.167171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:54.167701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:54.168205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:54.357601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:54.371609 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3589edad-dea3-4442-b9dc-e7573910d909 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1203 microversion: 2.1 time: 0.651582 Oct 27 10:42:54.375511 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3117/6028] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:53 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1203 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:54.742165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:54.761484 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-90dd57fe-3f5b-4896-9d89-c0f7ab9bfca6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1564 microversion: 2.1 time: 0.612677 Oct 27 10:42:54.780956 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2912/6029] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:54 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1564 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:55.407074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:55.407689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:55.456837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:55.457375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:55.457840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:55.458627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:55.469314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:55.469951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:55.857982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:55.870095 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dddccee4-405c-4664-89c0-96c83f649e51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1203 microversion: 2.1 time: 0.466905 Oct 27 10:42:55.895883 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3118/6030] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:55 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1203 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:56.734097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-535ce67b-a8d2-48e8-af81-f5e777206837 req-636133cf-805b-49ce-bd8e-9f10c9715cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed8221c-cbca-4946-be74-69aa9d7d386b", "name": "network-vif-plugged", "status": "completed", "tag": "27539a98-ea6a-4ba7-a82f-f978c37557aa"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:56.752340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-535ce67b-a8d2-48e8-af81-f5e777206837 req-636133cf-805b-49ce-bd8e-9f10c9715cbf service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:56.752871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-535ce67b-a8d2-48e8-af81-f5e777206837 req-636133cf-805b-49ce-bd8e-9f10c9715cbf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:56.753312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-535ce67b-a8d2-48e8-af81-f5e777206837 req-636133cf-805b-49ce-bd8e-9f10c9715cbf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:56.790650 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-535ce67b-a8d2-48e8-af81-f5e777206837 req-636133cf-805b-49ce-bd8e-9f10c9715cbf service nova] Creating event network-vif-plugged:27539a98-ea6a-4ba7-a82f-f978c37557aa for instance 5ed8221c-cbca-4946-be74-69aa9d7d386b on n-h2-854663-10 Oct 27 10:42:56.797749 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-535ce67b-a8d2-48e8-af81-f5e777206837 req-636133cf-805b-49ce-bd8e-9f10c9715cbf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067104 Oct 27 10:42:56.799866 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2913/6031] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:42:56.894119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:56.896031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:56.906131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:56.906935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:56.907583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:56.908496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:56.909147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:56.909799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:57.563352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:57.574112 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e69595e1-9cbb-4080-b9cb-ab882e0e9778 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1203 microversion: 2.1 time: 0.685220 Oct 27 10:42:57.577458 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3119/6032] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:56 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1203 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:58.326647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:58.328262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9fef6068-3433-49b8-9fdc-1f2e308adf7f req-b928b083-ad8e-4c27-a237-0a163e144671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52863b3d-eea8-4b52-8649-c3b54f842f2f", "tag": "edc15bb8-b1b2-40d9-98cb-001fb44e1f24"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:58.337010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:58.347637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:58.348249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:58.361899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:58.362837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:58.363261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:58.363755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:58.365684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9fef6068-3433-49b8-9fdc-1f2e308adf7f req-b928b083-ad8e-4c27-a237-0a163e144671 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:58.366169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9fef6068-3433-49b8-9fdc-1f2e308adf7f req-b928b083-ad8e-4c27-a237-0a163e144671 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:58.366599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9fef6068-3433-49b8-9fdc-1f2e308adf7f req-b928b083-ad8e-4c27-a237-0a163e144671 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:58.428895 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9fef6068-3433-49b8-9fdc-1f2e308adf7f req-b928b083-ad8e-4c27-a237-0a163e144671 service nova] Creating event network-changed:edc15bb8-b1b2-40d9-98cb-001fb44e1f24 for instance 52863b3d-eea8-4b52-8649-c3b54f842f2f on n-h1-854663-10 Oct 27 10:42:58.439980 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9fef6068-3433-49b8-9fdc-1f2e308adf7f req-b928b083-ad8e-4c27-a237-0a163e144671 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120121 Oct 27 10:42:58.469464 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3120/6033] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:42:58.604207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:58.605765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:58.613595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:58.614042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:58.614489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:58.625998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:58.631413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:58.632043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:58.821104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:58.829933 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f5ef76f-b59b-46b3-a7f9-90ac140fe261 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1564 microversion: 2.1 time: 0.513133 Oct 27 10:42:58.834604 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2914/6034] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:58 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1564 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:59.045602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:59.065970 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95378fd6-b373-4ef9-a98b-fd60410d83eb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1389 microversion: 2.1 time: 0.465128 Oct 27 10:42:59.066586 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3121/6035] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:58 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1389 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:59.093081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:59.093696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:59.106111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:59.106606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:59.107043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:59.107745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:59.108191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:59.108681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:59.320880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:59.330433 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62615ed7-69d7-4984-9120-8fe950753972 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1389 microversion: 2.1 time: 0.241159 Oct 27 10:42:59.332283 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2915/6036] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:59 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1389 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:59.361626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:59.363190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:59.378768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:59.379707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:59.380325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:59.381338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:59.383014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:59.391359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:59.665785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:59.683793 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33db6b9b-e4eb-4295-a582-fb0517701516 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1389 microversion: 2.1 time: 0.328776 Oct 27 10:42:59.684404 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3122/6037] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:59 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1389 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:59.708260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:59.709195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:59.718916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:59.720306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:59.720962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:59.721877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:59.722507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:59.723185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:59.748697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:59.754181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:42:59.921499 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f2f2826c-ac9c-4260-9940-ce7748f018b1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 204 len: 0 microversion: 2.1 time: 0.217138 Oct 27 10:42:59.923733 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2916/6038] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:42:59 2022] DELETE /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:42:59.938583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:59.939744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:59.951168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:59.951915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:59.954017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:59.956419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:59.957111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:59.958996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:59.973805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:43:00.242215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:00.254017 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a7f2d808-28f0-4587-b2e9-d4b6b35179ab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1395 microversion: 2.1 time: 0.319741 Oct 27 10:43:00.255546 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3123/6039] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:59 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1395 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:01.281634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:01.282906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:01.298024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:01.298855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:01.299294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:01.300192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:01.300860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:01.303701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:01.779989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:01.790969 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e3db722-e700-43c7-906c-291a182ae04d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1395 microversion: 2.1 time: 0.513591 Oct 27 10:43:01.792452 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2917/6040] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:01 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1395 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:02.275107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-44bc06b6-8825-4b9c-8fdf-50ae8c4b6627 req-01b2dafc-c667-45c0-905d-50c2019e15bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed8221c-cbca-4946-be74-69aa9d7d386b", "name": "network-vif-deleted", "tag": "27539a98-ea6a-4ba7-a82f-f978c37557aa"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:43:02.316083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-44bc06b6-8825-4b9c-8fdf-50ae8c4b6627 req-01b2dafc-c667-45c0-905d-50c2019e15bd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:02.321555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-44bc06b6-8825-4b9c-8fdf-50ae8c4b6627 req-01b2dafc-c667-45c0-905d-50c2019e15bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:02.322479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-44bc06b6-8825-4b9c-8fdf-50ae8c4b6627 req-01b2dafc-c667-45c0-905d-50c2019e15bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:02.370803 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-44bc06b6-8825-4b9c-8fdf-50ae8c4b6627 req-01b2dafc-c667-45c0-905d-50c2019e15bd service nova] Creating event network-vif-deleted:27539a98-ea6a-4ba7-a82f-f978c37557aa for instance 5ed8221c-cbca-4946-be74-69aa9d7d386b on n-h2-854663-10 Oct 27 10:43:02.386805 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-44bc06b6-8825-4b9c-8fdf-50ae8c4b6627 req-01b2dafc-c667-45c0-905d-50c2019e15bd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117951 Oct 27 10:43:02.392519 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3124/6041] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:43:02.815930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:02.817338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:02.821508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:43:02.834642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:02.837922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:02.838598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:02.840613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:02.844550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:02.845284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:03.384695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:03.407043 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-341b11d9-8791-4c23-8288-afce2ddb31bd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1188 microversion: 2.1 time: 0.595412 Oct 27 10:43:03.413422 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2918/6042] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:02 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1188 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:04.439722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:04.441349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:04.449763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:43:04.453586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:04.455110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:04.456201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:04.457643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:04.458477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:04.459957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:04.590875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:04.602719 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f37d3da5-7555-4b61-babe-0680664f735b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1188 microversion: 2.1 time: 0.174765 Oct 27 10:43:04.604858 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3125/6043] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:04 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1188 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:05.627464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:05.628182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:05.635926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:05.636918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:05.637588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:05.638527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:05.639348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:05.640836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:05.816268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:05.825380 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31806c9f-d559-4e16-8973-f2b2dd7531d9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1188 microversion: 2.1 time: 0.202649 Oct 27 10:43:05.825980 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2919/6044] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:05 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1188 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:06.852354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:06.853135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:06.877537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:06.878202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:06.879372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:06.881608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:06.883473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:06.885492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:07.115602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:07.128577 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db1c6df7-a181-4faa-aeb1-10b76ca45c59 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1188 microversion: 2.1 time: 0.280803 Oct 27 10:43:07.135114 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3126/6045] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:06 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:08.162970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:08.163629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:08.205251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:08.216041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:08.217032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:08.218478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:08.219157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:08.219757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:08.345225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:08.356912 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-980b0fa3-b9eb-4ee5-9477-22c0aee2afd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 200 len: 1188 microversion: 2.1 time: 0.198571 Oct 27 10:43:08.358171 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2920/6046] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:08 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 1188 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:09.387208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:09.389363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 5ed8221c-cbca-4946-be74-69aa9d7d386b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:09.407703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:09.408622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:09.409327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:09.410525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:09.411351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:09.411957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:09.452293 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 5ed8221c-cbca-4946-be74-69aa9d7d386b could not be found. Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b HTTP/1.1 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 5ed8221c-cbca-4946-be74-69aa9d7d386b could not be found. Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '5ed8221c-cbca-4946-be74-69aa9d7d386b'} Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ed8221c-cbca-4946-be74-69aa9d7d386b could not be found. Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ed8221c-cbca-4946-be74-69aa9d7d386b could not be found. Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:43:09.455074 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:43:09.461179 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:43:09.461179 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:43:09.461179 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:43:09.461179 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:43:09.461179 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:43:09.461179 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ed8221c-cbca-4946-be74-69aa9d7d386b could not be found. Oct 27 10:43:09.461179 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:43:09.463563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 5ed8221c-cbca-4946-be74-69aa9d7d386b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:43:09.465056 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92ffd3d6-004d-4521-b6ae-112f42ca563c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b" status: 404 len: 111 microversion: 2.1 time: 0.086342 Oct 27 10:43:09.466171 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3127/6047] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:09 2022] GET /compute/v2.1/servers/5ed8221c-cbca-4946-be74-69aa9d7d386b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:43:19.449022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0100da13-9281-46ee-80a1-0868f1bad36d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:43:19.452641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0100da13-9281-46ee-80a1-0868f1bad36d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:19.465862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:43:19.469877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:43:19.490231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0100da13-9281-46ee-80a1-0868f1bad36d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:19.494286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0100da13-9281-46ee-80a1-0868f1bad36d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:19.497469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0100da13-9281-46ee-80a1-0868f1bad36d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:19.499596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0100da13-9281-46ee-80a1-0868f1bad36d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:19.500516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0100da13-9281-46ee-80a1-0868f1bad36d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:19.503457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0100da13-9281-46ee-80a1-0868f1bad36d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:19.653629 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0100da13-9281-46ee-80a1-0868f1bad36d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action" status: 200 len: 24563 microversion: 2.1 time: 0.210126 Oct 27 10:43:19.654719 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2921/6048] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:43:19 2022] POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action => generated 24563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:43:30.696534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22d547a4-3b0c-4c32-92cb-6f76d45acbb0 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:30.697064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22d547a4-3b0c-4c32-92cb-6f76d45acbb0 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:30.708464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:43:30.711282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=20 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:43:30.726310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d547a4-3b0c-4c32-92cb-6f76d45acbb0 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:30.726813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d547a4-3b0c-4c32-92cb-6f76d45acbb0 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:30.728881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d547a4-3b0c-4c32-92cb-6f76d45acbb0 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:30.729623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d547a4-3b0c-4c32-92cb-6f76d45acbb0 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:30.732271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d547a4-3b0c-4c32-92cb-6f76d45acbb0 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:30.733175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d547a4-3b0c-4c32-92cb-6f76d45acbb0 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:31.712334 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22d547a4-3b0c-4c32-92cb-6f76d45acbb0 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1835 microversion: 2.1 time: 1.026224 Oct 27 10:43:31.716001 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3128/6049] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:30 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1835 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:31.737790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:31.738808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:31.745735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:43:31.746428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:43:31.751401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:31.756255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:31.757118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:31.757839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:31.758488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:31.759103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:32.391572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:32.405475 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ec31efe-8743-417e-a9f6-d0f22371ac4a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1682 microversion: 2.1 time: 0.672186 Oct 27 10:43:32.406364 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2922/6050] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:31 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1682 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:32.733021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b92e19bb-b140-484a-a1dd-e6c7c5cd538f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:43:32.736763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b92e19bb-b140-484a-a1dd-e6c7c5cd538f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:32.746169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b92e19bb-b140-484a-a1dd-e6c7c5cd538f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:32.746974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b92e19bb-b140-484a-a1dd-e6c7c5cd538f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:32.747593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b92e19bb-b140-484a-a1dd-e6c7c5cd538f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:32.748507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b92e19bb-b140-484a-a1dd-e6c7c5cd538f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:32.749158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b92e19bb-b140-484a-a1dd-e6c7c5cd538f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:32.749756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b92e19bb-b140-484a-a1dd-e6c7c5cd538f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:32.864593 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b92e19bb-b140-484a-a1dd-e6c7c5cd538f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action" status: 200 len: 32631 microversion: 2.1 time: 0.136661 Oct 27 10:43:32.865939 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3129/6051] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:43:32 2022] POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action => generated 32631 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:43:33.029844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:43:33.032223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:33.089352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:33.106332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:33.127218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:33.143100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:33.146302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:33.151875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:33.407721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd963fef7e7f44219b0c85258b706cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d12fa75dda34a36bb23a0a743a9d4a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:33.408345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] flavor_id is None. Assuming migration. {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 10:43:33.408808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 10:43:34.025887 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2f5c974-5f59-4890-b743-954151c56df3 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action" status: 202 len: 0 microversion: 2.1 time: 0.999896 Oct 27 10:43:34.029571 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2923/6052] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:43:33 2022] POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action => generated 0 bytes in 1006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:43:34.045838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:34.046612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:34.060918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:34.065382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:34.067607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:34.071098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:34.074115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:34.074704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:34.693988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:34.704097 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33585108-6e4c-4274-bbaa-18d0efaeafd7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1691 microversion: 2.1 time: 0.669883 Oct 27 10:43:34.724870 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3130/6053] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:34 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1691 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:35.733826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:35.736453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:35.752448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:35.755626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:35.756616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:35.760377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:35.762611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:35.764847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:36.341445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:36.352694 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be4357e5-4d46-400d-9490-25846a8b5c47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1691 microversion: 2.1 time: 0.625331 Oct 27 10:43:36.353282 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2924/6054] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:35 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1691 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:37.381457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:37.383010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:37.398981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:37.401632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:37.402231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:37.403252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:37.406928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:37.407714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:38.801404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:38.810423 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-394234f7-f087-4e9a-b3e2-e5e261c42033 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1691 microversion: 2.1 time: 1.434889 Oct 27 10:43:38.819755 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3131/6055] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:37 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1691 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:39.837776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:39.838563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:39.852094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:39.857245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:39.860637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:39.861532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:39.862936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:39.873920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:40.339300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:40.350929 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b59d246-a9a3-4665-bfb1-006bb1fb0964 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1696 microversion: 2.1 time: 0.521011 Oct 27 10:43:40.373165 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2925/6056] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:39 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1696 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:41.381337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:41.382638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:41.414306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:41.415089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:41.423377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:41.424155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:41.424631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:41.425219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:42.187471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:42.201891 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc2f6e3f-0400-4cd1-81aa-f6eef319c53f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1696 microversion: 2.1 time: 0.826466 Oct 27 10:43:42.222500 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3132/6057] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:41 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1696 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:43.229774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:43.230391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:43.243299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:43.248391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:43.249147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:43.253551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:43.254313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:43.258474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:43.807892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:43.819468 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e726a96f-3373-4fa0-8d7c-bd7f5ab25fb3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1696 microversion: 2.1 time: 0.593682 Oct 27 10:43:43.820806 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2926/6058] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:43 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1696 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:44.860695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:44.869061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:44.883687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:44.885759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:44.886359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:44.889456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:44.890084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:44.890698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:45.363363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:45.376551 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1ecc6ba-b5e4-4207-ac20-b035c8590270 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1696 microversion: 2.1 time: 0.519555 Oct 27 10:43:45.377590 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3133/6059] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:44 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1696 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:46.404609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:46.405267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:46.439179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:46.439699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:46.446298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:46.453157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:46.454652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:46.455301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:46.816589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:46.826268 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e59843fc-2921-43ec-9953-c573d2049bcd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1696 microversion: 2.1 time: 0.427269 Oct 27 10:43:46.845500 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2927/6060] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:46 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1696 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:47.858136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:47.858759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:47.878410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:47.879028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:47.879690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:47.884161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:47.885139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:47.885582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:48.332825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:48.345483 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18687699-b807-4cb4-bf80-ac275719b523 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1696 microversion: 2.1 time: 0.491728 Oct 27 10:43:48.346641 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3134/6061] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:47 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1696 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:49.377114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:49.378763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:49.430124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:49.431167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:49.433694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:49.436376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:49.437648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:49.439214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:49.811785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:49.824056 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-059f765a-3976-4b7e-82bb-40446ea1c5a7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1696 microversion: 2.1 time: 0.455446 Oct 27 10:43:49.840737 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2928/6062] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:49 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1696 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:50.854766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:50.856219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:50.882175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:50.882668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:50.883394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:50.884143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:50.884622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:50.885177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:51.225957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:51.237268 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c9735fd-becb-4fbb-840d-3dd47cf4ffbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1696 microversion: 2.1 time: 0.388415 Oct 27 10:43:51.254189 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3135/6063] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:50 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1696 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:52.265943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:52.266554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:52.280223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:52.280840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:52.281358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:52.288997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:52.289600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:52.290128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:52.617873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:52.630472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f1a6e759-c705-4d07-9920-42ec79e7ce0e req-bb72f6da-1b7a-4cd3-bbfe-3beb87d0f456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52863b3d-eea8-4b52-8649-c3b54f842f2f", "name": "network-vif-unplugged", "status": "completed", "tag": "edc15bb8-b1b2-40d9-98cb-001fb44e1f24"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:43:52.657012 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a28037fd-cf6c-4949-a751-891c1f140db4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1695 microversion: 2.1 time: 0.395057 Oct 27 10:43:52.663890 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2929/6064] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:52 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1695 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:52.684391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1a6e759-c705-4d07-9920-42ec79e7ce0e req-bb72f6da-1b7a-4cd3-bbfe-3beb87d0f456 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:52.685059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1a6e759-c705-4d07-9920-42ec79e7ce0e req-bb72f6da-1b7a-4cd3-bbfe-3beb87d0f456 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:52.689232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1a6e759-c705-4d07-9920-42ec79e7ce0e req-bb72f6da-1b7a-4cd3-bbfe-3beb87d0f456 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:52.740704 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f1a6e759-c705-4d07-9920-42ec79e7ce0e req-bb72f6da-1b7a-4cd3-bbfe-3beb87d0f456 service nova] Creating event network-vif-unplugged:edc15bb8-b1b2-40d9-98cb-001fb44e1f24 for instance 52863b3d-eea8-4b52-8649-c3b54f842f2f on n-h2-854663-10 Oct 27 10:43:52.756183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-f1a6e759-c705-4d07-9920-42ec79e7ce0e req-bb72f6da-1b7a-4cd3-bbfe-3beb87d0f456 service nova] Instance 52863b3d-eea8-4b52-8649-c3b54f842f2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:43:52.810272 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f1a6e759-c705-4d07-9920-42ec79e7ce0e req-bb72f6da-1b7a-4cd3-bbfe-3beb87d0f456 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.198210 Oct 27 10:43:52.811079 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3136/6065] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:43:53.692112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:53.693785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:53.717820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:53.721201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:53.727715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:53.728650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:53.731796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:53.732407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:54.158498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:54.170481 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e52a6671-7fa3-4562-8a48-c2a54a47ddeb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1695 microversion: 2.1 time: 0.482637 Oct 27 10:43:54.171079 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2930/6066] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:53 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1695 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:55.202988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:55.203778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:55.219355 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:43:55.219870 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 10:43:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f (ip 10.222.0.76) !!! Oct 27 10:43:55.237154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:55.240218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:55.241011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:55.242185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:55.244077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:55.244582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:55.652291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-834fca18-bc60-45a3-8331-2adbbc699e38 req-7cd76aee-d7fc-44be-836c-a430842dd447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52863b3d-eea8-4b52-8649-c3b54f842f2f", "tag": "edc15bb8-b1b2-40d9-98cb-001fb44e1f24"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:43:55.708612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:55.710369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-834fca18-bc60-45a3-8331-2adbbc699e38 req-7cd76aee-d7fc-44be-836c-a430842dd447 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:55.713956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-834fca18-bc60-45a3-8331-2adbbc699e38 req-7cd76aee-d7fc-44be-836c-a430842dd447 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:55.717275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-834fca18-bc60-45a3-8331-2adbbc699e38 req-7cd76aee-d7fc-44be-836c-a430842dd447 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:55.741719 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-834fca18-bc60-45a3-8331-2adbbc699e38 req-7cd76aee-d7fc-44be-836c-a430842dd447 service nova] Creating event network-changed:edc15bb8-b1b2-40d9-98cb-001fb44e1f24 for instance 52863b3d-eea8-4b52-8649-c3b54f842f2f on n-h2-854663-10 Oct 27 10:43:55.762370 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b03dc54b-507d-4315-83a2-b87eb53a0149 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1695 microversion: 2.1 time: 0.563828 Oct 27 10:43:55.763790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-834fca18-bc60-45a3-8331-2adbbc699e38 req-7cd76aee-d7fc-44be-836c-a430842dd447 service nova] Instance 52863b3d-eea8-4b52-8649-c3b54f842f2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:43:55.767253 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3137/6067] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:55 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1695 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:55.849459 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-834fca18-bc60-45a3-8331-2adbbc699e38 req-7cd76aee-d7fc-44be-836c-a430842dd447 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187685 Oct 27 10:43:55.850196 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2931/6068] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:43:56.799392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:56.799986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:56.824351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:56.824874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:56.825493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:56.828006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:56.828639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:56.829137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:56.862509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-896183498", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b60e8fc3-b3af-461e-ad29-3eb2c5dd1211", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0264043c-59ac-40f6-8b89-4caf5f646c28"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:43:57.135462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] validate_networks() for [('0264043c-59ac-40f6-8b89-4caf5f646c28', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:43:57.416985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:57.459053 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aba901b9-80a4-491c-b191-2a8eefb8a6f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1693 microversion: 2.1 time: 0.669128 Oct 27 10:43:57.460177 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3138/6069] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:56 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1693 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:58.163403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:43:58.164347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:43:58.165227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:43:58.166147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:43:58.166771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:43:58.195816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:58.199822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:58.203572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:58.204451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:58.206197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:58.208685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:58.260941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:43:58.273576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for user 6e16c7669eb34fa49714040f728210e4 and project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:43:58.298640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:43:58.304598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b60e8fc3-b3af-461e-ad29-3eb2c5dd1211',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:43:58.502983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:58.503652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:58.543055 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b32713e8-7c79-41fc-84ac-93e1ffe89755 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682771 Oct 27 10:43:58.543737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:58.544312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:58.544794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:58.549064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:58.553561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:58.554078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:58.585962 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2932/6070] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:43:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:43:58.614801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-27d8665e-2b4a-4645-a41d-1301095f5770 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:58.632734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-27d8665e-2b4a-4645-a41d-1301095f5770 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:58.872280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-27d8665e-2b4a-4645-a41d-1301095f5770 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:58.882721 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-27d8665e-2b4a-4645-a41d-1301095f5770 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1056 microversion: 2.1 time: 0.289564 Oct 27 10:43:58.899819 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2933/6071] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:58 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1056 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:59.183225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:43:59.206103 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-969d8f1b-90e9-4591-8c27-ffdbdaecda66 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1690 microversion: 2.1 time: 0.706825 Oct 27 10:43:59.241028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c9b19287-05a5-4d46-81fa-68057b108b94 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:43:59.241717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c9b19287-05a5-4d46-81fa-68057b108b94 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:59.259630 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3139/6072] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:58 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1690 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:43:59.279799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9b19287-05a5-4d46-81fa-68057b108b94 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:59.280521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9b19287-05a5-4d46-81fa-68057b108b94 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:59.281020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9b19287-05a5-4d46-81fa-68057b108b94 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:59.281790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9b19287-05a5-4d46-81fa-68057b108b94 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:59.282250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9b19287-05a5-4d46-81fa-68057b108b94 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:59.282677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9b19287-05a5-4d46-81fa-68057b108b94 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:59.525973 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c9b19287-05a5-4d46-81fa-68057b108b94 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action" status: 204 len: 0 microversion: 2.1 time: 0.288943 Oct 27 10:43:59.543693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:59.545473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:59.549832 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2934/6073] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:43:59 2022] POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:43:59.571363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:59.573239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:59.575665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:59.581671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:59.583664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:59.585429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:59.915404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:43:59.919725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:43:59.958503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:59.969622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:59.972970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:43:59.974617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:43:59.978257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:43:59.979619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:00.411680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:00.421053 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-648df0d5-8e25-4041-b401-7de008d752d6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1690 microversion: 2.1 time: 0.881880 Oct 27 10:44:00.426024 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3140/6074] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:59 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1690 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:44:00.442442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:00.455899 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c860649c-7d31-4e7c-9484-7ed4ed860381 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1052 microversion: 2.1 time: 0.544821 Oct 27 10:44:00.471908 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2935/6075] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:43:59 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1052 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:01.023829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-525efca8-ea58-4214-89f0-e9460ef0dc5c req-346829e6-7556-41fa-b83a-419be79d952b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52863b3d-eea8-4b52-8649-c3b54f842f2f", "name": "network-vif-plugged", "status": "completed", "tag": "edc15bb8-b1b2-40d9-98cb-001fb44e1f24"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:01.050293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=27 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:01.058183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-525efca8-ea58-4214-89f0-e9460ef0dc5c req-346829e6-7556-41fa-b83a-419be79d952b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:01.063727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-525efca8-ea58-4214-89f0-e9460ef0dc5c req-346829e6-7556-41fa-b83a-419be79d952b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:01.064148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-525efca8-ea58-4214-89f0-e9460ef0dc5c req-346829e6-7556-41fa-b83a-419be79d952b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:01.092689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=75 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:01.101192 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-525efca8-ea58-4214-89f0-e9460ef0dc5c req-346829e6-7556-41fa-b83a-419be79d952b service nova] Creating event network-vif-plugged:edc15bb8-b1b2-40d9-98cb-001fb44e1f24 for instance 52863b3d-eea8-4b52-8649-c3b54f842f2f on n-h2-854663-10 Oct 27 10:44:01.119791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-525efca8-ea58-4214-89f0-e9460ef0dc5c req-346829e6-7556-41fa-b83a-419be79d952b service nova] Instance 52863b3d-eea8-4b52-8649-c3b54f842f2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:44:01.159642 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-525efca8-ea58-4214-89f0-e9460ef0dc5c req-346829e6-7556-41fa-b83a-419be79d952b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141836 Oct 27 10:44:01.167952 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3141/6076] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:44:01.456123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:01.458119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:01.483792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:01.498488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:01.502825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:01.507179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:01.508637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:01.509287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:01.511786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:01.512479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:01.513143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:01.529991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:01.530954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:01.533038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:01.538662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:01.539273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:02.513554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:02.542017 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38bb5b80-7b66-411b-81d7-c8f7e799202c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1126 microversion: 2.1 time: 1.062140 Oct 27 10:44:02.544166 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3142/6077] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:01 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1126 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:44:02.691269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:02.695888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:02.709790 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55342f15-c227-41b7-ae2b-387afd4876c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1690 microversion: 2.1 time: 1.261453 Oct 27 10:44:02.713444 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2936/6078] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:01 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1690 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:03.568912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:03.570113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:03.599707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:03.600187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:03.600603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:03.611085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:03.612322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:03.617851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:03.735992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:03.737460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:03.775185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:03.778907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:03.783584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:03.790732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:03.793440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:03.799252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:03.800024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:04.588802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:04.598323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:04.603024 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c428b2a8-b4c3-405b-b1a6-f8216e7b78a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1682 microversion: 2.1 time: 0.867559 Oct 27 10:44:04.604529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2937/6079] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:03 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1682 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:04.644044 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-521f9123-46fd-4d5a-b92f-70a5c5ee1e2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 1.079195 Oct 27 10:44:04.651883 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3143/6080] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:03 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:05.686339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:05.688194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:05.710237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:05.713429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:05.713429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:05.713429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:05.713429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:05.713429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:06.041265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8ccbb488-fa44-42b9-878f-97e530e02c75 req-d62a704e-2c31-4c8e-a882-ae9b9b44e987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73754ef5-ba25-4448-9434-479ed5f058de", "tag": "65bf3d50-d6e4-4468-a2c9-416768f24bf9"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:06.077365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ccbb488-fa44-42b9-878f-97e530e02c75 req-d62a704e-2c31-4c8e-a882-ae9b9b44e987 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:06.077466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ccbb488-fa44-42b9-878f-97e530e02c75 req-d62a704e-2c31-4c8e-a882-ae9b9b44e987 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:06.077838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ccbb488-fa44-42b9-878f-97e530e02c75 req-d62a704e-2c31-4c8e-a882-ae9b9b44e987 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:06.112892 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8ccbb488-fa44-42b9-878f-97e530e02c75 req-d62a704e-2c31-4c8e-a882-ae9b9b44e987 service nova] Creating event network-changed:65bf3d50-d6e4-4468-a2c9-416768f24bf9 for instance 73754ef5-ba25-4448-9434-479ed5f058de on n-h1-854663-10 Oct 27 10:44:06.125766 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8ccbb488-fa44-42b9-878f-97e530e02c75 req-d62a704e-2c31-4c8e-a882-ae9b9b44e987 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096122 Oct 27 10:44:06.126724 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3144/6081] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:44:06.176205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:06.191229 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-822f6619-04aa-49da-8b72-614113eb8153 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.519497 Oct 27 10:44:06.196814 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2938/6082] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:05 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:07.223044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:07.226277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:07.261403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:07.261912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:07.262361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:07.263628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:07.263628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:07.264008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:07.632731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:07.654098 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e0772cd-a517-4b0a-948b-48eb28fc023b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.437126 Oct 27 10:44:07.656706 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3145/6083] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:07 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:08.682664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:08.684590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:08.710578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:08.718668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:08.719999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:08.721148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:08.728805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:08.740045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:08.742109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:08.888215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:09.096588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:09.106317 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12cb41c1-c14b-42f4-bd0d-f03b9107aa0b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.430500 Oct 27 10:44:09.107055 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2939/6084] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:08 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:10.134973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:10.135602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:10.175507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:10.184001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:10.184600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:10.188368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:10.192116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:10.194463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:10.957526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:10.978421 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96f8e6a9-10bf-42bb-bd0e-b6e83967f600 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.845886 Oct 27 10:44:10.980353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3146/6085] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:10 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:12.010609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:12.011811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:12.026652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:12.027540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:12.028205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:12.029317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:12.034428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:12.035231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:12.431778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:12.452427 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7f5dfb3-f567-4d14-b24f-b094c3f4fa51 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.446165 Oct 27 10:44:12.464689 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2940/6086] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:12 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:13.487644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:13.488861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:13.518352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:13.522812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:13.523429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:13.525949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:13.533219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:13.535249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:13.858139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:13.868539 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e440685-9615-4161-9c17-b5c8c92d4617 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.385541 Oct 27 10:44:13.869988 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3147/6087] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:13 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:14.895635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:14.896270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:14.928834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:14.929827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:14.930640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:14.931406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:14.931861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:14.932290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:15.313040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:15.323191 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-40e7c13c-4775-4c4b-9eca-d22a5f741566 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.432468 Oct 27 10:44:15.328742 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2941/6088] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:14 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:44:16.352571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:16.354001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:16.372807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:16.374499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:16.375038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:16.385689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:16.386497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:16.387033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:16.790688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:16.799993 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09839e38-6ec7-433c-80d2-3022cc2d6cc1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.451502 Oct 27 10:44:16.800810 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3148/6089] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:16 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:17.825032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:17.825783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:17.838439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:17.840969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:17.841580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:17.842958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:17.844730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:17.849649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:18.375311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:18.435273 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-497e443a-b148-4a0d-9ec8-d8c8850f7557 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.615159 Oct 27 10:44:18.439763 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2942/6090] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:17 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:19.463237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:19.464441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:19.482958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:19.484772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:19.489787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:19.490947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:19.492834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:19.495233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:19.843253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:19.878610 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0404be9d-9566-43ae-ba1b-637d94006737 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.420196 Oct 27 10:44:19.884557 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3149/6091] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:19 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:20.904653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:20.910122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:20.932545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:20.934046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:20.935616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:20.948131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:20.949202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:20.951045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:21.390801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:21.402683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9711bc51-ee55-43d3-adcf-550d67db9e76 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.502363 Oct 27 10:44:21.414008 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2943/6092] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:20 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:22.426078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:22.426960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:22.438572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:22.441784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:22.442199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:22.445458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:22.446169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:22.447336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:22.942475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c655e430-c174-40ba-8d01-6168735b9acf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:22.946075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c655e430-c174-40ba-8d01-6168735b9acf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:22.965253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c655e430-c174-40ba-8d01-6168735b9acf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:22.966162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c655e430-c174-40ba-8d01-6168735b9acf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:22.968939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c655e430-c174-40ba-8d01-6168735b9acf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:22.972351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c655e430-c174-40ba-8d01-6168735b9acf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:22.975420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c655e430-c174-40ba-8d01-6168735b9acf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:22.975902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c655e430-c174-40ba-8d01-6168735b9acf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:23.109654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:23.120061 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c655e430-c174-40ba-8d01-6168735b9acf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action" status: 200 len: 24575 microversion: 2.1 time: 0.187810 Oct 27 10:44:23.127748 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2944/6093] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:44:22 2022] POST /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f/action => generated 24575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:44:23.127866 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7835eff-cfe2-4f74-835c-8c85c536239c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.702538 Oct 27 10:44:23.146566 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3150/6094] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:22 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:24.161026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:24.162177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:24.193217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:24.194529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:24.201442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:24.202973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:24.203590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:24.206075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:24.637813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:24.656346 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-94d0ce58-5219-4928-975e-2c5132bade2a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.505980 Oct 27 10:44:24.658859 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2945/6095] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:24 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:25.682415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:25.683047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:25.695864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:25.696380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:25.697140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:25.697883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:25.698357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:25.698784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:25.973146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:25.987821 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-160e249b-df36-43bd-a818-b65339511036 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.309834 Oct 27 10:44:25.992792 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3151/6096] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:25 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:27.032842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:27.035308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:27.046812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:27.047484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:27.047932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:27.048758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:27.049501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:27.050042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:27.289634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:27.298208 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1378eb80-2abd-4df2-a46c-a09f798830e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.273838 Oct 27 10:44:27.298862 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2946/6097] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:27 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:28.324229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:28.326070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:28.340302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:28.341407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:28.342529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:28.343509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:28.344190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:28.345016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:28.601378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:28.611005 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9991de7-e695-4d5c-b242-11094eed0d7b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.290807 Oct 27 10:44:28.612519 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3152/6098] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:28 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:29.516277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7afe0926-fc75-4bf4-881a-e392987248dd tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:29.516277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7afe0926-fc75-4bf4-881a-e392987248dd tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:29.532215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7afe0926-fc75-4bf4-881a-e392987248dd tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:29.532742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7afe0926-fc75-4bf4-881a-e392987248dd tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:29.533264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7afe0926-fc75-4bf4-881a-e392987248dd tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:29.533995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7afe0926-fc75-4bf4-881a-e392987248dd tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:29.534452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7afe0926-fc75-4bf4-881a-e392987248dd tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:29.534879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7afe0926-fc75-4bf4-881a-e392987248dd tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:29.636469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:29.637133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:29.653366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:29.654014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:29.654576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:29.655416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:29.659180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:29.659768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:30.065434 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7afe0926-fc75-4bf4-881a-e392987248dd tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1835 microversion: 2.1 time: 0.553733 Oct 27 10:44:30.072299 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2947/6099] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:29 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1835 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:30.089280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:30.099228 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71697227-dada-4300-bc49-ccd0965dced1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1168 microversion: 2.1 time: 0.466776 Oct 27 10:44:30.102718 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3153/6100] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:29 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1168 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:44:31.132540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:31.133177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:31.163724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:31.164381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:31.173934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:31.174769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:31.175250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:31.175675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:31.632087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:31.640088 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-28e3320e-daba-4cc4-ab0d-8a2d1346fac6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1214 microversion: 2.1 time: 0.515508 Oct 27 10:44:31.641002 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2948/6101] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:31 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1214 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:32.663963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:32.665043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:32.670275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=26 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:32.683384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:32.685436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:32.687574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:32.688587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:32.690415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:32.691613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:32.701945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=72 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:33.205747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:33.206506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:33.217764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:33.220123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:33.221097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:33.222576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:33.224269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:33.226201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:33.266364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:33.276329 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f11fca62-a00e-4d95-994f-3bc63a8e861d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1202 microversion: 2.1 time: 0.616482 Oct 27 10:44:33.277714 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3154/6102] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:32 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1202 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:33.283364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0e07645d-063a-44c5-8480-317e37a93a0a req-d55cd5d5-d7e9-4507-af41-4a9c5f010b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52863b3d-eea8-4b52-8649-c3b54f842f2f", "tag": "edc15bb8-b1b2-40d9-98cb-001fb44e1f24"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:33.295072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0e07645d-063a-44c5-8480-317e37a93a0a req-d55cd5d5-d7e9-4507-af41-4a9c5f010b37 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:33.295828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0e07645d-063a-44c5-8480-317e37a93a0a req-d55cd5d5-d7e9-4507-af41-4a9c5f010b37 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:33.296416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0e07645d-063a-44c5-8480-317e37a93a0a req-d55cd5d5-d7e9-4507-af41-4a9c5f010b37 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:33.310252 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0e07645d-063a-44c5-8480-317e37a93a0a req-d55cd5d5-d7e9-4507-af41-4a9c5f010b37 service nova] Creating event network-changed:edc15bb8-b1b2-40d9-98cb-001fb44e1f24 for instance 52863b3d-eea8-4b52-8649-c3b54f842f2f on n-h2-854663-10 Oct 27 10:44:33.316903 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0e07645d-063a-44c5-8480-317e37a93a0a req-d55cd5d5-d7e9-4507-af41-4a9c5f010b37 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037611 Oct 27 10:44:33.317885 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3155/6103] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:44:33.334637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:44:33.531377 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b039bf2-957f-407c-abca-bbf42705fe85 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 204 len: 0 microversion: 2.1 time: 0.329382 Oct 27 10:44:33.532388 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2949/6104] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:44:33 2022] DELETE /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:44:33.543652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:33.544378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:33.556836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:33.557853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:33.558318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:33.559064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:33.562912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:33.563391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:33.893131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:33.906758 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ba02d18-604e-4d71-9f2a-eb24a3f358e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1688 microversion: 2.1 time: 0.368328 Oct 27 10:44:33.925821 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3156/6105] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:33 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1688 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:34.305519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:34.306240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:34.309111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:34.327378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:34.328106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:34.328720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:34.329626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:34.335258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:34.335900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:34.389112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:34.933832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:34.935122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:34.957801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:34.958769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:34.959409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:34.960342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:34.961298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:34.961977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:35.659637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:35.668861 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b963cd5-7179-47e2-b7a4-b25fb23930c2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1688 microversion: 2.1 time: 0.739352 Oct 27 10:44:35.689291 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3157/6106] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:34 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1688 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:35.830254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:35.844820 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d991f985-0270-4e14-968c-85dd79e0fd9f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1202 microversion: 2.1 time: 1.544040 Oct 27 10:44:35.845781 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2950/6107] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:34 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1202 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:36.719112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:36.723868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:36.741964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:36.748582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:36.749187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:36.749972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:36.750478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:36.750903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:36.947522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:36.969592 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b0a4560-00af-467d-aa0e-ddebba016661 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 200 len: 1503 microversion: 2.1 time: 0.259892 Oct 27 10:44:36.973078 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3158/6108] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:36 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:36.992211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:36.997456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:37.039602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:37.041084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:37.044285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:37.049962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:37.053356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:37.054013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:37.250883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-77d4a0c8-c439-47ff-8573-70396c9df52b req-ed3cab09-ce1c-40ec-a43e-55d9d87cbf91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52863b3d-eea8-4b52-8649-c3b54f842f2f", "name": "network-vif-deleted", "tag": "edc15bb8-b1b2-40d9-98cb-001fb44e1f24"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:37.323851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-77d4a0c8-c439-47ff-8573-70396c9df52b req-ed3cab09-ce1c-40ec-a43e-55d9d87cbf91 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:37.334169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-77d4a0c8-c439-47ff-8573-70396c9df52b req-ed3cab09-ce1c-40ec-a43e-55d9d87cbf91 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:37.336477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-77d4a0c8-c439-47ff-8573-70396c9df52b req-ed3cab09-ce1c-40ec-a43e-55d9d87cbf91 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:37.381870 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-77d4a0c8-c439-47ff-8573-70396c9df52b req-ed3cab09-ce1c-40ec-a43e-55d9d87cbf91 service nova] Creating event network-vif-deleted:edc15bb8-b1b2-40d9-98cb-001fb44e1f24 for instance 52863b3d-eea8-4b52-8649-c3b54f842f2f on n-h2-854663-10 Oct 27 10:44:37.396809 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-77d4a0c8-c439-47ff-8573-70396c9df52b req-ed3cab09-ce1c-40ec-a43e-55d9d87cbf91 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.633558 Oct 27 10:44:37.398910 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2951/6109] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:44:37.446042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:37.478313 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6eb1872-3726-4e38-86d8-023c46de3419 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1202 microversion: 2.1 time: 0.497843 Oct 27 10:44:37.479698 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3159/6110] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:36 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1202 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:37.998552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:37.999269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 52863b3d-eea8-4b52-8649-c3b54f842f2f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:38.016581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:38.019850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:38.020911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:38.022221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:38.023087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:38.023758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:38.043445 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] HTTP exception thrown: Instance 52863b3d-eea8-4b52-8649-c3b54f842f2f could not be found. Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Request method failure captured: Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f HTTP/1.1 Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmCB8b4BRHsH94RlDS3xYrhwfaqEsty7QYPzPqKpJZ9MHvNb0KEFX2OGq7Y9a1uA6gmR-kLao7lu13KscHPRbXuAOCZi6EE-CskQcdrHFDuQXm_jRNlw9KrLoJqKLAMqdAlw8qkWlaZnbme4veJuK1hnJ7dqbpyxw53lmnUa5qTvUDE Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d5b8083f3e1a40cf978ae9605cc2239b Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d5b8083f3e1a40cf978ae9605cc2239b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d5b8083f3e1a40cf978ae9605cc2239b Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestNetworkAdvancedServerOps-1627469587-project Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5263c34954a94017b2d5095e391ceffc Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1627469587-project Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 52863b3d-eea8-4b52-8649-c3b54f842f2f could not be found. Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '52863b3d-eea8-4b52-8649-c3b54f842f2f'} Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52863b3d-eea8-4b52-8649-c3b54f842f2f could not be found. Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52863b3d-eea8-4b52-8649-c3b54f842f2f could not be found. Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:38.045510 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:44:38.049291 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:38.049291 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:44:38.049291 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:44:38.049291 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:44:38.049291 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:44:38.049291 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:44:38.049291 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52863b3d-eea8-4b52-8649-c3b54f842f2f could not be found. Oct 27 10:44:38.049291 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:38.051368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Returning 404 to user: Instance 52863b3d-eea8-4b52-8649-c3b54f842f2f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:44:38.052555 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f3d8fa45-5dfc-4981-b26c-b3bb25ded01a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f" status: 404 len: 111 microversion: 2.1 time: 0.059647 Oct 27 10:44:38.053702 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2952/6111] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:37 2022] GET /compute/v2.1/servers/52863b3d-eea8-4b52-8649-c3b54f842f2f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:44:38.505558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:38.506185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:38.540055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:38.545639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:38.546825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:38.550078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:38.555712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:38.557931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:39.029834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:39.047072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b839f829-014e-4487-891b-cafdc3e45fd8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1202 microversion: 2.1 time: 0.546102 Oct 27 10:44:39.048857 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3160/6112] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:38 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1202 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:40.073350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:40.073989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:40.088886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:40.089778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:40.091351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:40.092146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:40.092763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:40.093636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:40.436095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:40.452194 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9bef9c4-c6f7-49e5-9dc7-61ea9c6fa1a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1202 microversion: 2.1 time: 0.378485 Oct 27 10:44:40.453464 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2953/6113] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:40 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1202 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:41.029663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d312b923-351d-438d-bf69-a6241a8da021 req-c72bef70-aa07-4c59-8b87-88a1d38579b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73754ef5-ba25-4448-9434-479ed5f058de", "name": "network-vif-plugged", "status": "completed", "tag": "65bf3d50-d6e4-4468-a2c9-416768f24bf9"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:41.049415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d312b923-351d-438d-bf69-a6241a8da021 req-c72bef70-aa07-4c59-8b87-88a1d38579b4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:41.053653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d312b923-351d-438d-bf69-a6241a8da021 req-c72bef70-aa07-4c59-8b87-88a1d38579b4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:41.054288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d312b923-351d-438d-bf69-a6241a8da021 req-c72bef70-aa07-4c59-8b87-88a1d38579b4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:41.076783 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d312b923-351d-438d-bf69-a6241a8da021 req-c72bef70-aa07-4c59-8b87-88a1d38579b4 service nova] Creating event network-vif-plugged:65bf3d50-d6e4-4468-a2c9-416768f24bf9 for instance 73754ef5-ba25-4448-9434-479ed5f058de on n-h1-854663-10 Oct 27 10:44:41.089206 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d312b923-351d-438d-bf69-a6241a8da021 req-c72bef70-aa07-4c59-8b87-88a1d38579b4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071635 Oct 27 10:44:41.091287 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3161/6114] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:44:41.484024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:41.484707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:41.494307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:41.495020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:41.495775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:41.497385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:41.498811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:41.499411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:41.734754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:41.754086 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54055050-5035-4641-bc6d-019e6f2d8901 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1202 microversion: 2.1 time: 0.282485 Oct 27 10:44:41.762039 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2954/6115] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:41 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1202 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:42.783601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:42.785762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:42.802653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:42.807158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:42.807768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:42.809313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:42.809916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:42.812121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:43.354901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:43.375622 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61c4c45d-c918-4975-8696-323ed917d30e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1202 microversion: 2.1 time: 0.599195 Oct 27 10:44:43.377218 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3162/6116] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:42 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1202 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:44.406084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:44.406720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:44.420569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:44.421097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:44.421546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:44.422229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:44.422711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:44.423443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:45.077331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:45.087375 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ba872879-ae17-4f53-a8c0-d3cdba94213c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1388 microversion: 2.1 time: 0.687776 Oct 27 10:44:45.097448 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2955/6117] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:44 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1388 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:45.116369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:45.117009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:45.131107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:45.133224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:45.133853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:45.136168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:45.136806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:45.141239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:45.653002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:45.710174 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c311c5fd-83c8-4773-9dcf-18ce8057f96d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1388 microversion: 2.1 time: 0.589248 Oct 27 10:44:45.714692 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3163/6118] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:45 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1388 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:45.742243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:45.745248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:45.758048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:45.758885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:45.759961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:45.760913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:45.761562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:45.762331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:46.321597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:46.334622 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4f301c66-91a2-4eb0-86cb-5cc77d56b30a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1388 microversion: 2.1 time: 0.597060 Oct 27 10:44:46.338401 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2956/6119] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:45 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1388 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:46.568597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:46.573066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:46.594609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:46.595619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:46.596254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:46.597165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:46.597777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:46.599440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:46.674059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:44:46.893214 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-93ca84f6-ac5e-4bba-8d2e-8baa6cc026c0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 204 len: 0 microversion: 2.1 time: 0.338692 Oct 27 10:44:46.896395 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3164/6120] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:44:46 2022] DELETE /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:44:46.904586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:46.905393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:46.921833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:46.922333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:46.922768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:46.923623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:46.924116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:46.924613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:47.144937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29f211cb-c20d-438e-84dd-a9b5cb53f362 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '.version_select at 0x7f6d603141f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:47.196062 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29f211cb-c20d-438e-84dd-a9b5cb53f362 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-950209419" status: 202 len: 0 microversion: 2.1 time: 0.056055 Oct 27 10:44:47.197267 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3165/6121] 10.222.0.76 () {58 vars in 1281 bytes} [Thu Oct 27 10:44:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-950209419 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:44:47.226833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a55d3397-e09b-42cc-974a-da195c848ca5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'create', calling method: .version_select at 0x7f6d5a1a9670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-810206394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeIikHIaLE28/sOAX8nXKiiyDX8dSLp1zLZmYr/tCnmD8snw2CebtZGNQjIyBcYjgGL+TfC2YNXGGxHRAIjc/p8ZvxlX5A1KiYQ5AGvctt4X6RcrOq31DeUk6XL3IXUBQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:47.262239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-a55d3397-e09b-42cc-974a-da195c848ca5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:44:47.271142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-a55d3397-e09b-42cc-974a-da195c848ca5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for user 5263c34954a94017b2d5095e391ceffc and project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:44:47.284712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:47.309515 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fdd59f63-581a-40b1-ae17-33ac84dd671a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1394 microversion: 2.1 time: 0.400949 Oct 27 10:44:47.315256 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2957/6122] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:46 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1394 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:47.358451 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a55d3397-e09b-42cc-974a-da195c848ca5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.135574 Oct 27 10:44:47.359370 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3166/6123] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:44:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:44:48.157486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-361786260", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:48.245630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:44:48.334618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:48.335563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:48.382709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:48.382709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:48.386907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:48.388914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:48.389384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:48.389820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:48.875083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:48.889601 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a0ee7c0-8bca-44f0-821f-96cf699d62d3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1394 microversion: 2.1 time: 0.555269 Oct 27 10:44:48.890315 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3167/6124] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:48 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1394 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:49.273836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:44:49.274397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:44:49.274710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:44:49.275171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:44:49.275509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:44:49.294003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:49.294495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:49.294931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:49.295659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:49.296110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:49.296535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:49.343644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Getting quotas for project ac41c93a3fc54ea1a0a4bfac9913543a. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:44:49.354141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Getting quotas for user acb8b1e211404ea6802fd54e40bee35c and project ac41c93a3fc54ea1a0a4bfac9913543a. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:44:49.385934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:44:49.392298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:44:49.518430 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c9a1a37-d46c-4d1e-bfc1-49a52c653662 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.369338 Oct 27 10:44:49.522114 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2958/6125] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:44:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:44:49.534239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f78a267-5fdd-41db-8e9a-c377940b1ad4 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:49.535575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f78a267-5fdd-41db-8e9a-c377940b1ad4 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:49.675050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6b6cb6a4-e900-4421-b424-02dfc3bcee20 req-b47bbdc3-44ca-41f2-8e11-1288d7037ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73754ef5-ba25-4448-9434-479ed5f058de", "name": "network-vif-deleted", "tag": "65bf3d50-d6e4-4468-a2c9-416768f24bf9"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:49.730247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6b6cb6a4-e900-4421-b424-02dfc3bcee20 req-b47bbdc3-44ca-41f2-8e11-1288d7037ddd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:49.730742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6b6cb6a4-e900-4421-b424-02dfc3bcee20 req-b47bbdc3-44ca-41f2-8e11-1288d7037ddd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:49.731180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6b6cb6a4-e900-4421-b424-02dfc3bcee20 req-b47bbdc3-44ca-41f2-8e11-1288d7037ddd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:49.784608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6b6cb6a4-e900-4421-b424-02dfc3bcee20 req-b47bbdc3-44ca-41f2-8e11-1288d7037ddd service nova] Creating event network-vif-deleted:65bf3d50-d6e4-4468-a2c9-416768f24bf9 for instance 73754ef5-ba25-4448-9434-479ed5f058de on n-h1-854663-10 Oct 27 10:44:49.799380 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6b6cb6a4-e900-4421-b424-02dfc3bcee20 req-b47bbdc3-44ca-41f2-8e11-1288d7037ddd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128485 Oct 27 10:44:49.804997 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2959/6126] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:44:49.922212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:49.922322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:49.936253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:49.936801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:49.937201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:49.938096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:49.938848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:49.938981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:50.774453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:50.776431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f78a267-5fdd-41db-8e9a-c377940b1ad4 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:50.785328 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f78a267-5fdd-41db-8e9a-c377940b1ad4 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1214 microversion: 2.1 time: 1.255819 Oct 27 10:44:50.788585 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3168/6127] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:49 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1214 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:50.791711 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b053028-2f5c-4ad2-859a-1129086c504c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1187 microversion: 2.1 time: 0.875040 Oct 27 10:44:50.792752 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2960/6128] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:49 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1187 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:51.813291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:51.829235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:51.831118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:51.833066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:51.849992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:51.854408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:51.858868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:51.860016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:51.860428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:51.861726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:51.862944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:51.864061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:51.864474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:51.865216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:51.865859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:51.866593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:52.107151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:52.116431 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1222e00e-d8f0-4277-b1cc-06ae684fc6e7 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1272 microversion: 2.1 time: 0.308223 Oct 27 10:44:52.118743 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3169/6129] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:51 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:52.174818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:52.184146 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-79c9b99e-3dc4-47d8-ac0e-ece901c27508 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1187 microversion: 2.1 time: 0.368149 Oct 27 10:44:52.188617 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2961/6130] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:51 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1187 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:53.148331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:53.149163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:53.163254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:53.163771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:53.164254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:53.165210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:53.165803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:53.166374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:53.216485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:53.218402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:53.238273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:53.245212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:53.245903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:53.246845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:53.247517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:53.248145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:53.383861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:53.392142 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e1a0e1a-2bcf-44dc-b869-082877d1d0d1 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1272 microversion: 2.1 time: 0.249115 Oct 27 10:44:53.406566 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3170/6131] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:53 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:53.446796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:53.461091 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c1e8b83-34f7-4d9a-a9e2-6de42b32d892 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1187 microversion: 2.1 time: 0.249112 Oct 27 10:44:53.462024 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2962/6132] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:53 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1187 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:54.434030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:54.434648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:54.446740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:54.447216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:54.449010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:54.449726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:54.454081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:54.454805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:54.487441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:54.487968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:54.499874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:54.500384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:54.500866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:54.519984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:54.520695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:54.521134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:55.176876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:55.192121 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c7ef215-fe2f-45ab-892b-ec573bf41f90 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1187 microversion: 2.1 time: 0.707379 Oct 27 10:44:55.193253 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2963/6133] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:54 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1187 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:55.312806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:55.329509 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9bc989ed-72d5-4135-9a2b-738e42fbd272 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1314 microversion: 2.1 time: 0.899672 Oct 27 10:44:55.336228 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3171/6134] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:54 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:56.217461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:56.218379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:56.244383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:56.245913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:56.246810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:56.250765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:56.251456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:56.252245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:56.358108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:56.359204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:56.376056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:56.377144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:56.381287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:56.382729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:56.387847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:56.388503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:56.545064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:56.573370 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1edb3771-d1ae-4eff-8edb-58217fe556a6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1187 microversion: 2.1 time: 0.358798 Oct 27 10:44:56.574590 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2964/6135] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:56 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1187 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:57.121378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:57.130505 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-876e8b9a-23aa-4db6-a65d-4968b52b337e tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1314 microversion: 2.1 time: 0.776502 Oct 27 10:44:57.151891 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3172/6136] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:56 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:44:57.607966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:57.609142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:57.639594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:57.640084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:57.640515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:57.641248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:57.641722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:57.642344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:57.753677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:57.756126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:57.756604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:57.758277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lazy-loading 'fault' on Instance uuid 73754ef5-ba25-4448-9434-479ed5f058de {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:44:57.798877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-efdb8320-904f-48cf-a489-9977942a4b5b req-efb18e4f-3dc5-4c05-8886-45df5e555c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33928f9b-a1d4-444a-8cfc-9273c7434978", "tag": "678f1746-65c8-4079-961c-4cc93a262a69"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:57.824837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-efdb8320-904f-48cf-a489-9977942a4b5b req-efb18e4f-3dc5-4c05-8886-45df5e555c5f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:57.830759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-efdb8320-904f-48cf-a489-9977942a4b5b req-efb18e4f-3dc5-4c05-8886-45df5e555c5f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:57.833215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-efdb8320-904f-48cf-a489-9977942a4b5b req-efb18e4f-3dc5-4c05-8886-45df5e555c5f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:57.855078 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-efdb8320-904f-48cf-a489-9977942a4b5b req-efb18e4f-3dc5-4c05-8886-45df5e555c5f service nova] Creating event network-changed:678f1746-65c8-4079-961c-4cc93a262a69 for instance 33928f9b-a1d4-444a-8cfc-9273c7434978 on n-h2-854663-10 Oct 27 10:44:57.876797 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-efdb8320-904f-48cf-a489-9977942a4b5b req-efb18e4f-3dc5-4c05-8886-45df5e555c5f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081444 Oct 27 10:44:57.878276 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3173/6137] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:44:58.160180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:58.160942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:58.172337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:58.172864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:58.173386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:58.184354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:58.184893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:58.185529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:58.191321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:58.471633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:58.482412 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8057771f-cb96-4f0a-bb80-63f65bd3e70e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 200 len: 1146 microversion: 2.1 time: 0.886247 Oct 27 10:44:58.488386 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2965/6138] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:57 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 1146 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:59.367365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:59.380329 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08d7a7e9-2442-40f0-9602-5746aae40f27 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1314 microversion: 2.1 time: 1.224520 Oct 27 10:44:59.383941 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3174/6139] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:58 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1314 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:59.512378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:59.514294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:59.519279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:59.520182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:59.534390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:59.546725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:59.547611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:59.548642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:59.549355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:59.550640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:59.599872 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de HTTP/1.1 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '73754ef5-ba25-4448-9434-479ed5f058de'} Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:44:59.603388 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:59.607876 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:44:59.607876 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:44:59.607876 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:44:59.607876 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:44:59.607876 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:44:59.607876 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:44:59.607876 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:44:59.619663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:44:59.622424 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c743233-66ae-4bb0-9941-f8d81ecc2500 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 404 len: 111 microversion: 2.1 time: 0.113634 Oct 27 10:44:59.629400 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2966/6140] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:59 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:45:00.406122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:00.407518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:00.420003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:00.422565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:00.423269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:00.428284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:00.433506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:00.451746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:00.785740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:01.525143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:01.539553 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-584704d5-6ca6-4f65-8337-92b1fbb3123f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1314 microversion: 2.1 time: 1.137971 Oct 27 10:45:01.546134 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3175/6141] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:00 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1314 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:02.573812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:02.574880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:02.600081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:02.600626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:02.601098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:02.601858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:02.602641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:02.603075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:03.900812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:03.916044 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c2d8aa1d-6dc2-43b9-8193-b93fcb25a13f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1314 microversion: 2.1 time: 1.345914 Oct 27 10:45:03.916853 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2967/6142] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:02 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1314 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:04.249044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:04.249552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:04.284732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:04.288008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:04.289184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:04.289973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:04.291134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:04.292538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:04.293279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:04.333423 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de HTTP/1.1 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '73754ef5-ba25-4448-9434-479ed5f058de'} Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:45:04.335941 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.340195 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.342074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:45:04.343107 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f557a6ca-517d-4007-90aa-7c0847b89676 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 404 len: 111 microversion: 2.1 time: 0.100198 Oct 27 10:45:04.344151 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3176/6143] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:45:04 2022] DELETE /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:45:04.361515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:04.364037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 73754ef5-ba25-4448-9434-479ed5f058de] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:04.402629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:04.410389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:04.411501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:04.414249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:04.416012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:04.417412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:04.433064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=90 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:04.455289 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de HTTP/1.1 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '73754ef5-ba25-4448-9434-479ed5f058de'} Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:45:04.480724 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 73754ef5-ba25-4448-9434-479ed5f058de could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43fbf311-c6b6-452e-b0a3-15de95c3440d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de" status: 404 len: 111 microversion: 2.1 time: 0.133453 Oct 27 10:45:04.484827 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2968/6144] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:04 2022] GET /compute/v2.1/servers/73754ef5-ba25-4448-9434-479ed5f058de => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:45:04.947034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:04.947662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:04.966493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:04.972503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:04.973470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:04.975652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:04.976926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:04.978068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:05.245415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-891000852", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "a8c9d246-a259-45e2-9c71-6d313f90f899"}], "key_name": "tempest-TestNetworkAdvancedServerOps-810206394", "security_groups": [{"name": "tempest-secgroup-smoke-1812868219"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:05.288611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:05.316910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:05.328692 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f82ef8f4-96c4-4106-a102-f378a88464d6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1314 microversion: 2.1 time: 0.386680 Oct 27 10:45:05.358158 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3177/6145] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:04 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:05.560048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] validate_networks() for [('a8c9d246-a259-45e2-9c71-6d313f90f899', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:45:06.364492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:06.365983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:06.390606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:06.396172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:06.401364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:06.401364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:06.401364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:06.401364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:06.629487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:45:06.630012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:45:06.630530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:45:06.630944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:45:06.631348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:45:06.651293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:06.651556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:06.651796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:06.652429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:06.655297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:06.663613 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-863de211-41ec-43c4-a8c6-3d8a47f36fa3 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1314 microversion: 2.1 time: 0.303406 Oct 27 10:45:06.677708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:06.677708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:06.680620 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3178/6146] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:06 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:06.718800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:45:06.740168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for user 5263c34954a94017b2d5095e391ceffc and project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:45:06.781734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:45:06.787653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:45:06.925430 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b75b256c-0e7f-412b-bab6-c72faa047bb8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.684695 Oct 27 10:45:06.937010 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2969/6147] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:45:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:45:06.939567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a156cbbf-0b04-4619-8584-2a686cb3e28b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:06.940255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a156cbbf-0b04-4619-8584-2a686cb3e28b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:07.087639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a156cbbf-0b04-4619-8584-2a686cb3e28b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:07.097533 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a156cbbf-0b04-4619-8584-2a686cb3e28b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1265 microversion: 2.1 time: 0.162058 Oct 27 10:45:07.099595 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3179/6148] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:06 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:07.692965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:07.693605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:07.706810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:07.707306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:07.713549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:07.714323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:07.718756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:07.726109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:08.084049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:08.095553 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2526fed1-224a-4b02-b404-0ee5bda525b6 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1314 microversion: 2.1 time: 0.407661 Oct 27 10:45:08.099106 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2970/6149] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:07 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:08.122651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:08.124199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:08.134536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:08.135232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:08.135888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:08.136876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:08.137651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:08.138281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:08.297801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:08.318656 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f5f4918-395d-41a9-afdd-8318850b5681 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1261 microversion: 2.1 time: 0.200167 Oct 27 10:45:08.319334 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3180/6150] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:08 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:08.351088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0d0cef61-5d13-4136-a4d6-9e4b027ac7d6 req-569957b2-8aa5-43cb-83a4-8f26f0973b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33928f9b-a1d4-444a-8cfc-9273c7434978", "name": "network-vif-plugged", "status": "completed", "tag": "678f1746-65c8-4079-961c-4cc93a262a69"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:08.386752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0d0cef61-5d13-4136-a4d6-9e4b027ac7d6 req-569957b2-8aa5-43cb-83a4-8f26f0973b55 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:08.387637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0d0cef61-5d13-4136-a4d6-9e4b027ac7d6 req-569957b2-8aa5-43cb-83a4-8f26f0973b55 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:08.389047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0d0cef61-5d13-4136-a4d6-9e4b027ac7d6 req-569957b2-8aa5-43cb-83a4-8f26f0973b55 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:08.416764 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0d0cef61-5d13-4136-a4d6-9e4b027ac7d6 req-569957b2-8aa5-43cb-83a4-8f26f0973b55 service nova] Creating event network-vif-plugged:678f1746-65c8-4079-961c-4cc93a262a69 for instance 33928f9b-a1d4-444a-8cfc-9273c7434978 on n-h2-854663-10 Oct 27 10:45:08.427872 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0d0cef61-5d13-4136-a4d6-9e4b027ac7d6 req-569957b2-8aa5-43cb-83a4-8f26f0973b55 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082703 Oct 27 10:45:08.434008 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2971/6151] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:45:09.126838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:09.129356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:09.151559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:09.158439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:09.159088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:09.163087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:09.164432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:09.165973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:09.345809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:09.346522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:09.373155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:09.373949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:09.378877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:09.380729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:09.380729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:09.381035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:09.624937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:09.640996 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-63e7a701-1c19-4138-8ed0-69819e0f5a2c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1323 microversion: 2.1 time: 0.301203 Oct 27 10:45:09.663387 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2972/6152] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:09 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:09.765259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:09.780258 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33a04226-cb0e-4d2e-a5a3-1e0a291f5137 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1314 microversion: 2.1 time: 0.657706 Oct 27 10:45:09.781163 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3181/6153] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:09 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:10.670799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:10.671546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:10.694369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:10.701538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:10.702255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:10.703255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:10.704131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:10.704944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:10.810314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:10.811540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:10.831237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:10.838354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:10.839002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:10.845403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:10.853660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:10.854290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:11.269774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:11.280400 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa9c1bd2-d3c4-4730-9165-ec98e394be95 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1391 microversion: 2.1 time: 0.616483 Oct 27 10:45:11.294407 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2973/6154] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:10 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1391 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:11.504759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:11.519234 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a162819d-e752-446f-b671-f442efa7fd43 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1463 microversion: 2.1 time: 0.712051 Oct 27 10:45:11.537864 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3182/6155] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:10 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1463 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:45:11.573230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:11.574109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:11.585660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:11.586987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:11.589325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:11.591671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:11.592363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:11.593709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:11.652855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:45:11.874572 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16a66060-47f1-47fd-8c78-a51701b84681 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "DELETE /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 204 len: 0 microversion: 2.1 time: 0.305850 Oct 27 10:45:11.875972 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2974/6156] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:45:11 2022] DELETE /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:45:11.885406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:11.886565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:11.903687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:11.904445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:11.905063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:11.906066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:11.906773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:11.907571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:12.311272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:12.312076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:12.325978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:12.326730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:12.327811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:12.328817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:12.329810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:12.330594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:12.344783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:12.356878 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ecd07d6-0873-4728-9433-b1799bb68e60 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1469 microversion: 2.1 time: 0.475512 Oct 27 10:45:12.357479 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3183/6157] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:11 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1469 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:12.707934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:12.717049 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0af84dc1-c38e-45b9-aa3c-823a84867140 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1391 microversion: 2.1 time: 0.411748 Oct 27 10:45:12.717953 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2975/6158] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:12 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1391 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:13.232919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b6538c3d-271b-46e2-ad28-96c54e9839b4 req-a6c8a5c5-100a-4557-be6d-9889128e0d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:13.267154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b6538c3d-271b-46e2-ad28-96c54e9839b4 req-a6c8a5c5-100a-4557-be6d-9889128e0d77 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:13.268121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b6538c3d-271b-46e2-ad28-96c54e9839b4 req-a6c8a5c5-100a-4557-be6d-9889128e0d77 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:13.268820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b6538c3d-271b-46e2-ad28-96c54e9839b4 req-a6c8a5c5-100a-4557-be6d-9889128e0d77 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:13.282526 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b6538c3d-271b-46e2-ad28-96c54e9839b4 req-a6c8a5c5-100a-4557-be6d-9889128e0d77 service nova] Creating event network-changed:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h1-854663-10 Oct 27 10:45:13.289058 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b6538c3d-271b-46e2-ad28-96c54e9839b4 req-a6c8a5c5-100a-4557-be6d-9889128e0d77 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059556 Oct 27 10:45:13.290549 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3184/6159] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:45:13.388241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:13.389084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:13.412598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:13.413148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:13.413562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:13.414267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:13.414716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:13.415136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:13.746487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:13.747400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:13.756242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:13.757280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:13.757954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:13.759531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:13.760456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:13.761289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:14.195265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:14.212046 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96539bff-576e-4d71-9928-5da07198c405 tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1469 microversion: 2.1 time: 0.828030 Oct 27 10:45:14.212895 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2976/6160] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:13 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1469 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:14.523033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-56ba65db-bbad-499e-8ad8-d2275e793539 req-ea1715bf-fedb-4328-b3d6-04c7969612e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33928f9b-a1d4-444a-8cfc-9273c7434978", "name": "network-vif-deleted", "tag": "678f1746-65c8-4079-961c-4cc93a262a69"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:14.557906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-56ba65db-bbad-499e-8ad8-d2275e793539 req-ea1715bf-fedb-4328-b3d6-04c7969612e0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:14.558673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-56ba65db-bbad-499e-8ad8-d2275e793539 req-ea1715bf-fedb-4328-b3d6-04c7969612e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:14.559383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-56ba65db-bbad-499e-8ad8-d2275e793539 req-ea1715bf-fedb-4328-b3d6-04c7969612e0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:14.576985 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-56ba65db-bbad-499e-8ad8-d2275e793539 req-ea1715bf-fedb-4328-b3d6-04c7969612e0 service nova] Creating event network-vif-deleted:678f1746-65c8-4079-961c-4cc93a262a69 for instance 33928f9b-a1d4-444a-8cfc-9273c7434978 on n-h2-854663-10 Oct 27 10:45:14.606497 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-56ba65db-bbad-499e-8ad8-d2275e793539 req-ea1715bf-fedb-4328-b3d6-04c7969612e0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094229 Oct 27 10:45:14.608299 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2977/6161] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:45:14.623884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:14.636489 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c72ebb3e-a54c-40d3-9289-88233380ae9b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1391 microversion: 2.1 time: 0.894972 Oct 27 10:45:14.645023 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3185/6162] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:13 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1391 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:15.245493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:15.245493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:15.272198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:15.274023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:15.274480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:15.275224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:15.282577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:15.284244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:15.379905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:15.380459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:15.382623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:15.383107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lazy-loading 'fault' on Instance uuid 33928f9b-a1d4-444a-8cfc-9273c7434978 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:45:15.537701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb8b1e211404ea6802fd54e40bee35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac41c93a3fc54ea1a0a4bfac9913543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:15.551780 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d9bd486-91c6-4a44-970d-56a97bb0b65f tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 200 len: 1304 microversion: 2.1 time: 0.315390 Oct 27 10:45:15.552388 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2978/6163] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:15 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 1304 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:15.689765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:15.690466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:15.701956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:15.702270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:15.702709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:15.703435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:15.704033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:15.704473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:16.056501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:16.077189 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7c784fb-748e-4fb6-aecd-5c652dc85553 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1391 microversion: 2.1 time: 0.405056 Oct 27 10:45:16.077823 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3186/6164] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:15 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1391 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:16.584012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:16.585455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] [instance: 33928f9b-a1d4-444a-8cfc-9273c7434978] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:16.596144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:16.598079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:16.598795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:16.600696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:16.601488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:16.603446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:16.630825 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] HTTP exception thrown: Instance 33928f9b-a1d4-444a-8cfc-9273c7434978 could not be found. Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Request method failure captured: Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 HTTP/1.1 Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmEcq0z57-6BA6mflZRDNm8ruRoxST1ZN6YRn_bVZkNiYKdAvACqMctEFy2I0A0n9LAjg8P3HIqnweqaQlTm7mvcIzyBKqLecyltjfFNMNf3owBImibL2WaDozWCo5VU7Ju8oGzdm-TROL5xiZ8C4nq1S-I5b720DKcAP0ITf_vSXqM Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ac41c93a3fc54ea1a0a4bfac9913543a Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-81543984 Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ac41c93a3fc54ea1a0a4bfac9913543a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ac41c93a3fc54ea1a0a4bfac9913543a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ac41c93a3fc54ea1a0a4bfac9913543a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ac41c93a3fc54ea1a0a4bfac9913543a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-81543984 Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ac41c93a3fc54ea1a0a4bfac9913543a Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-81543984 Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-81543984-project Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: acb8b1e211404ea6802fd54e40bee35c Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-81543984-project Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 33928f9b-a1d4-444a-8cfc-9273c7434978 could not be found. Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '33928f9b-a1d4-444a-8cfc-9273c7434978'} Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33928f9b-a1d4-444a-8cfc-9273c7434978 could not be found. Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33928f9b-a1d4-444a-8cfc-9273c7434978 could not be found. Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:45:16.633436 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:16.637283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:45:16.637283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:45:16.637283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:45:16.637283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:45:16.637283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:45:16.637283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33928f9b-a1d4-444a-8cfc-9273c7434978 could not be found. Oct 27 10:45:16.637283 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:45:16.640354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] Returning 404 to user: Instance 33928f9b-a1d4-444a-8cfc-9273c7434978 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:45:16.641623 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-70ccf0b0-3957-4f77-85d4-a4ff618917cf tempest-VolumesNegativeTest-81543984 tempest-VolumesNegativeTest-81543984-project] 10.222.0.76 "GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978" status: 404 len: 111 microversion: 2.1 time: 0.069735 Oct 27 10:45:16.648557 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2979/6165] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:16 2022] GET /compute/v2.1/servers/33928f9b-a1d4-444a-8cfc-9273c7434978 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:45:17.110577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:17.111558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:17.126040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:17.128202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:17.128897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:17.129792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:17.131604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:17.136343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:17.138730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:17.573634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:17.586655 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59eb3235-ab79-4337-b13d-5ac63ca3bf74 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1391 microversion: 2.1 time: 0.482024 Oct 27 10:45:17.586870 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3187/6166] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:17 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1391 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:18.611013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:18.611638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:18.621187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:18.625779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:18.631554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:18.633839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:18.636728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:18.640098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:18.640930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:18.642465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:19.004502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4339a259-25b9-4156-a7b3-c941cb5d5010 req-701832b8-eeeb-4ab7-85e3-203caa9fe333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "name": "network-vif-plugged", "status": "completed", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:19.040136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4339a259-25b9-4156-a7b3-c941cb5d5010 req-701832b8-eeeb-4ab7-85e3-203caa9fe333 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:19.043331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4339a259-25b9-4156-a7b3-c941cb5d5010 req-701832b8-eeeb-4ab7-85e3-203caa9fe333 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:19.047720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4339a259-25b9-4156-a7b3-c941cb5d5010 req-701832b8-eeeb-4ab7-85e3-203caa9fe333 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:19.092564 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4339a259-25b9-4156-a7b3-c941cb5d5010 req-701832b8-eeeb-4ab7-85e3-203caa9fe333 service nova] Creating event network-vif-plugged:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h1-854663-10 Oct 27 10:45:19.120783 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4339a259-25b9-4156-a7b3-c941cb5d5010 req-701832b8-eeeb-4ab7-85e3-203caa9fe333 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120612 Oct 27 10:45:19.128106 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3188/6167] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:45:19.349365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:19.388807 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-56b6674b-55e4-4029-851b-54d46a4dea92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1391 microversion: 2.1 time: 0.778203 Oct 27 10:45:19.390358 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2980/6168] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:18 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1391 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:20.423869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:20.424765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:20.440256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:20.445966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:20.448236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:20.449883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:20.455198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:20.456258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:20.769683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:20.778431 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-861ec13a-454a-4f06-8f51-346c04a893b5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1391 microversion: 2.1 time: 0.360023 Oct 27 10:45:20.798065 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3189/6169] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:20 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1391 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:21.806082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:21.807555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:21.819263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:21.820159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:21.820826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:21.822130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:21.822765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:21.823423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:22.423845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:22.449684 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10a37592-3cb8-4cfd-aada-815c6d91e5c1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1562 microversion: 2.1 time: 0.647002 Oct 27 10:45:22.450317 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2981/6170] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:21 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1562 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:22.479123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:22.480452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:22.502713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:22.503222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:22.503645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:22.504366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:22.504844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:22.512438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:22.879401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:22.890640 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-176cdc36-a03a-4f14-8ce5-ad89635b0941 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1562 microversion: 2.1 time: 0.418080 Oct 27 10:45:22.923628 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3190/6171] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:22 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1562 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:26.737864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:26.739368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:26.744493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a0a21cc4-676c-477d-aa53-e981032039ab req-725f2fde-f876-4475-a84e-54865dc6a37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:26.758599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:26.759121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:26.761289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:26.763893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:26.764373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:26.764849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:26.766289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a0a21cc4-676c-477d-aa53-e981032039ab req-725f2fde-f876-4475-a84e-54865dc6a37e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:26.767048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a0a21cc4-676c-477d-aa53-e981032039ab req-725f2fde-f876-4475-a84e-54865dc6a37e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:26.767950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a0a21cc4-676c-477d-aa53-e981032039ab req-725f2fde-f876-4475-a84e-54865dc6a37e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:26.783047 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a0a21cc4-676c-477d-aa53-e981032039ab req-725f2fde-f876-4475-a84e-54865dc6a37e service nova] Creating event network-changed:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h1-854663-10 Oct 27 10:45:26.790370 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a0a21cc4-676c-477d-aa53-e981032039ab req-725f2fde-f876-4475-a84e-54865dc6a37e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051726 Oct 27 10:45:26.791201 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3191/6172] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:45:27.052552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:27.071016 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2d150afe-47e9-4ee7-98e9-83bad0212c6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1562 microversion: 2.1 time: 0.339374 Oct 27 10:45:27.072389 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2982/6173] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:26 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1562 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:27.480146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1206168815", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:27.589123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:45:28.165601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:45:28.166225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:45:28.167193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:45:28.167785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:45:28.168347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:45:28.196704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:28.201944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:28.204973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:28.211360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:28.212203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:28.215174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:28.334141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Getting quotas for project be050a846ebe4ec8b1a5031b1d28f457. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:45:28.425210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Getting quotas for user 226eb18f33a84d38bf3ac5db0b26cbec and project be050a846ebe4ec8b1a5031b1d28f457. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:45:28.458918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:45:28.462963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:45:28.586701 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [f75cdeb4-a620-401a-be95-7190d6e95b8e] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:45:29.599646 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [f75cdeb4-a620-401a-be95-7190d6e95b8e] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33798. Oct 27 10:45:29.604231 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5dcf3a43-599e-4bdb-b86c-31ebc7adbaf4 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.130297 Oct 27 10:45:29.611528 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3192/6174] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:45:29.616790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-786bac2a-6d70-4366-a718-f450cfccf98c tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:29.617436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-786bac2a-6d70-4366-a718-f450cfccf98c tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:29.795842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-786bac2a-6d70-4366-a718-f450cfccf98c tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:29.810593 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-786bac2a-6d70-4366-a718-f450cfccf98c tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1214 microversion: 2.1 time: 0.197527 Oct 27 10:45:29.811994 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2983/6175] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:29 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:30.848720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:30.854886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:30.867101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:30.868050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:30.868892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:30.869917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:30.874600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:30.875702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:30.905363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=88 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:30.980574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:30.992864 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ffa48bf-9932-4580-811e-df41d2e498aa tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1266 microversion: 2.1 time: 0.156533 Oct 27 10:45:30.993663 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3193/6176] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:30 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:32.021392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:32.023354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:32.044727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:32.048304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:32.049119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:32.050339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:32.053932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:32.053932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:32.246216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:32.258888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b80788f-3719-4f76-8db4-3e27126bff0d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1272 microversion: 2.1 time: 0.243076 Oct 27 10:45:32.261048 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2984/6177] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:32 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:33.288968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:33.289679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:33.310590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:33.314658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:33.318176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:33.320522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:33.323655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:33.325200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:33.863832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:33.879428 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cc3fc1f4-89dd-4b66-b022-60cfbd9edfbd tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1314 microversion: 2.1 time: 0.595633 Oct 27 10:45:33.884118 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3194/6178] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:33 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:34.485522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e2a1197f-aaba-4bc9-97f9-40dbc27b6d38 req-67039698-c1d8-4e74-a910-f35d9c86387c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f4e68a-53fc-4f23-be0e-d8db5f181dbc", "tag": "fdf65f5d-7808-4af7-899a-b76f1b501ecf"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:34.509779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e2a1197f-aaba-4bc9-97f9-40dbc27b6d38 req-67039698-c1d8-4e74-a910-f35d9c86387c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:34.511418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e2a1197f-aaba-4bc9-97f9-40dbc27b6d38 req-67039698-c1d8-4e74-a910-f35d9c86387c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:34.514725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e2a1197f-aaba-4bc9-97f9-40dbc27b6d38 req-67039698-c1d8-4e74-a910-f35d9c86387c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:34.524101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:34.561445 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e2a1197f-aaba-4bc9-97f9-40dbc27b6d38 req-67039698-c1d8-4e74-a910-f35d9c86387c service nova] Creating event network-changed:fdf65f5d-7808-4af7-899a-b76f1b501ecf for instance 81f4e68a-53fc-4f23-be0e-d8db5f181dbc on n-h2-854663-10 Oct 27 10:45:34.577573 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e2a1197f-aaba-4bc9-97f9-40dbc27b6d38 req-67039698-c1d8-4e74-a910-f35d9c86387c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096965 Oct 27 10:45:34.585445 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2985/6179] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:45:34.909919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:34.910545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:34.918207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:34.918903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:34.919514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:34.920386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:34.921017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:34.921597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:35.242652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:35.254123 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5d387f3-7a97-4fb6-afcd-863ae19e7126 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1314 microversion: 2.1 time: 0.348177 Oct 27 10:45:35.255899 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3195/6180] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:34 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:36.282702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:36.283430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:36.298145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:36.299948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:36.300457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:36.300958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:36.303016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:36.303428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:36.303870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:36.611407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:36.619781 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0aabd99-032f-46ac-9759-ec8556929580 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1314 microversion: 2.1 time: 0.344878 Oct 27 10:45:36.620369 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2986/6181] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:36 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:37.646425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:37.647029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:37.651091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:37.655024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:37.655774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:37.656461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:37.657490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:37.658135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:37.658823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:37.928435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:37.948394 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddabf2ae-8684-4410-a602-0a73658cb101 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1314 microversion: 2.1 time: 0.296788 Oct 27 10:45:37.948394 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3196/6182] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:37 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:45:38.964971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:38.966166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:38.978876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:38.979384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:38.979829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:38.980565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:38.994877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:38.994877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:39.387249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:39.418187 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d22caaa-0838-454c-a484-7f7c42a3e7fe tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1314 microversion: 2.1 time: 0.456902 Oct 27 10:45:39.419456 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2987/6183] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:38 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:39.625115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b762d9a7-fe47-4847-9360-6b24d644b4c3 req-97eb44ff-b6ae-4562-a779-afab27d5eacb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f4e68a-53fc-4f23-be0e-d8db5f181dbc", "name": "network-vif-plugged", "status": "completed", "tag": "fdf65f5d-7808-4af7-899a-b76f1b501ecf"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:39.642749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:39.645782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:39.656827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b762d9a7-fe47-4847-9360-6b24d644b4c3 req-97eb44ff-b6ae-4562-a779-afab27d5eacb service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:39.658702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b762d9a7-fe47-4847-9360-6b24d644b4c3 req-97eb44ff-b6ae-4562-a779-afab27d5eacb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:39.659173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b762d9a7-fe47-4847-9360-6b24d644b4c3 req-97eb44ff-b6ae-4562-a779-afab27d5eacb service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:39.691171 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b762d9a7-fe47-4847-9360-6b24d644b4c3 req-97eb44ff-b6ae-4562-a779-afab27d5eacb service nova] Creating event network-vif-plugged:fdf65f5d-7808-4af7-899a-b76f1b501ecf for instance 81f4e68a-53fc-4f23-be0e-d8db5f181dbc on n-h2-854663-10 Oct 27 10:45:39.717358 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b762d9a7-fe47-4847-9360-6b24d644b4c3 req-97eb44ff-b6ae-4562-a779-afab27d5eacb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098588 Oct 27 10:45:39.720420 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3197/6184] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:45:40.443710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:40.444521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:40.462355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:40.465275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:40.465901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:40.466532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:40.467365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:40.467913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:40.468441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:40.785434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:40.794134 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-63433ef4-7c46-4754-bdb6-1857bc535473 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1314 microversion: 2.1 time: 0.355097 Oct 27 10:45:40.795287 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2988/6185] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:40 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:41.825704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:41.827104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:41.835248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:41.835773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:41.836219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:41.836955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:41.837409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:41.837833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:42.052415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:42.070011 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90bb71ac-956d-4d29-84bc-65d6191253ff tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1464 microversion: 2.1 time: 0.249833 Oct 27 10:45:42.084375 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3198/6186] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:41 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1464 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:42.110873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd178690-e30e-4943-808d-1a5be70e5bd9 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23248601-d495-4b6e-a834-ddb751439ce4", "device": "/dev/sdb"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:42.113857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd178690-e30e-4943-808d-1a5be70e5bd9 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:42.128822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd178690-e30e-4943-808d-1a5be70e5bd9 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:42.129796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd178690-e30e-4943-808d-1a5be70e5bd9 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:42.130533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd178690-e30e-4943-808d-1a5be70e5bd9 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:42.131592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd178690-e30e-4943-808d-1a5be70e5bd9 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:42.139157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd178690-e30e-4943-808d-1a5be70e5bd9 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:42.140343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd178690-e30e-4943-808d-1a5be70e5bd9 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:42.718291 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd178690-e30e-4943-808d-1a5be70e5bd9 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "POST /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613467 Oct 27 10:45:42.720007 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2989/6187] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:45:42 2022] POST /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc/os-volume_attachments => generated 194 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:45:45.139025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1365948763", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b0472c81-93b0-4a51-91f2-03fb0eeae1b8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0264043c-59ac-40f6-8b89-4caf5f646c28"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:45.235453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] validate_networks() for [('0264043c-59ac-40f6-8b89-4caf5f646c28', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:45:45.947494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:45:45.948221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:45:45.949137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:45:45.949747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:45:45.950355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:45:45.962576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:45.963452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:45.964297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:45.965312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:45.965992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:45.966825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:45.988623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:45:45.997168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for user 6e16c7669eb34fa49714040f728210e4 and project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:45:46.077244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:45:46.079928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0472c81-93b0-4a51-91f2-03fb0eeae1b8',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:45:46.295056 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52a88570-2dc4-4d1d-b967-d97caeb07948 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159804 Oct 27 10:45:46.295732 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3199/6188] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:45:46.309847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f45840f-b7d5-48e4-bb83-edcbc3420bae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:46.311168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f45840f-b7d5-48e4-bb83-edcbc3420bae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:46.424207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f45840f-b7d5-48e4-bb83-edcbc3420bae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:46.436775 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f45840f-b7d5-48e4-bb83-edcbc3420bae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1071 microversion: 2.1 time: 0.132629 Oct 27 10:45:46.437443 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2990/6189] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:46 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1071 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:47.461644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:47.462841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:47.478831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:47.479622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:47.480071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:47.480849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:47.481645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:47.482939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:47.620192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:47.630100 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ffe1bf6-f9c0-4b24-9d89-28ec21b26f45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1121 microversion: 2.1 time: 0.172272 Oct 27 10:45:47.640426 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3200/6190] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:47 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1121 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:47.951523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30b9d20b-51ba-4a61-aac4-cf42646a0aea tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:47.955526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30b9d20b-51ba-4a61-aac4-cf42646a0aea tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:47.977572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b9d20b-51ba-4a61-aac4-cf42646a0aea tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:47.978061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b9d20b-51ba-4a61-aac4-cf42646a0aea tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:47.981675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b9d20b-51ba-4a61-aac4-cf42646a0aea tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:47.982420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b9d20b-51ba-4a61-aac4-cf42646a0aea tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:47.982884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b9d20b-51ba-4a61-aac4-cf42646a0aea tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:47.983311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b9d20b-51ba-4a61-aac4-cf42646a0aea tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:48.197443 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30b9d20b-51ba-4a61-aac4-cf42646a0aea tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action" status: 200 len: 24558 microversion: 2.1 time: 0.250234 Oct 27 10:45:48.199009 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2991/6191] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:45:47 2022] POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action => generated 24558 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:45:48.660958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:48.662148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:48.677025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:48.677902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:48.683121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:48.685800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:48.696583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:48.697548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:48.823176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:48.832623 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e18b43ac-c594-49e3-8d26-b6484199bb1c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1187 microversion: 2.1 time: 0.177018 Oct 27 10:45:48.842625 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3201/6192] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:48 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1187 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:49.868232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:49.869031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:49.884649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:49.885528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:49.886605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:49.888595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:49.889208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:49.892768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:50.226730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:50.235783 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a9029da9-76d6-4c97-a637-79454f4f0ad9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.371920 Oct 27 10:45:50.237057 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2992/6193] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:49 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:51.261296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:51.261983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:51.283146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:51.283932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:51.284298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:51.285124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:51.285587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:51.286020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:51.447922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0e033075-0f50-435b-b9da-9eefd8c9a848 req-e739a6e0-b677-49f4-a9f9-f6bd9dec03b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "249e37af-92ba-4204-a64d-ef8f92b0769c", "tag": "38fdf8b6-c89d-4510-aed3-19ab8fb3fbd1"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:51.467717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0e033075-0f50-435b-b9da-9eefd8c9a848 req-e739a6e0-b677-49f4-a9f9-f6bd9dec03b4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:51.468290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0e033075-0f50-435b-b9da-9eefd8c9a848 req-e739a6e0-b677-49f4-a9f9-f6bd9dec03b4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:51.473600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0e033075-0f50-435b-b9da-9eefd8c9a848 req-e739a6e0-b677-49f4-a9f9-f6bd9dec03b4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:51.500900 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0e033075-0f50-435b-b9da-9eefd8c9a848 req-e739a6e0-b677-49f4-a9f9-f6bd9dec03b4 service nova] Creating event network-changed:38fdf8b6-c89d-4510-aed3-19ab8fb3fbd1 for instance 249e37af-92ba-4204-a64d-ef8f92b0769c on n-h1-854663-10 Oct 27 10:45:51.520064 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0e033075-0f50-435b-b9da-9eefd8c9a848 req-e739a6e0-b677-49f4-a9f9-f6bd9dec03b4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.528393 Oct 27 10:45:51.521095 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3202/6194] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:45:51.563834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:51.574264 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cacdeef3-79ce-4039-84c8-b353655ffefc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.316116 Oct 27 10:45:51.575943 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2993/6195] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:51 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:52.602012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:52.603899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:52.612122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:52.613320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:52.613783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:52.614496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:52.614956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:52.615382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:52.762204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:52.772845 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-071b832d-d17b-4819-a8fd-687b16da5dc8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.176042 Oct 27 10:45:52.773592 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3203/6196] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:52 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:53.795978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:53.797047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:53.804603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:53.805526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:53.806081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:53.806972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:53.807458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:53.807897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:53.947692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:53.956340 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83fb9dca-fba6-4aad-b719-7c841d527e67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.164704 Oct 27 10:45:53.968700 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2994/6197] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:53 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:54.980491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:54.981911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:54.990213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:54.990730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:54.991168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:54.992148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:54.992615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:54.993060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:55.163028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:55.171817 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7af057b6-7e41-48c2-a41c-f8bbf8bec7e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.195724 Oct 27 10:45:55.175119 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3204/6198] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:54 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:56.195414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:56.196165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:56.210333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:56.211171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:56.211879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:56.212933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:56.213680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:56.214456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:56.428438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:56.472598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:56.486434 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3adfbd32-5803-4212-9fb7-f4f2f583daa4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.294947 Oct 27 10:45:56.487187 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2995/6199] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:56 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:57.510728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:57.511994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:57.519286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:57.522281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:57.524576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:57.524903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:57.526422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:57.527339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:57.533491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:57.534206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:57.786368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:57.796724 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57e40d9c-11fb-4ca0-b39c-2bead8588ab3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.289989 Oct 27 10:45:57.797683 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3205/6200] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:57 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:58.819987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:58.820589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:58.834167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:58.834673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:58.835117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:58.835838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:58.836345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:58.836841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:59.071705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:59.080581 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46c0fd90-22e6-48f0-a13b-65093c22e890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.264727 Oct 27 10:45:59.100754 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2996/6201] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:58 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:59.183755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b915db50-4883-4dde-8680-ed74eeb35f62 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:59.184917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b915db50-4883-4dde-8680-ed74eeb35f62 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:59.203339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b915db50-4883-4dde-8680-ed74eeb35f62 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:59.204107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b915db50-4883-4dde-8680-ed74eeb35f62 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:59.204541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b915db50-4883-4dde-8680-ed74eeb35f62 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:59.205296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b915db50-4883-4dde-8680-ed74eeb35f62 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:59.205742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b915db50-4883-4dde-8680-ed74eeb35f62 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:59.206161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b915db50-4883-4dde-8680-ed74eeb35f62 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:59.535327 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b915db50-4883-4dde-8680-ed74eeb35f62 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1833 microversion: 2.1 time: 0.356741 Oct 27 10:45:59.537289 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3206/6202] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:59 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1833 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:59.568875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:59.569503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:59.582629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:59.588603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:59.589157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:59.589936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:59.590407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:59.590836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:59.765458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:59.774380 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0cfe818a-5f3b-46e1-b5ab-050c7faf21c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1680 microversion: 2.1 time: 0.215908 Oct 27 10:45:59.775470 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2997/6203] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:59 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:59.916702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f131d1b-1e86-4dae-917f-2443b73cf8e1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:59.919071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f131d1b-1e86-4dae-917f-2443b73cf8e1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:59.935105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f131d1b-1e86-4dae-917f-2443b73cf8e1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:59.938728 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f131d1b-1e86-4dae-917f-2443b73cf8e1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:59.939180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f131d1b-1e86-4dae-917f-2443b73cf8e1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:59.939973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f131d1b-1e86-4dae-917f-2443b73cf8e1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:59.945237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f131d1b-1e86-4dae-917f-2443b73cf8e1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:59.945898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f131d1b-1e86-4dae-917f-2443b73cf8e1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:00.012654 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f131d1b-1e86-4dae-917f-2443b73cf8e1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action" status: 200 len: 32628 microversion: 2.1 time: 0.099842 Oct 27 10:46:00.014047 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3207/6204] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:45:59 2022] POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action => generated 32628 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:46:00.119396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:00.120247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:00.130064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:00.131302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:00.132111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:00.133091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:00.133890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:00.134755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:00.253561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:00.254227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:00.284032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:00.289729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:00.290465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:00.292384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:00.293436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:00.297099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:00.469621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd963fef7e7f44219b0c85258b706cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d12fa75dda34a36bb23a0a743a9d4a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:00.470236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] flavor_id is None. Assuming migration. {{(pid=120720) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 10:46:00.470674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120720) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 10:46:00.507892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:00.527151 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd3778bd-cf98-4626-b4dd-b351b2966010 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.421549 Oct 27 10:46:00.530033 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2998/6205] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:00 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:01.056563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=84 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:01.259669 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-34ea72ed-b431-42ed-9ba5-9add05a9076c tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action" status: 202 len: 0 microversion: 2.1 time: 1.008336 Oct 27 10:46:01.261548 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3208/6206] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:46:00 2022] POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action => generated 0 bytes in 1013 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:46:01.269960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:01.271174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:01.288752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:01.289472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:01.290066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:01.290959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:01.291559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:01.292231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:01.554546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:01.556023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:01.573133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:01.575390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:01.576161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:01.577987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:01.582765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:01.584507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:01.599138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:01.634786 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b52b867a-85c1-4d50-8255-07aab1e4a1d5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1689 microversion: 2.1 time: 0.365109 Oct 27 10:46:01.638004 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2999/6207] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:01 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1689 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:01.947756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:01.959302 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ba82fad-2803-4370-8af0-804794fab6e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1229 microversion: 2.1 time: 0.412271 Oct 27 10:46:01.960189 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3209/6208] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:01 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1229 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:02.665787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:02.668122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:02.687671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:02.688739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:02.690534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:02.694552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:02.695244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:02.695784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:02.987602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:02.988334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:03.002745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:03.003914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:03.004499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:03.011681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:03.013395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:03.015479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:03.026867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:03.039178 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5ee4778-957b-41a9-b433-1372507d4cf0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1689 microversion: 2.1 time: 0.379846 Oct 27 10:46:03.041696 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3000/6209] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:02 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1689 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:03.365714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:03.378720 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8dedee4-33e6-4a43-85c3-463a8b424e4d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1217 microversion: 2.1 time: 0.396256 Oct 27 10:46:03.398093 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3210/6210] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:02 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1217 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:04.070830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:04.072071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:04.089244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:04.092493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:04.093332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:04.094123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:04.094589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:04.095010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:04.412547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:04.413285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:04.427443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:04.427938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:04.428378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:04.438108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:04.445566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:04.445765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:04.446994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:04.456892 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aac2275b-bba5-4179-aa76-a34bb9bacf92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1689 microversion: 2.1 time: 0.390564 Oct 27 10:46:04.471628 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3001/6211] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:04 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1689 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:04.840006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:04.849611 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ced3bc1a-2b53-4e86-93b7-6b142e88aa21 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1217 microversion: 2.1 time: 0.441253 Oct 27 10:46:04.850815 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3211/6212] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:04 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1217 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:05.481478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:05.482025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:05.489457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:05.490486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:05.491013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:05.491965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:05.492570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:05.493221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:05.516969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:05.831794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:05.845240 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b60ee133-6c3c-4f5b-a101-65f3f9920041 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.367613 Oct 27 10:46:05.850208 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3002/6213] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:05 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:05.875523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:05.876963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:05.890546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:05.891295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:05.891821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:05.892636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:05.893192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:05.893732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:06.257815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:06.283474 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac3a91bd-bbfc-4b2d-a766-58262ee0d97d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1217 microversion: 2.1 time: 0.412985 Oct 27 10:46:06.284077 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3212/6214] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:05 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1217 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:06.877244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:06.878500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:06.890545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=36 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:06.895212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:06.897972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:06.899531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:06.901856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:06.903434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:06.904495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:07.135761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:07.148390 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4cf837ee-4a86-413f-b5f2-a34141401130 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.272799 Oct 27 10:46:07.152793 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3003/6215] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:06 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:07.311182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:07.312010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:07.321602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:07.322260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:07.322690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:07.323442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:07.327537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:07.330141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:07.672470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:07.684341 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3ecaefd-1af4-4c9b-8fed-faacfe81192d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1217 microversion: 2.1 time: 0.377372 Oct 27 10:46:07.684774 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3213/6216] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:07 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1217 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:08.175962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:08.177449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:08.184798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:08.185581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:08.186305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:08.187499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:08.188112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:08.188712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:08.416753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:08.425552 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e8fd6ade-ed36-47b9-ab4a-570c47a110e3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.256657 Oct 27 10:46:08.445713 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3004/6217] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:08 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:08.711309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:08.711309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:08.715102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:08.731096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:08.731599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:08.732041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:08.735799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:08.736290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:08.736762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:09.366367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:09.378930 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d29040d2-2160-4ac0-9823-24bf46d962f4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1217 microversion: 2.1 time: 0.673563 Oct 27 10:46:09.392982 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3214/6218] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:08 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1217 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:09.454572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:09.455290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:09.467571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:09.468426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:09.469111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:09.474512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:09.475639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:09.488762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:09.708819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:09.722171 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65c50c4f-0663-4d76-8b5b-3f16c40e0e35 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.273093 Oct 27 10:46:09.723138 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3005/6219] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:09 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:10.418855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:10.420045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:10.428164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:10.429551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:10.430601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:10.431641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:10.432162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:10.432808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:10.639213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:10.647994 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e38ee18f-4181-4555-b0c9-41cf9320b967 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1217 microversion: 2.1 time: 0.233553 Oct 27 10:46:10.649368 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3215/6220] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:10 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1217 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:10.747305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:10.747932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:10.764392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:10.765259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:10.765863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:10.766772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:10.767380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:10.767965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:10.975767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:10.987567 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0b198179-56c0-430b-afc2-e00193af0b92 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.244679 Oct 27 10:46:10.988808 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3006/6221] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:10 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:11.671587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:11.673085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:11.683716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:11.684405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:11.685024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:11.686149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:11.686881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:11.687487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:11.878366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:11.887231 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-84cdded9-00fe-4be4-96e2-e29c0a260f2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1217 microversion: 2.1 time: 0.219684 Oct 27 10:46:11.887818 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3216/6222] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:11 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:12.014916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:12.016426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:12.032469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:12.033217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:12.033899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:12.034846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:12.035516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:12.036181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:12.230297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:12.239574 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d02481f0-ee89-4f39-af36-aa744962452d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.228576 Oct 27 10:46:12.240178 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3007/6223] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:12 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:12.909909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:12.911244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:12.926592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:12.927403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:12.928040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:12.929029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:12.929673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:12.930625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:13.273392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:13.286964 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2627a25-cbef-46ce-a41e-d2af9fec01ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1217 microversion: 2.1 time: 0.380867 Oct 27 10:46:13.288888 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3217/6224] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:12 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1217 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:13.317086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:13.318067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:13.336471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-be1ffcad-515f-41b6-a10e-88a1df2e2df6 req-06460b7c-5433-4e6d-a49b-eb640f001824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249e37af-92ba-4204-a64d-ef8f92b0769c", "name": "network-vif-plugged", "status": "completed", "tag": "38fdf8b6-c89d-4510-aed3-19ab8fb3fbd1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:13.346955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:13.347447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:13.347887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:13.348601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:13.349084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:13.349512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:13.358300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-be1ffcad-515f-41b6-a10e-88a1df2e2df6 req-06460b7c-5433-4e6d-a49b-eb640f001824 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:13.368456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-be1ffcad-515f-41b6-a10e-88a1df2e2df6 req-06460b7c-5433-4e6d-a49b-eb640f001824 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:13.369050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-be1ffcad-515f-41b6-a10e-88a1df2e2df6 req-06460b7c-5433-4e6d-a49b-eb640f001824 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:13.395233 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-be1ffcad-515f-41b6-a10e-88a1df2e2df6 req-06460b7c-5433-4e6d-a49b-eb640f001824 service nova] Creating event network-vif-plugged:38fdf8b6-c89d-4510-aed3-19ab8fb3fbd1 for instance 249e37af-92ba-4204-a64d-ef8f92b0769c on n-h1-854663-10 Oct 27 10:46:13.406638 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-be1ffcad-515f-41b6-a10e-88a1df2e2df6 req-06460b7c-5433-4e6d-a49b-eb640f001824 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382869 Oct 27 10:46:13.407265 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3008/6225] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:46:13.631052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:13.639433 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2797bd87-e6c4-4fb1-95e6-866eb06c7615 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.348674 Oct 27 10:46:13.640301 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3218/6226] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:13 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:14.312625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:14.313387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:14.330702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:14.331205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:14.331644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:14.332364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:14.332861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:14.333289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:14.503519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:14.516436 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc3d4f6c-03f7-432f-bae6-8f0068d37b85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1217 microversion: 2.1 time: 0.207685 Oct 27 10:46:14.516986 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3009/6227] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:14 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:14.664404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:14.665806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:14.679600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:14.681422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:14.683161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:14.685918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:14.687330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:14.688854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:15.049807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:15.069029 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4b335a4-5514-45e6-b611-aaeb64d714fd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.407903 Oct 27 10:46:15.070446 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3219/6228] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:14 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:15.539632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:15.540774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:15.551446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:15.556467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:15.557080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:15.557919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:15.558998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:15.560758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:15.862100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:15.873146 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f6ec5f6-196e-4be3-aee9-f4d5237e53ef tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1404 microversion: 2.1 time: 0.337535 Oct 27 10:46:15.877271 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3010/6229] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:15 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1404 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:15.899331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:15.908421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:15.925314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:15.926706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:15.928045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:15.930232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:15.933219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:15.933849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:16.091849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:16.092502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:16.101679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:16.102491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:16.103136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:16.104151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:16.104964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:16.105572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:16.198507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:16.218009 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f54b503a-2356-4a54-bbf4-883bf2d1e389 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1404 microversion: 2.1 time: 0.322653 Oct 27 10:46:16.219087 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3220/6230] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:15 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1404 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:16.250276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-287350871"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:16.254297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:16.274266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:16.274770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:16.275213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:16.275950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:16.276399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:16.276879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:16.418449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:16.434471 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5fecdb20-6930-4169-8f59-f5bb8769f3f9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.344961 Oct 27 10:46:16.435924 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3011/6231] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:16 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:16.523453 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.api [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Attempting to quiesce instance before volume snapshot. Oct 27 10:46:16.561268 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.api [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 27 10:46:16.694016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Creating snapshot from volume b0472c81-93b0-4a51-91f2-03fb0eeae1b8. {{(pid=120720) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 27 10:46:17.494535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:17.495407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:17.506906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:17.507643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:17.508192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:17.511195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:17.511995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:17.512579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:17.875272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:17.899607 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-adb22b2e-08ed-4950-b983-b315706b54fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.433793 Oct 27 10:46:17.900513 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3012/6232] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:17 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:18.240610 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81fb6f64-7874-467e-98aa-cebf9a926e94 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c/action" status: 202 len: 0 microversion: 2.1 time: 1.998724 Oct 27 10:46:18.243339 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3221/6233] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:46:16 2022] POST /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c/action => generated 0 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 27 10:46:18.923615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:18.925024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:18.951722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:18.953363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:18.954428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:18.955629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:18.956287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:18.963008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:19.382239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:19.401093 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a658180-901f-4672-8866-ee1c6084c510 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.480257 Oct 27 10:46:19.402353 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3013/6234] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:18 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:20.428654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:20.429444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:20.438780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:20.439295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:20.439757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:20.440579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:20.441412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:20.441714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:20.462700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:20.655164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1812311126", "imageRef": "4c24849b-21b3-468e-8a13-61da5a54a5e5", "flavorRef": "452", "networks": [{"uuid": "0264043c-59ac-40f6-8b89-4caf5f646c28"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:20.684702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:20.695509 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39c9f640-1e4b-4013-809e-78fa957a9e9d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.271411 Oct 27 10:46:20.696583 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3222/6235] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:20 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:20.741679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] validate_networks() for [('0264043c-59ac-40f6-8b89-4caf5f646c28', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:46:21.360838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:46:21.361403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:46:21.361882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:46:21.362474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:46:21.362891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:46:21.384624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:21.385408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:21.386026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:21.386952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:21.387576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:21.388486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:21.446963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:46:21.459720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for user 6e16c7669eb34fa49714040f728210e4 and project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:46:21.479341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:46:21.484158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='00b1fbe0-65c4-4d14-98ff-972c258fa089',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:46:21.655057 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df4facb5-9117-413c-aa7a-50fe41bc7539 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002655 Oct 27 10:46:21.655712 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3014/6236] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:46:21.671669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4aeab436-066e-4b93-8b86-54d87b44ed9d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:21.672312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4aeab436-066e-4b93-8b86-54d87b44ed9d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:21.724051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:21.724837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:21.766452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:21.767305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:21.767761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:21.768827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:21.769683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:21.770301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:21.794773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4aeab436-066e-4b93-8b86-54d87b44ed9d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:21.805754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4aeab436-066e-4b93-8b86-54d87b44ed9d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1230 microversion: 2.1 time: 0.139399 Oct 27 10:46:21.828902 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3223/6237] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:21 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1230 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:22.057377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:22.075232 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2775bf71-61f5-4450-b3e7-568835b444c7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1694 microversion: 2.1 time: 0.356223 Oct 27 10:46:22.090248 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3015/6238] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:21 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1694 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:22.835795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:22.836488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:22.852534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:22.853057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:22.853501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:22.854243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:22.868129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:22.868744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:22.993904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:23.007298 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3ef72ec-2288-4c03-b65d-7575d4ddfe11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1234 microversion: 2.1 time: 0.173514 Oct 27 10:46:23.007911 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3224/6239] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:22 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1234 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:23.104134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:23.113547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:23.134865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:23.137534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:23.138310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:23.141203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:23.142435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:23.148760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:23.731258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:23.751401 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-639ba9d1-e7de-4da1-8609-5a642e233f26 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1693 microversion: 2.1 time: 0.652163 Oct 27 10:46:23.772156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3016/6240] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:23 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1693 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:24.043148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:24.044212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:24.086149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:24.087660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:24.104555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:24.105834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:24.109805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:24.110544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:24.263272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:24.282121 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1f5eb5d-9786-464a-8fc6-10e128e149ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1282 microversion: 2.1 time: 0.247201 Oct 27 10:46:24.299329 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3225/6241] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:24 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1282 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:24.461879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a28d1d81-0034-48d1-b877-4ba24b7ae9e4 req-1784e418-e263-4473-8515-75b2a7288a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "name": "network-vif-unplugged", "status": "completed", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:24.540807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a28d1d81-0034-48d1-b877-4ba24b7ae9e4 req-1784e418-e263-4473-8515-75b2a7288a93 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:24.541636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a28d1d81-0034-48d1-b877-4ba24b7ae9e4 req-1784e418-e263-4473-8515-75b2a7288a93 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:24.542848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a28d1d81-0034-48d1-b877-4ba24b7ae9e4 req-1784e418-e263-4473-8515-75b2a7288a93 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:24.577166 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a28d1d81-0034-48d1-b877-4ba24b7ae9e4 req-1784e418-e263-4473-8515-75b2a7288a93 service nova] Creating event network-vif-unplugged:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h2-854663-10 Oct 27 10:46:24.585768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-a28d1d81-0034-48d1-b877-4ba24b7ae9e4 req-1784e418-e263-4473-8515-75b2a7288a93 service nova] Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:46:24.621469 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a28d1d81-0034-48d1-b877-4ba24b7ae9e4 req-1784e418-e263-4473-8515-75b2a7288a93 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.210524 Oct 27 10:46:24.627981 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3017/6242] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:46:24.781033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:24.781887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:24.817078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:24.831348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:24.837690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:24.843260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:24.844267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:24.844995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:25.313180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:25.314483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:25.330608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:25.334304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:25.336769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:25.339380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:25.340159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:25.342348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:25.602900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:25.616242 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2af2790-63b0-4569-85e1-607559d06034 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1693 microversion: 2.1 time: 0.839683 Oct 27 10:46:25.644904 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3226/6243] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:24 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1693 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:25.702705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:25.715485 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4f3240d2-a028-4881-b261-43f080897a15 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1300 microversion: 2.1 time: 0.406188 Oct 27 10:46:25.716275 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3018/6244] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:25 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1300 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:26.646442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:26.647082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:26.676441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:26.676990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:26.688339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ebb533b5-8180-46df-a4e5-535aab2685e7 req-b9bf7446-6283-4a43-8b4d-2e13c8328768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:26.689254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:26.690055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:26.709737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:26.710597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ebb533b5-8180-46df-a4e5-535aab2685e7 req-b9bf7446-6283-4a43-8b4d-2e13c8328768 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:26.711226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:26.711429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ebb533b5-8180-46df-a4e5-535aab2685e7 req-b9bf7446-6283-4a43-8b4d-2e13c8328768 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:26.712463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ebb533b5-8180-46df-a4e5-535aab2685e7 req-b9bf7446-6283-4a43-8b4d-2e13c8328768 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:26.776534 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ebb533b5-8180-46df-a4e5-535aab2685e7 req-b9bf7446-6283-4a43-8b4d-2e13c8328768 service nova] Creating event network-changed:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h2-854663-10 Oct 27 10:46:26.783447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-ebb533b5-8180-46df-a4e5-535aab2685e7 req-b9bf7446-6283-4a43-8b4d-2e13c8328768 service nova] Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:46:26.839479 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ebb533b5-8180-46df-a4e5-535aab2685e7 req-b9bf7446-6283-4a43-8b4d-2e13c8328768 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155240 Oct 27 10:46:26.872573 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3019/6245] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:46:26.900591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:26.908712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:26.925362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:26.926420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:26.927921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:26.928856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:26.932282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:26.933930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:27.431957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:27.449435 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa673d21-ec55-4ae5-9142-2064a4b9ca24 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1693 microversion: 2.1 time: 0.803384 Oct 27 10:46:27.451704 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3227/6246] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:26 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1693 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:27.698057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:27.711511 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-03c77e5c-c43e-4c58-9b1b-08d2190a48e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.832360 Oct 27 10:46:27.716687 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3020/6247] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:26 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:28.478776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:28.480237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:28.495854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:28.496882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:28.497504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:28.498623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:28.499400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:28.500414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:28.753924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:28.755008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:28.777414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:28.777933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:28.778388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:28.805227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:28.806003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:28.809946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:28.874441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:28.967196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:28.980598 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c6f965a-2a61-408e-b957-91c79b440153 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1691 microversion: 2.1 time: 0.506360 Oct 27 10:46:28.986260 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3228/6248] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:28 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1691 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:29.199408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:29.209727 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41ef37f3-9c4d-40fb-8770-4d0d5f26477c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.467198 Oct 27 10:46:29.212041 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3021/6249] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:28 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:30.007684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:30.009947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:30.027415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:30.028222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:30.028894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:30.029808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:30.030518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:30.031104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:30.236708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:30.237425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:30.267609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:30.269644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:30.272055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:30.273891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:30.276026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:30.277460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:31.418438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:31.477347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:31.654651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:31.664331 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39e8f658-626b-4691-8cb4-519a4dfb4863 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1688 microversion: 2.1 time: 1.660625 Oct 27 10:46:31.669220 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3229/6250] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:30 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1688 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:31.679414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a666f8fe-deeb-475b-96ae-34677e8d5ad6 req-182c3d03-b3a8-49af-97f3-e8d73d03dbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "890b3724-a6df-43f7-adad-e01ddfe37637", "tag": "20003c16-2d5d-495d-838c-459af6c16c16"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:31.709328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a666f8fe-deeb-475b-96ae-34677e8d5ad6 req-182c3d03-b3a8-49af-97f3-e8d73d03dbdd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:31.711171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a666f8fe-deeb-475b-96ae-34677e8d5ad6 req-182c3d03-b3a8-49af-97f3-e8d73d03dbdd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:31.711768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a666f8fe-deeb-475b-96ae-34677e8d5ad6 req-182c3d03-b3a8-49af-97f3-e8d73d03dbdd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:31.762799 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a666f8fe-deeb-475b-96ae-34677e8d5ad6 req-182c3d03-b3a8-49af-97f3-e8d73d03dbdd service nova] Creating event network-changed:20003c16-2d5d-495d-838c-459af6c16c16 for instance 890b3724-a6df-43f7-adad-e01ddfe37637 on n-h1-854663-10 Oct 27 10:46:31.776343 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a666f8fe-deeb-475b-96ae-34677e8d5ad6 req-182c3d03-b3a8-49af-97f3-e8d73d03dbdd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105184 Oct 27 10:46:31.792715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:31.804065 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3230/6251] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:46:31.821038 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a93d33ed-a0a6-4a8e-803a-65e9e27345a8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 1.587856 Oct 27 10:46:31.823476 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3022/6252] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:30 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:31.827454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d0e48efc-49d1-4daa-95b7-95c502420e47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:31.831425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d0e48efc-49d1-4daa-95b7-95c502420e47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:31.867232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:31.872462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0e48efc-49d1-4daa-95b7-95c502420e47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:31.873281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0e48efc-49d1-4daa-95b7-95c502420e47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:31.874778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0e48efc-49d1-4daa-95b7-95c502420e47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:31.876427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0e48efc-49d1-4daa-95b7-95c502420e47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:31.880628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0e48efc-49d1-4daa-95b7-95c502420e47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:31.881364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d0e48efc-49d1-4daa-95b7-95c502420e47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:32.219131 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d0e48efc-49d1-4daa-95b7-95c502420e47 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action" status: 202 len: 0 microversion: 2.1 time: 0.388034 Oct 27 10:46:32.232074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:32.233502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:32.240164 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3231/6253] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:46:31 2022] POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:46:32.254535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:32.261619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:32.263719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:32.264974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:32.267865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:32.268626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:32.858290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:32.859195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:32.879804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:32.904232 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8fb375de-f3b6-4240-834f-a979fcddf183 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1687 microversion: 2.1 time: 0.679151 Oct 27 10:46:32.911809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:32.912313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:32.912789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:32.922256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:32.922939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:32.923553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:32.933051 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3023/6254] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:32 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1687 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:33.300818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:33.311911 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32fe6bd0-89ca-4854-a227-3ef8b29fd511 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.460982 Oct 27 10:46:33.312978 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3232/6255] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:32 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:33.825485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-52949b9a-7727-40b4-b67d-785368430d40 req-61860d19-9a3f-4ea4-9ed7-29c5a1d61e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "name": "network-vif-plugged", "status": "completed", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:33.837966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-52949b9a-7727-40b4-b67d-785368430d40 req-61860d19-9a3f-4ea4-9ed7-29c5a1d61e65 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:33.838625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-52949b9a-7727-40b4-b67d-785368430d40 req-61860d19-9a3f-4ea4-9ed7-29c5a1d61e65 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:33.839239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-52949b9a-7727-40b4-b67d-785368430d40 req-61860d19-9a3f-4ea4-9ed7-29c5a1d61e65 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:33.857895 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-52949b9a-7727-40b4-b67d-785368430d40 req-61860d19-9a3f-4ea4-9ed7-29c5a1d61e65 service nova] Creating event network-vif-plugged:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h2-854663-10 Oct 27 10:46:33.868696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-52949b9a-7727-40b4-b67d-785368430d40 req-61860d19-9a3f-4ea4-9ed7-29c5a1d61e65 service nova] Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:46:33.900874 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-52949b9a-7727-40b4-b67d-785368430d40 req-61860d19-9a3f-4ea4-9ed7-29c5a1d61e65 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086750 Oct 27 10:46:33.913921 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3024/6256] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:46:33.941418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:33.942062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:33.958147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:33.959506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:33.963949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:33.970891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:33.973731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:33.974433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:34.335403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:34.336407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:34.350555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:34.351330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:34.353839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:34.354529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:34.355443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:34.356356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:34.356974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:34.364906 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94a242c7-06a9-4db9-a794-bd005400ecd5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1687 microversion: 2.1 time: 0.428903 Oct 27 10:46:34.367024 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3233/6257] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:33 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1687 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:34.675383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:34.688926 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e7d22b5-ea13-4b96-8b5a-b6e8770144c9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.358409 Oct 27 10:46:34.689991 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3025/6258] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:34 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:35.399672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:35.401070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:35.418035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:35.424760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:35.425583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:35.426617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:35.430554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:35.431252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:35.898000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:35.899859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:35.924467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:35.925192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:35.925673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:35.926328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:35.926785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:35.927364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:36.021857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:36.035678 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1a5df063-43fa-408d-9ae1-22f608297411 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1687 microversion: 2.1 time: 0.639975 Oct 27 10:46:36.036283 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3234/6259] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:35 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1687 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:36.367861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:36.387603 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-667fc2c2-086d-4945-bb62-5483907e5b13 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.671145 Oct 27 10:46:36.390556 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3026/6260] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:35 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:46:37.083124 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:37.085507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:37.124206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:37.130256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:37.133491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:37.136840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:37.137573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:37.139278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:37.445720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:37.448460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:37.460072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:37.463036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:37.466629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:37.470446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:37.471553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:37.472204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:37.472889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:37.516827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:37.555276 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be14922a-767c-4690-b054-f1fe2046c114 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1687 microversion: 2.1 time: 0.488585 Oct 27 10:46:37.556482 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3235/6261] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:37 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1687 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:37.826480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:37.847475 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17024617-ace2-4ed0-9358-cddb5ea538b9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.415090 Oct 27 10:46:37.856404 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3027/6262] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:37 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:38.589406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:38.590367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:38.609167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6c69d8bb-28a6-49c7-8ddf-326384661589 req-68ec2e0d-90f5-4758-b5c5-be7732b99c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "name": "network-vif-unplugged", "status": "completed", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:38.638151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:38.642786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:38.645098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:38.647909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:38.648424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:38.650223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:38.653192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6c69d8bb-28a6-49c7-8ddf-326384661589 req-68ec2e0d-90f5-4758-b5c5-be7732b99c6f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:38.663182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6c69d8bb-28a6-49c7-8ddf-326384661589 req-68ec2e0d-90f5-4758-b5c5-be7732b99c6f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:38.663182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6c69d8bb-28a6-49c7-8ddf-326384661589 req-68ec2e0d-90f5-4758-b5c5-be7732b99c6f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:38.705799 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6c69d8bb-28a6-49c7-8ddf-326384661589 req-68ec2e0d-90f5-4758-b5c5-be7732b99c6f service nova] Creating event network-vif-unplugged:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h1-854663-10 Oct 27 10:46:38.719471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-6c69d8bb-28a6-49c7-8ddf-326384661589 req-68ec2e0d-90f5-4758-b5c5-be7732b99c6f service nova] Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:46:38.749681 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6c69d8bb-28a6-49c7-8ddf-326384661589 req-68ec2e0d-90f5-4758-b5c5-be7732b99c6f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152062 Oct 27 10:46:38.750966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3028/6263] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:46:38.875296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:38.876507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:38.903950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:38.911255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:38.914063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:38.916958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:38.921646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:38.922593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:39.405681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:39.418098 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4907e525-527f-430d-83de-b1b87d4fc724 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1687 microversion: 2.1 time: 0.834491 Oct 27 10:46:39.423980 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3236/6264] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:38 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1687 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:39.684482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:39.697690 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7b45972-0cbb-4d42-bc01-63b680495a8b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.826800 Oct 27 10:46:39.698290 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3029/6265] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:38 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:40.464021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:40.477755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:40.534202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=52 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:40.539692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:40.543492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:40.544267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:40.547153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:40.549098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:40.549804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:40.728245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:40.729598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:40.751599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:40.753283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:40.753283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:40.754702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:40.755167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:40.755606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:41.272516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:41.284863 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4bbb939e-4d21-4c93-af19-49276082e8ad tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1687 microversion: 2.1 time: 0.837480 Oct 27 10:46:41.285232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:41.285505 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3237/6266] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:40 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1687 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:41.304495 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b7f7759-b9c2-4cdf-a2f7-d42a1d222c3b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.580101 Oct 27 10:46:41.306431 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3030/6267] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:40 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:41.312121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-42d8c934-96c1-4611-bf2c-37cfb90edfd8 req-5b37c756-e3f8-431d-adde-f535d02bca2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:41.397159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-42d8c934-96c1-4611-bf2c-37cfb90edfd8 req-5b37c756-e3f8-431d-adde-f535d02bca2e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:41.397752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-42d8c934-96c1-4611-bf2c-37cfb90edfd8 req-5b37c756-e3f8-431d-adde-f535d02bca2e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:41.398360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-42d8c934-96c1-4611-bf2c-37cfb90edfd8 req-5b37c756-e3f8-431d-adde-f535d02bca2e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:41.425504 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-42d8c934-96c1-4611-bf2c-37cfb90edfd8 req-5b37c756-e3f8-431d-adde-f535d02bca2e service nova] Creating event network-changed:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h1-854663-10 Oct 27 10:46:41.437907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-42d8c934-96c1-4611-bf2c-37cfb90edfd8 req-5b37c756-e3f8-431d-adde-f535d02bca2e service nova] Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 10:46:41.470466 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-42d8c934-96c1-4611-bf2c-37cfb90edfd8 req-5b37c756-e3f8-431d-adde-f535d02bca2e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170860 Oct 27 10:46:41.476984 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3238/6268] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:46:42.319524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:42.324174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:42.348094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:42.349144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:42.349865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:42.352062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:42.354585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:42.359870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:42.364026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:42.365994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:42.389664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:42.390189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:42.390646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:42.408029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:42.408543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:42.421528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:42.474593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:42.838077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:42.847692 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72849ff1-c70f-4602-89cc-2edc911186aa tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1687 microversion: 2.1 time: 0.539644 Oct 27 10:46:42.863560 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3031/6269] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:42 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1687 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:42.921862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:42.933812 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8842ca6d-a447-4781-9cee-dfdebf4b5947 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.596075 Oct 27 10:46:42.934416 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3239/6270] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:42 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:43.872032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:43.873466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:43.886496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:43.888843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:43.894096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:43.895203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:43.895978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:43.897009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:43.971307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:43.972578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:43.998628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:44.003555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:44.004347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:44.005502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:44.006946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:44.007626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:44.538507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:44.564822 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c994b73-3cc6-4adb-a89e-5b83cd38625f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1687 microversion: 2.1 time: 0.686066 Oct 27 10:46:44.568805 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3032/6271] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:43 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1687 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:44.577816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:44.596782 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3bd0a0f3-ab5a-45d8-87bd-584542bf75f5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.638505 Oct 27 10:46:44.630771 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3240/6272] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:43 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:45.588183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:45.589138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:45.596181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:45.596803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:45.597329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:45.598179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:45.598695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:45.599295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:45.627803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:45.629520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:45.649383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:45.650243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:45.650917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:45.651840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:45.652483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:45.653160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:45.931258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:45.950882 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f9850e3-da70-47d9-af78-7f6c2b9fc835 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1680 microversion: 2.1 time: 0.367235 Oct 27 10:46:45.952488 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3033/6273] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:45 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1680 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:45.996643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:46.021135 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2601152-0f53-4de5-bac3-b9314714131d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.397198 Oct 27 10:46:46.032398 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3241/6274] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:45 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:47.051749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:47.052467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:47.068269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:47.068269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:47.068816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:47.070654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:47.072036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:47.072653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:47.205745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f6e5cb6d-180a-4697-8f26-4d1bcb28381b req-66efd00e-8514-4508-8310-9d676591e879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "name": "network-vif-plugged", "status": "completed", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:46:47.237792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f6e5cb6d-180a-4697-8f26-4d1bcb28381b req-66efd00e-8514-4508-8310-9d676591e879 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:47.239444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f6e5cb6d-180a-4697-8f26-4d1bcb28381b req-66efd00e-8514-4508-8310-9d676591e879 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:47.240482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f6e5cb6d-180a-4697-8f26-4d1bcb28381b req-66efd00e-8514-4508-8310-9d676591e879 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:47.284897 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f6e5cb6d-180a-4697-8f26-4d1bcb28381b req-66efd00e-8514-4508-8310-9d676591e879 service nova] Creating event network-vif-plugged:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h1-854663-10 Oct 27 10:46:47.304310 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f6e5cb6d-180a-4697-8f26-4d1bcb28381b req-66efd00e-8514-4508-8310-9d676591e879 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103091 Oct 27 10:46:47.306262 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3242/6275] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:46:47.460581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:47.470534 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25e86420-e78a-40c2-af1c-e25c9960f4ca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.422485 Oct 27 10:46:47.471683 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3034/6276] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:47 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:48.501793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:48.502469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:48.527189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:48.528056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:48.529911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:48.532798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:48.533776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:48.536763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:48.949974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:48.964382 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-deef4cee-7d6e-4557-abab-be66a516793e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.466830 Oct 27 10:46:48.969803 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3243/6277] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:48 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:49.991108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:49.992687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:50.008217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:50.008764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:50.009643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:50.010564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:50.011210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:50.011780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:50.366217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:50.377852 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f36964f4-5e25-4d54-a222-8076aa498a85 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.388824 Oct 27 10:46:50.378734 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3035/6278] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:49 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:51.406813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:51.408804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:51.424389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:51.424924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:51.425373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:51.432609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:51.433456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:51.436981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:51.799127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:51.827797 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a3da6da-879c-4a13-9fb8-5cf4f0732c3c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.425818 Oct 27 10:46:51.840759 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3244/6279] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:51 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:52.853866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:52.854506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:52.874553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:52.875471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:52.876185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:52.877254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:52.877719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:52.889518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:53.199532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:53.211960 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-11e02747-3765-44a0-a627-291f106397f1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.362164 Oct 27 10:46:53.231071 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3036/6280] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:52 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:54.241743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:54.242346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:54.253106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:54.253862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:54.255860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:54.256789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:54.257401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:54.258039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:54.512262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:54.523337 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2526ac5-4a8c-463a-b3d2-c056ff2b7ece tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1342 microversion: 2.1 time: 0.287470 Oct 27 10:46:54.524179 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3245/6281] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:54 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1342 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:55.552080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:55.553045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:55.561957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:55.562901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:55.563497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:55.564519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:55.565232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:55.565817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:55.805635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:55.817956 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5518ef06-4778-4681-b4ee-99852b058528 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1376 microversion: 2.1 time: 0.270708 Oct 27 10:46:55.818755 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3037/6282] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:55 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1376 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:56.845077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:56.846647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:56.855288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:56.856253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:56.857369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:56.858343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:56.859032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:56.859811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:57.111418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:57.124626 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0e6cd27-6629-488d-bc77-0f1070d9a6a1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1376 microversion: 2.1 time: 0.283081 Oct 27 10:46:57.127121 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3246/6283] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:56 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1376 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:58.152280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:58.153452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:58.162180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:58.162870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:58.163438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:58.164318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:58.165038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:58.165794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:58.184493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:46:58.357674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:58.368108 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e20a77f6-31e9-47b9-bcf2-87447763fb45 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1376 microversion: 2.1 time: 0.220706 Oct 27 10:46:58.378092 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3038/6284] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:58 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1376 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:46:59.403990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:46:59.405146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:46:59.432059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:59.432276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:59.432779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:59.436724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:46:59.436724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:46:59.436724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:46:59.668341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:46:59.678721 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be91e963-9231-4084-865e-ff274356e424 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1376 microversion: 2.1 time: 0.280131 Oct 27 10:46:59.681631 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3247/6285] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:46:59 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1376 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:00.705943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:00.707657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:00.728326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:00.729618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:00.732962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:00.736195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:00.737387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:00.741160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:01.020279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:01.031523 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-063df58c-6f87-4463-a866-ab559425de60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1376 microversion: 2.1 time: 0.330551 Oct 27 10:47:01.049057 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3039/6286] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:00 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1376 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:02.062628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:02.064591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:02.080049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:02.080845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:02.081447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:02.082331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:02.088459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:02.093213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:02.394104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:02.410965 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4d401e5-1b8f-457f-85c9-5c5832f2449f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1376 microversion: 2.1 time: 0.353997 Oct 27 10:47:02.416837 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3248/6287] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:02 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1376 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:03.445193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:03.445962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:03.476894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:03.477408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:03.477849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:03.480424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:03.482614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:03.483118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:03.817672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:03.828786 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-031ea506-8962-447b-8d73-1c621716a8ad tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1376 microversion: 2.1 time: 0.387801 Oct 27 10:47:03.858223 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3040/6288] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:03 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1376 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:04.871976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:04.874222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:04.891097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:04.891903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:04.892908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:04.893973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:04.894589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:04.895372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:05.154476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:05.172646 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dbbcf76a-8d7d-4850-9261-98f41e7c28e9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1376 microversion: 2.1 time: 0.307571 Oct 27 10:47:05.174422 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3249/6289] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:04 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1376 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:05.307170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5f072e95-6ea0-47ab-919f-b7c0e950ac7c req-c10ca5f0-a14c-4fe6-96a6-091f1bb31e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890b3724-a6df-43f7-adad-e01ddfe37637", "name": "network-vif-plugged", "status": "completed", "tag": "20003c16-2d5d-495d-838c-459af6c16c16"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:05.329119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5f072e95-6ea0-47ab-919f-b7c0e950ac7c req-c10ca5f0-a14c-4fe6-96a6-091f1bb31e23 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:05.332526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5f072e95-6ea0-47ab-919f-b7c0e950ac7c req-c10ca5f0-a14c-4fe6-96a6-091f1bb31e23 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:05.333246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5f072e95-6ea0-47ab-919f-b7c0e950ac7c req-c10ca5f0-a14c-4fe6-96a6-091f1bb31e23 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:05.369386 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5f072e95-6ea0-47ab-919f-b7c0e950ac7c req-c10ca5f0-a14c-4fe6-96a6-091f1bb31e23 service nova] Creating event network-vif-plugged:20003c16-2d5d-495d-838c-459af6c16c16 for instance 890b3724-a6df-43f7-adad-e01ddfe37637 on n-h1-854663-10 Oct 27 10:47:05.420231 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5f072e95-6ea0-47ab-919f-b7c0e950ac7c req-c10ca5f0-a14c-4fe6-96a6-091f1bb31e23 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118348 Oct 27 10:47:05.424952 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3041/6290] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:06.199823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:06.200483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:06.214224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:06.216207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:06.216646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:06.217483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:06.217856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:06.218297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:06.427742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:06.440309 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf414ca2-3e80-4625-a893-2c90a2fac069 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1376 microversion: 2.1 time: 0.244710 Oct 27 10:47:06.441743 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3250/6291] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:06 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1376 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:06.653305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-46057933", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9ea5eac6-a985-491c-b182-647c5deec98e"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:06.732907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] validate_networks() for [('9ea5eac6-a985-491c-b182-647c5deec98e', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:47:07.167600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:47:07.167600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:47:07.167899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:47:07.168510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:47:07.169492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:47:07.187101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:07.187916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:07.188514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:07.189454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:07.190066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:07.190653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:07.211401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Getting quotas for project 53e6fb8b09ed4b29bfdef7ba34bb3a39. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:47:07.217869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Getting quotas for user eee39f2efb7d48c1b2643c710c4834ca and project 53e6fb8b09ed4b29bfdef7ba34bb3a39. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:47:07.233835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:47:07.237875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:47:07.308776 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54b18b51-87df-4ca9-9051-272d4a1fbcf2 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662052 Oct 27 10:47:07.309913 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3042/6292] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:47:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:47:07.321975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9adeacae-cbce-4650-80db-08f5d00378dc tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:07.323157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9adeacae-cbce-4650-80db-08f5d00378dc tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:07.422076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9adeacae-cbce-4650-80db-08f5d00378dc tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:07.437613 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9adeacae-cbce-4650-80db-08f5d00378dc tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1217 microversion: 2.1 time: 0.119143 Oct 27 10:47:07.438535 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3251/6293] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:07 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:07.470769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:07.471676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:07.488258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:07.488785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:07.489238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:07.493571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:07.494050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:07.496298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:07.800225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:07.812086 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b3aa3c6a-a283-4672-8682-7d73215e3da9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1562 microversion: 2.1 time: 0.345652 Oct 27 10:47:07.822576 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3043/6294] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:07 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1562 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:07.849206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:07.850282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:07.861885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:07.862712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:07.863693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:07.865037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:07.865842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:07.866283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.061524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:08.072021 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c269da7-a8d6-4034-90c4-393dbfa8fa03 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1562 microversion: 2.1 time: 0.236993 Oct 27 10:47:08.073055 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3252/6295] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:07 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1562 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:47:08.193808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:08.194643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:08.201225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:08.203440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.204192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.204943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.206048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.206774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.207732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.242728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:47:08.345206 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1dbd4cfc-ad79-4709-a84e-4be18e9cf01f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 204 len: 0 microversion: 2.1 time: 0.155072 Oct 27 10:47:08.346804 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3044/6296] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:47:08 2022] DELETE /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:47:08.355885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:08.356568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:08.408537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.419053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.420244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.420825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.425565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.426152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.473473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:08.474114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:08.492013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.493010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.493986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.495822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.497079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.498256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.731063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:08.749727 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f40e5269-c09e-4b9a-8711-c908f4e12344 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1269 microversion: 2.1 time: 0.280839 Oct 27 10:47:08.752478 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3045/6297] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:08 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1269 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:08.762597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:08.771940 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5079671e-1716-4881-b56c-a459468efa7f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1568 microversion: 2.1 time: 0.420934 Oct 27 10:47:08.773135 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3253/6298] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:08 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1568 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:09.820611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:09.820611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:09.821411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:09.821411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:09.828143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:09.832554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:09.834118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:09.836128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:09.837253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:09.837940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:09.838650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:09.839302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:09.841036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:09.842463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:09.844284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:09.845510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:09.964618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:09.975910 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5dbc3f95-35c5-4f9a-beae-f1662c0ba9b4 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1275 microversion: 2.1 time: 0.189634 Oct 27 10:47:09.977103 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3046/6299] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:09 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1275 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:10.173695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:10.186913 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67fd4d3c-9727-4743-bc87-f1be68503f40 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1568 microversion: 2.1 time: 0.390020 Oct 27 10:47:10.188150 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3254/6300] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:09 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1568 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:10.807833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-70225e71-bf03-4d1c-8fb7-cd70aa546022 req-cf133545-8e17-427b-a6d6-d86d74839040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890b3724-a6df-43f7-adad-e01ddfe37637", "name": "network-vif-deleted", "tag": "20003c16-2d5d-495d-838c-459af6c16c16"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:10.844524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-70225e71-bf03-4d1c-8fb7-cd70aa546022 req-cf133545-8e17-427b-a6d6-d86d74839040 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:10.845874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-70225e71-bf03-4d1c-8fb7-cd70aa546022 req-cf133545-8e17-427b-a6d6-d86d74839040 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:10.846933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-70225e71-bf03-4d1c-8fb7-cd70aa546022 req-cf133545-8e17-427b-a6d6-d86d74839040 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:10.917739 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-70225e71-bf03-4d1c-8fb7-cd70aa546022 req-cf133545-8e17-427b-a6d6-d86d74839040 service nova] Creating event network-vif-deleted:20003c16-2d5d-495d-838c-459af6c16c16 for instance 890b3724-a6df-43f7-adad-e01ddfe37637 on n-h1-854663-10 Oct 27 10:47:10.934304 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-70225e71-bf03-4d1c-8fb7-cd70aa546022 req-cf133545-8e17-427b-a6d6-d86d74839040 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130460 Oct 27 10:47:10.937439 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3047/6301] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:11.015237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:11.019348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:11.042203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=38 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:11.047828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:11.049313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:11.053377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:11.055246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:11.055850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:11.056393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:11.236654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:11.237421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:11.253480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:11.253976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:11.254630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:11.255521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:11.256260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:11.256882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:11.426758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:11.435822 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab780eb1-55d3-42d6-85c1-318f8ce749d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1361 microversion: 2.1 time: 0.205663 Oct 27 10:47:11.437101 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3048/6302] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:11 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:11.571726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:11.581374 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0dd0efe0-46ca-4002-8e11-220b3a85f5bf tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1317 microversion: 2.1 time: 0.574626 Oct 27 10:47:11.587779 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3255/6303] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:11 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:11.713791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-65bb2666-f67d-488f-9e21-15f65a5c4675 req-21d6cb38-d629-421e-a9dc-712222efc0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a73ed2b-7962-462f-b9ee-ee693589125d", "tag": "b5597c13-f5a2-43bf-8a32-10afb44419b4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:11.734875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65bb2666-f67d-488f-9e21-15f65a5c4675 req-21d6cb38-d629-421e-a9dc-712222efc0ff service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:11.735546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65bb2666-f67d-488f-9e21-15f65a5c4675 req-21d6cb38-d629-421e-a9dc-712222efc0ff service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:11.736073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65bb2666-f67d-488f-9e21-15f65a5c4675 req-21d6cb38-d629-421e-a9dc-712222efc0ff service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:11.763732 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-65bb2666-f67d-488f-9e21-15f65a5c4675 req-21d6cb38-d629-421e-a9dc-712222efc0ff service nova] Creating event network-changed:b5597c13-f5a2-43bf-8a32-10afb44419b4 for instance 2a73ed2b-7962-462f-b9ee-ee693589125d on n-h2-854663-10 Oct 27 10:47:11.769304 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-65bb2666-f67d-488f-9e21-15f65a5c4675 req-21d6cb38-d629-421e-a9dc-712222efc0ff service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059938 Oct 27 10:47:11.773488 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3049/6304] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:12.473171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0966d3f0-60cf-4eb5-825b-1bf44c65d28a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:12.475859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:12.476270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0966d3f0-60cf-4eb5-825b-1bf44c65d28a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:12.477140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:12.484589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0966d3f0-60cf-4eb5-825b-1bf44c65d28a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:12.487146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0966d3f0-60cf-4eb5-825b-1bf44c65d28a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:12.487804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:12.487944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0966d3f0-60cf-4eb5-825b-1bf44c65d28a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:12.488301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:12.488547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0966d3f0-60cf-4eb5-825b-1bf44c65d28a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:12.490577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0966d3f0-60cf-4eb5-825b-1bf44c65d28a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:12.491185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0966d3f0-60cf-4eb5-825b-1bf44c65d28a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:12.492852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:12.493718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:12.494477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:12.505192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:12.533033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:12.574194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0966d3f0-60cf-4eb5-825b-1bf44c65d28a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action" status: 200 len: 63154 microversion: 2.1 time: 0.355296 Oct 27 10:47:12.575127 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3256/6305] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:47:12 2022] POST /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3/action => generated 63154 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:47:12.612039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:12.613164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:12.626386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:12.627213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:12.627837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:12.628785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:12.629437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:12.633762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:12.695752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:12.717063 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a54aeaf6-e180-4e7d-8431-6139e6792a07 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1361 microversion: 2.1 time: 0.246134 Oct 27 10:47:12.721929 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3050/6306] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:12 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:12.973070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:12.983538 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8fec54f-db68-4f40-882b-36cc90d3a182 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1317 microversion: 2.1 time: 0.373952 Oct 27 10:47:13.000645 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3257/6307] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:12 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:13.764112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:13.766057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:13.776032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:13.776529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:13.777003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:13.777723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:13.778226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:13.778696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:13.910450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:13.935116 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d3b8151-bcaa-4798-a91d-45e7794951fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1361 microversion: 2.1 time: 0.181449 Oct 27 10:47:13.960886 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3051/6308] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:13 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:14.008776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:14.010314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:14.024117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:14.026946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:14.027656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:14.028646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:14.031739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:14.032316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:14.344822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:14.360152 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-726efa8c-98a5-480d-83c2-4cf9953a5214 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1317 microversion: 2.1 time: 0.356332 Oct 27 10:47:14.361304 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3258/6309] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:14 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:14.969945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:14.971375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:14.979601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:14.980494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:14.981259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:14.982615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:14.983369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:14.984034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:15.120024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:15.130011 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0fa377f9-3145-4f6c-a396-4778a34b65d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1361 microversion: 2.1 time: 0.164409 Oct 27 10:47:15.130589 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3052/6310] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:14 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:15.387351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:15.388247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:15.397941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:15.398434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:15.403748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:15.404915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:15.405550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:15.410430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:15.677123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:15.688492 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fee6946c-a86f-4b24-aedb-1437608c900d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1317 microversion: 2.1 time: 0.304922 Oct 27 10:47:15.690151 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3259/6311] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:15 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:16.156481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:16.158457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:16.171165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:16.175651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:16.176189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:16.177114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:16.181211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:16.181941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:16.313397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:16.330709 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78069711-9e1e-43fc-bced-d5e59a3d2fe1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 200 len: 1361 microversion: 2.1 time: 0.178254 Oct 27 10:47:16.332713 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3053/6312] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:16 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:16.714388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:16.715181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:16.729298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:16.730968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:16.732517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:16.735209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:16.739158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:16.739888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:16.954060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:16.964420 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68d5697f-4b9d-4479-89e6-ebd0979359ce tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1317 microversion: 2.1 time: 0.254647 Oct 27 10:47:16.977332 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3260/6313] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:16 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:17.362005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:17.364153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:17.384462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:17.385373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:17.393330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:17.394166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:17.394792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:17.396232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:17.396906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:17.397521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:17.430389 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 HTTP/1.1 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '890b3724-a6df-43f7-adad-e01ddfe37637'} Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:17.433277 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:17.438416 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:17.438416 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:17.438416 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:17.438416 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:47:17.438416 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:47:17.438416 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:17.438416 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:17.439953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:47:17.441083 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a3f878f-96af-4e82-80dc-781b9c6d1d05 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 404 len: 111 microversion: 2.1 time: 0.086972 Oct 27 10:47:17.441841 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3054/6314] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:17 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:47:18.004572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:18.006665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:18.022723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:18.025797 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:47:18.028606 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 10:47:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d (ip 10.222.0.76) !!! Oct 27 10:47:18.040521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:18.041771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:18.043237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:18.045952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:18.046692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:18.047580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:18.048211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-65079501-c9b4-4c87-a5b3-41bfe788993c req-b75f1ad9-9974-4838-aadd-c845134f7ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a73ed2b-7962-462f-b9ee-ee693589125d", "name": "network-vif-plugged", "status": "completed", "tag": "b5597c13-f5a2-43bf-8a32-10afb44419b4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:18.066671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65079501-c9b4-4c87-a5b3-41bfe788993c req-b75f1ad9-9974-4838-aadd-c845134f7ed0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:18.067169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65079501-c9b4-4c87-a5b3-41bfe788993c req-b75f1ad9-9974-4838-aadd-c845134f7ed0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:18.068701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65079501-c9b4-4c87-a5b3-41bfe788993c req-b75f1ad9-9974-4838-aadd-c845134f7ed0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:18.113723 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-65079501-c9b4-4c87-a5b3-41bfe788993c req-b75f1ad9-9974-4838-aadd-c845134f7ed0 service nova] Creating event network-vif-plugged:b5597c13-f5a2-43bf-8a32-10afb44419b4 for instance 2a73ed2b-7962-462f-b9ee-ee693589125d on n-h2-854663-10 Oct 27 10:47:18.130755 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-65079501-c9b4-4c87-a5b3-41bfe788993c req-b75f1ad9-9974-4838-aadd-c845134f7ed0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093774 Oct 27 10:47:18.132423 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3055/6315] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:18.411911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:18.424373 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4bcb529e-548d-44c5-bd92-8adddf634990 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1317 microversion: 2.1 time: 0.431401 Oct 27 10:47:18.425640 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3261/6316] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:17 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:18.792281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3cf21e95-c04e-4221-aede-bba551f4d045 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:18.793165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3cf21e95-c04e-4221-aede-bba551f4d045 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:18.823809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf21e95-c04e-4221-aede-bba551f4d045 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:18.824063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf21e95-c04e-4221-aede-bba551f4d045 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:18.824706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf21e95-c04e-4221-aede-bba551f4d045 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:18.826376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf21e95-c04e-4221-aede-bba551f4d045 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:18.826997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf21e95-c04e-4221-aede-bba551f4d045 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:18.827573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf21e95-c04e-4221-aede-bba551f4d045 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:18.988396 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:47:18.988557 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 10:47:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 (ip 10.222.0.76) !!! Oct 27 10:47:19.016755 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3cf21e95-c04e-4221-aede-bba551f4d045 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1833 microversion: 2.1 time: 0.233056 Oct 27 10:47:19.029160 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3056/6317] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:18 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1833 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:19.450617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:19.452932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:19.495408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:19.498335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:19.501130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:19.505409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:19.506426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:19.510736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:19.827734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:19.838394 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d1015e8-b019-4b58-946c-2cf060ba0758 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1317 microversion: 2.1 time: 0.391502 Oct 27 10:47:19.839000 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3262/6318] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:19 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:20.322867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:20.323959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:20.342276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5f89e9f9-89fa-4e69-8bb2-8274422d8953 req-a2e0c9f0-9499-4cea-8bc5-e12f8db02e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:20.348622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:20.350042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:20.351824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:20.352792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:20.355032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:20.357113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:20.363193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5f89e9f9-89fa-4e69-8bb2-8274422d8953 req-a2e0c9f0-9499-4cea-8bc5-e12f8db02e1a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:20.363928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5f89e9f9-89fa-4e69-8bb2-8274422d8953 req-a2e0c9f0-9499-4cea-8bc5-e12f8db02e1a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:20.364543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5f89e9f9-89fa-4e69-8bb2-8274422d8953 req-a2e0c9f0-9499-4cea-8bc5-e12f8db02e1a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:20.407739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:20.410120 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5f89e9f9-89fa-4e69-8bb2-8274422d8953 req-a2e0c9f0-9499-4cea-8bc5-e12f8db02e1a service nova] Creating event network-changed:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h1-854663-10 Oct 27 10:47:20.426115 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5f89e9f9-89fa-4e69-8bb2-8274422d8953 req-a2e0c9f0-9499-4cea-8bc5-e12f8db02e1a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089266 Oct 27 10:47:20.429372 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3263/6319] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:47:20.448383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:47:20.635035 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6d593885-9530-4021-8853-c9906cc09e1c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 204 len: 0 microversion: 2.1 time: 0.316685 Oct 27 10:47:20.636139 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3057/6320] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:47:20 2022] DELETE /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:47:20.646503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:20.647324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:20.673741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:20.674497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:20.676102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:20.677230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:20.680270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:20.682920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:20.864251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:20.865982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:20.881838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:20.885400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:20.896293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:20.898331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:20.900062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:20.901417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:21.129885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:21.139292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1ec3cfb-ca1f-4a45-b6ce-a2112f307be9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1686 microversion: 2.1 time: 0.497849 Oct 27 10:47:21.146241 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3264/6321] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:20 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1686 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:21.251081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:21.262911 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-291611c2-5115-4c98-82eb-40b460540681 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1506 microversion: 2.1 time: 0.402886 Oct 27 10:47:21.267095 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3058/6322] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:20 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:47:22.171810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:22.173134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:22.198445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:22.206395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:22.207048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:22.213159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:22.213928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:22.214554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:22.632196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:22.659882 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09ca9ce3-25c6-4873-a32e-46500aa1d145 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1686 microversion: 2.1 time: 0.484552 Oct 27 10:47:22.659882 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3265/6323] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:22 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1686 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:23.676499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:23.678549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:23.695888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:23.698965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:23.699625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:23.701279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:23.704109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:23.704894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:24.027142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:24.042674 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-66f61e1e-de0a-487f-8160-59bcd64f7305 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1568 microversion: 2.1 time: 0.370276 Oct 27 10:47:24.047769 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3059/6324] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:23 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:24.635554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2695f637-dcff-4902-8b62-46097d9c4118 req-0f990b36-4953-42a0-a98d-0d13fd8147ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254e4821-7a7e-449b-b1ee-6cc9251871a3", "name": "network-vif-deleted", "tag": "1b9f3ba7-516d-49f8-ab33-c15d91bdfd31"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:24.691759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2695f637-dcff-4902-8b62-46097d9c4118 req-0f990b36-4953-42a0-a98d-0d13fd8147ea service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:24.712410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2695f637-dcff-4902-8b62-46097d9c4118 req-0f990b36-4953-42a0-a98d-0d13fd8147ea service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:24.715855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2695f637-dcff-4902-8b62-46097d9c4118 req-0f990b36-4953-42a0-a98d-0d13fd8147ea service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:24.811385 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2695f637-dcff-4902-8b62-46097d9c4118 req-0f990b36-4953-42a0-a98d-0d13fd8147ea service nova] Creating event network-vif-deleted:1b9f3ba7-516d-49f8-ab33-c15d91bdfd31 for instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 on n-h1-854663-10 Oct 27 10:47:24.835154 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2695f637-dcff-4902-8b62-46097d9c4118 req-0f990b36-4953-42a0-a98d-0d13fd8147ea service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205229 Oct 27 10:47:24.836243 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3266/6325] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:25.071094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:25.071997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:25.087399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:25.092287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:25.093082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:25.097592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:25.101651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:25.103120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:25.189501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:25.190440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:25.191183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:25.192060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lazy-loading 'fault' on Instance uuid 254e4821-7a7e-449b-b1ee-6cc9251871a3 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:47:25.343191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:25.353753 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ced5b356-3d09-4f69-825c-3c8334cf2238 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 200 len: 1355 microversion: 2.1 time: 0.286487 Oct 27 10:47:25.378092 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3060/6326] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:25 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 1355 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:26.407929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:26.407929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: 254e4821-7a7e-449b-b1ee-6cc9251871a3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:26.441557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:26.442972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:26.468121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:26.469238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:26.473015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:26.475302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:26.509929 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] HTTP exception thrown: Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 could not be found. Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Request method failure captured: Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 HTTP/1.1 Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmCB8b4BRHsH94RlDS3xYrhwfaqEsty7QYPzPqKpJZ9MHvNb0KEFX2OGq7Y9a1uA6gmR-kLao7lu13KscHPRbXuAOCZi6EE-CskQcdrHFDuQXm_jRNlw9KrLoJqKLAMqdAlw8qkWlaZnbme4veJuK1hnJ7dqbpyxw53lmnUa5qTvUDE Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d5b8083f3e1a40cf978ae9605cc2239b Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d5b8083f3e1a40cf978ae9605cc2239b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d5b8083f3e1a40cf978ae9605cc2239b Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestNetworkAdvancedServerOps-1627469587-project Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5263c34954a94017b2d5095e391ceffc Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1627469587-project Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 could not be found. Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '254e4821-7a7e-449b-b1ee-6cc9251871a3'} Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 could not be found. Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 could not be found. Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:26.524827 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 could not be found. Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Returning 404 to user: Instance 254e4821-7a7e-449b-b1ee-6cc9251871a3 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:47:26.531940 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f054dd81-7125-4ac4-8c3f-e55e50dae2a2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3" status: 404 len: 111 microversion: 2.1 time: 0.136976 Oct 27 10:47:26.533680 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3267/6327] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:26 2022] GET /compute/v2.1/servers/254e4821-7a7e-449b-b1ee-6cc9251871a3 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:47:28.683314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:28.684744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:28.712449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:28.713006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:28.715872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:28.717496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:28.721133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:28.721809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:28.811735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:47:29.001817 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-372938c2-c83b-4e1c-bd7a-2cf1f48b66fd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 204 len: 0 microversion: 2.1 time: 0.322250 Oct 27 10:47:29.011250 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3061/6328] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:47:28 2022] DELETE /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:47:29.019777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:29.023229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:29.038807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:29.039390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:29.039861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:29.040614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:29.041181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:29.041862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:29.677984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:29.694230 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-740b0847-5e7f-40c3-883c-34526f346bab tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1410 microversion: 2.1 time: 0.676477 Oct 27 10:47:29.711338 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3268/6329] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:29 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1410 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:30.721790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:30.723132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:30.768489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:30.779662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:30.780176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:30.780994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:30.781469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:30.781899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:31.332253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:31.341921 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9161100d-5c03-48a3-afaa-e2fb7375fb7e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1410 microversion: 2.1 time: 0.624410 Oct 27 10:47:31.345514 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3062/6330] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:30 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1410 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:32.371698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:32.373447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:32.390923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:32.391437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:32.406600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:32.420740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:32.421366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:32.421826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:32.592982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:32.607179 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e6346b40-e8ef-4edf-ad1e-ca0c4d731854 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1368 microversion: 2.1 time: 0.238430 Oct 27 10:47:32.607975 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3269/6331] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:32 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:32.920838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:32.921347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:32.942626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:32.943175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:32.945026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:32.945785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:32.953280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:32.955902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:33.206468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lazy-loading 'services' on Instance uuid 81f4e68a-53fc-4f23-be0e-d8db5f181dbc {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:47:33.389255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e56e497d-c091-4544-8654-0605be128403 req-09418ef7-43f5-47d4-a5e0-3777d345d723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249e37af-92ba-4204-a64d-ef8f92b0769c", "name": "network-vif-deleted", "tag": "38fdf8b6-c89d-4510-aed3-19ab8fb3fbd1"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:33.462084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e56e497d-c091-4544-8654-0605be128403 req-09418ef7-43f5-47d4-a5e0-3777d345d723 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:33.464680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e56e497d-c091-4544-8654-0605be128403 req-09418ef7-43f5-47d4-a5e0-3777d345d723 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:33.466731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e56e497d-c091-4544-8654-0605be128403 req-09418ef7-43f5-47d4-a5e0-3777d345d723 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:33.477085 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-29099bd3-e3d3-427f-ac60-f2c60c333714 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "DELETE /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc/os-volume_attachments/23248601-d495-4b6e-a834-ddb751439ce4" status: 202 len: 0 microversion: 2.1 time: 0.568094 Oct 27 10:47:33.483812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3063/6332] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:47:32 2022] DELETE /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc/os-volume_attachments/23248601-d495-4b6e-a834-ddb751439ce4 => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:47:33.527239 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e56e497d-c091-4544-8654-0605be128403 req-09418ef7-43f5-47d4-a5e0-3777d345d723 service nova] Creating event network-vif-deleted:38fdf8b6-c89d-4510-aed3-19ab8fb3fbd1 for instance 249e37af-92ba-4204-a64d-ef8f92b0769c on n-h1-854663-10 Oct 27 10:47:33.539646 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e56e497d-c091-4544-8654-0605be128403 req-09418ef7-43f5-47d4-a5e0-3777d345d723 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154454 Oct 27 10:47:33.542058 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3270/6333] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:47:33.635718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:33.636743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:33.651578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:33.655059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:33.655541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:33.656293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:33.657010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:33.657454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:33.793782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:33.810909 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80cd2f8e-a335-411c-8cba-aa4b76daec75 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1202 microversion: 2.1 time: 0.180605 Oct 27 10:47:33.812649 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3064/6334] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:33 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:34.836635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:34.837929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:34.855926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:34.858998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:34.861545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:34.864701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:34.865457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:34.867752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:35.109178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:35.127004 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-adc373a7-62e4-45f6-9ad6-b151f0fe5f09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1202 microversion: 2.1 time: 0.295560 Oct 27 10:47:35.128130 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3271/6335] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:34 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1202 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:35.358834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f343ca84-5a4d-4527-8db0-a37ded7b9e3d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '.version_select at 0x7f6d63974700>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:35.406268 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f343ca84-5a4d-4527-8db0-a37ded7b9e3d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-810206394" status: 202 len: 0 microversion: 2.1 time: 0.053634 Oct 27 10:47:35.417931 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3065/6336] 10.222.0.76 () {58 vars in 1281 bytes} [Thu Oct 27 10:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-810206394 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:47:35.453038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d134dca3-63f1-4785-9ccc-ffe92cdfc482 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'create', calling method: .version_select at 0x7f6d5bdd2940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-892525437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslk6Rx3jDL33r3lXtlci/vZpCU9tmGOmaFDtZOvDJuVNFU0HaMAI1RyHJ+Mq4vz8t8NKkY26WnaKFcNaSSNl1PB22xAGZrTbfOT5df7kKbbaTCFLLgXDdT1z+EG/9rVg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:35.473682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d134dca3-63f1-4785-9ccc-ffe92cdfc482 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:47:35.485576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d134dca3-63f1-4785-9ccc-ffe92cdfc482 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for user 5263c34954a94017b2d5095e391ceffc and project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:47:35.524390 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d134dca3-63f1-4785-9ccc-ffe92cdfc482 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.075697 Oct 27 10:47:35.528837 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3272/6337] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:47:35 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:36.151183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:36.151916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:36.165210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:36.170474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:36.171374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:36.172151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:36.172629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:36.173095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:36.278537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:36.287171 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-66e7b5d6-2bc9-460e-8578-9632a17f1df2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1202 microversion: 2.1 time: 0.140525 Oct 27 10:47:36.296858 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3066/6338] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:36 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:37.312462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:37.313194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:37.326709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:37.328048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:37.328578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:37.329403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:37.329935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:37.330746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:37.407994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:37.417528 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43cb1e6b-5148-4051-875c-aeafbbd68890 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1202 microversion: 2.1 time: 0.110023 Oct 27 10:47:37.431042 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3273/6339] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:37 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1202 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:38.441635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:38.442972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:38.447460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:38.452228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:38.453065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:38.453714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:38.454855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:38.455507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:38.456155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:38.523823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:38.533312 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec10cac6-12c5-48d1-9b92-616815480478 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1202 microversion: 2.1 time: 0.095607 Oct 27 10:47:38.534213 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3067/6340] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:38 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:39.567971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:39.569692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:39.582456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:39.583296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:39.585781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:39.587267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:39.589292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:39.591427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:39.678045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:39.678553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:39.680454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:39.681020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lazy-loading 'fault' on Instance uuid 249e37af-92ba-4204-a64d-ef8f92b0769c {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:47:39.781481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:39.790163 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6f175f6-77dc-44ad-9640-bf7d4495102a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 200 len: 1207 microversion: 2.1 time: 0.237024 Oct 27 10:47:39.795697 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3274/6341] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:39 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 1207 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:40.819942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:40.820836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:40.839803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:40.846120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:40.850209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:40.854139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:40.864834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:40.866457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:40.948794 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c HTTP/1.1 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '249e37af-92ba-4204-a64d-ef8f92b0769c'} Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:40.953040 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:40.957449 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:40.957449 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:40.957449 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:40.957449 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:47:40.957449 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:47:40.957449 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:40.957449 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:40.963439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:47:40.964521 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb5b26c1-3476-41c9-9a15-71af0389b8b2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 404 len: 111 microversion: 2.1 time: 0.149846 Oct 27 10:47:40.968793 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3068/6342] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:40 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:47:45.936406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1576395675", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "ff206d3a-4098-4ab1-a8a1-becf1201429b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-892525437", "security_groups": [{"name": "tempest-secgroup-smoke-1489182528"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:45.971598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:45.983537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:46.932817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] validate_networks() for [('ff206d3a-4098-4ab1-a8a1-becf1201429b', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:47:47.296295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:47.296929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:47.308527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:47.317262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:47.317262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:47.320693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:47.324226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:47.325121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:47.452343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:47:47.572888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:47.654418 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9387eec5-aa85-4ce2-93ad-4466f4b4dd37 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "DELETE /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 204 len: 0 microversion: 2.1 time: 0.362991 Oct 27 10:47:47.655979 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3069/6343] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:47:47 2022] DELETE /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:47:47.670772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:47.673175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:47.695246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:47.696043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:47.696877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:47.697765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:47.699092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:47.701389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:48.191161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:47:48.192309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:47:48.193203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:47:48.194207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:47:48.194954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:47:48.223526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:48.230226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:48.230962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:48.231949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:48.242335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:48.242988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:48.243559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:48.246757 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f649c9c3-3c89-4efc-90c9-f5a49397f2b8 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1470 microversion: 2.1 time: 0.584890 Oct 27 10:47:48.264156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3070/6344] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:47 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1470 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:48.276909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:48.302459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:47:48.319972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for user 5263c34954a94017b2d5095e391ceffc and project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:47:48.351259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:47:48.371126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:47:48.511448 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-661ae299-7069-4c45-b3bc-8a4d8f49c929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.578917 Oct 27 10:47:48.514548 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3275/6345] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:47:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:47:48.525910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-06901cc4-b8da-440e-9cb2-3dfedb9488fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:48.527519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-06901cc4-b8da-440e-9cb2-3dfedb9488fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:48.597706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-06901cc4-b8da-440e-9cb2-3dfedb9488fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:48.607276 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-06901cc4-b8da-440e-9cb2-3dfedb9488fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1266 microversion: 2.1 time: 0.085698 Oct 27 10:47:48.609930 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3071/6346] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:48 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:49.277456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:49.280185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:49.301771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:49.302280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:49.311948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:49.312799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:49.313298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:49.313769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:49.643823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:49.645258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:49.662505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:49.663317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:49.669406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:49.670663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:49.671434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:49.672149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:49.928324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:49.942953 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c915f98e-f02d-4270-a024-8434e182151a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1270 microversion: 2.1 time: 0.304634 Oct 27 10:47:49.957240 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3072/6347] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:49 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1270 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:47:50.142402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:50.179045 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe33e425-ac60-4b9a-b0e6-693cade7ca2d tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1470 microversion: 2.1 time: 0.910269 Oct 27 10:47:50.192784 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3276/6348] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:49 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1470 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:50.890900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-bc3c5340-bf49-4e2c-9fd6-31ba48082bbe req-0b5513f5-94a0-4771-a7ed-f811076e6e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f4e68a-53fc-4f23-be0e-d8db5f181dbc", "name": "network-vif-deleted", "tag": "fdf65f5d-7808-4af7-899a-b76f1b501ecf"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:50.913005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bc3c5340-bf49-4e2c-9fd6-31ba48082bbe req-0b5513f5-94a0-4771-a7ed-f811076e6e87 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:50.914054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bc3c5340-bf49-4e2c-9fd6-31ba48082bbe req-0b5513f5-94a0-4771-a7ed-f811076e6e87 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:50.916604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bc3c5340-bf49-4e2c-9fd6-31ba48082bbe req-0b5513f5-94a0-4771-a7ed-f811076e6e87 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:50.954642 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-bc3c5340-bf49-4e2c-9fd6-31ba48082bbe req-0b5513f5-94a0-4771-a7ed-f811076e6e87 service nova] Creating event network-vif-deleted:fdf65f5d-7808-4af7-899a-b76f1b501ecf for instance 81f4e68a-53fc-4f23-be0e-d8db5f181dbc on n-h2-854663-10 Oct 27 10:47:50.983293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:50.984715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:50.992259 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-bc3c5340-bf49-4e2c-9fd6-31ba48082bbe req-0b5513f5-94a0-4771-a7ed-f811076e6e87 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077589 Oct 27 10:47:50.997713 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3073/6349] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:51.006147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:51.006827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:51.007516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:51.009513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:51.011855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:51.012569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:51.205346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:51.207486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:51.225745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:51.229840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:51.235557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:51.238293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:51.250542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:51.251968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:51.253253 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1a3443cb-f104-49bc-a241-9f43157e995e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1326 microversion: 2.1 time: 0.274752 Oct 27 10:47:51.260210 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3277/6350] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:50 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1326 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:47:51.270823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:51.432252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:51.433689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:51.436010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:51.436732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lazy-loading 'fault' on Instance uuid 81f4e68a-53fc-4f23-be0e-d8db5f181dbc {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:47:51.543469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226eb18f33a84d38bf3ac5db0b26cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050a846ebe4ec8b1a5031b1d28f457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:51.551995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1684eb1d-f86c-41d1-bbd9-c5dcd8e47932 tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 200 len: 1304 microversion: 2.1 time: 0.351762 Oct 27 10:47:51.552593 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3074/6351] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:51 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 1304 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:52.281615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:52.283043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:52.292260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:52.293433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:52.294061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:52.295259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:52.296478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:52.297114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:52.585185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:52.587370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] [instance: 81f4e68a-53fc-4f23-be0e-d8db5f181dbc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:52.597617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:52.611848 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d508f8fa-a482-4f8a-9522-5aab2b658c99 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1392 microversion: 2.1 time: 0.339025 Oct 27 10:47:52.614650 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3278/6352] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:52 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1392 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:52.637116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:52.637726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:52.638288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:52.639131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:52.640367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:52.642565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:52.675867 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] HTTP exception thrown: Instance 81f4e68a-53fc-4f23-be0e-d8db5f181dbc could not be found. Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Request method failure captured: Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc HTTP/1.1 Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmFE45U0_nGX8xFiL5AG_z0x6eHSxZ-fG7KuKTv8_uhX4D_IP5vLf0dDrKGrXqUnEs_xBhpGooFA-gIWGH7dEe4bu6XLsMPiaaupggudCbA0XZwe7r-vf2yvNnP5tNj8mX178f7tz__CiBCvDwoN2oREmcEyAYfcl-GuS24yRhMsmrc Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: be050a846ebe4ec8b1a5031b1d28f457 Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesBackupsTest-508442164 Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/be050a846ebe4ec8b1a5031b1d28f457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/be050a846ebe4ec8b1a5031b1d28f457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_be050a846ebe4ec8b1a5031b1d28f457", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/be050a846ebe4ec8b1a5031b1d28f457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesBackupsTest-508442164 Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: be050a846ebe4ec8b1a5031b1d28f457 Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesBackupsTest-508442164 Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesBackupsTest-508442164-project Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 226eb18f33a84d38bf3ac5db0b26cbec Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesBackupsTest-508442164-project Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 81f4e68a-53fc-4f23-be0e-d8db5f181dbc could not be found. Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '81f4e68a-53fc-4f23-be0e-d8db5f181dbc'} Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f4e68a-53fc-4f23-be0e-d8db5f181dbc could not be found. Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f4e68a-53fc-4f23-be0e-d8db5f181dbc could not be found. Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:52.678921 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:52.683442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:52.683442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:52.683442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:52.683442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:47:52.683442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:47:52.683442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f4e68a-53fc-4f23-be0e-d8db5f181dbc could not be found. Oct 27 10:47:52.683442 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:52.688361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] Returning 404 to user: Instance 81f4e68a-53fc-4f23-be0e-d8db5f181dbc could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:47:52.688361 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f8e42d9-bbf3-4953-a954-c2457983688f tempest-VolumesBackupsTest-508442164 tempest-VolumesBackupsTest-508442164-project] 10.222.0.76 "GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc" status: 404 len: 111 microversion: 2.1 time: 0.113692 Oct 27 10:47:52.688361 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3075/6353] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:52 2022] GET /compute/v2.1/servers/81f4e68a-53fc-4f23-be0e-d8db5f181dbc => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:47:53.638768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:53.639659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:53.660644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:53.661461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:53.662271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:53.663297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:53.663990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:53.665213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:53.773381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:53.773972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:53.789979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:53.791231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:53.791823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:53.793124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:53.793734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:53.794311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:53.819775 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 HTTP/1.1 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '890b3724-a6df-43f7-adad-e01ddfe37637'} Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:47:53.822154 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.826993 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.829061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:47:53.830167 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1a09c42-de5c-43b3-9a63-830136e7aade tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 404 len: 111 microversion: 2.1 time: 0.069871 Oct 27 10:47:53.831386 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3076/6354] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:47:53 2022] DELETE /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:47:53.836559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f0fbd5d3-3238-41e7-897e-ec98696bd99c req-f00a0cbd-937f-4031-9571-b9c9164539df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07339ef-315d-4182-885f-7a3c925f5d91", "tag": "90a1454c-0c27-40a0-9f34-f486d6fb0f36"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:53.852505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f0fbd5d3-3238-41e7-897e-ec98696bd99c req-f00a0cbd-937f-4031-9571-b9c9164539df service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:53.853331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f0fbd5d3-3238-41e7-897e-ec98696bd99c req-f00a0cbd-937f-4031-9571-b9c9164539df service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:53.854437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f0fbd5d3-3238-41e7-897e-ec98696bd99c req-f00a0cbd-937f-4031-9571-b9c9164539df service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:53.868528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f0fbd5d3-3238-41e7-897e-ec98696bd99c req-f00a0cbd-937f-4031-9571-b9c9164539df service nova] Creating event network-changed:90a1454c-0c27-40a0-9f34-f486d6fb0f36 for instance e07339ef-315d-4182-885f-7a3c925f5d91 on n-h1-854663-10 Oct 27 10:47:53.876614 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f0fbd5d3-3238-41e7-897e-ec98696bd99c req-f00a0cbd-937f-4031-9571-b9c9164539df service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043501 Oct 27 10:47:53.877675 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3077/6355] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:53.886310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:53.888588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 890b3724-a6df-43f7-adad-e01ddfe37637] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:53.899430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:53.900148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:53.901594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:53.902814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:53.903461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:53.904385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:53.922954 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 HTTP/1.1 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '890b3724-a6df-43f7-adad-e01ddfe37637'} Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:53.925312 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.930133 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:53.930133 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:53.930133 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:53.930133 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:47:53.930133 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:47:53.930133 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. Oct 27 10:47:53.930133 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:47:53.933191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 890b3724-a6df-43f7-adad-e01ddfe37637 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:47:53.934605 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2d7219f-1c22-4522-9731-a35d3f2bb1d4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637" status: 404 len: 111 microversion: 2.1 time: 0.055077 Oct 27 10:47:53.935622 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3078/6356] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:53 2022] GET /compute/v2.1/servers/890b3724-a6df-43f7-adad-e01ddfe37637 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:47:54.019171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:54.031905 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69559a23-605f-4c49-b836-701601935e01 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1392 microversion: 2.1 time: 0.397171 Oct 27 10:47:54.035303 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3279/6357] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:53 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1392 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:55.062050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:55.062762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:55.081407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:55.082338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:55.082969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:55.084950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:55.087335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:55.087964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:55.172318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:55.173503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:55.190136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:55.203697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:55.208540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:55.213348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:55.214152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:55.214758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:55.262118 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c HTTP/1.1 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '249e37af-92ba-4204-a64d-ef8f92b0769c'} Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:47:55.265653 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d1d934d-9b2f-4c33-8eec-3514860d0b2e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 404 len: 111 microversion: 2.1 time: 0.099380 Oct 27 10:47:55.273754 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3280/6358] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:47:55 2022] DELETE /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:47:55.290061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:55.294894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 249e37af-92ba-4204-a64d-ef8f92b0769c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:55.316970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:55.316970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:55.316970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:55.316970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:55.316970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:55.316970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:55.343486 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c HTTP/1.1 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '249e37af-92ba-4204-a64d-ef8f92b0769c'} Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:47:55.357276 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.362212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:47:55.362212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:47:55.362212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:47:55.362212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:47:55.362212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:47:55.362212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. Oct 27 10:47:55.362212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:47:55.362212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 249e37af-92ba-4204-a64d-ef8f92b0769c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:47:55.362212 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30570d3e-c361-4452-ae4e-d0902de9faa2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c" status: 404 len: 111 microversion: 2.1 time: 0.080271 Oct 27 10:47:55.364629 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3281/6359] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:55 2022] GET /compute/v2.1/servers/249e37af-92ba-4204-a64d-ef8f92b0769c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:47:55.514306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:55.534852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bdd39eae-540e-442a-81d8-c64b0dec0fc9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'create', calling method: .version_select at 0x7f6d5a1a9940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1830090047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtkarPD3iuNnXuF64BFILyhUiJbBwlz3ht4esVxjG0gvSzKvIgSQm+TjW7qZkOk/8mdUQ24RwTyUHwruVNcbX6Tmm5wzrhRUYyxO1gF/7pF4E49Kw+nhkpiUz8NbVHw3w=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:55.543974 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82d10134-63a6-4a39-a9bf-d464cccae3a8 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1392 microversion: 2.1 time: 0.483101 Oct 27 10:47:55.545181 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3079/6360] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:55 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1392 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:55.608067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-bdd39eae-540e-442a-81d8-c64b0dec0fc9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for project 3e99c27693094793bfcf910ff5798d08. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:47:55.617129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-bdd39eae-540e-442a-81d8-c64b0dec0fc9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for user 6e16c7669eb34fa49714040f728210e4 and project 3e99c27693094793bfcf910ff5798d08. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:47:55.715190 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bdd39eae-540e-442a-81d8-c64b0dec0fc9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.192161 Oct 27 10:47:55.716127 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3282/6361] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:47:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:47:56.577768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:56.582105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:56.599663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:56.605192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:56.613003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:56.616248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:56.619636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:56.622805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:56.868346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:56.879015 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16fe9e93-d4e7-45fc-950b-26676de80be3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1392 microversion: 2.1 time: 0.308908 Oct 27 10:47:56.881492 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3080/6362] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:56 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1392 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:57.907404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:57.908609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:57.923777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:57.924519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:57.926582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:57.930388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:57.930887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:57.931334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:58.166238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:58.177068 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-efa18602-3708-4a25-8329-32481f141d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1392 microversion: 2.1 time: 0.273318 Oct 27 10:47:58.177802 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3283/6363] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:57 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:58.738409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f1384c9-0425-4396-8192-e82af96d8706 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34413508-074f-427e-8ceb-52ca053c804d", "device": "/dev/sdb"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:58.743830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f1384c9-0425-4396-8192-e82af96d8706 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:58.760573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:58.762991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f1384c9-0425-4396-8192-e82af96d8706 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:58.764025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f1384c9-0425-4396-8192-e82af96d8706 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:58.764633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f1384c9-0425-4396-8192-e82af96d8706 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:58.765686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f1384c9-0425-4396-8192-e82af96d8706 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:58.766503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f1384c9-0425-4396-8192-e82af96d8706 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:58.767416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f1384c9-0425-4396-8192-e82af96d8706 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:59.201530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:59.203075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:59.206593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:59.227062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:59.227737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:59.231220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:59.239078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:59.240332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:59.242055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:59.299048 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f1384c9-0425-4396-8192-e82af96d8706 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "POST /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572385 Oct 27 10:47:59.309251 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3081/6364] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:47:58 2022] POST /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:59.738530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:59.750592 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5fa6c029-a7cb-4a89-ae14-6034f83e3405 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1392 microversion: 2.1 time: 0.553701 Oct 27 10:47:59.756462 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3284/6365] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:59 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1392 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:00.786184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:00.787040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:00.803890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:00.804750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:00.805194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:00.805922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:00.806385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:00.806810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:01.025884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:01.042158 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39134de3-2eba-428f-aa59-d03e2de09d6d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1392 microversion: 2.1 time: 0.260601 Oct 27 10:48:01.058443 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3082/6366] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:00 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1392 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:01.511459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ce3378a2-f2cf-4796-8225-76266fad6115 req-b91ed502-757f-4f03-94f1-662251489448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07339ef-315d-4182-885f-7a3c925f5d91", "name": "network-vif-plugged", "status": "completed", "tag": "90a1454c-0c27-40a0-9f34-f486d6fb0f36"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:01.538965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ce3378a2-f2cf-4796-8225-76266fad6115 req-b91ed502-757f-4f03-94f1-662251489448 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:01.539954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ce3378a2-f2cf-4796-8225-76266fad6115 req-b91ed502-757f-4f03-94f1-662251489448 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:01.540744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ce3378a2-f2cf-4796-8225-76266fad6115 req-b91ed502-757f-4f03-94f1-662251489448 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:01.590321 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ce3378a2-f2cf-4796-8225-76266fad6115 req-b91ed502-757f-4f03-94f1-662251489448 service nova] Creating event network-vif-plugged:90a1454c-0c27-40a0-9f34-f486d6fb0f36 for instance e07339ef-315d-4182-885f-7a3c925f5d91 on n-h1-854663-10 Oct 27 10:48:01.607167 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ce3378a2-f2cf-4796-8225-76266fad6115 req-b91ed502-757f-4f03-94f1-662251489448 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097152 Oct 27 10:48:01.607167 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3285/6367] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:48:02.067397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:02.068710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:02.096813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:02.097523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:02.098150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:02.106072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:02.106761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:02.110334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:02.366435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:02.374920 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5229313f-a189-4179-b76f-1020ac2b0234 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1392 microversion: 2.1 time: 0.311396 Oct 27 10:48:02.376674 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3083/6368] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:02 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1392 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:03.401345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:03.405520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:03.420633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:03.430586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:03.435788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:03.437615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:03.438834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:03.440464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:03.751658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:03.767616 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2c39750-4560-4cc3-bfe7-d62f81e700e2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1565 microversion: 2.1 time: 0.373015 Oct 27 10:48:03.768741 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3286/6369] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:03 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1565 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:03.799440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:03.802646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:03.823355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:03.827553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:03.828938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:03.831780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:03.833097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:03.835373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:04.033824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:04.043608 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87218649-f663-43ec-930e-5e9259a472bc tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1565 microversion: 2.1 time: 0.256462 Oct 27 10:48:04.044715 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3084/6370] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:03 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1565 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:07.208450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9aa85e86-577b-4065-aaad-b1a08af3c5a3 req-b8c9933d-bfcb-405d-92f8-0a2698962f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07339ef-315d-4182-885f-7a3c925f5d91", "tag": "90a1454c-0c27-40a0-9f34-f486d6fb0f36"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:07.210918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:07.211563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:07.231233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:07.236487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:07.238064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:07.239228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:07.242014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9aa85e86-577b-4065-aaad-b1a08af3c5a3 req-b8c9933d-bfcb-405d-92f8-0a2698962f10 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:07.242367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:07.243002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:07.244039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9aa85e86-577b-4065-aaad-b1a08af3c5a3 req-b8c9933d-bfcb-405d-92f8-0a2698962f10 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:07.244648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:07.245280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9aa85e86-577b-4065-aaad-b1a08af3c5a3 req-b8c9933d-bfcb-405d-92f8-0a2698962f10 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:07.279226 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9aa85e86-577b-4065-aaad-b1a08af3c5a3 req-b8c9933d-bfcb-405d-92f8-0a2698962f10 service nova] Creating event network-changed:90a1454c-0c27-40a0-9f34-f486d6fb0f36 for instance e07339ef-315d-4182-885f-7a3c925f5d91 on n-h1-854663-10 Oct 27 10:48:07.296806 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9aa85e86-577b-4065-aaad-b1a08af3c5a3 req-b8c9933d-bfcb-405d-92f8-0a2698962f10 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088449 Oct 27 10:48:07.298860 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3085/6371] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:48:07.512738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:07.531502 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c38baf36-cd9b-4fa5-8a20-404c932c0622 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1565 microversion: 2.1 time: 0.332404 Oct 27 10:48:07.540373 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3287/6372] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:07 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1565 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:28.776594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:28.777942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:28.786033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:28.788111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=73,nova_cell1:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:28.790749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:28.791713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:28.792751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:28.793711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:28.794429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:28.796299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:28.931390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lazy-loading 'services' on Instance uuid 2a73ed2b-7962-462f-b9ee-ee693589125d {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:48:29.060773 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9776557e-6e4a-4a80-ad15-90f70cb18995 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d/os-volume_attachments/34413508-074f-427e-8ceb-52ca053c804d" status: 202 len: 0 microversion: 2.1 time: 0.292383 Oct 27 10:48:29.061439 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3086/6373] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:48:28 2022] DELETE /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d/os-volume_attachments/34413508-074f-427e-8ceb-52ca053c804d => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:48:30.013305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7819fd6b-e480-4af2-858e-1d5d3baec005 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:30.016244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7819fd6b-e480-4af2-858e-1d5d3baec005 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:30.022493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:30.023451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=55 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:30.038598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7819fd6b-e480-4af2-858e-1d5d3baec005 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:30.039358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7819fd6b-e480-4af2-858e-1d5d3baec005 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:30.040010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7819fd6b-e480-4af2-858e-1d5d3baec005 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:30.040927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7819fd6b-e480-4af2-858e-1d5d3baec005 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:30.041551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7819fd6b-e480-4af2-858e-1d5d3baec005 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:30.042229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7819fd6b-e480-4af2-858e-1d5d3baec005 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:30.134750 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7819fd6b-e480-4af2-858e-1d5d3baec005 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91/action" status: 200 len: 24569 microversion: 2.1 time: 0.125641 Oct 27 10:48:30.136114 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3288/6374] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:48:30 2022] POST /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91/action => generated 24569 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:48:33.093639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-537604656", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1830090047", "security_groups": [{"name": "tempest-secgroup-smoke-2129446865"}], "block_device_mapping_v2": [{"uuid": "14d31458-b27c-436b-bf53-9741d57a4cd2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0264043c-59ac-40f6-8b89-4caf5f646c28"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:33.477734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] validate_networks() for [('0264043c-59ac-40f6-8b89-4caf5f646c28', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:48:34.028454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:48:34.029272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:48:34.030851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:48:34.031269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:48:34.031683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:48:34.044105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:34.044603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:34.045070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:34.045791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:34.046240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:34.046845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:34.094091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:48:34.103579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for user 6e16c7669eb34fa49714040f728210e4 and project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:48:34.180844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:48:34.184612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14d31458-b27c-436b-bf53-9741d57a4cd2',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:48:34.350011 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c96cef24-a208-46e0-a429-0e1826b4150a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.263053 Oct 27 10:48:34.351137 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3087/6375] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:48:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:48:34.364327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1cf5497-ff48-44e0-a918-9ee772b06d28 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:34.365286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1cf5497-ff48-44e0-a918-9ee772b06d28 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:34.544232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1cf5497-ff48-44e0-a918-9ee772b06d28 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:34.562673 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1cf5497-ff48-44e0-a918-9ee772b06d28 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1094 microversion: 2.1 time: 0.193753 Oct 27 10:48:34.562673 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3289/6376] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:34 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1094 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:35.581406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:35.582355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:35.596870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:35.597355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:35.598787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:35.607195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:35.608155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:35.608986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:35.727767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:35.741839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-730ef344-2274-4d6c-b1f8-a823fc0b0186 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1200 microversion: 2.1 time: 0.165693 Oct 27 10:48:35.743236 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3088/6377] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:35 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1200 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:35.786895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:35.788409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:35.797213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:35.798106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:35.798762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:35.799859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:35.800549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:35.801208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:35.843634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:48:35.992480 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-946eb522-6b72-4622-83e0-c3beda122d2a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 204 len: 0 microversion: 2.1 time: 0.209806 Oct 27 10:48:35.999106 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3290/6378] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:48:35 2022] DELETE /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:48:36.006072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:36.010012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:36.024019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:36.024155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:36.024599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:36.025559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:36.026017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:36.026910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:36.279636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:36.288172 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bde3d44c-fd5e-43c8-80b5-f39dab7dc320 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1512 microversion: 2.1 time: 0.287563 Oct 27 10:48:36.289512 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3089/6379] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:35 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:36.769597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:36.770752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:36.778920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:36.779778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:36.780393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:36.781316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:36.781999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:36.782597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:37.114545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:37.126576 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58ba68e6-a06e-4654-8a2c-ff1e43327946 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1278 microversion: 2.1 time: 0.362578 Oct 27 10:48:37.132163 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3291/6380] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:36 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1278 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:37.313303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:37.314531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:37.322110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:37.323507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:37.324151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:37.325108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:37.325864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:37.327735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:37.602718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:37.614451 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d1ff5445-e35a-4b41-bd14-377dff727f1f tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1512 microversion: 2.1 time: 0.305421 Oct 27 10:48:37.615056 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3090/6381] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:37 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1512 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:37.851794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f1f43c02-29f0-4595-8388-6d8930f09a66 req-6433c761-1805-4f9a-8d92-7c146f7d3de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b793bd-5e88-4400-9755-5f3bd8ec3736", "tag": "587a0344-5573-42d5-a403-b1ab2cab6716"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:37.885498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1f43c02-29f0-4595-8388-6d8930f09a66 req-6433c761-1805-4f9a-8d92-7c146f7d3de3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:37.886515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1f43c02-29f0-4595-8388-6d8930f09a66 req-6433c761-1805-4f9a-8d92-7c146f7d3de3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:37.887183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1f43c02-29f0-4595-8388-6d8930f09a66 req-6433c761-1805-4f9a-8d92-7c146f7d3de3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:37.912885 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f1f43c02-29f0-4595-8388-6d8930f09a66 req-6433c761-1805-4f9a-8d92-7c146f7d3de3 service nova] Creating event network-changed:587a0344-5573-42d5-a403-b1ab2cab6716 for instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 on n-h1-854663-10 Oct 27 10:48:37.922722 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f1f43c02-29f0-4595-8388-6d8930f09a66 req-6433c761-1805-4f9a-8d92-7c146f7d3de3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074926 Oct 27 10:48:37.928071 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3292/6382] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:48:38.116209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0004c023-5bae-43fb-91bb-1087b57a999f req-1cbf204e-2b49-4018-8ae8-7df158da905c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a73ed2b-7962-462f-b9ee-ee693589125d", "name": "network-vif-deleted", "tag": "b5597c13-f5a2-43bf-8a32-10afb44419b4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:38.134168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0004c023-5bae-43fb-91bb-1087b57a999f req-1cbf204e-2b49-4018-8ae8-7df158da905c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:38.134756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0004c023-5bae-43fb-91bb-1087b57a999f req-1cbf204e-2b49-4018-8ae8-7df158da905c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:38.135247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0004c023-5bae-43fb-91bb-1087b57a999f req-1cbf204e-2b49-4018-8ae8-7df158da905c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:38.150697 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0004c023-5bae-43fb-91bb-1087b57a999f req-1cbf204e-2b49-4018-8ae8-7df158da905c service nova] Creating event network-vif-deleted:b5597c13-f5a2-43bf-8a32-10afb44419b4 for instance 2a73ed2b-7962-462f-b9ee-ee693589125d on n-h2-854663-10 Oct 27 10:48:38.153501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:38.155722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:38.168012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:38.168975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:38.169630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:38.170730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:38.171364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:38.172204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:38.174672 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0004c023-5bae-43fb-91bb-1087b57a999f req-1cbf204e-2b49-4018-8ae8-7df158da905c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066299 Oct 27 10:48:38.179876 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3091/6383] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:48:38.482809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:38.491618 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5212029a-1e56-44ae-9ef2-dddd22db4348 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1278 microversion: 2.1 time: 0.345013 Oct 27 10:48:38.492371 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3293/6384] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:38 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1278 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:38.643578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:38.644323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:38.652527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:38.653394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:38.654080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:38.655009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:38.655669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:38.656271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:38.738491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:38.741134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:38.741591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:38.745547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lazy-loading 'fault' on Instance uuid 2a73ed2b-7962-462f-b9ee-ee693589125d {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:48:38.819239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:38.834378 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b7e255d3-85dd-4938-99ea-f198d465b0d9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 200 len: 1307 microversion: 2.1 time: 0.195360 Oct 27 10:48:38.836927 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3092/6385] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:38 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 1307 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:39.515996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:39.516708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:39.524279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:39.524743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:39.525200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:39.525910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:39.526433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:39.527142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:39.685270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:39.694611 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec0ffb8c-4af6-4627-8721-f6457a9ea8a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1278 microversion: 2.1 time: 0.182780 Oct 27 10:48:39.695210 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3294/6386] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:39 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:39.859924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:39.860734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: 2a73ed2b-7962-462f-b9ee-ee693589125d] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:39.868022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:39.868637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:39.869249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:39.870270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:39.871003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:39.871519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:39.886141 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] HTTP exception thrown: Instance 2a73ed2b-7962-462f-b9ee-ee693589125d could not be found. Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Request method failure captured: Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d HTTP/1.1 Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmFL77ol6rtJrkCZcI11LRo7Jbphnpm1Oz0lpMiNSGhFLqLFLvbUjAl8XgSIzHIh5hLjfxs6TrswszYkxuTlz9TEC-tnhdJPmULcPf_c9wXlCzm7cqWvCtqJqY8JTnmGDgTAxJSZ9-IuDqj8FhsOVz1RnEe8tmMh8J4w-ffFqst1K4U Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 53e6fb8b09ed4b29bfdef7ba34bb3a39 Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotTestJSON-833697325 Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53e6fb8b09ed4b29bfdef7ba34bb3a39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53e6fb8b09ed4b29bfdef7ba34bb3a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53e6fb8b09ed4b29bfdef7ba34bb3a39", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53e6fb8b09ed4b29bfdef7ba34bb3a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotTestJSON-833697325 Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 53e6fb8b09ed4b29bfdef7ba34bb3a39 Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-833697325 Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotTestJSON-833697325-project Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: eee39f2efb7d48c1b2643c710c4834ca Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotTestJSON-833697325-project Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 2a73ed2b-7962-462f-b9ee-ee693589125d could not be found. Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '2a73ed2b-7962-462f-b9ee-ee693589125d'} Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a73ed2b-7962-462f-b9ee-ee693589125d could not be found. Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a73ed2b-7962-462f-b9ee-ee693589125d could not be found. Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:48:39.887974 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:48:39.893369 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:48:39.893369 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:48:39.893369 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:48:39.893369 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:48:39.893369 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:48:39.893369 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a73ed2b-7962-462f-b9ee-ee693589125d could not be found. Oct 27 10:48:39.893369 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:48:39.893369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Returning 404 to user: Instance 2a73ed2b-7962-462f-b9ee-ee693589125d could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:48:39.893369 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb8d8848-8d58-4dd3-91ee-0e2d853d386a tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d" status: 404 len: 111 microversion: 2.1 time: 0.036307 Oct 27 10:48:39.896911 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3093/6387] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:39 2022] GET /compute/v2.1/servers/2a73ed2b-7962-462f-b9ee-ee693589125d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:48:40.718312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:40.718934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:40.730314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:40.731055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:40.731676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:40.732466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:40.733136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:40.734032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:40.908010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:40.919567 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c19fed8-0f31-4491-906b-28479963e384 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1278 microversion: 2.1 time: 0.205693 Oct 27 10:48:40.937583 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3295/6388] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:40 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:41.076170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:41.077582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:41.092484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.093067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.093510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:41.094222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.094678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.095106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:41.252003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:41.260683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-898cfb08-ec24-49f7-ba9d-ec8e8f5c4027 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1684 microversion: 2.1 time: 0.191655 Oct 27 10:48:41.264743 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3094/6389] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:41 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1684 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:41.389384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa4b5d8d-16de-4fe6-a0b9-932ccdd75097 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:41.392058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa4b5d8d-16de-4fe6-a0b9-932ccdd75097 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:41.400280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa4b5d8d-16de-4fe6-a0b9-932ccdd75097 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.401461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa4b5d8d-16de-4fe6-a0b9-932ccdd75097 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.402447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa4b5d8d-16de-4fe6-a0b9-932ccdd75097 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:41.403934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa4b5d8d-16de-4fe6-a0b9-932ccdd75097 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.404978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa4b5d8d-16de-4fe6-a0b9-932ccdd75097 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.405979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa4b5d8d-16de-4fe6-a0b9-932ccdd75097 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:41.477060 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa4b5d8d-16de-4fe6-a0b9-932ccdd75097 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91/action" status: 200 len: 32640 microversion: 2.1 time: 0.091209 Oct 27 10:48:41.486002 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3296/6390] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:48:41 2022] POST /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91/action => generated 32640 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:48:41.632480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5096d848-bb17-41e2-bfae-1fa67e0c3386 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:41.639342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5096d848-bb17-41e2-bfae-1fa67e0c3386 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:41.656716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5096d848-bb17-41e2-bfae-1fa67e0c3386 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.656716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5096d848-bb17-41e2-bfae-1fa67e0c3386 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.656716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5096d848-bb17-41e2-bfae-1fa67e0c3386 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:41.657302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5096d848-bb17-41e2-bfae-1fa67e0c3386 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.657756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5096d848-bb17-41e2-bfae-1fa67e0c3386 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.658177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5096d848-bb17-41e2-bfae-1fa67e0c3386 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:41.843050 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5096d848-bb17-41e2-bfae-1fa67e0c3386 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1837 microversion: 2.1 time: 0.211446 Oct 27 10:48:41.864156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3095/6391] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:41 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1837 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:41.876484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:41.879616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:41.887863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.888614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.889224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:41.890240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.891373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.891902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:41.925955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lazy-loading 'flavor' on Instance uuid e07339ef-315d-4182-885f-7a3c925f5d91 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:48:41.941960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Going to try to live migrate instance to another host {{(pid=120720) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 10:48:41.943966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:41.945142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:41.951939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.952736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.953285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:41.954083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:41.954739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:41.955285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:42.132273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:42.142307 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5f09dde-0956-4727-9976-5e68e8c64048 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1278 microversion: 2.1 time: 0.203533 Oct 27 10:48:42.143159 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3096/6392] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:41 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:43.169920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:43.170559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:43.182864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:43.183659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:43.184119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:43.184974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:43.185445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:43.185885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:43.480840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:43.490308 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e9fb8a79-0b83-43f5-8f56-d7dd8a9c79b6 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1278 microversion: 2.1 time: 0.328316 Oct 27 10:48:43.493598 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3097/6393] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:43 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1278 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:44.309827 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10cb816f-3740-407c-8add-7d24b61d6014 tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91/action" status: 202 len: 0 microversion: 2.1 time: 2.438927 Oct 27 10:48:44.313342 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3297/6394] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:48:41 2022] POST /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91/action => generated 0 bytes in 2444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:48:44.326788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:44.328143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:44.330656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:44.332517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:44.340596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:44.341596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:44.342549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:44.344544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:44.346707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:44.347431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:44.522602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:44.523487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:44.534714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:44.535978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:44.536559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:44.541834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:44.544458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:44.545154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:44.572143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:44.640391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:44.660391 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f8866003-0e18-481e-b05c-170b193b2c84 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1694 microversion: 2.1 time: 0.341013 Oct 27 10:48:44.661554 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3098/6395] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:44 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1694 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:44.960733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:44.971406 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-508e7b09-12f7-4cf5-8082-022583f7d62a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1278 microversion: 2.1 time: 0.452770 Oct 27 10:48:44.972409 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3298/6396] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:44 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1278 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:45.698462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:45.699150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:45.715807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:45.717298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:45.718917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:45.736134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:45.736134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:45.736134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:45.995643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:45.996279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:46.027435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:46.027966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:46.028432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:46.029214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:46.029691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:46.030137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:46.209462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:46.221256 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a6a3bbb-6f4d-4dda-9f06-a0b614c6c4c5 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1694 microversion: 2.1 time: 0.530220 Oct 27 10:48:46.222592 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3099/6397] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:45 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1694 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:46.338704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:46.359633 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-91a2c630-2f3e-4cd3-8068-2f1d344b872a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.368234 Oct 27 10:48:46.360252 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3299/6398] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:45 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:46.407312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-12a71566-6497-4b00-b1f6-e4bf8d80c597 req-f214dcda-dc81-4c1a-ba2e-cde966b35f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07339ef-315d-4182-885f-7a3c925f5d91", "name": "network-vif-unplugged", "status": "completed", "tag": "90a1454c-0c27-40a0-9f34-f486d6fb0f36"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:46.419782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12a71566-6497-4b00-b1f6-e4bf8d80c597 req-f214dcda-dc81-4c1a-ba2e-cde966b35f60 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:46.420392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12a71566-6497-4b00-b1f6-e4bf8d80c597 req-f214dcda-dc81-4c1a-ba2e-cde966b35f60 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:46.420898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12a71566-6497-4b00-b1f6-e4bf8d80c597 req-f214dcda-dc81-4c1a-ba2e-cde966b35f60 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:46.434245 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-12a71566-6497-4b00-b1f6-e4bf8d80c597 req-f214dcda-dc81-4c1a-ba2e-cde966b35f60 service nova] Creating event network-vif-unplugged:90a1454c-0c27-40a0-9f34-f486d6fb0f36 for instance e07339ef-315d-4182-885f-7a3c925f5d91 on n-h1-854663-10 Oct 27 10:48:46.440113 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-12a71566-6497-4b00-b1f6-e4bf8d80c597 req-f214dcda-dc81-4c1a-ba2e-cde966b35f60 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036449 Oct 27 10:48:46.441326 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3100/6399] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:48:47.162466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-649339815", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9ea5eac6-a985-491c-b182-647c5deec98e"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:47.230502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] validate_networks() for [('9ea5eac6-a985-491c-b182-647c5deec98e', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:48:47.247639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:47.248436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:47.258801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:47.260530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:47.263349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:47.264345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:47.265246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:47.267544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:47.559559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:47.570046 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-27a2af22-0cd7-4cbb-a171-283de4996929 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1694 microversion: 2.1 time: 0.328018 Oct 27 10:48:47.571435 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3101/6400] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:47 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1694 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:47.578047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:47.578863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:47.586833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:47.587560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:47.588130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:47.589465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:47.590608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:47.591263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:48.087727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:48:48.088604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:48:48.089801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:48:48.090470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:48:48.091247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:48:48.103358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:48.104541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:48.105257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:48.106223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:48.106904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:48.107570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:48.116432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:48.126024 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-690aa50e-cbfe-4ad4-bbea-a355eb69978c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.553277 Oct 27 10:48:48.137882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Getting quotas for project 53e6fb8b09ed4b29bfdef7ba34bb3a39. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:48:48.143013 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3102/6401] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:47 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:48.143816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Getting quotas for user eee39f2efb7d48c1b2643c710c4834ca and project 53e6fb8b09ed4b29bfdef7ba34bb3a39. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:48:48.156641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:48:48.159010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:48:48.207658 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bca55eb7-4c5c-4ffd-99f9-4ff50fa3a359 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049450 Oct 27 10:48:48.214912 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3300/6402] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:48:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:48:48.221279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6f2f281-e5a8-44e5-8a0d-84478fd44c41 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:48.222247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6f2f281-e5a8-44e5-8a0d-84478fd44c41 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:48.310080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6f2f281-e5a8-44e5-8a0d-84478fd44c41 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:48.318314 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6f2f281-e5a8-44e5-8a0d-84478fd44c41 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1218 microversion: 2.1 time: 0.100727 Oct 27 10:48:48.319433 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3103/6403] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:48 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:48.474354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6059d1ae-b350-43a5-b9a1-64f9fa717521 req-512381e1-07f7-43e8-b964-7f1dc06bca76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07339ef-315d-4182-885f-7a3c925f5d91", "tag": "90a1454c-0c27-40a0-9f34-f486d6fb0f36"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:48.501316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6059d1ae-b350-43a5-b9a1-64f9fa717521 req-512381e1-07f7-43e8-b964-7f1dc06bca76 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:48.504636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6059d1ae-b350-43a5-b9a1-64f9fa717521 req-512381e1-07f7-43e8-b964-7f1dc06bca76 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:48.506266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6059d1ae-b350-43a5-b9a1-64f9fa717521 req-512381e1-07f7-43e8-b964-7f1dc06bca76 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:48.524181 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6059d1ae-b350-43a5-b9a1-64f9fa717521 req-512381e1-07f7-43e8-b964-7f1dc06bca76 service nova] Creating event network-changed:90a1454c-0c27-40a0-9f34-f486d6fb0f36 for instance e07339ef-315d-4182-885f-7a3c925f5d91 on n-h1-854663-10 Oct 27 10:48:48.530878 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6059d1ae-b350-43a5-b9a1-64f9fa717521 req-512381e1-07f7-43e8-b964-7f1dc06bca76 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063639 Oct 27 10:48:48.531698 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3301/6404] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:48:48.614257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:48.615228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:48.638199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:48.639090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:48.649304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:48.650073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:48.650558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:48.651034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:48.887091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:48.899817 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff161b02-0b4b-49f8-8b3f-253646ac8d80 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1694 microversion: 2.1 time: 0.305429 Oct 27 10:48:48.900933 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3104/6405] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:48 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1694 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:49.151765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:49.152777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:49.159625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:49.160131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:49.160908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:49.161845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:49.162510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:49.163108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:49.342507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:49.343063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:49.354582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:49.355086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:49.355530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:49.356254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:49.356716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:49.357146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:49.371646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:49.395813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:49.429624 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5631837-8b7d-4752-812e-48d77c7395e0 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.276702 Oct 27 10:48:49.430269 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3302/6406] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:49 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:49.473032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:49.481636 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-20c301b0-597c-4dd8-af9f-26c9250ef119 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1270 microversion: 2.1 time: 0.143466 Oct 27 10:48:49.482571 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3105/6407] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:49 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:49.927723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:49.928693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:49.936893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:49.937563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:49.938202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:49.939081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:49.939702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:49.940300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:50.205385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:50.217203 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-184877fa-4063-4158-8862-56d145fd5d7a tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1694 microversion: 2.1 time: 0.293313 Oct 27 10:48:50.220162 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3303/6408] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:49 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1694 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:50.453257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:50.455263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:50.466049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:50.466802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:50.468412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:50.469802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:50.470602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:50.472027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:50.514248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:50.516567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:50.524460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:50.526185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:50.527002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:50.527897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:50.528514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:50.529234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:50.773799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:50.782463 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c2d19eed-b92b-4fb9-b2c3-8833191c4d09 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.334643 Oct 27 10:48:50.783454 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3106/6409] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:50 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:50.828797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:50.835328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:50.842585 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3062599e-292f-4906-8671-dbc802749b1d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1318 microversion: 2.1 time: 0.340728 Oct 27 10:48:50.843433 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3304/6410] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:50 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:51.243959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:51.244900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:51.253147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:51.253646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:51.254083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:51.254797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:51.255247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:51.255670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:51.508547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:51.524481 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5dbe6e10-d82f-4ecd-9435-a5cf3d2eec50 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1694 microversion: 2.1 time: 0.286111 Oct 27 10:48:51.525242 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3107/6411] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:51 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1694 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:51.698456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c1c5f00d-1ac6-4b99-8faa-18f18f446bef req-5f741147-401b-48c5-acab-8c4b233420b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d56931c7-43fc-4510-9aac-98e1d9a7d183", "tag": "5e8a0cdf-71eb-4de4-be85-12b0d4af360b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:51.711929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c1c5f00d-1ac6-4b99-8faa-18f18f446bef req-5f741147-401b-48c5-acab-8c4b233420b8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:51.712990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c1c5f00d-1ac6-4b99-8faa-18f18f446bef req-5f741147-401b-48c5-acab-8c4b233420b8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:51.713722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c1c5f00d-1ac6-4b99-8faa-18f18f446bef req-5f741147-401b-48c5-acab-8c4b233420b8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:51.728270 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c1c5f00d-1ac6-4b99-8faa-18f18f446bef req-5f741147-401b-48c5-acab-8c4b233420b8 service nova] Creating event network-changed:5e8a0cdf-71eb-4de4-be85-12b0d4af360b for instance d56931c7-43fc-4510-9aac-98e1d9a7d183 on n-h2-854663-10 Oct 27 10:48:51.746832 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c1c5f00d-1ac6-4b99-8faa-18f18f446bef req-5f741147-401b-48c5-acab-8c4b233420b8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051434 Oct 27 10:48:51.748370 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3305/6412] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:48:51.807425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:51.807802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:51.824296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:51.825007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:51.825455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:51.826180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:51.826782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:51.827211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:51.892136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:51.893173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:51.905998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:51.906695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:51.907313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:51.908192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:51.908852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:51.909445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:52.103490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:52.111918 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81085385-666d-4f47-8706-c7167ece5a09 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1318 microversion: 2.1 time: 0.239867 Oct 27 10:48:52.112502 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3306/6413] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:51 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:52.297542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:52.306331 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c7d06ad-0908-4e0a-8a3e-23a9aa4e5425 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.504254 Oct 27 10:48:52.306921 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3108/6414] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:51 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:52.548517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:52.549217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:52.557650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:52.558408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:52.559009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:52.559941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:52.560573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:52.561357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:52.793605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:52.804368 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea080d55-473d-434f-a819-cad5111d941e tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1694 microversion: 2.1 time: 0.259608 Oct 27 10:48:52.805673 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3307/6415] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:52 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1694 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:53.137742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:53.138556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:53.149167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:53.149800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:53.150328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:53.151481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:53.152054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:53.152571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:53.338715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:53.339777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:53.356699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:53.357368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:53.358005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:53.358921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:53.359548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:53.362342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:53.447985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:53.471737 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3252047d-fac9-4ae3-8a87-4977884ed1ca tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1318 microversion: 2.1 time: 0.339417 Oct 27 10:48:53.492318 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3109/6416] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:53 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:53.724143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:53.733385 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f306c99-afc1-430d-86c6-d68f5e05ae72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.399899 Oct 27 10:48:53.733980 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3308/6417] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:53 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:53.830010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:53.831121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:53.838472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:53.839297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:53.840423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:53.841535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:53.842550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:53.843322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:54.099449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:54.111043 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b624b20-4015-4c14-a2f9-ccec17276329 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1694 microversion: 2.1 time: 0.283530 Oct 27 10:48:54.112985 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3110/6418] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:53 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1694 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:54.498554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:54.500820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:54.507749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:54.508550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:54.509168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:54.511345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:54.511995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:54.512578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:54.738406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:54.757125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:54.757761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:54.759007 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-213e0611-3468-42fd-9749-7a0430ba0887 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1318 microversion: 2.1 time: 0.259299 Oct 27 10:48:54.760260 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3309/6419] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:54 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:54.766943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:54.767582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:54.768169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:54.769111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:54.769697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:54.770254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:55.068027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:55.077219 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d6f0e177-28d0-4551-9b84-f73eb46a5c0c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.324419 Oct 27 10:48:55.078287 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3111/6420] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:54 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:55.134346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:55.134972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:55.142420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:55.143134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:55.143752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:55.145715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:55.146471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:55.147566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:55.323557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:55.337801 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9bf0c858-61a4-430f-923b-370f36a451c6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1684 microversion: 2.1 time: 0.204888 Oct 27 10:48:55.339110 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3310/6421] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:55 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1684 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:55.362332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8cf09c73-24f1-45d1-baa1-1724cf50411f tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:55.363216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8cf09c73-24f1-45d1-baa1-1724cf50411f tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:55.371096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cf09c73-24f1-45d1-baa1-1724cf50411f tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:55.371949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cf09c73-24f1-45d1-baa1-1724cf50411f tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:55.372556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cf09c73-24f1-45d1-baa1-1724cf50411f tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:55.373501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cf09c73-24f1-45d1-baa1-1724cf50411f tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:55.374099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cf09c73-24f1-45d1-baa1-1724cf50411f tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:55.375120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cf09c73-24f1-45d1-baa1-1724cf50411f tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:55.540035 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8cf09c73-24f1-45d1-baa1-1724cf50411f tempest-TestNetworkAdvancedServerOps-1913298455 tempest-TestNetworkAdvancedServerOps-1913298455-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1837 microversion: 2.1 time: 0.181804 Oct 27 10:48:55.556366 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3112/6422] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:55 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1837 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:55.565027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:55.565657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:55.571802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:55.572296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:55.573032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:55.573929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:55.574548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:55.575135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:55.736052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:55.747022 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e48536c-1e98-4d24-bbc0-63e141d84ae6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1684 microversion: 2.1 time: 0.185878 Oct 27 10:48:55.747882 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3311/6423] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:55 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:55.797947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:55.805104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:55.819725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:55.820369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:55.823449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:55.826580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:55.827169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:55.838552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:56.020913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:56.030932 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-57b20886-9670-4508-b277-c8a4e4a43004 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1318 microversion: 2.1 time: 0.242118 Oct 27 10:48:56.031978 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3113/6424] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:55 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:56.116092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:56.116092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:56.116092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:56.116092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:56.116092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:56.116092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:56.116092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:56.116092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:56.272671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:56.281732 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cddc11bf-ca5c-479c-8114-d8e35a773ad4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.183707 Oct 27 10:48:56.282535 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3312/6425] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:56 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:56.591090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f14d35f6-d51b-479e-910e-af94b86d4247 req-bcf61dd3-5ebe-44ec-bf30-02c4c62c8416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56931c7-43fc-4510-9aac-98e1d9a7d183", "name": "network-vif-plugged", "status": "completed", "tag": "5e8a0cdf-71eb-4de4-be85-12b0d4af360b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:56.601091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f14d35f6-d51b-479e-910e-af94b86d4247 req-bcf61dd3-5ebe-44ec-bf30-02c4c62c8416 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:56.601574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f14d35f6-d51b-479e-910e-af94b86d4247 req-bcf61dd3-5ebe-44ec-bf30-02c4c62c8416 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:56.602204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f14d35f6-d51b-479e-910e-af94b86d4247 req-bcf61dd3-5ebe-44ec-bf30-02c4c62c8416 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:56.615858 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f14d35f6-d51b-479e-910e-af94b86d4247 req-bcf61dd3-5ebe-44ec-bf30-02c4c62c8416 service nova] Creating event network-vif-plugged:5e8a0cdf-71eb-4de4-be85-12b0d4af360b for instance d56931c7-43fc-4510-9aac-98e1d9a7d183 on n-h2-854663-10 Oct 27 10:48:56.621502 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f14d35f6-d51b-479e-910e-af94b86d4247 req-bcf61dd3-5ebe-44ec-bf30-02c4c62c8416 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034228 Oct 27 10:48:56.622660 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3114/6426] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:48:57.056460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:57.057448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:57.064973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:57.065478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:57.065921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:57.066944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:57.067427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:57.067871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:57.213733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:57.221853 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d7c4c1f-67c8-4a02-a475-0e55b00c69fe tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1318 microversion: 2.1 time: 0.170081 Oct 27 10:48:57.222406 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3313/6427] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:57 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:57.307362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:57.308981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:57.316147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:57.316629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:57.317117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:57.317821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:57.318274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:57.318700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:57.504140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:57.513032 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f446c588-e9d3-4a27-9f15-ca3638e372c3 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.212924 Oct 27 10:48:57.513626 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3115/6428] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:57 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:58.245777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:58.246419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:58.253285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:58.254310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:58.256993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:58.257489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:58.258018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:58.258743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:58.259411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:58.259841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:58.402360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:58.420031 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2ad2d15-639a-4ad4-bc8c-a9fccfd1346b tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1507 microversion: 2.1 time: 0.178455 Oct 27 10:48:58.421202 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3314/6429] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:58 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:48:58.444568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ef9abf7-b4b6-4da1-b3d0-735d40b88ab9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c18b015-6429-4124-82aa-11dad8d0813a", "device": "/dev/sdb"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:58.448343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ef9abf7-b4b6-4da1-b3d0-735d40b88ab9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:58.451643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:58.457902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ef9abf7-b4b6-4da1-b3d0-735d40b88ab9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:58.458504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ef9abf7-b4b6-4da1-b3d0-735d40b88ab9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:58.459045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ef9abf7-b4b6-4da1-b3d0-735d40b88ab9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:58.459873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ef9abf7-b4b6-4da1-b3d0-735d40b88ab9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:58.460436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ef9abf7-b4b6-4da1-b3d0-735d40b88ab9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:58.460995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ef9abf7-b4b6-4da1-b3d0-735d40b88ab9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:58.538146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:58.539422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:58.568474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:58.569332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:58.569798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:58.570538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:58.571008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:58.571454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:58.806465 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ef9abf7-b4b6-4da1-b3d0-735d40b88ab9 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "POST /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365564 Oct 27 10:48:58.808223 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3116/6430] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 10:48:58 2022] POST /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:48:58.824890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-07808718-a100-4bed-942b-fe81eeaf1f1d req-7e74f88e-fce6-42fc-8bd3-54004c3b685d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b793bd-5e88-4400-9755-5f3bd8ec3736", "name": "network-vif-plugged", "status": "completed", "tag": "587a0344-5573-42d5-a403-b1ab2cab6716"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:58.830787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:48:58.843947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:48:58.846694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-07808718-a100-4bed-942b-fe81eeaf1f1d req-7e74f88e-fce6-42fc-8bd3-54004c3b685d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:58.846845 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3e5dbee-c807-4829-89e9-8c750fe89758 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.312538 Oct 27 10:48:58.847498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-07808718-a100-4bed-942b-fe81eeaf1f1d req-7e74f88e-fce6-42fc-8bd3-54004c3b685d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:58.850094 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3315/6431] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:58 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:48:58.855085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-07808718-a100-4bed-942b-fe81eeaf1f1d req-7e74f88e-fce6-42fc-8bd3-54004c3b685d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:58.877060 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-07808718-a100-4bed-942b-fe81eeaf1f1d req-7e74f88e-fce6-42fc-8bd3-54004c3b685d service nova] Creating event network-vif-plugged:587a0344-5573-42d5-a403-b1ab2cab6716 for instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 on n-h1-854663-10 Oct 27 10:48:58.883559 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-07808718-a100-4bed-942b-fe81eeaf1f1d req-7e74f88e-fce6-42fc-8bd3-54004c3b685d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072525 Oct 27 10:48:58.885325 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3117/6432] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:48:59.879725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:48:59.880966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:59.888794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1032b55b-e3f4-49db-9397-176b5e107669 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:48:59.891789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1032b55b-e3f4-49db-9397-176b5e107669 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:48:59.902740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:59.905233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:59.905864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:59.907763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1032b55b-e3f4-49db-9397-176b5e107669 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:59.908713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:59.909343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:59.909962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:59.910592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1032b55b-e3f4-49db-9397-176b5e107669 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:59.913158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1032b55b-e3f4-49db-9397-176b5e107669 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:48:59.914043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1032b55b-e3f4-49db-9397-176b5e107669 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:48:59.914656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1032b55b-e3f4-49db-9397-176b5e107669 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:48:59.915267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1032b55b-e3f4-49db-9397-176b5e107669 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:00.013788 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1032b55b-e3f4-49db-9397-176b5e107669 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91/action" status: 200 len: 38689 microversion: 2.1 time: 0.129040 Oct 27 10:49:00.014925 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3118/6433] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:48:59 2022] POST /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91/action => generated 38689 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:49:00.135634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:00.163958 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ece2c7b2-75fd-4d9b-b536-b664b0240f60 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1266 microversion: 2.1 time: 0.288165 Oct 27 10:49:00.165096 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3316/6434] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:48:59 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:01.192284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:01.193068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:01.208413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:01.208984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:01.209365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:01.212920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:01.213460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:01.213913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:01.354939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:01.356294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:01.368290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:01.370199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:01.374897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:01.377215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:01.380757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:01.381401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:01.382154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:01.467989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:49:01.510983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:01.522460 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cbdfd7f8-b396-4dee-b240-c775d80c3bca tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1452 microversion: 2.1 time: 0.334141 Oct 27 10:49:01.536691 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3119/6435] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:01 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1452 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:01.536691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-98e06ef5-9363-4b19-9f92-be335a4b901f req-dc8f4756-b2d7-4728-baa6-5bc21b1ae863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07339ef-315d-4182-885f-7a3c925f5d91", "tag": "90a1454c-0c27-40a0-9f34-f486d6fb0f36"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:01.547628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-98e06ef5-9363-4b19-9f92-be335a4b901f req-dc8f4756-b2d7-4728-baa6-5bc21b1ae863 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:01.548040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-98e06ef5-9363-4b19-9f92-be335a4b901f req-dc8f4756-b2d7-4728-baa6-5bc21b1ae863 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:01.548478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-98e06ef5-9363-4b19-9f92-be335a4b901f req-dc8f4756-b2d7-4728-baa6-5bc21b1ae863 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:01.563127 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-98e06ef5-9363-4b19-9f92-be335a4b901f req-dc8f4756-b2d7-4728-baa6-5bc21b1ae863 service nova] Creating event network-changed:90a1454c-0c27-40a0-9f34-f486d6fb0f36 for instance e07339ef-315d-4182-885f-7a3c925f5d91 on n-h2-854663-10 Oct 27 10:49:01.570622 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-98e06ef5-9363-4b19-9f92-be335a4b901f req-dc8f4756-b2d7-4728-baa6-5bc21b1ae863 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044646 Oct 27 10:49:01.572646 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3120/6436] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:01.586679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:01.587506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:01.594390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:01.595139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:01.595622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:01.596467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:01.597151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:01.597673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:01.699831 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0be44fad-f755-450b-8f62-cf7e4a2abaab tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 204 len: 0 microversion: 2.1 time: 0.348518 Oct 27 10:49:01.700860 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3317/6437] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:49:01 2022] DELETE /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:49:01.715525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:01.716395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:01.732975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:01.733489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:01.733945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:01.734681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:01.735149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:01.746314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:01.886917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:01.914170 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50204bde-3aa9-4d07-b6de-9c3ffb7ba8c1 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1452 microversion: 2.1 time: 0.334041 Oct 27 10:49:01.914170 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3121/6438] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:01 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1452 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:02.191371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:02.207610 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14a22e84-cfdf-4a9f-a5da-a8bd1f14a74d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1690 microversion: 2.1 time: 0.501932 Oct 27 10:49:02.224017 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3318/6439] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:01 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1690 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:03.234516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:03.235133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:03.254864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:03.255635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:03.256255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:03.257218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:03.257818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:03.258398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:03.816590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:03.820790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:03.829774 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c13193b-7ed6-42b7-88da-d59045c3d738 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 200 len: 1690 microversion: 2.1 time: 0.597658 Oct 27 10:49:03.849285 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3122/6440] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:03 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 1690 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:04.036591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-12fc8e83-859e-488a-b308-a05b827c7491 req-7d1f02e2-8899-4c46-949a-d3749ba6dc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07339ef-315d-4182-885f-7a3c925f5d91", "name": "network-vif-deleted", "tag": "90a1454c-0c27-40a0-9f34-f486d6fb0f36"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:04.054220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-12fc8e83-859e-488a-b308-a05b827c7491 req-7d1f02e2-8899-4c46-949a-d3749ba6dc91 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:04.055012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-12fc8e83-859e-488a-b308-a05b827c7491 req-7d1f02e2-8899-4c46-949a-d3749ba6dc91 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:04.055636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-12fc8e83-859e-488a-b308-a05b827c7491 req-7d1f02e2-8899-4c46-949a-d3749ba6dc91 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:04.080064 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-12fc8e83-859e-488a-b308-a05b827c7491 req-7d1f02e2-8899-4c46-949a-d3749ba6dc91 service nova] Creating event network-vif-deleted:90a1454c-0c27-40a0-9f34-f486d6fb0f36 for instance e07339ef-315d-4182-885f-7a3c925f5d91 on n-h2-854663-10 Oct 27 10:49:04.094523 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-12fc8e83-859e-488a-b308-a05b827c7491 req-7d1f02e2-8899-4c46-949a-d3749ba6dc91 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061662 Oct 27 10:49:04.099234 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3319/6441] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:49:04.864202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:04.865045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: e07339ef-315d-4182-885f-7a3c925f5d91] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:04.875323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:04.876081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:04.876695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:04.877551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:04.878246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:04.878879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:04.903339 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] HTTP exception thrown: Instance e07339ef-315d-4182-885f-7a3c925f5d91 could not be found. Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Request method failure captured: Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 HTTP/1.1 Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmCB8b4BRHsH94RlDS3xYrhwfaqEsty7QYPzPqKpJZ9MHvNb0KEFX2OGq7Y9a1uA6gmR-kLao7lu13KscHPRbXuAOCZi6EE-CskQcdrHFDuQXm_jRNlw9KrLoJqKLAMqdAlw8qkWlaZnbme4veJuK1hnJ7dqbpyxw53lmnUa5qTvUDE Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: d5b8083f3e1a40cf978ae9605cc2239b Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d5b8083f3e1a40cf978ae9605cc2239b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: d5b8083f3e1a40cf978ae9605cc2239b Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestNetworkAdvancedServerOps-1627469587-project Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 5263c34954a94017b2d5095e391ceffc Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1627469587-project Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e07339ef-315d-4182-885f-7a3c925f5d91 could not be found. Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e07339ef-315d-4182-885f-7a3c925f5d91'} Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07339ef-315d-4182-885f-7a3c925f5d91 could not be found. Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07339ef-315d-4182-885f-7a3c925f5d91 could not be found. Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:49:04.905593 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07339ef-315d-4182-885f-7a3c925f5d91 could not be found. Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Returning 404 to user: Instance e07339ef-315d-4182-885f-7a3c925f5d91 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-26b6ff40-2464-4407-ac8b-9ca1cad79096 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91" status: 404 len: 111 microversion: 2.1 time: 0.047269 Oct 27 10:49:04.915219 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3123/6442] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:04 2022] GET /compute/v2.1/servers/e07339ef-315d-4182-885f-7a3c925f5d91 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:49:07.128125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-83903b98-fc5a-4e9a-b433-cdaca1564b5f req-94e911b7-99bb-4b14-a598-9083398ec71e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b793bd-5e88-4400-9755-5f3bd8ec3736", "tag": "587a0344-5573-42d5-a403-b1ab2cab6716"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:07.153616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-83903b98-fc5a-4e9a-b433-cdaca1564b5f req-94e911b7-99bb-4b14-a598-9083398ec71e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:07.157836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-83903b98-fc5a-4e9a-b433-cdaca1564b5f req-94e911b7-99bb-4b14-a598-9083398ec71e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:07.158506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-83903b98-fc5a-4e9a-b433-cdaca1564b5f req-94e911b7-99bb-4b14-a598-9083398ec71e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:07.186600 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-83903b98-fc5a-4e9a-b433-cdaca1564b5f req-94e911b7-99bb-4b14-a598-9083398ec71e service nova] Creating event network-changed:587a0344-5573-42d5-a403-b1ab2cab6716 for instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 on n-h1-854663-10 Oct 27 10:49:07.197035 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-83903b98-fc5a-4e9a-b433-cdaca1564b5f req-94e911b7-99bb-4b14-a598-9083398ec71e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073989 Oct 27 10:49:07.202984 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3320/6443] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:11.000418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a6cf87c-7636-4038-b4bc-ee9cf0118fb6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '.version_select at 0x7f6d5a2f5ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:11.039093 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4a6cf87c-7636-4038-b4bc-ee9cf0118fb6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-892525437" status: 202 len: 0 microversion: 2.1 time: 0.042435 Oct 27 10:49:11.039842 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3124/6444] 10.222.0.76 () {58 vars in 1281 bytes} [Thu Oct 27 10:49:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-892525437 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:49:11.071604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad45df80-506b-45d8-b640-a2776e33dd88 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'create', calling method: .version_select at 0x7f6d5a154d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-273150886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCu5F/p8OrmoR2OtwOSghvLv5K5QTgQ36M+Z+/NNPs2fs6/Lqa3flatTjkbZbd/PP8MTy1MJdu3DanC3Ily6ifTY0YGqLLhnfgpzGfzQYDOEY6+enSUVnWGMzBxyfpPOQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:11.089516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ad45df80-506b-45d8-b640-a2776e33dd88 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:49:11.095738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-ad45df80-506b-45d8-b640-a2776e33dd88 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for user 5263c34954a94017b2d5095e391ceffc and project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:49:11.123465 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad45df80-506b-45d8-b640-a2776e33dd88 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055782 Oct 27 10:49:11.124058 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3321/6445] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:49:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:20.513067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:20.525471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-752193422", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "18459e76-3f65-47de-aa78-a18e942e93b1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-273150886", "security_groups": [{"name": "tempest-secgroup-smoke-1807434294"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:20.851528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] validate_networks() for [('18459e76-3f65-47de-aa78-a18e942e93b1', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:49:21.388423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:49:21.388983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:49:21.389592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:49:21.390131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:49:21.390612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:49:21.402647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:21.403475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:21.404165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:21.405231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:21.405901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:21.406551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:21.441624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:49:21.449993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Getting quotas for user 5263c34954a94017b2d5095e391ceffc and project d5b8083f3e1a40cf978ae9605cc2239b. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:49:21.472872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:49:21.475361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:49:21.528756 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e73c84d0-5bae-4f60-af76-443d34edc5c4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.020127 Oct 27 10:49:21.529481 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3125/6446] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:49:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:49:21.538918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:21.540341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:21.541208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:21.545290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-579a8194-9e42-4f40-a812-f7a5f08e1cdf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:21.546110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-579a8194-9e42-4f40-a812-f7a5f08e1cdf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:21.691216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-579a8194-9e42-4f40-a812-f7a5f08e1cdf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:21.703791 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-579a8194-9e42-4f40-a812-f7a5f08e1cdf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1265 microversion: 2.1 time: 0.166568 Oct 27 10:49:21.704998 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3322/6447] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:21 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:22.743638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:22.744642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:22.788556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:22.789931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:22.790389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:22.795156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:22.795653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:22.796144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:22.970928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:22.992080 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-37a61b74-51cc-4ebf-b05e-6308919d6df6 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1317 microversion: 2.1 time: 0.260778 Oct 27 10:49:22.994963 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3126/6448] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:22 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:24.034103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:24.034761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:24.075210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:24.085390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:24.086253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:24.087430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:24.088461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:24.089267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:24.352164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:24.377228 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d36cc93-30bc-49c8-b5af-cac31b59076c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1323 microversion: 2.1 time: 0.350211 Oct 27 10:49:24.382814 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3323/6449] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:24 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1323 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:25.417509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:25.419097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:25.432178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:25.432815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:25.434534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:25.436876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:25.438880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:25.439840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:25.766533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:25.776253 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1fd541ea-eed2-4e31-a9d3-13d4e05a4911 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1391 microversion: 2.1 time: 0.364235 Oct 27 10:49:25.776870 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3127/6450] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:25 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1391 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:26.804050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:26.804896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:26.819968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:26.824295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:26.825276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:26.827227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:26.827932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:26.828611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:27.259144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:27.272126 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-829824dd-6c16-431a-92da-85b70ca807e9 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1391 microversion: 2.1 time: 0.473216 Oct 27 10:49:27.274946 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3324/6451] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:26 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1391 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:27.379370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-468421e9-1506-4690-9c06-07487476c801 req-9eb941d9-18fb-4d68-b681-fc02850e61c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23efd25-e0bf-4c68-ad1c-931d4731015c", "tag": "3dd29b48-0671-4a13-b770-4b07119a64c4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:27.394193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-468421e9-1506-4690-9c06-07487476c801 req-9eb941d9-18fb-4d68-b681-fc02850e61c4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:27.421401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-468421e9-1506-4690-9c06-07487476c801 req-9eb941d9-18fb-4d68-b681-fc02850e61c4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:27.421401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-468421e9-1506-4690-9c06-07487476c801 req-9eb941d9-18fb-4d68-b681-fc02850e61c4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:27.439659 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-468421e9-1506-4690-9c06-07487476c801 req-9eb941d9-18fb-4d68-b681-fc02850e61c4 service nova] Creating event network-changed:3dd29b48-0671-4a13-b770-4b07119a64c4 for instance a23efd25-e0bf-4c68-ad1c-931d4731015c on n-h1-854663-10 Oct 27 10:49:27.446454 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-468421e9-1506-4690-9c06-07487476c801 req-9eb941d9-18fb-4d68-b681-fc02850e61c4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071186 Oct 27 10:49:27.448496 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3128/6452] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:28.297900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:28.299026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:28.307119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:28.307672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:28.308156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:28.309047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:28.309512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:28.309956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:28.473859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:28.483064 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-520682f5-619b-422f-9f58-996c7b45b7a3 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1391 microversion: 2.1 time: 0.189667 Oct 27 10:49:28.499725 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3325/6453] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:28 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1391 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:29.510256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:29.517168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:29.521129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:29.533348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:29.534243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:29.534937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:29.535677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:29.536229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:29.536914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:29.770458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:29.782963 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8eb4ed5f-98cb-4165-9054-73907c01834f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1391 microversion: 2.1 time: 0.277739 Oct 27 10:49:29.784107 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3129/6454] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:29 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1391 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:30.672938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:30.673540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:30.681947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:30.683995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:30.684456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:30.685398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:30.686030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:30.686646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:30.783539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lazy-loading 'services' on Instance uuid d56931c7-43fc-4510-9aac-98e1d9a7d183 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:49:30.814980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:30.816706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:30.825972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:30.826951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:30.827884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:30.829268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:30.829883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:30.830880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:30.887962 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f17a03d-87c5-423b-92bd-d4633e389c0d tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183/os-volume_attachments/3c18b015-6429-4124-82aa-11dad8d0813a" status: 202 len: 0 microversion: 2.1 time: 0.224059 Oct 27 10:49:30.906854 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3326/6455] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 10:49:30 2022] DELETE /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183/os-volume_attachments/3c18b015-6429-4124-82aa-11dad8d0813a => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:49:31.087009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:31.096070 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a15d4d1-32f3-40d1-b1cb-bffb81cdeebf tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1391 microversion: 2.1 time: 0.290704 Oct 27 10:49:31.096685 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3130/6456] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:30 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1391 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:49:32.123770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:32.124496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:32.132901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:32.136504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:32.137064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:32.137525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:32.138572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:32.139053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:32.139501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:32.305292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:32.318384 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be3ea2ba-5d03-4ef4-bc58-645efb7b8c8c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1391 microversion: 2.1 time: 0.199586 Oct 27 10:49:32.338689 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3327/6457] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:32 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:33.346130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:33.348133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:33.356586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:33.358110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:33.360317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:33.360718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:33.361148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:33.361908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:33.362910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:33.363345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:33.564027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:33.577273 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f2ed88e-7912-4ec6-9b1d-7c279e5fd2f2 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1391 microversion: 2.1 time: 0.235357 Oct 27 10:49:33.589840 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3131/6458] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:33 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:33.816817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-eaaf5240-5023-4460-b75d-4c3c05a87a9b req-9ac2457b-4cf1-46d7-ae07-18a9680b0bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23efd25-e0bf-4c68-ad1c-931d4731015c", "name": "network-vif-plugged", "status": "completed", "tag": "3dd29b48-0671-4a13-b770-4b07119a64c4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:33.846899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eaaf5240-5023-4460-b75d-4c3c05a87a9b req-9ac2457b-4cf1-46d7-ae07-18a9680b0bc9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:33.847564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eaaf5240-5023-4460-b75d-4c3c05a87a9b req-9ac2457b-4cf1-46d7-ae07-18a9680b0bc9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:33.849587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eaaf5240-5023-4460-b75d-4c3c05a87a9b req-9ac2457b-4cf1-46d7-ae07-18a9680b0bc9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:33.882202 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-eaaf5240-5023-4460-b75d-4c3c05a87a9b req-9ac2457b-4cf1-46d7-ae07-18a9680b0bc9 service nova] Creating event network-vif-plugged:3dd29b48-0671-4a13-b770-4b07119a64c4 for instance a23efd25-e0bf-4c68-ad1c-931d4731015c on n-h1-854663-10 Oct 27 10:49:33.897401 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-eaaf5240-5023-4460-b75d-4c3c05a87a9b req-9ac2457b-4cf1-46d7-ae07-18a9680b0bc9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085176 Oct 27 10:49:33.898800 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3328/6459] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:34.604916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:34.606532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:34.614695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:34.615510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:34.616450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:34.617575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:34.618231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:34.619140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:34.817281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:34.827905 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-749d25d5-3520-4542-a060-3920915b4151 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1391 microversion: 2.1 time: 0.228001 Oct 27 10:49:34.844280 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3132/6460] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:34 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:35.856122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:35.857638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:35.864525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:35.865342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:35.866033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:35.867158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:35.867620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:35.868364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:36.060879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:36.072794 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df57f09d-8425-49cb-9beb-2af33ba17da4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1563 microversion: 2.1 time: 0.221489 Oct 27 10:49:36.088424 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3329/6461] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:35 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1563 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:49:36.098617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:36.100021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:36.112028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:36.113703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:36.114386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:36.115165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:36.115725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:36.116608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:36.298735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:36.310077 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6a7e6b7-b491-4261-8371-4a29ae926b40 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1563 microversion: 2.1 time: 0.215441 Oct 27 10:49:36.314304 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3133/6462] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:36 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1563 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:49:37.566893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:37.568254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:37.581538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:37.584097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:37.585303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:37.587612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:37.589433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:37.589649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:37.648918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:49:37.768802 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-577bf61e-c676-46bc-b27f-550a19b1f06e tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 204 len: 0 microversion: 2.1 time: 0.205888 Oct 27 10:49:37.769422 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3330/6463] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:49:37 2022] DELETE /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:49:37.781986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:37.784212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:37.805199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:37.805823 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:37.806341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:37.807335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:37.807773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:37.817898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:37.997097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:38.011538 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fdf9b330-1a6b-4324-b889-b58a7b2fc954 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1513 microversion: 2.1 time: 0.236655 Oct 27 10:49:38.012734 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3134/6464] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:37 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:38.366230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:38.366958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:38.373686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2747591f-671a-4eef-a5e3-f011b903d354 req-ab0b08de-7b7e-4d83-84b8-4c4e81a00160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23efd25-e0bf-4c68-ad1c-931d4731015c", "tag": "3dd29b48-0671-4a13-b770-4b07119a64c4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:38.385126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:38.385560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:38.386007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:38.390966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:38.391220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2747591f-671a-4eef-a5e3-f011b903d354 req-ab0b08de-7b7e-4d83-84b8-4c4e81a00160 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:38.391842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2747591f-671a-4eef-a5e3-f011b903d354 req-ab0b08de-7b7e-4d83-84b8-4c4e81a00160 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:38.392486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:38.393103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2747591f-671a-4eef-a5e3-f011b903d354 req-ab0b08de-7b7e-4d83-84b8-4c4e81a00160 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:38.393713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:38.411051 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2747591f-671a-4eef-a5e3-f011b903d354 req-ab0b08de-7b7e-4d83-84b8-4c4e81a00160 service nova] Creating event network-changed:3dd29b48-0671-4a13-b770-4b07119a64c4 for instance a23efd25-e0bf-4c68-ad1c-931d4731015c on n-h1-854663-10 Oct 27 10:49:38.431320 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2747591f-671a-4eef-a5e3-f011b903d354 req-ab0b08de-7b7e-4d83-84b8-4c4e81a00160 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061326 Oct 27 10:49:38.432025 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3135/6465] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:49:38.652004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:38.665633 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b04dc5ee-00f9-4d9f-acc2-521e6ccdb881 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1563 microversion: 2.1 time: 0.303339 Oct 27 10:49:38.670046 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3331/6466] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:38 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1563 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:39.038741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:39.040258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:39.048175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:39.048799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:39.049455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:39.050438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:39.051080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:39.051690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:39.314250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:39.326224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0094478e-faad-4b5d-a605-b1866a9eeac5 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1513 microversion: 2.1 time: 0.294101 Oct 27 10:49:39.350897 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3136/6467] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:39 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1513 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:40.177880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b84aa25b-0c64-44b5-ace6-4a0f6eb3b4e7 req-1b9c050a-c55a-4437-a0fd-128d5648c7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56931c7-43fc-4510-9aac-98e1d9a7d183", "name": "network-vif-deleted", "tag": "5e8a0cdf-71eb-4de4-be85-12b0d4af360b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:40.189794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b84aa25b-0c64-44b5-ace6-4a0f6eb3b4e7 req-1b9c050a-c55a-4437-a0fd-128d5648c7d4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:40.190430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b84aa25b-0c64-44b5-ace6-4a0f6eb3b4e7 req-1b9c050a-c55a-4437-a0fd-128d5648c7d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:40.190881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b84aa25b-0c64-44b5-ace6-4a0f6eb3b4e7 req-1b9c050a-c55a-4437-a0fd-128d5648c7d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:40.202480 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b84aa25b-0c64-44b5-ace6-4a0f6eb3b4e7 req-1b9c050a-c55a-4437-a0fd-128d5648c7d4 service nova] Creating event network-vif-deleted:5e8a0cdf-71eb-4de4-be85-12b0d4af360b for instance d56931c7-43fc-4510-9aac-98e1d9a7d183 on n-h2-854663-10 Oct 27 10:49:40.207485 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b84aa25b-0c64-44b5-ace6-4a0f6eb3b4e7 req-1b9c050a-c55a-4437-a0fd-128d5648c7d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224588 Oct 27 10:49:40.208607 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3332/6468] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:40.350309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:40.350933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:40.358517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:40.359011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:40.359652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:40.360542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:40.361186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:40.361780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:40.407532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:40.408219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:40.408804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:40.413469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lazy-loading 'fault' on Instance uuid d56931c7-43fc-4510-9aac-98e1d9a7d183 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:49:40.463599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee39f2efb7d48c1b2643c710c4834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e6fb8b09ed4b29bfdef7ba34bb3a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:40.473940 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76d99807-5537-4945-9ce2-3dcc8a589d86 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 200 len: 1308 microversion: 2.1 time: 0.127697 Oct 27 10:49:40.475273 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3137/6469] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:40 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:41.505384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:41.506096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] [instance: d56931c7-43fc-4510-9aac-98e1d9a7d183] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:41.513914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:41.514453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:41.514901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:41.515626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:41.516131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:41.516576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:41.537949 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] HTTP exception thrown: Instance d56931c7-43fc-4510-9aac-98e1d9a7d183 could not be found. Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Request method failure captured: Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 HTTP/1.1 Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmFL77ol6rtJrkCZcI11LRo7Jbphnpm1Oz0lpMiNSGhFLqLFLvbUjAl8XgSIzHIh5hLjfxs6TrswszYkxuTlz9TEC-tnhdJPmULcPf_c9wXlCzm7cqWvCtqJqY8JTnmGDgTAxJSZ9-IuDqj8FhsOVz1RnEe8tmMh8J4w-ffFqst1K4U Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 53e6fb8b09ed4b29bfdef7ba34bb3a39 Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotTestJSON-833697325 Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53e6fb8b09ed4b29bfdef7ba34bb3a39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/53e6fb8b09ed4b29bfdef7ba34bb3a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_53e6fb8b09ed4b29bfdef7ba34bb3a39", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/53e6fb8b09ed4b29bfdef7ba34bb3a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotTestJSON-833697325 Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 53e6fb8b09ed4b29bfdef7ba34bb3a39 Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-833697325 Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotTestJSON-833697325-project Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: eee39f2efb7d48c1b2643c710c4834ca Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotTestJSON-833697325-project Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance d56931c7-43fc-4510-9aac-98e1d9a7d183 could not be found. Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'd56931c7-43fc-4510-9aac-98e1d9a7d183'} Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d56931c7-43fc-4510-9aac-98e1d9a7d183 could not be found. Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d56931c7-43fc-4510-9aac-98e1d9a7d183 could not be found. Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:49:41.539961 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:49:41.545230 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:49:41.545230 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:49:41.545230 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:49:41.545230 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:49:41.545230 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:49:41.545230 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d56931c7-43fc-4510-9aac-98e1d9a7d183 could not be found. Oct 27 10:49:41.545230 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:49:41.545230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] Returning 404 to user: Instance d56931c7-43fc-4510-9aac-98e1d9a7d183 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:49:41.546094 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19a809e8-883d-4df8-a8b8-25de5d74a254 tempest-VolumesSnapshotTestJSON-833697325 tempest-VolumesSnapshotTestJSON-833697325-project] 10.222.0.76 "GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183" status: 404 len: 111 microversion: 2.1 time: 0.048610 Oct 27 10:49:41.546726 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3333/6470] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:41 2022] GET /compute/v2.1/servers/d56931c7-43fc-4510-9aac-98e1d9a7d183 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:50:03.422619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3646068-a6db-408e-8f70-7b785e3f0b86 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:50:03.427873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e3646068-a6db-408e-8f70-7b785e3f0b86 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:03.438138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=19 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:03.439479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=68 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:03.441741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3646068-a6db-408e-8f70-7b785e3f0b86 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:03.442753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3646068-a6db-408e-8f70-7b785e3f0b86 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:03.444275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3646068-a6db-408e-8f70-7b785e3f0b86 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:03.445291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3646068-a6db-408e-8f70-7b785e3f0b86 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:03.446171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3646068-a6db-408e-8f70-7b785e3f0b86 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:03.446935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3646068-a6db-408e-8f70-7b785e3f0b86 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:03.550435 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e3646068-a6db-408e-8f70-7b785e3f0b86 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c/action" status: 200 len: 24551 microversion: 2.1 time: 0.132202 Oct 27 10:50:03.557437 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3138/6471] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:50:03 2022] POST /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c/action => generated 24551 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:50:14.661612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e360a591-87a4-48a1-b578-afd9703b636a"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:50:14.665839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:14.684965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:14.684965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:14.689786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:14.690331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:14.690788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:14.691887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:14.692391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:14.693044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:14.820651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:50:14.821348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:50:14.822093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:50:14.824107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:50:14.827215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:50:14.934402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:14.945946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:14.947787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:14.947787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:14.947787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:14.948253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:14.948995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:15.004477 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e29eba4-dbc3-458d-81cd-0421f79f2fd4 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c/action" status: 202 len: 1136 microversion: 2.1 time: 0.347404 Oct 27 10:50:15.008859 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3334/6472] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:50:14 2022] POST /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c/action => generated 1136 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 10:50:15.029283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:15.031091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:15.040641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:15.041663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:15.044989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:15.045896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:15.046724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:15.047810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:15.048526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:15.049263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:15.267992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:15.278470 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa7fd622-f76e-4fd9-80cd-a8db520c672d tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.257497 Oct 27 10:50:15.279799 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3139/6473] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:15 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:16.303696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:16.304319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:16.323290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:16.323801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:16.324254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:16.325241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:16.325711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:16.326152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:16.596706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:16.611550 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-34e04adc-c8ae-4234-9d56-e1e68485e7ff tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.312338 Oct 27 10:50:16.612634 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3335/6474] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:16 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:17.640837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:17.642384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:17.665223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:17.669262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:17.670400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:17.674060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:17.675400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:17.676049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:17.946562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:17.956485 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0175489-f1b0-4d9e-ae9a-97cad4c312c0 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.320879 Oct 27 10:50:17.957353 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3140/6475] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:17 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:18.980143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:18.981198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:18.988519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:18.989381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:18.989762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:18.990950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:18.991466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:18.992122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:19.168822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:19.180398 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40af5e35-3dd0-402a-97c4-ee3696aafc30 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.204067 Oct 27 10:50:19.181491 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3336/6476] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:18 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:20.205542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:20.206165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:20.216907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:20.218095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:20.218726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:20.219444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:20.220068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:20.220961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:20.386410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:20.395932 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-edaee2dc-1bbd-49e6-852a-a5a22232d846 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.193670 Oct 27 10:50:20.396544 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3141/6477] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:20 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:21.424100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:21.424782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:21.438751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:21.439311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:21.439778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:21.440842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:21.449267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:21.449920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:21.637420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:21.648842 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-778de47f-7b5f-4559-890f-231350afad09 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.230746 Oct 27 10:50:21.649635 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3337/6478] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:21 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:22.675210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:22.675849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:22.694027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:22.694530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:22.695522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:22.696803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:22.697389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:22.697711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:22.885341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:22.894953 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4d46827-231d-4532-96da-447e5afb7e00 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.223791 Oct 27 10:50:22.896104 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3142/6479] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:22 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:23.931965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:23.933711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:23.941451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:23.942288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:23.942923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:23.943839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:23.944497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:23.945210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:24.142805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:24.152006 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e767c5b-8730-447c-a746-9eb355385e7c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.224655 Oct 27 10:50:24.153229 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3338/6480] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:23 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:25.176765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:25.182403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:25.194670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:25.199555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:25.206661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:25.207632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:25.217863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:25.218502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:25.514027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:25.523363 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4098c50a-6698-4a00-9ae0-07fafb3236a1 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.351305 Oct 27 10:50:25.524109 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3143/6481] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:25 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:26.547026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:26.547662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:26.556112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:26.556608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:26.557088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:26.557806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:26.558294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:26.558926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:26.721002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:26.734344 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a42ab4d7-1413-4b9f-b150-5cc3466e4d05 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.191262 Oct 27 10:50:26.735825 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3339/6482] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:26 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:27.759796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:27.760353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:27.767660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:27.768148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:27.768852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:27.769556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:27.770171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:27.770764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:27.931658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:27.941704 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-abd9ebc2-0854-41d8-9831-6e699a832a59 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.185624 Oct 27 10:50:27.942544 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3144/6483] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:27 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:28.966144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:28.969472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:28.977009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:28.977825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:28.978898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:28.979820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:28.980458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:28.981109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:29.165308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:29.173902 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e0f16689-a17f-49d9-ace5-5edeae3e5d03 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.212142 Oct 27 10:50:29.190518 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3340/6484] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:28 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:30.198595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:30.199196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:30.215318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:30.215766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:30.216412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:30.217358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:30.218660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:30.221911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:30.429329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:30.439012 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3aa6a3c-3934-48ad-8051-2c7a20f6150f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.244988 Oct 27 10:50:30.448175 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3145/6485] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:30 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:31.463932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:31.464575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:31.482170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:31.482864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:31.483494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:31.485601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:31.489032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:31.490261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:31.777091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:31.789540 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1990168f-cc21-48ae-9ebf-75b2d0c4d79c tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.330142 Oct 27 10:50:31.790139 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3341/6486] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:31 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:32.813607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:32.814222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:32.821106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:32.821587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:32.822021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:32.822715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:32.823157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:32.823571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:33.025572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:33.034215 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ec02df6-5675-446c-935f-5b390b88d566 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1690 microversion: 2.1 time: 0.224594 Oct 27 10:50:33.035476 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3146/6487] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:32 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:34.059864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:34.061162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:34.074028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:34.074581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:34.075088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:34.075780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:34.076252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:34.078286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:34.265339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:34.276037 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f546fe76-e73f-45df-af2e-6dfc2af567fe tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1696 microversion: 2.1 time: 0.218091 Oct 27 10:50:34.277126 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3342/6488] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:34 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1696 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:35.300608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:35.301916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:35.310982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:35.311466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:35.311958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:35.312956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:35.313424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:35.319211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:35.477862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:35.486791 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3369af5c-3fa5-4994-841f-ce48cbe2d761 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1696 microversion: 2.1 time: 0.190465 Oct 27 10:50:35.487827 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3147/6489] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:35 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:36.513694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:36.514442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:36.530702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:36.531519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:36.532291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:36.535015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:36.535683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:36.537217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:36.795471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:36.804390 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fba2b4ac-db48-416b-97e2-15c6fe302112 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1681 microversion: 2.1 time: 0.297205 Oct 27 10:50:36.805528 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3343/6490] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:36 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1681 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:37.986140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1e63b859-2a49-4f4f-ac4b-fcb46ccee2b3 req-2535b804-1c37-4458-9fe2-5f26e1d33d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23efd25-e0bf-4c68-ad1c-931d4731015c", "name": "network-vif-plugged", "status": "completed", "tag": "3dd29b48-0671-4a13-b770-4b07119a64c4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:50:37.998223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1e63b859-2a49-4f4f-ac4b-fcb46ccee2b3 req-2535b804-1c37-4458-9fe2-5f26e1d33d38 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:37.998970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1e63b859-2a49-4f4f-ac4b-fcb46ccee2b3 req-2535b804-1c37-4458-9fe2-5f26e1d33d38 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:37.999628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1e63b859-2a49-4f4f-ac4b-fcb46ccee2b3 req-2535b804-1c37-4458-9fe2-5f26e1d33d38 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:38.013965 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1e63b859-2a49-4f4f-ac4b-fcb46ccee2b3 req-2535b804-1c37-4458-9fe2-5f26e1d33d38 service nova] Creating event network-vif-plugged:3dd29b48-0671-4a13-b770-4b07119a64c4 for instance a23efd25-e0bf-4c68-ad1c-931d4731015c on n-h1-854663-10 Oct 27 10:50:38.019827 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1e63b859-2a49-4f4f-ac4b-fcb46ccee2b3 req-2535b804-1c37-4458-9fe2-5f26e1d33d38 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037442 Oct 27 10:50:38.021527 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3148/6491] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:50:46.460260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44adafb2-5909-4bda-a60b-e079c32247ae tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Action: 'create', calling method: .version_select at 0x7f6d5a1b59d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1683787461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSNHi3g0Px0o/NLT55X7MOY4c9YJnZi9znZbV6jTCWfP//CZuyhPN3E0nXyvmHwabZc8aBRFEuzInSN9ddkGpqSmhCmHX1AfSeugBw6J4rfpgaLiP/QYp3XBUVqkfb6UQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:50:46.471068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=25 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:46.485908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-44adafb2-5909-4bda-a60b-e079c32247ae tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:50:46.494860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-44adafb2-5909-4bda-a60b-e079c32247ae tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for user c6f77e88f7c148a7996cb6ccabd9f64f and project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:50:46.554529 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44adafb2-5909-4bda-a60b-e079c32247ae tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.095701 Oct 27 10:50:46.555771 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3344/6492] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:50:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:50:48.104698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-168154535", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "94361b62-40f6-4ea0-868b-6ae31171ce24"}], "key_name": "tempest-TestNetworkBasicOps-1683787461", "security_groups": [{"name": "tempest-secgroup-smoke-1158162685"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:50:48.119461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=20 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:48.120145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=56 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:48.250431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] validate_networks() for [('94361b62-40f6-4ea0-868b-6ae31171ce24', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:50:48.801976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:50:48.802487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:50:48.802854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:50:48.803681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:50:48.804284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:50:48.822819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:48.823311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:48.823749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:48.824535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:48.825121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:48.834392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:48.856420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:50:48.876990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for user c6f77e88f7c148a7996cb6ccabd9f64f and project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:50:48.895204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:50:48.898811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:50:48.956269 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5335f4e9-2e6f-4dc8-8657-37835af04ef4 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.857099 Oct 27 10:50:48.970615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2e7e067-f3d7-4d33-9783-c896c813b044 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:48.978026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2e7e067-f3d7-4d33-9783-c896c813b044 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:48.978703 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3149/6493] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:50:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:50:48.985901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:49.098902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2e7e067-f3d7-4d33-9783-c896c813b044 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:49.115817 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2e7e067-f3d7-4d33-9783-c896c813b044 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1248 microversion: 2.1 time: 0.151160 Oct 27 10:50:49.116699 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3345/6494] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:48 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1248 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:50.140377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:50.141088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:50.149033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:50.149948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:50.150579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:50.151447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:50.153140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:50.153741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:50.228379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:50.238314 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7baed18a-ff42-4b33-83ee-e3a4d629780c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1300 microversion: 2.1 time: 0.102549 Oct 27 10:50:50.239010 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3150/6495] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:50 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:51.263126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:51.264620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:51.280945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:51.281465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:51.282143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:51.283250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:51.283771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:51.284313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:51.510414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:51.528162 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ef622d6-37c9-4866-89cf-9cc2417ce26e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1306 microversion: 2.1 time: 0.268707 Oct 27 10:50:51.529094 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3346/6496] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:51 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1306 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:50:52.556513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:52.557310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:52.568863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:52.569728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:52.570361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:52.571386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:52.571999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:52.573043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:52.673311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ff145663-68bd-49f5-bf75-1eeb44526beb req-9375b2e6-30bd-4860-94e5-3dbb701606ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8232e55-e23c-4c9d-9076-9ae160cd474a", "tag": "70f85b78-cab9-4e0e-add2-88e7876a4c0b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:50:52.694127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ff145663-68bd-49f5-bf75-1eeb44526beb req-9375b2e6-30bd-4860-94e5-3dbb701606ad service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:52.695056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ff145663-68bd-49f5-bf75-1eeb44526beb req-9375b2e6-30bd-4860-94e5-3dbb701606ad service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:52.695666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ff145663-68bd-49f5-bf75-1eeb44526beb req-9375b2e6-30bd-4860-94e5-3dbb701606ad service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:52.710291 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ff145663-68bd-49f5-bf75-1eeb44526beb req-9375b2e6-30bd-4860-94e5-3dbb701606ad service nova] Creating event network-changed:70f85b78-cab9-4e0e-add2-88e7876a4c0b for instance a8232e55-e23c-4c9d-9076-9ae160cd474a on n-h2-854663-10 Oct 27 10:50:52.717273 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ff145663-68bd-49f5-bf75-1eeb44526beb req-9375b2e6-30bd-4860-94e5-3dbb701606ad service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048095 Oct 27 10:50:52.718573 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3347/6497] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:50:52.938853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:52.949620 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a9324fd9-12f9-4b58-9589-56706f3010d8 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1374 microversion: 2.1 time: 0.397685 Oct 27 10:50:52.950212 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3151/6498] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:52 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1374 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:53.974647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:53.975392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:53.982374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:53.982886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:53.983336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:53.984059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:53.984525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:53.985134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:54.240136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:54.249156 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be387a60-ebca-44fe-b7ee-ad6b76dfdd59 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1374 microversion: 2.1 time: 0.279650 Oct 27 10:50:54.255001 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3348/6499] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:53 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1374 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:55.273527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:55.274120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:55.281717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:55.282281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:55.282797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:55.283571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:55.284095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:55.284599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:55.436013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:55.444749 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88a71c82-f6e8-46d0-bb2e-781365e277c7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1374 microversion: 2.1 time: 0.175274 Oct 27 10:50:55.445473 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3152/6500] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:55 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:56.468415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:56.469048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:56.476539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:56.477080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:56.477537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:56.478253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:56.478724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:56.479169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:56.619318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:56.628284 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f0b3da3-8fb3-4b34-93c3-095146510aa7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1374 microversion: 2.1 time: 0.163939 Oct 27 10:50:56.628887 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3349/6501] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:56 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:57.651656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:57.652389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:57.659826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:57.660305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:57.660759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:57.661447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:57.661896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:57.662317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:57.805566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:57.813659 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf5c1554-2356-4f1b-92da-56df84fba9f5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1374 microversion: 2.1 time: 0.166243 Oct 27 10:50:57.814274 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3153/6502] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:57 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:58.837433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:50:58.838067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:50:58.845426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:58.845929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:58.846563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:58.847475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:58.847947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:58.848388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:59.007535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:50:59.023247 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff98f557-5920-4f89-aa40-0ee8b960851c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1374 microversion: 2.1 time: 0.189754 Oct 27 10:50:59.039412 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3350/6503] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:50:58 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:50:59.092807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9dc59114-0404-4473-b060-3e64af07c681 req-5de8cc26-91aa-4289-9544-63635ea31b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8232e55-e23c-4c9d-9076-9ae160cd474a", "name": "network-vif-plugged", "status": "completed", "tag": "70f85b78-cab9-4e0e-add2-88e7876a4c0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:50:59.113306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:59.114122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:50:59.116865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9dc59114-0404-4473-b060-3e64af07c681 req-5de8cc26-91aa-4289-9544-63635ea31b8f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:50:59.117517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9dc59114-0404-4473-b060-3e64af07c681 req-5de8cc26-91aa-4289-9544-63635ea31b8f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:50:59.117970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9dc59114-0404-4473-b060-3e64af07c681 req-5de8cc26-91aa-4289-9544-63635ea31b8f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:50:59.133257 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9dc59114-0404-4473-b060-3e64af07c681 req-5de8cc26-91aa-4289-9544-63635ea31b8f service nova] Creating event network-vif-plugged:70f85b78-cab9-4e0e-add2-88e7876a4c0b for instance a8232e55-e23c-4c9d-9076-9ae160cd474a on n-h2-854663-10 Oct 27 10:50:59.139066 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9dc59114-0404-4473-b060-3e64af07c681 req-5de8cc26-91aa-4289-9544-63635ea31b8f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051316 Oct 27 10:50:59.140235 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3154/6504] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:00.049158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:00.049925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:00.051964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:00.059472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:00.059999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:00.060484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:00.061304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:00.061762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:00.062206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:00.212705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:00.233548 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a4dcdad-4268-44ae-8174-1fd744a72373 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1374 microversion: 2.1 time: 0.188391 Oct 27 10:51:00.241393 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3351/6505] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:00 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:01.270447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:01.271151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:01.279282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:01.279840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:01.280341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:01.281140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:01.281660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:01.282150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:01.445728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:01.455593 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-568118f3-5e3f-4f5b-a316-a261577fa838 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1547 microversion: 2.1 time: 0.189830 Oct 27 10:51:01.456309 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3155/6506] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:01 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1547 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:01.479029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:01.479810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:01.487034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:01.487528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:01.487977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:01.488717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:01.489185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:01.489623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:01.650314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:01.659723 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd04a074-db7d-4661-974f-c5b9d7169e93 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1547 microversion: 2.1 time: 0.184761 Oct 27 10:51:01.660335 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3352/6507] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:01 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:03.050571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e75c0016-0220-4950-a3f2-39e73a066775 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:03.052898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e75c0016-0220-4950-a3f2-39e73a066775 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:03.065830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e75c0016-0220-4950-a3f2-39e73a066775 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:03.066655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e75c0016-0220-4950-a3f2-39e73a066775 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:03.067303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e75c0016-0220-4950-a3f2-39e73a066775 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:03.068362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e75c0016-0220-4950-a3f2-39e73a066775 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:03.069483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e75c0016-0220-4950-a3f2-39e73a066775 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:03.070111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e75c0016-0220-4950-a3f2-39e73a066775 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:03.144850 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e75c0016-0220-4950-a3f2-39e73a066775 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "POST /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c/action" status: 200 len: 24568 microversion: 2.1 time: 0.096427 Oct 27 10:51:03.145832 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3156/6508] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:51:03 2022] POST /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c/action => generated 24568 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:51:03.637625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2feb6e75-b5d5-4854-a68b-2fb32e3d7097 req-6dc079c3-a87c-46a6-b74f-575642765843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8232e55-e23c-4c9d-9076-9ae160cd474a", "tag": "70f85b78-cab9-4e0e-add2-88e7876a4c0b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:03.648821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2feb6e75-b5d5-4854-a68b-2fb32e3d7097 req-6dc079c3-a87c-46a6-b74f-575642765843 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:03.649614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2feb6e75-b5d5-4854-a68b-2fb32e3d7097 req-6dc079c3-a87c-46a6-b74f-575642765843 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:03.650257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2feb6e75-b5d5-4854-a68b-2fb32e3d7097 req-6dc079c3-a87c-46a6-b74f-575642765843 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:03.662691 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2feb6e75-b5d5-4854-a68b-2fb32e3d7097 req-6dc079c3-a87c-46a6-b74f-575642765843 service nova] Creating event network-changed:70f85b78-cab9-4e0e-add2-88e7876a4c0b for instance a8232e55-e23c-4c9d-9076-9ae160cd474a on n-h2-854663-10 Oct 27 10:51:03.698360 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2feb6e75-b5d5-4854-a68b-2fb32e3d7097 req-6dc079c3-a87c-46a6-b74f-575642765843 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204587 Oct 27 10:51:03.703196 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3353/6509] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:10.873786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:10.875067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:10.883708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:10.884187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:10.884618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:10.885344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:10.885791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:10.886211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:10.913717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:51:11.000670 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c8acbcc4-9eaa-420c-9daa-fe8ba583939f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 204 len: 0 microversion: 2.1 time: 0.131628 Oct 27 10:51:11.001834 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3157/6510] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:51:10 2022] DELETE /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:51:11.012500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:11.013258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:11.020093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:11.020692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:11.021221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:11.022191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:11.022669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:11.023105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:11.174779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:11.184564 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65fb9acb-9ad9-49a7-b4bf-c56170751af2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1577 microversion: 2.1 time: 0.178360 Oct 27 10:51:11.188617 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3354/6511] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:11 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:12.208325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:12.209378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:12.221020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:12.221800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:12.222243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:12.222914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:12.223552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:12.224182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:12.413320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:12.425149 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71bb4d8b-e71f-4b8f-abc4-13e8f00546ae tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1577 microversion: 2.1 time: 0.220845 Oct 27 10:51:12.425739 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3158/6512] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:12 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:13.449470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:13.450766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:13.463367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:13.463935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:13.464633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:13.465602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:13.466238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:13.466924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:13.672786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:13.684528 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a0cee7ef-a38b-48fe-94d6-2001367ccdec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1577 microversion: 2.1 time: 0.238931 Oct 27 10:51:13.685759 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3355/6513] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:13 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:14.137649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-bb442cc3-04c0-407b-bd1b-35a1dd3a1717 req-fa47b1dd-6e67-44b4-b709-f6ccd67dbcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b793bd-5e88-4400-9755-5f3bd8ec3736", "name": "network-vif-deleted", "tag": "587a0344-5573-42d5-a403-b1ab2cab6716"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:14.152412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bb442cc3-04c0-407b-bd1b-35a1dd3a1717 req-fa47b1dd-6e67-44b4-b709-f6ccd67dbcb4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:14.153359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bb442cc3-04c0-407b-bd1b-35a1dd3a1717 req-fa47b1dd-6e67-44b4-b709-f6ccd67dbcb4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:14.153964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bb442cc3-04c0-407b-bd1b-35a1dd3a1717 req-fa47b1dd-6e67-44b4-b709-f6ccd67dbcb4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:14.169479 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-bb442cc3-04c0-407b-bd1b-35a1dd3a1717 req-fa47b1dd-6e67-44b4-b709-f6ccd67dbcb4 service nova] Creating event network-vif-deleted:587a0344-5573-42d5-a403-b1ab2cab6716 for instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 on n-h1-854663-10 Oct 27 10:51:14.176360 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-bb442cc3-04c0-407b-bd1b-35a1dd3a1717 req-fa47b1dd-6e67-44b4-b709-f6ccd67dbcb4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042277 Oct 27 10:51:14.182138 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3159/6514] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:14.712039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:14.713510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:14.722901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:14.723671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:14.724285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:14.725770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:14.726544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:14.727776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:14.886290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:14.899059 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6e5590f-77a4-41fb-8b61-7b73467ff718 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1225 microversion: 2.1 time: 0.191854 Oct 27 10:51:14.900105 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3356/6515] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:14 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1225 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:15.742859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:15.743613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cb711061-b7a9-417f-9e7d-544f600c1817 req-1fda38a6-07a8-4910-9f31-03bd3580d695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23efd25-e0bf-4c68-ad1c-931d4731015c", "tag": "3dd29b48-0671-4a13-b770-4b07119a64c4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:15.747878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:15.767469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:15.768252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:15.768985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:15.769956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:15.770466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cb711061-b7a9-417f-9e7d-544f600c1817 req-1fda38a6-07a8-4910-9f31-03bd3580d695 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:15.770863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:15.771042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cb711061-b7a9-417f-9e7d-544f600c1817 req-1fda38a6-07a8-4910-9f31-03bd3580d695 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:15.771737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cb711061-b7a9-417f-9e7d-544f600c1817 req-1fda38a6-07a8-4910-9f31-03bd3580d695 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:15.772004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:15.792021 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cb711061-b7a9-417f-9e7d-544f600c1817 req-1fda38a6-07a8-4910-9f31-03bd3580d695 service nova] Creating event network-changed:3dd29b48-0671-4a13-b770-4b07119a64c4 for instance a23efd25-e0bf-4c68-ad1c-931d4731015c on n-h1-854663-10 Oct 27 10:51:15.799321 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cb711061-b7a9-417f-9e7d-544f600c1817 req-1fda38a6-07a8-4910-9f31-03bd3580d695 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062446 Oct 27 10:51:15.805326 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3357/6516] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:51:15.823867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:51:15.930858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:15.932059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:15.951552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:15.953375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:15.954739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:15.958751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:15.961733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:15.963735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:16.014913 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41e91afc-9924-4306-8446-00d4859b200b tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 204 len: 0 microversion: 2.1 time: 0.280031 Oct 27 10:51:16.022822 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3160/6517] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:51:15 2022] DELETE /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:51:16.047442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:16.051392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:16.074165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:16.075160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:16.077858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:16.079306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:16.082672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:16.086163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:16.166269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:16.180110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aae0780b-dcc9-4c61-8f1d-f3d811c2321d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1225 microversion: 2.1 time: 0.256351 Oct 27 10:51:16.183688 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3358/6518] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:15 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1225 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:51:16.349264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:16.358800 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a7832ba-0d55-48d0-ab03-962363b4ed0f tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1687 microversion: 2.1 time: 0.333791 Oct 27 10:51:16.360261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3161/6519] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:16 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1687 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:17.205667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:17.206263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:17.219348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:17.221110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:17.221618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:17.222070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:17.222793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:17.223639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:17.224425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:17.366314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:17.383104 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d14ee32-3808-42ca-922d-d83a5f3313a2 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1225 microversion: 2.1 time: 0.181254 Oct 27 10:51:17.386147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:17.386787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:17.388595 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3359/6520] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:17 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1225 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:17.399123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:17.403580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:17.404271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:17.405244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:17.414072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:17.415131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:17.680506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:17.694735 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd40392e-daa4-4d73-a521-c4abdedd3cbd tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1687 microversion: 2.1 time: 0.312849 Oct 27 10:51:17.702167 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3162/6521] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:17 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1687 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:18.417746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:18.418319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:18.435585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:18.436099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:18.436558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:18.437343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:18.437810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:18.438263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:18.577141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:18.588542 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a290b84-f9e6-49ff-aa6a-3e253c9a4481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1225 microversion: 2.1 time: 0.174700 Oct 27 10:51:18.589204 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3360/6522] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:18 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:18.637276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b7efb352-51bf-4bce-a743-b6ba78156c64 req-e5366cf1-4c7e-4a53-85e7-4dd8fa63e28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23efd25-e0bf-4c68-ad1c-931d4731015c", "name": "network-vif-deleted", "tag": "3dd29b48-0671-4a13-b770-4b07119a64c4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:18.649153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:18.660373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7efb352-51bf-4bce-a743-b6ba78156c64 req-e5366cf1-4c7e-4a53-85e7-4dd8fa63e28a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:18.661275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7efb352-51bf-4bce-a743-b6ba78156c64 req-e5366cf1-4c7e-4a53-85e7-4dd8fa63e28a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:18.661935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7efb352-51bf-4bce-a743-b6ba78156c64 req-e5366cf1-4c7e-4a53-85e7-4dd8fa63e28a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:18.681290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:18.686946 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b7efb352-51bf-4bce-a743-b6ba78156c64 req-e5366cf1-4c7e-4a53-85e7-4dd8fa63e28a service nova] Creating event network-vif-deleted:3dd29b48-0671-4a13-b770-4b07119a64c4 for instance a23efd25-e0bf-4c68-ad1c-931d4731015c on n-h1-854663-10 Oct 27 10:51:18.692981 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b7efb352-51bf-4bce-a743-b6ba78156c64 req-e5366cf1-4c7e-4a53-85e7-4dd8fa63e28a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060574 Oct 27 10:51:18.698682 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3163/6523] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:18.726848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:18.728365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:18.738209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:18.739109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:18.740787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:18.742016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:18.742731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:18.743949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:18.848164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:18.851425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:18.853073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:18.853788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lazy-loading 'fault' on Instance uuid a23efd25-e0bf-4c68-ad1c-931d4731015c {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:51:18.945022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c34954a94017b2d5095e391ceffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b8083f3e1a40cf978ae9605cc2239b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:18.967491 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca94dacb-d93e-4533-8ffb-67daf70d4144 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 200 len: 1355 microversion: 2.1 time: 0.245203 Oct 27 10:51:18.975897 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3361/6524] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:18 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 1355 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:19.613632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:19.614430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:19.637279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:19.638616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:19.639323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:19.640330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:19.641090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:19.641759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:19.727533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:19.735902 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f976ef3-1fda-407b-b265-6f3be3044599 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1225 microversion: 2.1 time: 0.128053 Oct 27 10:51:19.738623 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3164/6525] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:19 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:19.998367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:19.999620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [instance: a23efd25-e0bf-4c68-ad1c-931d4731015c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:20.007929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:20.008757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:20.009419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:20.010465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:20.011259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:20.011903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:20.027677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=87 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:20.029641 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] HTTP exception thrown: Instance a23efd25-e0bf-4c68-ad1c-931d4731015c could not be found. Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Request method failure captured: Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c HTTP/1.1 Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmCB8b4BRHsH94RlDS3xYrhwfaqEsty7QYPzPqKpJZ9MHvNb0KEFX2OGq7Y9a1uA6gmR-kLao7lu13KscHPRbXuAOCZi6EE-CskQcdrHFDuQXm_jRNlw9KrLoJqKLAMqdAlw8qkWlaZnbme4veJuK1hnJ7dqbpyxw53lmnUa5qTvUDE Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: d5b8083f3e1a40cf978ae9605cc2239b Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d5b8083f3e1a40cf978ae9605cc2239b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d5b8083f3e1a40cf978ae9605cc2239b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: d5b8083f3e1a40cf978ae9605cc2239b Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1627469587 Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestNetworkAdvancedServerOps-1627469587-project Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 5263c34954a94017b2d5095e391ceffc Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1627469587-project Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance a23efd25-e0bf-4c68-ad1c-931d4731015c could not be found. Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a23efd25-e0bf-4c68-ad1c-931d4731015c'} Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23efd25-e0bf-4c68-ad1c-931d4731015c could not be found. Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23efd25-e0bf-4c68-ad1c-931d4731015c could not be found. Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:20.032152 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:51:20.036770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:20.036770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:51:20.036770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:51:20.036770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:51:20.036770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:51:20.036770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:51:20.036770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23efd25-e0bf-4c68-ad1c-931d4731015c could not be found. Oct 27 10:51:20.036770 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:20.039486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Returning 404 to user: Instance a23efd25-e0bf-4c68-ad1c-931d4731015c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:51:20.040594 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57d016f8-7380-4134-a45e-5a581435f0e7 tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c" status: 404 len: 111 microversion: 2.1 time: 0.046882 Oct 27 10:51:20.041755 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3362/6526] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:19 2022] GET /compute/v2.1/servers/a23efd25-e0bf-4c68-ad1c-931d4731015c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:51:20.768493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:20.780378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:20.797117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:20.798939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:20.799624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:20.804104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:20.804836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:20.805635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:20.844986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:20.845754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:20.846354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:20.846971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lazy-loading 'fault' on Instance uuid 83b793bd-5e88-4400-9755-5f3bd8ec3736 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:51:21.084208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:21.091842 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6481fb5b-c717-4cd4-a3a0-bbefc66bd77c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 200 len: 1184 microversion: 2.1 time: 0.333010 Oct 27 10:51:21.105280 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3165/6527] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:20 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 1184 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:22.115871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:22.117428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:22.132419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:22.137580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:22.138200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:22.139255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:22.139888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:22.140697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:22.191717 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 HTTP/1.1 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '83b793bd-5e88-4400-9755-5f3bd8ec3736'} Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:51:22.193467 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56adbe19-33bb-43cd-9a86-1daa5a9c6687 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 404 len: 111 microversion: 2.1 time: 0.083196 Oct 27 10:51:22.198982 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3363/6528] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:22 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:51:22.532867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-962013958", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1830090047", "security_groups": [{"name": "tempest-secgroup-smoke-2129446865"}], "block_device_mapping_v2": [{"uuid": "14d31458-b27c-436b-bf53-9741d57a4cd2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0264043c-59ac-40f6-8b89-4caf5f646c28"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:22.794374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] validate_networks() for [('0264043c-59ac-40f6-8b89-4caf5f646c28', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:51:23.479805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:51:23.480528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:51:23.481200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:51:23.482036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:51:23.482456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:51:23.510728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:23.511540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:23.512158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:23.513261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:23.514292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:23.515054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:23.540015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:51:23.547804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for user 6e16c7669eb34fa49714040f728210e4 and project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:51:23.705846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:51:23.708063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14d31458-b27c-436b-bf53-9741d57a4cd2',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:51:24.050048 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-946b68d6-f7f0-41c7-9dee-05883d1acd9a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.518570 Oct 27 10:51:24.051755 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3166/6529] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:51:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:51:24.064040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cec2bfed-aee2-4a62-b5a3-821012a2f95b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:24.066166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cec2bfed-aee2-4a62-b5a3-821012a2f95b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:24.193925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cec2bfed-aee2-4a62-b5a3-821012a2f95b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:24.220380 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cec2bfed-aee2-4a62-b5a3-821012a2f95b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1094 microversion: 2.1 time: 0.160297 Oct 27 10:51:24.224604 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3364/6530] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:24 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1094 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:25.257607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:25.258331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8243d6f6-b71f-40cd-a065-1d8fc9ed4feb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] Calling method '.version_select at 0x7f6d5b45b4c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:25.258786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:25.267773 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8243d6f6-b71f-40cd-a065-1d8fc9ed4feb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:51:25.295110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:25.295936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:25.297685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:25.300141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:25.301903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:25.303154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:25.398416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:25.410238 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5f98fd6-c3cd-43cb-a20b-bf3af9f8975f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1136 microversion: 2.1 time: 0.165435 Oct 27 10:51:25.412440 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3365/6531] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:25 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1136 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:25.882047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86a130d3-798e-4a81-8747-94e4ad700674 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:25.884565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-86a130d3-798e-4a81-8747-94e4ad700674 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:25.891305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86a130d3-798e-4a81-8747-94e4ad700674 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:25.891968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86a130d3-798e-4a81-8747-94e4ad700674 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:25.892525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86a130d3-798e-4a81-8747-94e4ad700674 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:25.893374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86a130d3-798e-4a81-8747-94e4ad700674 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:25.893951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86a130d3-798e-4a81-8747-94e4ad700674 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:25.894499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86a130d3-798e-4a81-8747-94e4ad700674 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:25.975042 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-86a130d3-798e-4a81-8747-94e4ad700674 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "POST /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a/action" status: 200 len: 24572 microversion: 2.1 time: 0.095902 Oct 27 10:51:25.982934 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3366/6532] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:51:25 2022] POST /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a/action => generated 24572 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:51:26.275796 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-8243d6f6-b71f-40cd-a065-1d8fc9ed4feb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 43530. Oct 27 10:51:26.316185 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8243d6f6-b71f-40cd-a065-1d8fc9ed4feb tempest-TestNetworkAdvancedServerOps-1627469587 tempest-TestNetworkAdvancedServerOps-1627469587-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-273150886" status: 202 len: 0 microversion: 2.1 time: 1.104954 Oct 27 10:51:26.317111 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3167/6533] 10.222.0.76 () {58 vars in 1281 bytes} [Thu Oct 27 10:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-273150886 => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:51:26.435926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:26.436470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:26.459166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:26.459665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:26.460131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:26.461593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:26.463702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:26.465067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:26.732296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:26.747101 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cfc702a9-e50d-40ed-bb08-6f50f0a2a244 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1210 microversion: 2.1 time: 0.315276 Oct 27 10:51:26.749669 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3367/6534] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:26 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1210 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:27.770804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:27.772502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:27.785800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:27.789268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:27.789723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:27.790565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:27.790958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:27.791307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:28.075116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:28.088016 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fdb0136e-be6e-4525-9438-259ca94df8d7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1278 microversion: 2.1 time: 0.321398 Oct 27 10:51:28.089482 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3168/6535] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:27 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1278 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:51:28.275259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-fabc74ca-2ab8-436f-96a7-410a85c08641 req-18048dc9-3193-44a3-aece-d60138a4552b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e02ca22-f27a-44d7-af7f-c0cc31bd9990", "tag": "0e73757f-0146-4199-ae95-89112a1508b7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:28.303180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fabc74ca-2ab8-436f-96a7-410a85c08641 req-18048dc9-3193-44a3-aece-d60138a4552b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:28.308549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fabc74ca-2ab8-436f-96a7-410a85c08641 req-18048dc9-3193-44a3-aece-d60138a4552b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:28.312595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fabc74ca-2ab8-436f-96a7-410a85c08641 req-18048dc9-3193-44a3-aece-d60138a4552b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:28.364552 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-fabc74ca-2ab8-436f-96a7-410a85c08641 req-18048dc9-3193-44a3-aece-d60138a4552b service nova] Creating event network-changed:0e73757f-0146-4199-ae95-89112a1508b7 for instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 on n-h1-854663-10 Oct 27 10:51:28.386167 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-fabc74ca-2ab8-436f-96a7-410a85c08641 req-18048dc9-3193-44a3-aece-d60138a4552b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114788 Oct 27 10:51:28.387379 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3368/6536] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:29.114691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:29.115550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:29.145375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:29.145875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:29.146432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:29.147243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:29.147696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:29.148132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:29.510685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:29.521651 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07af0c40-4019-4266-bd18-48723614d087 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1278 microversion: 2.1 time: 0.410658 Oct 27 10:51:29.528996 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3169/6537] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:29 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1278 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:30.553525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:30.554842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:30.566909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:30.567587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:30.568308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:30.569232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:30.569858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:30.570455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:30.782151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:30.794401 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79ab1961-6c12-4ddd-9a35-68463a1ec210 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1278 microversion: 2.1 time: 0.245446 Oct 27 10:51:30.795509 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3369/6538] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:30 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:31.820999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:31.822568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:31.831001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:31.831808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:31.832521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:31.833592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:31.834456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:31.835156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:31.920464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b1e814b-bf03-4af9-8d24-5815cc91f846 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Action: 'create', calling method: .version_select at 0x7f6d5b417f70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1603030126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6hCVH8/M3Xn7GEl61YujYubUvm/2w0nPtJ+GpaM4sZNxfiM308julCSIO6+dtstivyOGkZ29SE2YY6+dyC3lXH8ZRXzoT0ju+dxzOwjAraJT5FlKGspUQpRErgfZwjsw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:31.938351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4b1e814b-bf03-4af9-8d24-5815cc91f846 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Getting quotas for project a2a2944bf6014b8daf9895dbfdb0429d. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:51:31.945536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-4b1e814b-bf03-4af9-8d24-5815cc91f846 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Getting quotas for user d0bd2f924e784237a8b036625c5c6cb3 and project a2a2944bf6014b8daf9895dbfdb0429d. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:51:31.985444 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b1e814b-bf03-4af9-8d24-5815cc91f846 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.258568 Oct 27 10:51:31.986642 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3170/6539] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:51:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:32.034194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:32.045087 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-316c0735-db62-4046-ac8b-365b7a49cb72 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1278 microversion: 2.1 time: 0.228999 Oct 27 10:51:32.056752 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3370/6540] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:31 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:51:33.073232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:33.074427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:33.086348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:33.087274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:33.087940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:33.089086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:33.089768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:33.090267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:33.377086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:33.396805 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d93862b1-93cd-4072-9bb8-9c5daa102f2b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1278 microversion: 2.1 time: 0.328658 Oct 27 10:51:33.412931 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3171/6541] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:33 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1278 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:34.424093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:34.426393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:34.436706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:34.456703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:34.457245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:34.457703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:34.460291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:34.460818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:34.461274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:34.847909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:34.858166 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65d13ce9-d436-499c-8320-315bbf6b14da tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1266 microversion: 2.1 time: 0.440554 Oct 27 10:51:34.863099 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3371/6542] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:34 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1266 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:35.881881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:35.882507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:35.884574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:35.901124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:35.901617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:35.902059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:35.902772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:35.903235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:35.903662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:36.231938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:36.245202 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6d5a40a6-5b60-4741-907b-1583176fca67 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1266 microversion: 2.1 time: 0.363353 Oct 27 10:51:36.246278 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3172/6543] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:35 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:37.277616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:37.279891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:37.293006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:37.293630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:37.294991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:37.304171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:37.305028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:37.305600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:37.777383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:37.789092 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2307a954-01f5-4d1a-be67-66906ac820aa tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1266 microversion: 2.1 time: 0.515740 Oct 27 10:51:37.811410 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3372/6544] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:37 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1266 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:38.816071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:38.817512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:38.863631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:38.864571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:38.866024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:38.868099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:38.868896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:38.869594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:39.078762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67796346-6011-465b-b506-6efa4a877cd2 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Action: 'create', calling method: .version_select at 0x7f6d5a1b40d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1994902767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0FLvjKPY3McKhfgdod4m9grjTUufBTZcX7S/pU2sOwR3KCYl1Vr3HQcEH03Fom04KxrcEYXURdt+9JSxNSGC26FCECexQjSt2zeHn7bhWGP9jEChleXTW5cm1RrIaoXg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:39.125557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-67796346-6011-465b-b506-6efa4a877cd2 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:51:39.148232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-67796346-6011-465b-b506-6efa4a877cd2 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for user c6f77e88f7c148a7996cb6ccabd9f64f and project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:51:39.220182 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67796346-6011-465b-b506-6efa4a877cd2 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.146616 Oct 27 10:51:39.221518 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3373/6545] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:51:39 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:40.135300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:40.150625 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b74b030d-4c91-4e00-bf67-e2c9f2cb09d5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1266 microversion: 2.1 time: 1.338934 Oct 27 10:51:40.172108 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3173/6546] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:38 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1266 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:41.116127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-599453970-access_point-1750772407", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "e5140438-a232-43e2-925d-e723ab338b0e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1603030126", "security_groups": [{"name": "tempest-secgroup_access--2031972489"}, {"name": "tempest-secgroup_general--1961368237"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:41.199742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:41.201024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:41.233940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:41.234796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:41.238268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:41.239289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:41.241719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:41.248521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:41.653275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] validate_networks() for [('e5140438-a232-43e2-925d-e723ab338b0e', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:51:41.799019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:41.824476 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8daf8b3-dedb-4fd9-b0d3-96098e941c38 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1266 microversion: 2.1 time: 0.629377 Oct 27 10:51:41.825975 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3174/6547] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:41 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1266 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:41.846093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1373876817", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "b6e93e74-a056-4d83-bace-ba402b219fa5"}], "key_name": "tempest-TestNetworkBasicOps-1994902767", "security_groups": [{"name": "tempest-secgroup-smoke-1245797513"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:41.954672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:42.098554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] validate_networks() for [('b6e93e74-a056-4d83-bace-ba402b219fa5', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:51:42.877561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:51:42.878612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:51:42.879111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:51:42.879560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:51:42.880016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:51:42.904524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:42.904986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:42.905585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:42.906438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:42.913182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:42.914874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:42.953999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Getting quotas for project a2a2944bf6014b8daf9895dbfdb0429d. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:51:42.969169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Getting quotas for user d0bd2f924e784237a8b036625c5c6cb3 and project a2a2944bf6014b8daf9895dbfdb0429d. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:51:42.986851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:51:42.990851 n-d-854663-10 devstack@n-api.service[120720]: WARNING nova.utils [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-599453970-access_point-1750772407 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-599453970-acc Oct 27 10:51:42.996309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:51:43.107516 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44d8b283-c426-430f-8b56-31b1b8058511 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.996656 Oct 27 10:51:43.108787 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3374/6548] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:51:41 2022] POST /compute/v2.1/servers => generated 458 bytes in 1999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:51:43.113606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:43.114237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:43.148283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:43.149326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:43.151319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:43.154293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:43.154995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:43.161476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:43.347483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:51:43.347973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:51:43.348376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:51:43.348892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:51:43.349825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:51:43.369228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:43.375228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:43.375913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:43.376994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:43.377639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:43.378240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:43.437250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:51:43.449945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for user c6f77e88f7c148a7996cb6ccabd9f64f and project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:51:43.494605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:51:43.528454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:51:43.562774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:43.592011 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a85e82dd-e539-43c1-af88-727f5aa47d4c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1266 microversion: 2.1 time: 0.467116 Oct 27 10:51:43.622542 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3375/6549] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:43 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1266 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:43.640441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3583646-6c08-4c3a-947f-213b57645b82 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:43.643420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3583646-6c08-4c3a-947f-213b57645b82 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:43.701771 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50583dd0-3519-49d7-936f-533ac2c0045e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.873391 Oct 27 10:51:43.706428 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3175/6550] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:51:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:51:43.727434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2208b9fc-7fd2-4602-a9e9-26bd8450d2e9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:43.728346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2208b9fc-7fd2-4602-a9e9-26bd8450d2e9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:43.748802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3583646-6c08-4c3a-947f-213b57645b82 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:43.768167 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3583646-6c08-4c3a-947f-213b57645b82 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1294 microversion: 2.1 time: 0.141556 Oct 27 10:51:43.770378 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3376/6551] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:43 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1294 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:43.909016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2208b9fc-7fd2-4602-a9e9-26bd8450d2e9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:43.919362 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2208b9fc-7fd2-4602-a9e9-26bd8450d2e9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1249 microversion: 2.1 time: 0.196081 Oct 27 10:51:43.935497 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3176/6552] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:43 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1249 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:44.642158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:44.642970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:44.655193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:44.663325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:44.663805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:44.664600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:44.665110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:44.667914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:44.791843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:44.792554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:44.812920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:44.813848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:44.814831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:44.815797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:44.818423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:44.819053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:45.034438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:45.044242 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83720b96-362e-40c9-bfd7-4e592e47ce5e tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1346 microversion: 2.1 time: 0.256236 Oct 27 10:51:45.066966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3177/6553] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:44 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1346 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:51:45.073556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:45.074582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:45.082557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:45.083457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:45.084353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:45.086150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:45.086962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:45.087757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:45.110562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:45.121439 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c423f75-8a04-4c5e-a4a6-02fcd1846eb4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1266 microversion: 2.1 time: 0.505127 Oct 27 10:51:45.122042 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3377/6554] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:44 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1266 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:45.237947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:45.253533 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb36d374-1001-409d-ada7-2d3b7bb3a652 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1245 microversion: 2.1 time: 0.183593 Oct 27 10:51:45.254292 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3178/6555] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:45 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1245 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:45.288514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-39d10332-d194-46e7-af67-5b62b27c2996 req-3c3ec541-0d83-46ee-8d09-48a2bde207f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e02ca22-f27a-44d7-af7f-c0cc31bd9990", "name": "network-vif-plugged", "status": "completed", "tag": "0e73757f-0146-4199-ae95-89112a1508b7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:45.310359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-39d10332-d194-46e7-af67-5b62b27c2996 req-3c3ec541-0d83-46ee-8d09-48a2bde207f2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:45.310775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-39d10332-d194-46e7-af67-5b62b27c2996 req-3c3ec541-0d83-46ee-8d09-48a2bde207f2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:45.311447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-39d10332-d194-46e7-af67-5b62b27c2996 req-3c3ec541-0d83-46ee-8d09-48a2bde207f2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:45.336762 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-39d10332-d194-46e7-af67-5b62b27c2996 req-3c3ec541-0d83-46ee-8d09-48a2bde207f2 service nova] Creating event network-vif-plugged:0e73757f-0146-4199-ae95-89112a1508b7 for instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 on n-h1-854663-10 Oct 27 10:51:45.353988 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-39d10332-d194-46e7-af67-5b62b27c2996 req-3c3ec541-0d83-46ee-8d09-48a2bde207f2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230373 Oct 27 10:51:45.355190 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3378/6556] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:46.073789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:46.074609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:46.085558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:46.087043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:46.089080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:46.090464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:46.092165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:46.093181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:46.148554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:46.149285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:46.170933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:46.173058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:46.176567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:46.178165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:46.178695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:46.183073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:46.243160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:46.252899 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1c58755-4ba2-4ce0-ad2b-76d52c9d0565 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1352 microversion: 2.1 time: 0.183455 Oct 27 10:51:46.256569 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3179/6557] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:46 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1352 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:46.289927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:46.290192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:46.299030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:46.299876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:46.300535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:46.301486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:46.302451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:46.303600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:46.436956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:46.465054 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-48fb8c8b-6aef-4ae6-a4dc-5d2d696f069f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1307 microversion: 2.1 time: 0.181380 Oct 27 10:51:46.480687 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3180/6558] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:46 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:46.533631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:46.548298 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78d52b04-35e6-4168-93bd-92612074b43b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1266 microversion: 2.1 time: 0.404427 Oct 27 10:51:46.549964 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3379/6559] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:46 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:47.279293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:47.279966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:47.292381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:47.292903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:47.293342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:47.294165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:47.294488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:47.294909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:47.501747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:47.505447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:47.508772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:47.532391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:47.545123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:47.546003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:47.547058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:47.547772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:47.548546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:47.692703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:47.722865 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e3a0b1e-7462-4a26-bdd9-c4da312ccb00 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1307 microversion: 2.1 time: 0.224901 Oct 27 10:51:47.751887 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3380/6560] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:47 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:47.759855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:47.763908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:47.767060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:47.774998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:47.775800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:47.776866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:47.778204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:47.779118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:47.779787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:47.793689 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4465efee-0d07-4a35-b5f7-f2b3ce48f202 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1472 microversion: 2.1 time: 0.518414 Oct 27 10:51:47.794304 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3181/6561] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:47 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1472 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:48.048241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:48.059885 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5ef6560-3c53-4580-b676-1453f8d6fee8 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1453 microversion: 2.1 time: 0.306267 Oct 27 10:51:48.061276 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3381/6562] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:47 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1453 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:48.087628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:48.089940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:48.101555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:48.102365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:48.103553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:48.104745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:48.105387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:48.106092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:48.326635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-26608761-3358-47f4-a8ac-95bdd760e560 req-778fab29-63b6-484e-bb97-b7df86874879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ee005a-5e92-428b-a95f-7543de3ed710", "tag": "33d2da7c-f167-4b74-89ff-6cd6d9da88ec"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:48.342256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-26608761-3358-47f4-a8ac-95bdd760e560 req-778fab29-63b6-484e-bb97-b7df86874879 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:48.342746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-26608761-3358-47f4-a8ac-95bdd760e560 req-778fab29-63b6-484e-bb97-b7df86874879 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:48.345112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-26608761-3358-47f4-a8ac-95bdd760e560 req-778fab29-63b6-484e-bb97-b7df86874879 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:48.365150 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-26608761-3358-47f4-a8ac-95bdd760e560 req-778fab29-63b6-484e-bb97-b7df86874879 service nova] Creating event network-changed:33d2da7c-f167-4b74-89ff-6cd6d9da88ec for instance 30ee005a-5e92-428b-a95f-7543de3ed710 on n-h2-854663-10 Oct 27 10:51:48.372138 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-26608761-3358-47f4-a8ac-95bdd760e560 req-778fab29-63b6-484e-bb97-b7df86874879 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050559 Oct 27 10:51:48.373661 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3382/6563] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:48.394977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:48.403518 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-918eacd1-d2e6-4bbd-b602-1af38a408b26 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1453 microversion: 2.1 time: 0.321537 Oct 27 10:51:48.417475 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3182/6564] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:48 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1453 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:48.757048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:48.757794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:48.770606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:48.773044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:48.777269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:48.778075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:48.778903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:48.779014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:48.823997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:48.825214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:48.835719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:48.836317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:48.838143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:48.840710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:48.841457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:48.849641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:49.174580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:49.177996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:49.185839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78e7a4dd-8cc0-43d5-8f34-8583d9410700 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1472 microversion: 2.1 time: 0.365635 Oct 27 10:51:49.186199 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-493cf20c-95cf-442d-86bc-2ba6af78d156 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1375 microversion: 2.1 time: 0.435485 Oct 27 10:51:49.187284 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3383/6565] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:48 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1375 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:49.190367 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3183/6566] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:48 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:51:49.214969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c5a300e9-d1a8-4b12-9c37-7ae2852392e2 req-ac6676f3-5c7c-4443-ab8e-a9b8e773206e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cdc1ca9-5724-409c-aa97-2763e787657b", "tag": "b6c250cf-57a7-49a2-8692-5e641ebd219e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:49.225688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a300e9-d1a8-4b12-9c37-7ae2852392e2 req-ac6676f3-5c7c-4443-ab8e-a9b8e773206e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:49.226471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a300e9-d1a8-4b12-9c37-7ae2852392e2 req-ac6676f3-5c7c-4443-ab8e-a9b8e773206e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:49.227615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a300e9-d1a8-4b12-9c37-7ae2852392e2 req-ac6676f3-5c7c-4443-ab8e-a9b8e773206e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:49.240190 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c5a300e9-d1a8-4b12-9c37-7ae2852392e2 req-ac6676f3-5c7c-4443-ab8e-a9b8e773206e service nova] Creating event network-changed:b6c250cf-57a7-49a2-8692-5e641ebd219e for instance 3cdc1ca9-5724-409c-aa97-2763e787657b on n-h2-854663-10 Oct 27 10:51:49.246749 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c5a300e9-d1a8-4b12-9c37-7ae2852392e2 req-ac6676f3-5c7c-4443-ab8e-a9b8e773206e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058021 Oct 27 10:51:49.248609 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3384/6567] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:50.214265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:50.217483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:50.218561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:50.219546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:50.231192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:50.234253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:50.235986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:50.236756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:50.238310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:50.238310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:50.239019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:50.239965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:50.240375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:50.241580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:50.241856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:50.242456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:50.243120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:50.301212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:51.137449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:51.149255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:51.154913 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71067b1f-ffe8-462e-8aca-14950cd9a459 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1375 microversion: 2.1 time: 0.948240 Oct 27 10:51:51.168410 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3184/6568] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:50 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1375 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:51.178401 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c2a6981-6cfb-4574-8327-a889bc078b20 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1472 microversion: 2.1 time: 0.967854 Oct 27 10:51:51.180612 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3385/6569] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:50 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1472 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:51.446273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-374f99c3-4245-44d2-928d-f1e3fb69a040 req-f569b414-8762-4170-8edf-6aef07a142d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e02ca22-f27a-44d7-af7f-c0cc31bd9990", "tag": "0e73757f-0146-4199-ae95-89112a1508b7"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:51.458995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-374f99c3-4245-44d2-928d-f1e3fb69a040 req-f569b414-8762-4170-8edf-6aef07a142d3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:51.459500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-374f99c3-4245-44d2-928d-f1e3fb69a040 req-f569b414-8762-4170-8edf-6aef07a142d3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:51.459978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-374f99c3-4245-44d2-928d-f1e3fb69a040 req-f569b414-8762-4170-8edf-6aef07a142d3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:51.473199 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-374f99c3-4245-44d2-928d-f1e3fb69a040 req-f569b414-8762-4170-8edf-6aef07a142d3 service nova] Creating event network-changed:0e73757f-0146-4199-ae95-89112a1508b7 for instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 on n-h1-854663-10 Oct 27 10:51:51.479492 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-374f99c3-4245-44d2-928d-f1e3fb69a040 req-f569b414-8762-4170-8edf-6aef07a142d3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038692 Oct 27 10:51:51.480108 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3185/6570] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:52.188146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:52.189930 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:52.200054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:52.200573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:52.201077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:52.201818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:52.202295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:52.202747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:52.204574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:52.205842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:52.206047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:52.215230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:52.215489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:52.216163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:52.217277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:52.219020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:52.219662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:52.458971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:52.477976 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3577f007-267e-479f-a6ff-ab4d08652fda tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1472 microversion: 2.1 time: 0.277892 Oct 27 10:51:52.479728 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3186/6571] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:52 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:51:52.496183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:52.507101 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94d7dead-b837-49bb-ace1-0d9c62e51f6f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1375 microversion: 2.1 time: 0.331201 Oct 27 10:51:52.507705 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3386/6572] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:52 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1375 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:53.502397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:53.503083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:53.505632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:53.515759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:53.516673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:53.517450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:53.518600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:53.519287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:53.519930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:53.533009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:53.534604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:53.536865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:53.549530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:53.550360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:53.550979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:53.551945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:53.552454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:53.553255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:53.761383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:53.873447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:53.883163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:53.889055 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b25dafb7-24e7-4fb2-9e84-c2d078c84c60 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1472 microversion: 2.1 time: 0.390999 Oct 27 10:51:53.889680 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3187/6573] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:53 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1472 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:53.896396 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29188b5a-21e4-4ac7-bb14-f61bd814199a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1375 microversion: 2.1 time: 0.368587 Oct 27 10:51:53.897813 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3387/6574] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:53 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1375 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:54.912977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:54.913550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:54.919438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:54.920239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:54.925527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:51:54.928606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:54.929695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:54.930151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:54.930936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:54.931402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:54.931836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:54.948400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:54.949484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:54.950039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:54.950890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:54.951612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:54.952259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:55.168896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:55.182021 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cab6e420-bb4d-4391-9e59-852e5d5082a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1375 microversion: 2.1 time: 0.266351 Oct 27 10:51:55.182751 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3388/6575] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:54 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1375 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:51:55.254328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:55.266633 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4bc88a94-27b8-4e32-b20a-a2b0a095c3e9 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1472 microversion: 2.1 time: 0.358850 Oct 27 10:51:55.274918 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3188/6576] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:54 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:55.518943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-170adca0-c028-402c-b265-450468addd29 req-857647b5-ae11-433c-a0be-413b6866ebb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ee005a-5e92-428b-a95f-7543de3ed710", "name": "network-vif-plugged", "status": "completed", "tag": "33d2da7c-f167-4b74-89ff-6cd6d9da88ec"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:55.531523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-170adca0-c028-402c-b265-450468addd29 req-857647b5-ae11-433c-a0be-413b6866ebb4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:55.532032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-170adca0-c028-402c-b265-450468addd29 req-857647b5-ae11-433c-a0be-413b6866ebb4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:55.532505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-170adca0-c028-402c-b265-450468addd29 req-857647b5-ae11-433c-a0be-413b6866ebb4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:55.551407 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-170adca0-c028-402c-b265-450468addd29 req-857647b5-ae11-433c-a0be-413b6866ebb4 service nova] Creating event network-vif-plugged:33d2da7c-f167-4b74-89ff-6cd6d9da88ec for instance 30ee005a-5e92-428b-a95f-7543de3ed710 on n-h2-854663-10 Oct 27 10:51:55.561877 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-170adca0-c028-402c-b265-450468addd29 req-857647b5-ae11-433c-a0be-413b6866ebb4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046372 Oct 27 10:51:55.563470 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3389/6577] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:56.205890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:56.206526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:56.214599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:56.215118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:56.217040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:56.217788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:56.218295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:56.218752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:56.294230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:56.295003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:56.308432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:56.309031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:56.309762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:56.310703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:56.311505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:56.312042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:56.441711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:56.451037 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb42295e-98fa-4ff7-adca-07e1a643500a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1375 microversion: 2.1 time: 0.249033 Oct 27 10:51:56.451648 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3189/6578] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:56 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1375 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:56.528922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:56.539567 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f35d7fe-0bc8-4623-8574-7d38354ed939 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1472 microversion: 2.1 time: 0.250829 Oct 27 10:51:56.540681 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3390/6579] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:56 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:57.475065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:57.476476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:57.483437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:57.484929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:57.485378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:57.486110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:57.486570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:57.486991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:57.563631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:57.564268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:57.572028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:57.572868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:57.573586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:57.574558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:57.575282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:57.575967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:57.704550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:57.718696 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16868e1a-e22d-4e2e-a8bd-fc886da7bbba tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1375 microversion: 2.1 time: 0.246836 Oct 27 10:51:57.732812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3190/6580] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:57 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1375 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:57.754307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6998d704-e6ac-498b-b988-3760cb49f730 req-671991c7-0ddd-4426-9161-ee061ce69b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdc1ca9-5724-409c-aa97-2763e787657b", "name": "network-vif-plugged", "status": "completed", "tag": "b6c250cf-57a7-49a2-8692-5e641ebd219e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:51:57.769282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6998d704-e6ac-498b-b988-3760cb49f730 req-671991c7-0ddd-4426-9161-ee061ce69b2a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:57.770561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6998d704-e6ac-498b-b988-3760cb49f730 req-671991c7-0ddd-4426-9161-ee061ce69b2a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:57.772203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6998d704-e6ac-498b-b988-3760cb49f730 req-671991c7-0ddd-4426-9161-ee061ce69b2a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:57.787001 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6998d704-e6ac-498b-b988-3760cb49f730 req-671991c7-0ddd-4426-9161-ee061ce69b2a service nova] Creating event network-vif-plugged:b6c250cf-57a7-49a2-8692-5e641ebd219e for instance 3cdc1ca9-5724-409c-aa97-2763e787657b on n-h2-854663-10 Oct 27 10:51:57.793446 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6998d704-e6ac-498b-b988-3760cb49f730 req-671991c7-0ddd-4426-9161-ee061ce69b2a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059021 Oct 27 10:51:57.794372 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3191/6581] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:51:57.833023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:57.851796 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a83a5ad-9b12-4161-9213-40625fc77ab7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1644 microversion: 2.1 time: 0.291289 Oct 27 10:51:57.852552 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3391/6582] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:57 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1644 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:57.879799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:57.880779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:57.892859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:57.893543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:57.894028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:57.894785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:57.895475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:57.895984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:58.124854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:58.134846 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3de3ec7a-6096-4566-ab91-6debd2631521 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1644 microversion: 2.1 time: 0.260555 Oct 27 10:51:58.135645 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3192/6583] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:57 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1644 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:58.158388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5cde865-8fc3-43f7-9fe2-9d023c842444 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:58.159091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5cde865-8fc3-43f7-9fe2-9d023c842444 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:58.165792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5cde865-8fc3-43f7-9fe2-9d023c842444 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:58.166305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5cde865-8fc3-43f7-9fe2-9d023c842444 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:58.166819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5cde865-8fc3-43f7-9fe2-9d023c842444 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:58.167610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5cde865-8fc3-43f7-9fe2-9d023c842444 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:58.168105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5cde865-8fc3-43f7-9fe2-9d023c842444 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:58.168549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5cde865-8fc3-43f7-9fe2-9d023c842444 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:58.448942 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5cde865-8fc3-43f7-9fe2-9d023c842444 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1797 microversion: 2.1 time: 0.294589 Oct 27 10:51:58.449788 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3392/6584] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:58 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1797 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:51:58.748682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:51:58.749322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:51:58.759997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:58.760588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:58.761531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:58.762927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:51:58.763546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:51:58.765505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:51:59.030692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:51:59.039750 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00284ce8-6f98-412e-ac3d-cb0ae0a64324 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1375 microversion: 2.1 time: 0.295302 Oct 27 10:51:59.071220 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3193/6585] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:51:58 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1375 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:00.064197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:00.065551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:00.076213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:00.076914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:00.077421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:00.078159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:00.078678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:00.079382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:00.348581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:00.360149 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-27197e6e-86ed-45f6-b0fd-f432b99f2a74 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1548 microversion: 2.1 time: 0.300217 Oct 27 10:52:00.372709 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3393/6586] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:00 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1548 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:00.385347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:00.386506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:00.394155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:00.394541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:00.394984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:00.395737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:00.401227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:00.402010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:00.934969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:00.945525 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-598d03a9-23cf-4d38-99e6-dd5cbf7955a9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1548 microversion: 2.1 time: 0.564115 Oct 27 10:52:00.946571 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3194/6587] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:00 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1548 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:01.160045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e7b61633-b748-47e4-ac05-19526e8084d4 req-36da68c6-6813-4255-9560-f71596bf76b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ee005a-5e92-428b-a95f-7543de3ed710", "tag": "33d2da7c-f167-4b74-89ff-6cd6d9da88ec"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:01.186421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e7b61633-b748-47e4-ac05-19526e8084d4 req-36da68c6-6813-4255-9560-f71596bf76b2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:01.191572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e7b61633-b748-47e4-ac05-19526e8084d4 req-36da68c6-6813-4255-9560-f71596bf76b2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:01.192291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e7b61633-b748-47e4-ac05-19526e8084d4 req-36da68c6-6813-4255-9560-f71596bf76b2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:01.221859 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e7b61633-b748-47e4-ac05-19526e8084d4 req-36da68c6-6813-4255-9560-f71596bf76b2 service nova] Creating event network-changed:33d2da7c-f167-4b74-89ff-6cd6d9da88ec for instance 30ee005a-5e92-428b-a95f-7543de3ed710 on n-h2-854663-10 Oct 27 10:52:01.258248 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e7b61633-b748-47e4-ac05-19526e8084d4 req-36da68c6-6813-4255-9560-f71596bf76b2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095462 Oct 27 10:52:01.258248 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3394/6588] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:25.252713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:25.259964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:25.287586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=21 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:25.291301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=57 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:25.300556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:25.303254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:25.304622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:25.305533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:25.309461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:25.311724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:25.353378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:52:25.501792 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-74595d89-6ce3-4ca8-af78-55533017484c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 204 len: 0 microversion: 2.1 time: 0.257128 Oct 27 10:52:25.506514 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3195/6589] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:52:25 2022] DELETE /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:52:25.510392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=29 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:25.511168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=45 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:25.515836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:25.516587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:25.525045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:25.525850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:25.526488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:25.527394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:25.528057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:25.528692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:25.780153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:25.792984 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca858904-ed88-426c-9f19-6e6cdb5cb7f3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1554 microversion: 2.1 time: 0.284386 Oct 27 10:52:25.793854 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3395/6590] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:25 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1554 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:26.821052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:26.822352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:26.831127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:26.831808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:26.835195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:26.836755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:26.837376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:26.837965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:27.279736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:27.292142 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7bc6fa5a-cc25-460c-ad7f-88b2aad5a0a5 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1554 microversion: 2.1 time: 0.475342 Oct 27 10:52:27.293664 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3196/6591] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:26 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1554 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:27.817811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1645ca5f-d4d5-4712-bc61-b7e4096410a0 req-a711e495-0248-45e1-9ebd-69c5675ec256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdc1ca9-5724-409c-aa97-2763e787657b", "name": "network-vif-deleted", "tag": "b6c250cf-57a7-49a2-8692-5e641ebd219e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:27.867770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1645ca5f-d4d5-4712-bc61-b7e4096410a0 req-a711e495-0248-45e1-9ebd-69c5675ec256 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:27.870981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1645ca5f-d4d5-4712-bc61-b7e4096410a0 req-a711e495-0248-45e1-9ebd-69c5675ec256 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:27.871477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1645ca5f-d4d5-4712-bc61-b7e4096410a0 req-a711e495-0248-45e1-9ebd-69c5675ec256 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:27.886493 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1645ca5f-d4d5-4712-bc61-b7e4096410a0 req-a711e495-0248-45e1-9ebd-69c5675ec256 service nova] Creating event network-vif-deleted:b6c250cf-57a7-49a2-8692-5e641ebd219e for instance 3cdc1ca9-5724-409c-aa97-2763e787657b on n-h2-854663-10 Oct 27 10:52:27.892890 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1645ca5f-d4d5-4712-bc61-b7e4096410a0 req-a711e495-0248-45e1-9ebd-69c5675ec256 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079667 Oct 27 10:52:27.894640 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3396/6592] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:28.318915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:28.319595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:28.339333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:28.340479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:28.341047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:28.342118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:28.342835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:28.343129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:28.385134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:28.385892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:28.386493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:28.387708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lazy-loading 'fault' on Instance uuid 3cdc1ca9-5724-409c-aa97-2763e787657b {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:52:28.838400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:28.847631 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9457801e-d05d-402f-ab49-b7a7fe091581 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 200 len: 1339 microversion: 2.1 time: 0.533734 Oct 27 10:52:28.848437 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3197/6593] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:28 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 1339 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:29.872927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:29.873664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 3cdc1ca9-5724-409c-aa97-2763e787657b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:29.882456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:29.882970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:29.883425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:29.884156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:29.884628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:29.885225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:29.899700 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] HTTP exception thrown: Instance 3cdc1ca9-5724-409c-aa97-2763e787657b could not be found. Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Request method failure captured: Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b HTTP/1.1 Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmJ-RTThY278alaGCdBtiELe7NhzIZ6wgx7g8XjObuaJWPjDxWjZNyLZF6UUZTIt3LvQzxarZsDM3qASrIiclUXLjHUrTq5xQnzBNJSUZfQ2CZN6dzen20JYc1I9DgxehDrc-AB6I-outdPyFMsXBWEBb6VutPE2dw2n22jXQGulwYQ Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3eae1c0a30cb4e4fa9c7d8f93f7bf210 Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestNetworkBasicOps-1969496053 Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3eae1c0a30cb4e4fa9c7d8f93f7bf210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3eae1c0a30cb4e4fa9c7d8f93f7bf210"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3eae1c0a30cb4e4fa9c7d8f93f7bf210", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3eae1c0a30cb4e4fa9c7d8f93f7bf210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestNetworkBasicOps-1969496053 Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3eae1c0a30cb4e4fa9c7d8f93f7bf210 Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestNetworkBasicOps-1969496053 Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestNetworkBasicOps-1969496053-project Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c6f77e88f7c148a7996cb6ccabd9f64f Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestNetworkBasicOps-1969496053-project Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 3cdc1ca9-5724-409c-aa97-2763e787657b could not be found. Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '3cdc1ca9-5724-409c-aa97-2763e787657b'} Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdc1ca9-5724-409c-aa97-2763e787657b could not be found. Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdc1ca9-5724-409c-aa97-2763e787657b could not be found. Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:52:29.901955 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:29.907750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:52:29.907750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:52:29.907750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:52:29.907750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:52:29.907750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:52:29.907750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdc1ca9-5724-409c-aa97-2763e787657b could not be found. Oct 27 10:52:29.907750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:29.909314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Returning 404 to user: Instance 3cdc1ca9-5724-409c-aa97-2763e787657b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:52:29.911782 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-307d5a28-1691-4938-87fa-ee3e4cb2f2a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b" status: 404 len: 111 microversion: 2.1 time: 0.043657 Oct 27 10:52:29.913494 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3397/6594] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:29 2022] GET /compute/v2.1/servers/3cdc1ca9-5724-409c-aa97-2763e787657b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:52:30.113945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e52f0732-7fb9-4d48-98e2-d84b36a044c0 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '.version_select at 0x7f6d5a1525e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:30.147109 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e52f0732-7fb9-4d48-98e2-d84b36a044c0 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1994902767" status: 202 len: 0 microversion: 2.1 time: 0.038009 Oct 27 10:52:30.148240 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3198/6595] 10.222.0.76 () {58 vars in 1257 bytes} [Thu Oct 27 10:52:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1994902767 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:52:32.499019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:32.499531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:32.502154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-269335a2-4c8c-4f6a-a2aa-f87e8926268f req-f84d26d1-d9ff-4683-9d55-e19f56f09de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8232e55-e23c-4c9d-9076-9ae160cd474a", "tag": "70f85b78-cab9-4e0e-add2-88e7876a4c0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:32.507737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:32.508243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:32.508920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:32.509657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:32.510552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:32.511004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:32.516852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-269335a2-4c8c-4f6a-a2aa-f87e8926268f req-f84d26d1-d9ff-4683-9d55-e19f56f09de4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:32.517437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-269335a2-4c8c-4f6a-a2aa-f87e8926268f req-f84d26d1-d9ff-4683-9d55-e19f56f09de4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:32.518094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-269335a2-4c8c-4f6a-a2aa-f87e8926268f req-f84d26d1-d9ff-4683-9d55-e19f56f09de4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:32.532383 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-269335a2-4c8c-4f6a-a2aa-f87e8926268f req-f84d26d1-d9ff-4683-9d55-e19f56f09de4 service nova] Creating event network-changed:70f85b78-cab9-4e0e-add2-88e7876a4c0b for instance a8232e55-e23c-4c9d-9076-9ae160cd474a on n-h2-854663-10 Oct 27 10:52:32.539789 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-269335a2-4c8c-4f6a-a2aa-f87e8926268f req-f84d26d1-d9ff-4683-9d55-e19f56f09de4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042352 Oct 27 10:52:32.540557 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3199/6596] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:52:32.553853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:52:32.652181 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-810a4034-85f1-4a1f-acdb-034a69857a16 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 204 len: 0 microversion: 2.1 time: 0.157255 Oct 27 10:52:32.653140 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3398/6597] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:52:32 2022] DELETE /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:52:32.665603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:32.666486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:32.679711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:32.681070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:32.681763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:32.683235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:32.683925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:32.685941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:32.865321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:32.875453 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e1147e2-a742-402a-a3d7-532506d66671 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1671 microversion: 2.1 time: 0.216742 Oct 27 10:52:32.876639 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3200/6598] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:32 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1671 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:33.901024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:33.901707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:33.909153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:33.909666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:33.910142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:33.910905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:33.911379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:33.911820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:34.162173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:34.183303 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-741fa2b3-e50a-407b-94e1-ebfb2339ee88 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 200 len: 1671 microversion: 2.1 time: 0.286944 Oct 27 10:52:34.190565 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3399/6599] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:33 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 1671 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:34.613916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6dd95d37-8b97-4519-8cf4-6d32b508a24f req-2eb3ec16-c0cf-4963-8b4f-2fa661a25fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8232e55-e23c-4c9d-9076-9ae160cd474a", "name": "network-vif-deleted", "tag": "70f85b78-cab9-4e0e-add2-88e7876a4c0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:34.629176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6dd95d37-8b97-4519-8cf4-6d32b508a24f req-2eb3ec16-c0cf-4963-8b4f-2fa661a25fcc service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:34.629826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6dd95d37-8b97-4519-8cf4-6d32b508a24f req-2eb3ec16-c0cf-4963-8b4f-2fa661a25fcc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:34.630382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6dd95d37-8b97-4519-8cf4-6d32b508a24f req-2eb3ec16-c0cf-4963-8b4f-2fa661a25fcc service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:34.651364 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6dd95d37-8b97-4519-8cf4-6d32b508a24f req-2eb3ec16-c0cf-4963-8b4f-2fa661a25fcc service nova] Creating event network-vif-deleted:70f85b78-cab9-4e0e-add2-88e7876a4c0b for instance a8232e55-e23c-4c9d-9076-9ae160cd474a on n-h2-854663-10 Oct 27 10:52:34.657520 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6dd95d37-8b97-4519-8cf4-6d32b508a24f req-2eb3ec16-c0cf-4963-8b4f-2fa661a25fcc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048090 Oct 27 10:52:34.658232 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3201/6600] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:35.209708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:35.211043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: a8232e55-e23c-4c9d-9076-9ae160cd474a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:35.220578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:35.221312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:35.221568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:35.222886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:35.223509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:35.224143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:35.241901 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] HTTP exception thrown: Instance a8232e55-e23c-4c9d-9076-9ae160cd474a could not be found. Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Request method failure captured: Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a HTTP/1.1 Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmJ-RTThY278alaGCdBtiELe7NhzIZ6wgx7g8XjObuaJWPjDxWjZNyLZF6UUZTIt3LvQzxarZsDM3qASrIiclUXLjHUrTq5xQnzBNJSUZfQ2CZN6dzen20JYc1I9DgxehDrc-AB6I-outdPyFMsXBWEBb6VutPE2dw2n22jXQGulwYQ Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3eae1c0a30cb4e4fa9c7d8f93f7bf210 Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestNetworkBasicOps-1969496053 Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3eae1c0a30cb4e4fa9c7d8f93f7bf210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3eae1c0a30cb4e4fa9c7d8f93f7bf210"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3eae1c0a30cb4e4fa9c7d8f93f7bf210", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3eae1c0a30cb4e4fa9c7d8f93f7bf210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestNetworkBasicOps-1969496053 Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3eae1c0a30cb4e4fa9c7d8f93f7bf210 Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestNetworkBasicOps-1969496053 Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestNetworkBasicOps-1969496053-project Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c6f77e88f7c148a7996cb6ccabd9f64f Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestNetworkBasicOps-1969496053-project Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance a8232e55-e23c-4c9d-9076-9ae160cd474a could not be found. Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a8232e55-e23c-4c9d-9076-9ae160cd474a'} Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8232e55-e23c-4c9d-9076-9ae160cd474a could not be found. Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8232e55-e23c-4c9d-9076-9ae160cd474a could not be found. Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:52:35.243685 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8232e55-e23c-4c9d-9076-9ae160cd474a could not be found. Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Returning 404 to user: Instance a8232e55-e23c-4c9d-9076-9ae160cd474a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-93ab2fd1-f058-4bdd-bb3d-0c04a1129193 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a" status: 404 len: 111 microversion: 2.1 time: 0.041519 Oct 27 10:52:35.252068 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3400/6601] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:35 2022] GET /compute/v2.1/servers/a8232e55-e23c-4c9d-9076-9ae160cd474a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:52:35.445757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa3d58d3-41da-4858-b945-246727f5d850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '.version_select at 0x7f6d5b2dc280>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:35.475119 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa3d58d3-41da-4858-b945-246727f5d850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1683787461" status: 202 len: 0 microversion: 2.1 time: 0.033445 Oct 27 10:52:35.480081 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3202/6602] 10.222.0.76 () {58 vars in 1257 bytes} [Thu Oct 27 10:52:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1683787461 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:52:37.395887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1859b9c8-3e18-446a-915f-a0b2a88881e7 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Action: 'create', calling method: .version_select at 0x7f6d59f20430>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1586343301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY+wSjcQVM8POR9qGTOo/en3DOWYJxB5WpCUSTnWdU+BluWfx2DNDkYK9/GJc/1HhdnCeRjg9hpPVsb2dUGmBJj0QhU2XaEuEc9FQgUj2udbio5FZTXc3qXQtYYlaM+/Q=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:37.425523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1859b9c8-3e18-446a-915f-a0b2a88881e7 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Getting quotas for project 1c1a737b28b04249ae4c03b66cab0d58. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:52:37.433504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1859b9c8-3e18-446a-915f-a0b2a88881e7 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Getting quotas for user 1785cf695fdd4d99b3b94a4ffeed2920 and project 1c1a737b28b04249ae4c03b66cab0d58. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:52:37.463945 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1859b9c8-3e18-446a-915f-a0b2a88881e7 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.074582 Oct 27 10:52:37.465338 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3401/6603] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:52:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:40.325848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-626344534", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "91c283b3-f804-4fc3-8f89-29cf23d17a9f", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1586343301", "security_groups": [{"name": "tempest-secgroup-smoke-1902840936"}], "networks": [{"uuid": "08eaed46-e0b5-4dfe-801a-0249cae6e0f2"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:40.632941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] validate_networks() for [('08eaed46-e0b5-4dfe-801a-0249cae6e0f2', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:52:41.326358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:52:41.326975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:52:41.327252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:52:41.327668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:52:41.328145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:52:41.343891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:41.344388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:41.344912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:41.345650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:41.346354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:41.346833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:41.375810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Getting quotas for project 1c1a737b28b04249ae4c03b66cab0d58. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:52:41.382932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Getting quotas for user 1785cf695fdd4d99b3b94a4ffeed2920 and project 1c1a737b28b04249ae4c03b66cab0d58. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:52:41.461743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:52:41.464218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91c283b3-f804-4fc3-8f89-29cf23d17a9f',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:52:41.621853 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-070f4306-a626-4e27-b835-eb7c21c35f52 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.301808 Oct 27 10:52:41.622626 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3203/6604] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:52:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:52:41.635617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-598c481e-6a7a-46d0-8205-1208b0c575da tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:41.636275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-598c481e-6a7a-46d0-8205-1208b0c575da tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:41.716042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-598c481e-6a7a-46d0-8205-1208b0c575da tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:41.727311 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-598c481e-6a7a-46d0-8205-1208b0c575da tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1098 microversion: 2.1 time: 0.096549 Oct 27 10:52:41.731965 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3402/6605] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:41 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1098 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:42.751968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:42.752704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:42.767108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:42.767914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:42.768585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:42.770032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:42.771223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:42.772735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:42.873058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:42.884254 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01460226-39e4-469f-a9e8-52fb928381bb tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1196 microversion: 2.1 time: 0.137693 Oct 27 10:52:42.891409 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3204/6606] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:42 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1196 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:43.910895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:43.911701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:43.919181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-816337416", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "c372bd8e-53b5-4ff5-affe-af6f0d4fc675"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1603030126", "security_groups": []}, "os:scheduler_hints": {"different_host": ["30ee005a-5e92-428b-a95f-7543de3ed710"]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:43.920641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:43.921772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:43.922434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:43.923338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:43.923951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:43.925060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:44.004091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:44.012561 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd3d5bc9-7fba-4807-8ffa-37b6c088df86 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1214 microversion: 2.1 time: 0.107505 Oct 27 10:52:44.013777 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3403/6607] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:43 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:44.039186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] validate_networks() for [('c372bd8e-53b5-4ff5-affe-af6f0d4fc675', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:52:44.611866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:52:44.613051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:52:44.613977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:52:44.614448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:52:44.615112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:52:44.643410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:44.645442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:44.646093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:44.654308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:44.655176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:44.656048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:44.697631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Getting quotas for project a2a2944bf6014b8daf9895dbfdb0429d. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:52:44.706544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Getting quotas for user d0bd2f924e784237a8b036625c5c6cb3 and project a2a2944bf6014b8daf9895dbfdb0429d. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:52:44.724315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:52:44.727740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:52:44.858095 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93d2fe81-46ba-4b6d-aca9-4359be2ca6a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.943571 Oct 27 10:52:44.862402 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3205/6608] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:52:43 2022] POST /compute/v2.1/servers => generated 361 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:52:44.876855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b50722e-aef5-4281-b0df-2d465a62de16 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:44.877971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b50722e-aef5-4281-b0df-2d465a62de16 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:45.037280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:45.037959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:45.064972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:45.071026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:45.071592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:45.076700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:45.077076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:45.077520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:45.355221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b50722e-aef5-4281-b0df-2d465a62de16 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:45.369011 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b50722e-aef5-4281-b0df-2d465a62de16 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1241 microversion: 2.1 time: 0.496192 Oct 27 10:52:45.369678 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3404/6609] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:44 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1241 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:45.837738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:45.856945 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c5a3031-6077-4833-8402-f4f42026e75d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1282 microversion: 2.1 time: 0.824716 Oct 27 10:52:45.858490 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3206/6610] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:45 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1282 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:52:46.394109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:46.406487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:46.424720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:46.426595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:46.428035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:46.429150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:46.429830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:46.430612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:46.766348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:46.782152 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2146af79-b7d9-462c-b5aa-5bfc36dec4c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1293 microversion: 2.1 time: 0.391069 Oct 27 10:52:46.784337 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3405/6611] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:46 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1293 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:46.880257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:46.880908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:46.902904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:46.903631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:46.904295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:46.905473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:46.906084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:46.909321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:47.162916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6cf46a9c-7ef6-4e22-adab-821099546352 req-69fdad4c-5354-4bf8-a9cf-27edef0b7ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281b6b2e-48b6-4abe-bfdb-62d693169db6", "tag": "a4fccb34-d1b2-4239-9da3-785f824ecff2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:47.180235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6cf46a9c-7ef6-4e22-adab-821099546352 req-69fdad4c-5354-4bf8-a9cf-27edef0b7ba3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:47.186720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6cf46a9c-7ef6-4e22-adab-821099546352 req-69fdad4c-5354-4bf8-a9cf-27edef0b7ba3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:47.189215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6cf46a9c-7ef6-4e22-adab-821099546352 req-69fdad4c-5354-4bf8-a9cf-27edef0b7ba3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:47.214902 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6cf46a9c-7ef6-4e22-adab-821099546352 req-69fdad4c-5354-4bf8-a9cf-27edef0b7ba3 service nova] Creating event network-changed:a4fccb34-d1b2-4239-9da3-785f824ecff2 for instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 on n-h1-854663-10 Oct 27 10:52:47.235044 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:47.237617 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6cf46a9c-7ef6-4e22-adab-821099546352 req-69fdad4c-5354-4bf8-a9cf-27edef0b7ba3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078879 Oct 27 10:52:47.238514 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3406/6612] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:52:47.246859 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff8444b2-8654-475d-a6e9-87fb0273d73c tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1282 microversion: 2.1 time: 0.370776 Oct 27 10:52:47.253068 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3207/6613] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:46 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1282 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:47.811662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:47.812485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:47.829490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:47.841087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:47.842008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:47.843029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:47.843749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:47.844731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:47.991582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:48.002849 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2031ca9-2a4b-45fb-b2d2-f0e121ca0f71 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1299 microversion: 2.1 time: 0.196569 Oct 27 10:52:48.025407 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3407/6614] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:47 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1299 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:48.276450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:48.277129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:48.293242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:48.293809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:48.294261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:48.297291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:48.300848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:48.302881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:48.795813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:48.816820 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54c5d7c7-aba5-499e-a115-7953be8fd6cf tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1282 microversion: 2.1 time: 0.544772 Oct 27 10:52:48.832688 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3208/6615] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:48 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1282 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:49.039798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:49.040431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:49.056384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:49.062726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:49.066148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:49.067138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:49.067640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:49.068097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:49.242236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:49.261238 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2c93183-ed1f-46d1-ad66-7885fb477c50 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1299 microversion: 2.1 time: 0.225166 Oct 27 10:52:49.261902 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3408/6616] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:49 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1299 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:49.852819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:49.853485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:49.872785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:49.873481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:49.873726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:49.874427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:49.874902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:49.875309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:50.289220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:50.290651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:50.317117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:50.317710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:50.318179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:50.320784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:50.321288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:50.324541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:50.709233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:50.722758 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92847d3f-e3b4-48b8-b336-6f25eda01d3d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1299 microversion: 2.1 time: 0.438310 Oct 27 10:52:50.723379 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3409/6617] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:50 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1299 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:52:50.754678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:50.788264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9a571b80-f6f3-498e-8a83-f20e1e542341 req-6ecd547b-f207-43f5-ab6d-51a903c2c0fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8354140-1052-4b19-a5ec-add699ad4470", "tag": "022e56bb-253b-4c2b-ba05-51daa6b8b591"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:50.794447 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-baf58ae2-4cc8-4222-b4cb-5d62efeaa99b tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1282 microversion: 2.1 time: 0.950628 Oct 27 10:52:50.815090 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3209/6618] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:49 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1282 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:50.821734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9a571b80-f6f3-498e-8a83-f20e1e542341 req-6ecd547b-f207-43f5-ab6d-51a903c2c0fa service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:50.821734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9a571b80-f6f3-498e-8a83-f20e1e542341 req-6ecd547b-f207-43f5-ab6d-51a903c2c0fa service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:50.822207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9a571b80-f6f3-498e-8a83-f20e1e542341 req-6ecd547b-f207-43f5-ab6d-51a903c2c0fa service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:50.850047 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9a571b80-f6f3-498e-8a83-f20e1e542341 req-6ecd547b-f207-43f5-ab6d-51a903c2c0fa service nova] Creating event network-changed:022e56bb-253b-4c2b-ba05-51daa6b8b591 for instance f8354140-1052-4b19-a5ec-add699ad4470 on n-h1-854663-10 Oct 27 10:52:50.862528 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9a571b80-f6f3-498e-8a83-f20e1e542341 req-6ecd547b-f207-43f5-ab6d-51a903c2c0fa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078251 Oct 27 10:52:50.863943 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3410/6619] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:51.744072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f3deb40-ba50-421f-adca-f35541155b3f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Action: 'create', calling method: .version_select at 0x7f6d63773790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-880852829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/w7J9v1yvySTdU9axf3AyTQZFW3FI3IqWyLrP5PSLc2HCPSnzt/1+Vfui27h+DWxVe03C6+/TM6PEiu0Qmu/OL4g2bx9cEsM/e6fhUuITui+eibyBatThn6mH2a7tu+Q=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:51.746443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:51.747710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:51.757293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:51.758005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:51.758652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:51.759808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:51.760647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:51.762629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:51.808231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6f3deb40-ba50-421f-adca-f35541155b3f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:52:51.826324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6f3deb40-ba50-421f-adca-f35541155b3f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for user c6f77e88f7c148a7996cb6ccabd9f64f and project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:52:51.859761 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f3deb40-ba50-421f-adca-f35541155b3f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.123643 Oct 27 10:52:51.860638 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3210/6620] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:52:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:51.865383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:51.866000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:51.895299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:51.896299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:51.898577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:51.899056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:51.900856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:51.901329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:51.901759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:51.906430 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae1f3398-d9bb-4699-b82b-078ca0da695a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1299 microversion: 2.1 time: 0.164203 Oct 27 10:52:51.907411 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3411/6621] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:51 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:52.079324 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:52.088565 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3cbd0c1-9683-4b5b-bef8-8e61dc20be99 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1282 microversion: 2.1 time: 0.226884 Oct 27 10:52:52.089391 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3211/6622] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:51 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1282 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:52.937342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:52.937975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:52.951220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:52.952170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:52.952948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:52.953850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:52.954572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:52.955242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:53.060997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:53.071465 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23853530-d2c6-481d-8f4a-6ef8b1dbd2a3 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1299 microversion: 2.1 time: 0.138131 Oct 27 10:52:53.072574 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3412/6623] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:52 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:53.111459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:53.112076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:53.124112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:53.124595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:53.125215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:53.125923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:53.126371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:53.126790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:53.138132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-577105524", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "ca753581-67b3-47b6-92e9-75b67a67669a"}], "key_name": "tempest-TestNetworkBasicOps-880852829", "security_groups": [{"name": "tempest-secgroup-smoke-1339775669"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:53.318751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] validate_networks() for [('ca753581-67b3-47b6-92e9-75b67a67669a', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:52:53.405244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:53.417493 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dafa8139-4fe4-463c-a42a-4b184ce3f839 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1270 microversion: 2.1 time: 0.309917 Oct 27 10:52:53.418609 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3212/6624] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:53 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1270 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:53.756185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:52:53.756626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:52:53.757149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:52:53.757574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:52:53.758137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:52:53.768108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:53.768987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:53.769443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:53.770120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:53.770592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:53.771160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:53.791967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:52:53.797551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Getting quotas for user c6f77e88f7c148a7996cb6ccabd9f64f and project 3eae1c0a30cb4e4fa9c7d8f93f7bf210. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:52:53.813100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:52:53.815555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:52:53.868016 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-060b4acc-59fb-4798-a536-00b38ad7657a tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733654 Oct 27 10:52:53.869127 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3413/6625] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:52:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:52:53.881081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4b2b3c6-3402-4c65-ac84-45581e065a56 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:53.882016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d4b2b3c6-3402-4c65-ac84-45581e065a56 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:53.955519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d4b2b3c6-3402-4c65-ac84-45581e065a56 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:53.971792 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d4b2b3c6-3402-4c65-ac84-45581e065a56 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1247 microversion: 2.1 time: 0.094863 Oct 27 10:52:53.981651 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3213/6626] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:53 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1247 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:54.102334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:54.103643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:54.116608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:54.117466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:54.118198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:54.119133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:54.119799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:54.120471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:54.252503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:54.262773 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-228aeb3b-9b12-4255-b9ed-6b40861e2d6d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1299 microversion: 2.1 time: 0.171035 Oct 27 10:52:54.277760 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3414/6627] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:54 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:54.441753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:54.443294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:54.452639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:54.453973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:54.454479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:54.455274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:54.455795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:54.456492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:54.623249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:54.642369 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4fb43e7-45fa-4f55-9c30-eff305fe8a0f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1270 microversion: 2.1 time: 0.205453 Oct 27 10:52:54.642963 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3214/6628] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:54 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:54.996123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:54.996757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:55.004290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:55.004836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:55.005281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:55.006048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:55.006520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:55.006956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:55.128032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:55.137439 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd6383eb-aa99-49b0-93ad-9b3b75696a81 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1299 microversion: 2.1 time: 0.145997 Oct 27 10:52:55.138037 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3415/6629] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:54 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:55.287861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:55.288482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:55.290526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:55.296064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:55.296558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:55.297051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:55.297744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:55.298198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:55.298623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:55.318307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:55.665597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:55.666345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:55.669613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:55.673648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:55.674131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:55.674801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:55.679379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:55.679880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:55.680508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:55.685674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:55.694131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:55.703643 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-808d93c5-d8b0-4bd7-9101-b4532567acbc tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1299 microversion: 2.1 time: 0.419952 Oct 27 10:52:55.704517 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3215/6630] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:55 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1299 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:55.937324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:55.946156 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f51d323b-da53-4e6d-8c59-43f55090a1f1 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1270 microversion: 2.1 time: 0.284532 Oct 27 10:52:55.946769 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3416/6631] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:55 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1270 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:56.161430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:56.162054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:56.165050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:56.168810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:56.169305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:56.169745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:56.170478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:56.170929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:56.171357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:56.388006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:56.396877 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f1d9ac6-1ba3-42cd-adc9-21dc6b8ffea9 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1373 microversion: 2.1 time: 0.239337 Oct 27 10:52:56.398345 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3216/6632] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:56 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1373 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:56.529174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-fcd70755-4667-429c-baa2-ceac8e18d408 req-f7ddd37d-64ee-4ee4-8123-4a12ab9f1794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8354140-1052-4b19-a5ec-add699ad4470", "name": "network-vif-plugged", "status": "completed", "tag": "022e56bb-253b-4c2b-ba05-51daa6b8b591"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:56.544027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fcd70755-4667-429c-baa2-ceac8e18d408 req-f7ddd37d-64ee-4ee4-8123-4a12ab9f1794 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:56.544739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fcd70755-4667-429c-baa2-ceac8e18d408 req-f7ddd37d-64ee-4ee4-8123-4a12ab9f1794 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:56.545324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fcd70755-4667-429c-baa2-ceac8e18d408 req-f7ddd37d-64ee-4ee4-8123-4a12ab9f1794 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:56.559615 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-fcd70755-4667-429c-baa2-ceac8e18d408 req-f7ddd37d-64ee-4ee4-8123-4a12ab9f1794 service nova] Creating event network-vif-plugged:022e56bb-253b-4c2b-ba05-51daa6b8b591 for instance f8354140-1052-4b19-a5ec-add699ad4470 on n-h1-854663-10 Oct 27 10:52:56.565187 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-fcd70755-4667-429c-baa2-ceac8e18d408 req-f7ddd37d-64ee-4ee4-8123-4a12ab9f1794 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039787 Oct 27 10:52:56.566099 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3417/6633] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:56.727959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:56.728900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:56.736026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:56.736523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:56.737012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:56.737878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:56.738480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:56.738918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:56.887049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:56.898982 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1e328c7-7dcd-4173-9214-9bc716c0fce7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1299 microversion: 2.1 time: 0.174973 Oct 27 10:52:56.899917 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3217/6634] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:56 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:56.970654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:56.971404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:56.978220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:56.978753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:56.979199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:56.979939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:56.980408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:56.980889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:57.203563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:57.204469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-12cad6c5-6f96-44a5-9b6b-373b8357a75d req-e6bcd677-f349-454c-8cc3-8a04c34af9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a092a-ccdd-493b-a742-169626ceef80", "tag": "48814441-5ba3-4375-80f9-bd330b1e3853"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:57.212779 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46d934b7-6708-40a2-980e-f5b455ff66af tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1270 microversion: 2.1 time: 0.246389 Oct 27 10:52:57.213766 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3418/6635] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:56 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1270 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:57.229821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12cad6c5-6f96-44a5-9b6b-373b8357a75d req-e6bcd677-f349-454c-8cc3-8a04c34af9ec service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:57.230300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12cad6c5-6f96-44a5-9b6b-373b8357a75d req-e6bcd677-f349-454c-8cc3-8a04c34af9ec service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:57.230730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12cad6c5-6f96-44a5-9b6b-373b8357a75d req-e6bcd677-f349-454c-8cc3-8a04c34af9ec service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:57.243160 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-12cad6c5-6f96-44a5-9b6b-373b8357a75d req-e6bcd677-f349-454c-8cc3-8a04c34af9ec service nova] Creating event network-changed:48814441-5ba3-4375-80f9-bd330b1e3853 for instance 750a092a-ccdd-493b-a742-169626ceef80 on n-h2-854663-10 Oct 27 10:52:57.249258 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-12cad6c5-6f96-44a5-9b6b-373b8357a75d req-e6bcd677-f349-454c-8cc3-8a04c34af9ec service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048610 Oct 27 10:52:57.249953 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3218/6636] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:57.421303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:57.422109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:57.428785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:57.429282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:57.429739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:57.430449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:57.430916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:57.431305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:57.652125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:57.661075 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ef50035-219c-4069-8f5b-eefc6866fc7f tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1373 microversion: 2.1 time: 0.243839 Oct 27 10:52:57.661790 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3419/6637] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:57 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1373 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:57.926337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:57.927113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:57.934644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:57.935126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:57.935571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:57.936261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:57.936969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:57.937474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:58.028102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:58.036218 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-68f00c53-54c1-43e3-91ad-1303956ed1e7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1299 microversion: 2.1 time: 0.116054 Oct 27 10:52:58.036844 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3219/6638] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:57 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:58.237838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:58.238653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:58.246723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:58.247395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:58.247958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:58.248927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:58.249484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:58.250032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:58.397031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:58.405242 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e98a18e-464a-4e0e-b6b8-9a294d5833b8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1270 microversion: 2.1 time: 0.172447 Oct 27 10:52:58.405834 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3420/6639] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:58 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:58.686549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:58.687160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:58.693717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:58.694316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:58.694758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:58.695460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:58.695912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:58.696396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:58.896873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:58.905475 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-921c31cf-0136-464e-b77c-ff92af12b864 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1373 microversion: 2.1 time: 0.223202 Oct 27 10:52:58.906067 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3220/6640] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:58 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1373 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:59.060307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:59.061173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:59.069293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.069795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.070244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.071198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.071669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.072107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.157400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:59.165689 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d9a6b20-7d25-422d-919a-e4e57c566e48 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1471 microversion: 2.1 time: 0.109841 Oct 27 10:52:59.166275 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3421/6641] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:59 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:59.188518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:59.189171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:59.196628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.197160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.197600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.198296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.198760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.199182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.292314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:59.304610 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d4642d5d-6f46-4846-8d74-c79a6f63008f tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1471 microversion: 2.1 time: 0.120172 Oct 27 10:52:59.305228 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3221/6642] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:59 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1471 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:59.326600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-443e2f6b-229b-4550-9a05-09d2d3ef7a57 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:59.327272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-443e2f6b-229b-4550-9a05-09d2d3ef7a57 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:59.334020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443e2f6b-229b-4550-9a05-09d2d3ef7a57 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.334522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443e2f6b-229b-4550-9a05-09d2d3ef7a57 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.334975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443e2f6b-229b-4550-9a05-09d2d3ef7a57 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.335688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443e2f6b-229b-4550-9a05-09d2d3ef7a57 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.336153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443e2f6b-229b-4550-9a05-09d2d3ef7a57 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.336590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-443e2f6b-229b-4550-9a05-09d2d3ef7a57 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.427971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:59.428597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:59.435222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.435376 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-443e2f6b-229b-4550-9a05-09d2d3ef7a57 tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1624 microversion: 2.1 time: 0.112650 Oct 27 10:52:59.435712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.436002 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3422/6643] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:59 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1624 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:59.439078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.439078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.439078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.439078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.457192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a98df61f-8967-4176-9e63-1169da0246af tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:59.457814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a98df61f-8967-4176-9e63-1169da0246af tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:59.464310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a98df61f-8967-4176-9e63-1169da0246af tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.464855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a98df61f-8967-4176-9e63-1169da0246af tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.465306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a98df61f-8967-4176-9e63-1169da0246af tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.466033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a98df61f-8967-4176-9e63-1169da0246af tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.466504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a98df61f-8967-4176-9e63-1169da0246af tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.466945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a98df61f-8967-4176-9e63-1169da0246af tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.633145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:59.641453 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e60a604-bea0-4661-8782-d86786232c15 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1270 microversion: 2.1 time: 0.217779 Oct 27 10:52:59.642125 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3222/6644] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:59 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:59.653730 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a98df61f-8967-4176-9e63-1169da0246af tempest-TestSecurityGroupsBasicOps-53669380 tempest-TestSecurityGroupsBasicOps-53669380-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1915 microversion: 2.1 time: 0.200101 Oct 27 10:52:59.654309 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3423/6645] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:59 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1915 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:59.723968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:59.724544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:59.731002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.731476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.731900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.732579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.733051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.733470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.759029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:52:59.847179 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9caa2c56-235f-41b7-989c-60661e2afc57 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 204 len: 0 microversion: 2.1 time: 0.126854 Oct 27 10:52:59.847790 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3223/6646] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:52:59 2022] DELETE /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:52:59.856688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:59.857394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:59.863737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.864233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.864699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.865762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.866230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.866667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.932684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:59.933381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:59.939713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.940197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.940627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.941350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.941797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.942215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.962118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:59.970268 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70fc0416-8983-4186-8186-780f20784cd1 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1477 microversion: 2.1 time: 0.117682 Oct 27 10:52:59.971090 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3424/6647] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:59 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1477 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:00.080701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:00.090898 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12cb0d0a-1881-4f2b-89bd-31340fe9529c tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1373 microversion: 2.1 time: 0.162826 Oct 27 10:53:00.091547 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3224/6648] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:59 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:00.666291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:00.666898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:00.674490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:00.674996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:00.675443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:00.676232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:00.676699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:00.677523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:00.819504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:00.828214 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63fccbf0-5633-4507-bf82-6ddd94741c24 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1270 microversion: 2.1 time: 0.165983 Oct 27 10:53:00.829083 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3425/6649] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:00 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:00.993995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:00.994613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:01.001880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:01.002366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:01.002800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:01.003490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:01.003942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:01.004365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:01.099835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:01.108204 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a18a4e9e-33a5-4a05-9f8e-a16deb112609 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1477 microversion: 2.1 time: 0.118272 Oct 27 10:53:01.108811 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3225/6650] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:00 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1477 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:01.114958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:01.115949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:01.122256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:01.122847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:01.123288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:01.123986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:01.124445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:01.124918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:01.262773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:01.271628 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7942df4-6cff-4c40-bfde-86f472b673fa tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1373 microversion: 2.1 time: 0.160378 Oct 27 10:53:01.272209 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3426/6651] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:01 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:01.851371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:01.852382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:01.858734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:01.859336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:01.859840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:01.860603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:01.861175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:01.861666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:02.020917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:02.035414 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc2fd9b9-d493-4d0d-91d1-efb839d07936 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1270 microversion: 2.1 time: 0.188039 Oct 27 10:53:02.036065 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3226/6652] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:01 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1270 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:02.072778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8145c299-b32b-40aa-9300-dc153b6a3839 req-c2f40f60-e4a8-429a-94ee-63fc0612444d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8354140-1052-4b19-a5ec-add699ad4470", "name": "network-vif-deleted", "tag": "022e56bb-253b-4c2b-ba05-51daa6b8b591"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:02.086064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8145c299-b32b-40aa-9300-dc153b6a3839 req-c2f40f60-e4a8-429a-94ee-63fc0612444d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:02.086965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8145c299-b32b-40aa-9300-dc153b6a3839 req-c2f40f60-e4a8-429a-94ee-63fc0612444d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:02.087418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8145c299-b32b-40aa-9300-dc153b6a3839 req-c2f40f60-e4a8-429a-94ee-63fc0612444d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:02.100559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8145c299-b32b-40aa-9300-dc153b6a3839 req-c2f40f60-e4a8-429a-94ee-63fc0612444d service nova] Creating event network-vif-deleted:022e56bb-253b-4c2b-ba05-51daa6b8b591 for instance f8354140-1052-4b19-a5ec-add699ad4470 on n-h1-854663-10 Oct 27 10:53:02.106817 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8145c299-b32b-40aa-9300-dc153b6a3839 req-c2f40f60-e4a8-429a-94ee-63fc0612444d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037242 Oct 27 10:53:02.107890 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3427/6653] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:02.132841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:02.133471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:02.140251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:02.140929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:02.141365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:02.142078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:02.142527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:02.143216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:02.213083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:02.221635 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-56732fd2-1cce-449e-ab0a-57726d81a52c tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 200 len: 1326 microversion: 2.1 time: 0.093488 Oct 27 10:53:02.222232 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3227/6654] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:02 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:02.295640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:02.296316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:02.303543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:02.304038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:02.304490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:02.305241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:02.305694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:02.306131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:02.449777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:02.458098 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c642610-fa6a-4879-b033-ce50357c3df3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1373 microversion: 2.1 time: 0.166761 Oct 27 10:53:02.459443 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3428/6655] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:02 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:02.492038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c58391e0-c18c-4edf-ad26-8681c1728b94 req-5a122178-70e5-46d4-a732-7fd3a2a6605c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281b6b2e-48b6-4abe-bfdb-62d693169db6", "name": "network-vif-plugged", "status": "completed", "tag": "a4fccb34-d1b2-4239-9da3-785f824ecff2"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:02.502076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c58391e0-c18c-4edf-ad26-8681c1728b94 req-5a122178-70e5-46d4-a732-7fd3a2a6605c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:02.502641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c58391e0-c18c-4edf-ad26-8681c1728b94 req-5a122178-70e5-46d4-a732-7fd3a2a6605c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:02.503140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c58391e0-c18c-4edf-ad26-8681c1728b94 req-5a122178-70e5-46d4-a732-7fd3a2a6605c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:02.515886 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c58391e0-c18c-4edf-ad26-8681c1728b94 req-5a122178-70e5-46d4-a732-7fd3a2a6605c service nova] Creating event network-vif-plugged:a4fccb34-d1b2-4239-9da3-785f824ecff2 for instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 on n-h1-854663-10 Oct 27 10:53:02.520839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c58391e0-c18c-4edf-ad26-8681c1728b94 req-5a122178-70e5-46d4-a732-7fd3a2a6605c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 Oct 27 10:53:02.521828 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3228/6656] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:03.061555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:03.062217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:03.069309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:03.070237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:03.070345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:03.071243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:03.071743 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:03.072434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:03.218620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:03.226848 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db4fd403-c23a-490b-be16-dc75b96840e5 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1270 microversion: 2.1 time: 0.169460 Oct 27 10:53:03.227437 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3429/6657] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:03 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:53:03.246020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:03.246732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: f8354140-1052-4b19-a5ec-add699ad4470] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:03.254100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:03.254585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:03.255026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:03.256037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:03.256495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:03.256982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:03.270560 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] HTTP exception thrown: Instance f8354140-1052-4b19-a5ec-add699ad4470 could not be found. Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Request method failure captured: Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 HTTP/1.1 Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmKy3pkFbWJtLLvnwIRQP7ptmkPdCioFzQpOsHiVn9ySX_6FRjQLPevqJV8-xC8ipwfCqcDUVK4dn6KHFvP_swrEziSK_x3oT-kctNd3O_Z-2R1wRqDlS6xCFlTekKqRG2iJJlVzgvl1OYu01asr9ZguXfV6lTAnHbSwmXaIEjrUDT4 Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2a2944bf6014b8daf9895dbfdb0429d Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-599453970 Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2a2944bf6014b8daf9895dbfdb0429d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2a2944bf6014b8daf9895dbfdb0429d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2a2944bf6014b8daf9895dbfdb0429d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2a2944bf6014b8daf9895dbfdb0429d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestSecurityGroupsBasicOps-599453970 Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2a2944bf6014b8daf9895dbfdb0429d Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-599453970 Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestSecurityGroupsBasicOps-599453970-project Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d0bd2f924e784237a8b036625c5c6cb3 Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestSecurityGroupsBasicOps-599453970-project Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance f8354140-1052-4b19-a5ec-add699ad4470 could not be found. Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f8354140-1052-4b19-a5ec-add699ad4470'} Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8354140-1052-4b19-a5ec-add699ad4470 could not be found. Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8354140-1052-4b19-a5ec-add699ad4470 could not be found. Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:53:03.272292 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8354140-1052-4b19-a5ec-add699ad4470 could not be found. Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Returning 404 to user: Instance f8354140-1052-4b19-a5ec-add699ad4470 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f761b73-7cee-4757-a076-3bf314d2d682 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470" status: 404 len: 111 microversion: 2.1 time: 0.031994 Oct 27 10:53:03.275725 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3229/6658] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:03 2022] GET /compute/v2.1/servers/f8354140-1052-4b19-a5ec-add699ad4470 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:53:03.482060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:03.482667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:03.488826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:03.489320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:03.489768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:03.490524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:03.490949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:03.491399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:03.633520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:03.641706 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a4a5d14-c5b8-421d-9cb7-1bad4a236af7 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1373 microversion: 2.1 time: 0.163675 Oct 27 10:53:03.645980 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3430/6659] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:03 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:04.249763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=18 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:04.258535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:04.259557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:04.267526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:04.268372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:04.269072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:04.269909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:04.270491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:04.271132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:04.435305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:04.443917 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0b93afb4-c8f3-492d-981e-5399aff9a013 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1459 microversion: 2.1 time: 0.195066 Oct 27 10:53:04.444739 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3230/6660] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:04 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1459 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:04.466393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:04.467561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:04.470017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:04.470729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:04.478820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:04.479255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:04.479708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:04.480439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:04.481057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:04.481685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:04.543672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f92a5cbc-498b-4374-8165-a6d7bd5fe797 req-bfced999-688d-4841-96bc-d181df0b9444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750a092a-ccdd-493b-a742-169626ceef80", "name": "network-vif-plugged", "status": "completed", "tag": "48814441-5ba3-4375-80f9-bd330b1e3853"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:04.571488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f92a5cbc-498b-4374-8165-a6d7bd5fe797 req-bfced999-688d-4841-96bc-d181df0b9444 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:04.573892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f92a5cbc-498b-4374-8165-a6d7bd5fe797 req-bfced999-688d-4841-96bc-d181df0b9444 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:04.578337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f92a5cbc-498b-4374-8165-a6d7bd5fe797 req-bfced999-688d-4841-96bc-d181df0b9444 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:04.604078 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f92a5cbc-498b-4374-8165-a6d7bd5fe797 req-bfced999-688d-4841-96bc-d181df0b9444 service nova] Creating event network-vif-plugged:48814441-5ba3-4375-80f9-bd330b1e3853 for instance 750a092a-ccdd-493b-a742-169626ceef80 on n-h2-854663-10 Oct 27 10:53:04.609521 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f92a5cbc-498b-4374-8165-a6d7bd5fe797 req-bfced999-688d-4841-96bc-d181df0b9444 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070980 Oct 27 10:53:04.610664 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3231/6661] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:53:04.655393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:04.671405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:04.675227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:04.683729 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16e234d3-318e-4300-a69f-19ce6f53cbd2 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1459 microversion: 2.1 time: 0.221300 Oct 27 10:53:04.684342 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3431/6662] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:04 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1459 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:04.699933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:04.700771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:04.701417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:04.702325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:04.702924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:04.703497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:04.946577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:04.961414 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a15e4c65-1b0b-41a5-b298-9611279f3775 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1373 microversion: 2.1 time: 0.299680 Oct 27 10:53:04.962762 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3232/6663] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:04 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1373 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:53:05.989042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:05.989899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:06.025112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:06.025550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:06.027158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:06.029308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:06.030855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:06.032644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:06.319320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:06.330513 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57e2c01f-37a4-493e-9d10-1940984a31d6 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1373 microversion: 2.1 time: 0.345332 Oct 27 10:53:06.331556 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3432/6664] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:05 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1373 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:07.317638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c3e8e0b9-176d-47c5-8ede-4c108f5a7d1c req-2ac5b3b8-b049-443c-b16e-05a50500635f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281b6b2e-48b6-4abe-bfdb-62d693169db6", "tag": "a4fccb34-d1b2-4239-9da3-785f824ecff2"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:07.332101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c3e8e0b9-176d-47c5-8ede-4c108f5a7d1c req-2ac5b3b8-b049-443c-b16e-05a50500635f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:07.332960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c3e8e0b9-176d-47c5-8ede-4c108f5a7d1c req-2ac5b3b8-b049-443c-b16e-05a50500635f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:07.333675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c3e8e0b9-176d-47c5-8ede-4c108f5a7d1c req-2ac5b3b8-b049-443c-b16e-05a50500635f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:07.338643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:07.355018 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c3e8e0b9-176d-47c5-8ede-4c108f5a7d1c req-2ac5b3b8-b049-443c-b16e-05a50500635f service nova] Creating event network-changed:a4fccb34-d1b2-4239-9da3-785f824ecff2 for instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 on n-h1-854663-10 Oct 27 10:53:07.359521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:07.360087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:07.363138 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c3e8e0b9-176d-47c5-8ede-4c108f5a7d1c req-2ac5b3b8-b049-443c-b16e-05a50500635f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048868 Oct 27 10:53:07.365331 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3233/6665] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:07.372280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:07.373007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:07.373506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:07.377363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:07.378072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:07.378514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:07.668003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:07.668608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:07.685372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:07.686172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:07.687386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:07.689756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:07.690415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:07.693624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:07.748116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:53:07.830375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:07.848957 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24c8e7c5-814c-44d9-aab9-1f3b556971be tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1545 microversion: 2.1 time: 0.494126 Oct 27 10:53:07.867283 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3433/6666] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:07 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1545 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:07.879736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3d8a4621-b14d-4e80-b0e5-3fc0d448efa4 req-696e7415-3978-4358-bdf5-b7bcc92863ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ee005a-5e92-428b-a95f-7543de3ed710", "tag": "33d2da7c-f167-4b74-89ff-6cd6d9da88ec"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:07.906566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3d8a4621-b14d-4e80-b0e5-3fc0d448efa4 req-696e7415-3978-4358-bdf5-b7bcc92863ff service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:07.907072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3d8a4621-b14d-4e80-b0e5-3fc0d448efa4 req-696e7415-3978-4358-bdf5-b7bcc92863ff service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:07.907514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3d8a4621-b14d-4e80-b0e5-3fc0d448efa4 req-696e7415-3978-4358-bdf5-b7bcc92863ff service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:07.923242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:07.942047 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-66a24f34-dacc-4468-87c9-22fd0c623e53 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "DELETE /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 204 len: 0 microversion: 2.1 time: 0.277791 Oct 27 10:53:07.943169 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3234/6667] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:53:07 2022] DELETE /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:53:07.943649 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3d8a4621-b14d-4e80-b0e5-3fc0d448efa4 req-696e7415-3978-4358-bdf5-b7bcc92863ff service nova] Creating event network-changed:33d2da7c-f167-4b74-89ff-6cd6d9da88ec for instance 30ee005a-5e92-428b-a95f-7543de3ed710 on n-h2-854663-10 Oct 27 10:53:07.950847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:07.951893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:07.959202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:07.959702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:07.960188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:07.960827 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3d8a4621-b14d-4e80-b0e5-3fc0d448efa4 req-696e7415-3978-4358-bdf5-b7bcc92863ff service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092025 Oct 27 10:53:07.961085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:07.961674 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3434/6668] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:07.961779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:07.962156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:07.971542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:07.972568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:07.991684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:07.992363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:07.992990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:08.001757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:08.002581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:08.003257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:08.364397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:08.373368 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52c3863a-e6c3-49b2-bcbf-a70154ca0f40 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1545 microversion: 2.1 time: 0.428400 Oct 27 10:53:08.398062 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3235/6669] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:07 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1545 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:08.484990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:08.497793 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55bdeae4-8696-491e-b24a-e462ffbc8b3a tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1768 microversion: 2.1 time: 0.534835 Oct 27 10:53:08.500178 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3435/6670] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:07 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1768 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:09.525911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:09.526638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:09.534622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:09.535333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:09.535957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:09.537214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:09.538055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:09.538709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:09.663462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5b9473e4-dd19-4d06-b4f4-0b5d42e4a4c4 req-8c64a7d6-9da7-4d9a-a183-3bf21f9cf43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281b6b2e-48b6-4abe-bfdb-62d693169db6", "tag": "a4fccb34-d1b2-4239-9da3-785f824ecff2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:09.678022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5b9473e4-dd19-4d06-b4f4-0b5d42e4a4c4 req-8c64a7d6-9da7-4d9a-a183-3bf21f9cf43b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:09.678283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5b9473e4-dd19-4d06-b4f4-0b5d42e4a4c4 req-8c64a7d6-9da7-4d9a-a183-3bf21f9cf43b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:09.678934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5b9473e4-dd19-4d06-b4f4-0b5d42e4a4c4 req-8c64a7d6-9da7-4d9a-a183-3bf21f9cf43b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:09.694215 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5b9473e4-dd19-4d06-b4f4-0b5d42e4a4c4 req-8c64a7d6-9da7-4d9a-a183-3bf21f9cf43b service nova] Creating event network-changed:a4fccb34-d1b2-4239-9da3-785f824ecff2 for instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 on n-h1-854663-10 Oct 27 10:53:09.700198 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5b9473e4-dd19-4d06-b4f4-0b5d42e4a4c4 req-8c64a7d6-9da7-4d9a-a183-3bf21f9cf43b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041058 Oct 27 10:53:09.701513 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3436/6671] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:53:10.331414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0bd2f924e784237a8b036625c5c6cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2944bf6014b8daf9895dbfdb0429d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:10.342513 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2617127f-d60a-4700-b3f0-a137dc6bfada tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 200 len: 1768 microversion: 2.1 time: 0.820877 Oct 27 10:53:10.344843 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3236/6672] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:09 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 1768 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:10.462330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e850f87b-33f2-4165-bafc-7ddd4c48d9d0 req-97554af4-2cc5-46f0-bf9f-08cee9bd746a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ee005a-5e92-428b-a95f-7543de3ed710", "name": "network-vif-deleted", "tag": "33d2da7c-f167-4b74-89ff-6cd6d9da88ec"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:10.482827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e850f87b-33f2-4165-bafc-7ddd4c48d9d0 req-97554af4-2cc5-46f0-bf9f-08cee9bd746a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:10.483388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e850f87b-33f2-4165-bafc-7ddd4c48d9d0 req-97554af4-2cc5-46f0-bf9f-08cee9bd746a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:10.483780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e850f87b-33f2-4165-bafc-7ddd4c48d9d0 req-97554af4-2cc5-46f0-bf9f-08cee9bd746a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:10.500276 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e850f87b-33f2-4165-bafc-7ddd4c48d9d0 req-97554af4-2cc5-46f0-bf9f-08cee9bd746a service nova] Creating event network-vif-deleted:33d2da7c-f167-4b74-89ff-6cd6d9da88ec for instance 30ee005a-5e92-428b-a95f-7543de3ed710 on n-h2-854663-10 Oct 27 10:53:10.505523 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e850f87b-33f2-4165-bafc-7ddd4c48d9d0 req-97554af4-2cc5-46f0-bf9f-08cee9bd746a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053707 Oct 27 10:53:10.510225 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3437/6673] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:11.368277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:11.368853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] [instance: 30ee005a-5e92-428b-a95f-7543de3ed710] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:11.376426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:11.376944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:11.377381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:11.378079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:11.378530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:11.378953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:11.393399 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] HTTP exception thrown: Instance 30ee005a-5e92-428b-a95f-7543de3ed710 could not be found. Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Request method failure captured: Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 HTTP/1.1 Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmKy3pkFbWJtLLvnwIRQP7ptmkPdCioFzQpOsHiVn9ySX_6FRjQLPevqJV8-xC8ipwfCqcDUVK4dn6KHFvP_swrEziSK_x3oT-kctNd3O_Z-2R1wRqDlS6xCFlTekKqRG2iJJlVzgvl1OYu01asr9ZguXfV6lTAnHbSwmXaIEjrUDT4 Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: a2a2944bf6014b8daf9895dbfdb0429d Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-599453970 Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2a2944bf6014b8daf9895dbfdb0429d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a2a2944bf6014b8daf9895dbfdb0429d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a2a2944bf6014b8daf9895dbfdb0429d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a2a2944bf6014b8daf9895dbfdb0429d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestSecurityGroupsBasicOps-599453970 Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: a2a2944bf6014b8daf9895dbfdb0429d Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-599453970 Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestSecurityGroupsBasicOps-599453970-project Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: d0bd2f924e784237a8b036625c5c6cb3 Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestSecurityGroupsBasicOps-599453970-project Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 30ee005a-5e92-428b-a95f-7543de3ed710 could not be found. Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '30ee005a-5e92-428b-a95f-7543de3ed710'} Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30ee005a-5e92-428b-a95f-7543de3ed710 could not be found. Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30ee005a-5e92-428b-a95f-7543de3ed710 could not be found. Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:53:11.395093 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30ee005a-5e92-428b-a95f-7543de3ed710 could not be found. Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Returning 404 to user: Instance 30ee005a-5e92-428b-a95f-7543de3ed710 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-de505e2d-ebe8-4269-989e-48751ecc80c7 tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710" status: 404 len: 111 microversion: 2.1 time: 0.032853 Oct 27 10:53:11.398657 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3237/6674] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:11 2022] GET /compute/v2.1/servers/30ee005a-5e92-428b-a95f-7543de3ed710 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:53:11.733554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2a97e7ba-8591-400b-9f8e-613c1a4a4efb req-6c106823-f090-454b-9bab-98df256fb067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281b6b2e-48b6-4abe-bfdb-62d693169db6", "tag": "a4fccb34-d1b2-4239-9da3-785f824ecff2"}, {"name": "network-changed", "server_uuid": "750a092a-ccdd-493b-a742-169626ceef80", "tag": "48814441-5ba3-4375-80f9-bd330b1e3853"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:11.747911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2a97e7ba-8591-400b-9f8e-613c1a4a4efb req-6c106823-f090-454b-9bab-98df256fb067 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:11.749231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2a97e7ba-8591-400b-9f8e-613c1a4a4efb req-6c106823-f090-454b-9bab-98df256fb067 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:11.750408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2a97e7ba-8591-400b-9f8e-613c1a4a4efb req-6c106823-f090-454b-9bab-98df256fb067 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:11.772285 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2a97e7ba-8591-400b-9f8e-613c1a4a4efb req-6c106823-f090-454b-9bab-98df256fb067 service nova] Creating event network-changed:a4fccb34-d1b2-4239-9da3-785f824ecff2 for instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 on n-h1-854663-10 Oct 27 10:53:11.773305 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2a97e7ba-8591-400b-9f8e-613c1a4a4efb req-6c106823-f090-454b-9bab-98df256fb067 service nova] Creating event network-changed:48814441-5ba3-4375-80f9-bd330b1e3853 for instance 750a092a-ccdd-493b-a742-169626ceef80 on n-h2-854663-10 Oct 27 10:53:11.786715 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2a97e7ba-8591-400b-9f8e-613c1a4a4efb req-6c106823-f090-454b-9bab-98df256fb067 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058010 Oct 27 10:53:11.787724 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3438/6675] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:15.528405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de06c7a5-7a00-4973-9352-f0201c1bb23d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] Calling method '.version_select at 0x7f6d5a124d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:15.556630 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-de06c7a5-7a00-4973-9352-f0201c1bb23d tempest-TestSecurityGroupsBasicOps-599453970 tempest-TestSecurityGroupsBasicOps-599453970-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1603030126" status: 202 len: 0 microversion: 2.1 time: 0.032796 Oct 27 10:53:15.560683 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3238/6676] 10.222.0.76 () {58 vars in 1278 bytes} [Thu Oct 27 10:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1603030126 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:53:31.818031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=45 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:31.818915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=13 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:31.823698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bca0653f-6dbb-4679-b06f-8d949ad38250 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:31.826265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bca0653f-6dbb-4679-b06f-8d949ad38250 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:31.833707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca0653f-6dbb-4679-b06f-8d949ad38250 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:31.834205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca0653f-6dbb-4679-b06f-8d949ad38250 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:31.834649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca0653f-6dbb-4679-b06f-8d949ad38250 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:31.835363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca0653f-6dbb-4679-b06f-8d949ad38250 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:31.835825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca0653f-6dbb-4679-b06f-8d949ad38250 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:31.836264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bca0653f-6dbb-4679-b06f-8d949ad38250 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:31.894893 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bca0653f-6dbb-4679-b06f-8d949ad38250 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "POST /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80/action" status: 200 len: 24574 microversion: 2.1 time: 0.079080 Oct 27 10:53:31.896623 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3439/6677] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:53:31 2022] POST /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80/action => generated 24574 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:53:38.434021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:38.435124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:38.440528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4857cf35-f8b3-41bc-ac66-5144e2ebeeee tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:38.445555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4857cf35-f8b3-41bc-ac66-5144e2ebeeee tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:38.456592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4857cf35-f8b3-41bc-ac66-5144e2ebeeee tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:38.456592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4857cf35-f8b3-41bc-ac66-5144e2ebeeee tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:38.457355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4857cf35-f8b3-41bc-ac66-5144e2ebeeee tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:38.457747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4857cf35-f8b3-41bc-ac66-5144e2ebeeee tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:38.458210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4857cf35-f8b3-41bc-ac66-5144e2ebeeee tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:38.459086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4857cf35-f8b3-41bc-ac66-5144e2ebeeee tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:38.519998 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4857cf35-f8b3-41bc-ac66-5144e2ebeeee tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "POST /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80/action" status: 200 len: 32645 microversion: 2.1 time: 0.088270 Oct 27 10:53:38.520568 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3239/6678] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 10:53:38 2022] POST /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80/action => generated 32645 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:53:39.795233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:39.796386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:39.799993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c65b8e09-4f51-4bfa-8deb-8838c2892f19 req-30c62e9c-456a-4376-a884-2a3662c6e605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a092a-ccdd-493b-a742-169626ceef80", "tag": "48814441-5ba3-4375-80f9-bd330b1e3853"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:39.808626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:39.809545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:39.810016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:39.810888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:39.811501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:39.812090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:39.825971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c65b8e09-4f51-4bfa-8deb-8838c2892f19 req-30c62e9c-456a-4376-a884-2a3662c6e605 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:39.826452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c65b8e09-4f51-4bfa-8deb-8838c2892f19 req-30c62e9c-456a-4376-a884-2a3662c6e605 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:39.826887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c65b8e09-4f51-4bfa-8deb-8838c2892f19 req-30c62e9c-456a-4376-a884-2a3662c6e605 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:39.846989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:53:39.854350 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c65b8e09-4f51-4bfa-8deb-8838c2892f19 req-30c62e9c-456a-4376-a884-2a3662c6e605 service nova] Creating event network-changed:48814441-5ba3-4375-80f9-bd330b1e3853 for instance 750a092a-ccdd-493b-a742-169626ceef80 on n-h2-854663-10 Oct 27 10:53:39.859674 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c65b8e09-4f51-4bfa-8deb-8838c2892f19 req-30c62e9c-456a-4376-a884-2a3662c6e605 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065307 Oct 27 10:53:39.860864 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3240/6679] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:40.005501 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1437a01-289c-45d4-8362-1879c38d2850 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "DELETE /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 204 len: 0 microversion: 2.1 time: 0.214532 Oct 27 10:53:40.010881 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3440/6680] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:53:39 2022] DELETE /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:53:40.020901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:40.021618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:40.041196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:40.042376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:40.042832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:40.043527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:40.044145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:40.044809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:40.433843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:40.442831 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55bf2987-6b3b-4385-b126-6f261f8d3318 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1669 microversion: 2.1 time: 0.429924 Oct 27 10:53:40.444156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3241/6681] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:40 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1669 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:41.468241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:41.469148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:41.486859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:41.487325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:41.487785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:41.488529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:41.489322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:41.493316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:41.751433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f77e88f7c148a7996cb6ccabd9f64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eae1c0a30cb4e4fa9c7d8f93f7bf210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:41.760050 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-04a37824-bce4-412c-8a81-6631c913811d tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 200 len: 1669 microversion: 2.1 time: 0.296193 Oct 27 10:53:41.761243 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3441/6682] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:41 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 1669 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:41.872194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-029da8a6-ed54-477f-85d2-ce3b5bbd6bd4 req-9e1c74d9-9945-4480-9794-4425f576eaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750a092a-ccdd-493b-a742-169626ceef80", "name": "network-vif-deleted", "tag": "48814441-5ba3-4375-80f9-bd330b1e3853"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:41.891148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-029da8a6-ed54-477f-85d2-ce3b5bbd6bd4 req-9e1c74d9-9945-4480-9794-4425f576eaf8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:41.891767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-029da8a6-ed54-477f-85d2-ce3b5bbd6bd4 req-9e1c74d9-9945-4480-9794-4425f576eaf8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:41.892497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-029da8a6-ed54-477f-85d2-ce3b5bbd6bd4 req-9e1c74d9-9945-4480-9794-4425f576eaf8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:41.906033 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-029da8a6-ed54-477f-85d2-ce3b5bbd6bd4 req-9e1c74d9-9945-4480-9794-4425f576eaf8 service nova] Creating event network-vif-deleted:48814441-5ba3-4375-80f9-bd330b1e3853 for instance 750a092a-ccdd-493b-a742-169626ceef80 on n-h2-854663-10 Oct 27 10:53:41.911681 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-029da8a6-ed54-477f-85d2-ce3b5bbd6bd4 req-9e1c74d9-9945-4480-9794-4425f576eaf8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043603 Oct 27 10:53:41.912297 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3242/6683] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:42.283044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-100837042", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1830090047", "security_groups": [{"name": "tempest-secgroup-smoke-2129446865"}], "block_device_mapping_v2": [{"uuid": "a3fb9c5e-facf-4d2b-bf28-954a15c1c5aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0264043c-59ac-40f6-8b89-4caf5f646c28"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:42.410226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] validate_networks() for [('0264043c-59ac-40f6-8b89-4caf5f646c28', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:53:42.785366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:42.786174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] [instance: 750a092a-ccdd-493b-a742-169626ceef80] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:42.793742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:42.794226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:42.794661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:42.795361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:42.795814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:42.796243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:42.811626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] HTTP exception thrown: Instance 750a092a-ccdd-493b-a742-169626ceef80 could not be found. Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Request method failure captured: Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 HTTP/1.1 Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmJ-RTThY278alaGCdBtiELe7NhzIZ6wgx7g8XjObuaJWPjDxWjZNyLZF6UUZTIt3LvQzxarZsDM3qASrIiclUXLjHUrTq5xQnzBNJSUZfQ2CZN6dzen20JYc1I9DgxehDrc-AB6I-outdPyFMsXBWEBb6VutPE2dw2n22jXQGulwYQ Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 3eae1c0a30cb4e4fa9c7d8f93f7bf210 Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestNetworkBasicOps-1969496053 Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3eae1c0a30cb4e4fa9c7d8f93f7bf210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3eae1c0a30cb4e4fa9c7d8f93f7bf210"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3eae1c0a30cb4e4fa9c7d8f93f7bf210", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3eae1c0a30cb4e4fa9c7d8f93f7bf210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestNetworkBasicOps-1969496053 Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 3eae1c0a30cb4e4fa9c7d8f93f7bf210 Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestNetworkBasicOps-1969496053 Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestNetworkBasicOps-1969496053-project Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: c6f77e88f7c148a7996cb6ccabd9f64f Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestNetworkBasicOps-1969496053-project Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 750a092a-ccdd-493b-a742-169626ceef80 could not be found. Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '750a092a-ccdd-493b-a742-169626ceef80'} Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750a092a-ccdd-493b-a742-169626ceef80 could not be found. Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750a092a-ccdd-493b-a742-169626ceef80 could not be found. Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:53:42.813513 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750a092a-ccdd-493b-a742-169626ceef80 could not be found. Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Returning 404 to user: Instance 750a092a-ccdd-493b-a742-169626ceef80 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-092fbdec-1a67-4459-ba64-90b8880c69a3 tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80" status: 404 len: 111 microversion: 2.1 time: 0.034963 Oct 27 10:53:42.822350 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3243/6684] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:42 2022] GET /compute/v2.1/servers/750a092a-ccdd-493b-a742-169626ceef80 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:53:42.824842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:53:42.824842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:53:42.824842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:53:42.824842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:53:42.824842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:53:42.834555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:42.835059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:42.835514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:42.836263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:42.836736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:42.837195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:42.854679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:53:42.860116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Getting quotas for user 6e16c7669eb34fa49714040f728210e4 and project 3e99c27693094793bfcf910ff5798d08. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:53:42.923751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:53:42.925999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3fb9c5e-facf-4d2b-bf28-954a15c1c5aa',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:53:42.988327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-617af02d-5af4-4101-b20b-de01a19dfb2e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] Calling method '.version_select at 0x7f6d5bc504c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:43.011652 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-617af02d-5af4-4101-b20b-de01a19dfb2e tempest-TestNetworkBasicOps-1969496053 tempest-TestNetworkBasicOps-1969496053-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-880852829" status: 202 len: 0 microversion: 2.1 time: 0.027499 Oct 27 10:53:43.015232 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3244/6685] 10.222.0.76 () {58 vars in 1254 bytes} [Thu Oct 27 10:53:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-880852829 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:53:43.082969 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-678eb14c-701b-4e9e-8c5b-c6ad5719668b tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.804268 Oct 27 10:53:43.083659 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3442/6686] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:53:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:53:43.099797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30e85d91-56da-4706-b283-85b4e8af3670 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:43.100604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30e85d91-56da-4706-b283-85b4e8af3670 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:43.169877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-30e85d91-56da-4706-b283-85b4e8af3670 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:43.177889 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30e85d91-56da-4706-b283-85b4e8af3670 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1094 microversion: 2.1 time: 0.085657 Oct 27 10:53:43.178633 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3245/6687] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:43 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:44.202065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:44.203420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:44.210798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:44.211582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:44.212609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:44.213406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:44.214079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:44.214710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:44.283766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:44.301137 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b8ca9f86-deab-430f-ba76-ecdb86d5c379 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1210 microversion: 2.1 time: 0.104072 Oct 27 10:53:44.302844 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3443/6688] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:44 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:45.329838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:45.331222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:45.343610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:45.347039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:45.348088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:45.350067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:45.352277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:45.352991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:45.511144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:45.529961 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af3cd125-7d9e-400c-9474-dc1947012eb9 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1210 microversion: 2.1 time: 0.203371 Oct 27 10:53:45.531529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3246/6689] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:45 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1210 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:46.554119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:46.554768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:46.564952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:46.565476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:46.576211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:46.577130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:46.577640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:46.578174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:46.796951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1e6ab198-ac4b-45d0-a14d-60bfb81730b7 req-4a1321ae-1bf4-420c-8696-242d37727f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20e84a8f-8ba1-43d9-aced-0685cf7c4fa9", "tag": "8a0b94bc-3114-40f7-9733-1b614bcb444d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:46.811659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1e6ab198-ac4b-45d0-a14d-60bfb81730b7 req-4a1321ae-1bf4-420c-8696-242d37727f27 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:46.812414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1e6ab198-ac4b-45d0-a14d-60bfb81730b7 req-4a1321ae-1bf4-420c-8696-242d37727f27 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:46.813086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1e6ab198-ac4b-45d0-a14d-60bfb81730b7 req-4a1321ae-1bf4-420c-8696-242d37727f27 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:46.827296 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1e6ab198-ac4b-45d0-a14d-60bfb81730b7 req-4a1321ae-1bf4-420c-8696-242d37727f27 service nova] Creating event network-changed:8a0b94bc-3114-40f7-9733-1b614bcb444d for instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 on n-h2-854663-10 Oct 27 10:53:46.833790 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1e6ab198-ac4b-45d0-a14d-60bfb81730b7 req-4a1321ae-1bf4-420c-8696-242d37727f27 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041931 Oct 27 10:53:46.835121 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3247/6690] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:47.013428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:47.036374 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-677dfb4a-07e2-4920-948b-0a59e5a14f5a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1278 microversion: 2.1 time: 0.486426 Oct 27 10:53:47.037772 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3444/6691] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:46 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1278 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:47.844373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:47.845136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:47.862060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-65ad3a69-6c69-4444-9feb-911e1a364ca3 req-c09686bc-0e17-4682-84ec-c98294a48648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281b6b2e-48b6-4abe-bfdb-62d693169db6", "tag": "a4fccb34-d1b2-4239-9da3-785f824ecff2"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:47.864947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:47.866930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:47.870496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:47.874994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:47.876934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:47.881126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:47.885541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-65ad3a69-6c69-4444-9feb-911e1a364ca3 req-c09686bc-0e17-4682-84ec-c98294a48648 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:47.886339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-65ad3a69-6c69-4444-9feb-911e1a364ca3 req-c09686bc-0e17-4682-84ec-c98294a48648 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:47.886940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-65ad3a69-6c69-4444-9feb-911e1a364ca3 req-c09686bc-0e17-4682-84ec-c98294a48648 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:47.934235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:53:47.937296 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-65ad3a69-6c69-4444-9feb-911e1a364ca3 req-c09686bc-0e17-4682-84ec-c98294a48648 service nova] Creating event network-changed:a4fccb34-d1b2-4239-9da3-785f824ecff2 for instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 on n-h1-854663-10 Oct 27 10:53:47.951331 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-65ad3a69-6c69-4444-9feb-911e1a364ca3 req-c09686bc-0e17-4682-84ec-c98294a48648 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093423 Oct 27 10:53:47.956249 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3445/6692] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:48.063861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:48.064826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:48.079302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:48.080100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:48.082826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:48.083771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:48.084555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:48.086649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:48.154252 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fae5b29a-6948-4f3e-b809-a52fff659d1e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "DELETE /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 204 len: 0 microversion: 2.1 time: 0.315219 Oct 27 10:53:48.155527 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3248/6693] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:53:47 2022] DELETE /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:53:48.170425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:48.173796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:48.193365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:48.194072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:48.195001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:48.197431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:48.197972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:48.198409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:48.444363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:48.461897 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe3af9bc-71a5-424d-9d6c-5bb21527320c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1278 microversion: 2.1 time: 0.403502 Oct 27 10:53:48.462771 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3446/6694] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:48 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1278 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:53:48.480636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:48.491482 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6aca1e29-e30e-45de-9fc0-f0de0489a562 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1583 microversion: 2.1 time: 0.330386 Oct 27 10:53:48.492968 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3249/6695] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:48 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1583 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:49.499845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:49.501467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:49.509365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:49.510048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:49.510651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:49.511804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:49.514207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:49.514948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:49.520440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:49.521109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:49.537092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:49.538297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:49.539501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:49.542022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:49.542640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:49.544787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:49.831093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:49.834456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:49.840481 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7eb9938-1549-441a-adf4-a5cfaa96f75e tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1583 microversion: 2.1 time: 0.325375 Oct 27 10:53:49.842270 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3250/6696] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:49 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1583 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:49.861997 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6820f89-e49a-4dd5-ac79-d38fcfec01dd tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1278 microversion: 2.1 time: 0.372741 Oct 27 10:53:49.872316 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3447/6697] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:49 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1278 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:50.548017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-13af4487-343f-47d7-adab-bf5bb6659e12 req-4ce757c4-5393-4ac6-a300-c849e23f7f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281b6b2e-48b6-4abe-bfdb-62d693169db6", "name": "network-vif-deleted", "tag": "a4fccb34-d1b2-4239-9da3-785f824ecff2"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:50.560177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-13af4487-343f-47d7-adab-bf5bb6659e12 req-4ce757c4-5393-4ac6-a300-c849e23f7f69 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:50.560695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-13af4487-343f-47d7-adab-bf5bb6659e12 req-4ce757c4-5393-4ac6-a300-c849e23f7f69 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:50.561301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-13af4487-343f-47d7-adab-bf5bb6659e12 req-4ce757c4-5393-4ac6-a300-c849e23f7f69 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:50.572914 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-13af4487-343f-47d7-adab-bf5bb6659e12 req-4ce757c4-5393-4ac6-a300-c849e23f7f69 service nova] Creating event network-vif-deleted:a4fccb34-d1b2-4239-9da3-785f824ecff2 for instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 on n-h1-854663-10 Oct 27 10:53:50.578468 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-13af4487-343f-47d7-adab-bf5bb6659e12 req-4ce757c4-5393-4ac6-a300-c849e23f7f69 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034296 Oct 27 10:53:50.579076 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3251/6698] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:50.867767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:50.869213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:50.881375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:50.888809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:50.889541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:50.892817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:50.893435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:50.894208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:50.897956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:50.898740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:50.902648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:50.905648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:50.906383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:50.907873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:50.909998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:50.910816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:51.033776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:51.045617 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b48054c1-00e2-4b4e-80f4-4027048acde8 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1229 microversion: 2.1 time: 0.182648 Oct 27 10:53:51.046139 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3448/6699] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:50 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1229 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:51.118066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:51.127725 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d66d79b1-879b-4536-b366-c9816a5c82ea tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1266 microversion: 2.1 time: 0.244078 Oct 27 10:53:51.128315 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3252/6700] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:50 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:53:52.069735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:52.070698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:52.078900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:52.079436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:52.079956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:52.080801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:52.081391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:52.082104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:52.151449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:52.153221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:52.154102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:52.160506 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69d9a439-b644-40c2-8332-c522b06ba11f tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1229 microversion: 2.1 time: 0.095387 Oct 27 10:53:52.162329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:52.163340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:52.163928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:52.165335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:52.166319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:52.166881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:52.178357 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3449/6701] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:52 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1229 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:52.330656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:52.338972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2d8a1d2-da06-4bda-b850-b48a70eda2ec tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1266 microversion: 2.1 time: 0.191067 Oct 27 10:53:52.353725 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3253/6702] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:52 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:53.186404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:53.188127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:53.191850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:53.192621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:53.199193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:53.199704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:53.200220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:53.201013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:53.201487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:53.202736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:53.289051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:53.299544 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1679ffb7-4a35-402a-a816-c4de5c4b5d13 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1229 microversion: 2.1 time: 0.117779 Oct 27 10:53:53.300101 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3450/6703] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:53 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1229 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:53.364194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:53.365004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:53.367876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:53:53.375496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:53.379450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:53.379981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:53.380923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:53.381527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:53.382104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:53.594020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:53.604132 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8febb7d-eed4-4415-90aa-84af0daa931e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1266 microversion: 2.1 time: 0.244567 Oct 27 10:53:53.606124 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3254/6704] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:53 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:54.326615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:54.327498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:54.340631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:54.341501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:54.342101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:54.343150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:54.343912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:54.344638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:54.421397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:54.434833 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c802a845-1720-4611-90d5-c4eaabb6e24d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1229 microversion: 2.1 time: 0.113659 Oct 27 10:53:54.435442 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3451/6705] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:54 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1229 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:54.631873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:54.633376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:54.643145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:54.644039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:54.644815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:54.645721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:54.646543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:54.647040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:54.816464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:54.824361 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-171aee94-8fb9-413b-b3b9-a8c2302e76ac tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1266 microversion: 2.1 time: 0.198421 Oct 27 10:53:54.824974 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3255/6706] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:54 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:53:55.459488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:55.460848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:55.468780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:55.469880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:55.470561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:55.471421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:55.471878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:55.472478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:55.516057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:55.516885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:55.517623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:55.518177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lazy-loading 'fault' on Instance uuid 281b6b2e-48b6-4abe-bfdb-62d693169db6 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:53:55.589818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1785cf695fdd4d99b3b94a4ffeed2920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a737b28b04249ae4c03b66cab0d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:55.599050 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad422f4c-7c49-4506-8ffe-e1d6b552d2a3 tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 200 len: 1234 microversion: 2.1 time: 0.143735 Oct 27 10:53:55.600173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3452/6707] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:55 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 1234 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:55.849132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:55.849634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:55.859641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:55.860159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:55.861159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:55.861899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:55.862768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:55.863329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:56.024276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:56.033252 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-74f4f727-a07a-43d2-9569-665611739959 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1266 microversion: 2.1 time: 0.189287 Oct 27 10:53:56.033854 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3256/6708] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:55 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:56.626627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:56.627553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] [instance: 281b6b2e-48b6-4abe-bfdb-62d693169db6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:56.634953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:56.635468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:56.635935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:56.636707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:56.637187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:56.637635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:56.652202 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] HTTP exception thrown: Instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 could not be found. Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Request method failure captured: Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 HTTP/1.1 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmJb5fkxw6iIYHk-L2yDcAt_21ZOh-UWO6ggdB97KeNoo6nKZmvH45ufxbyTXHZYtzUsxsGxpJOQjeXHg5-jwK4vZvyhxQbw6SVRz6H2B0DvVbREcrRC9BHEeSSt2hl_impLpefCaAEoA1vGJxUKakh5OP1IelafkBYcRKK9HOI3eeY Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 1c1a737b28b04249ae4c03b66cab0d58 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBackupRestore-746712313 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c1a737b28b04249ae4c03b66cab0d58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1c1a737b28b04249ae4c03b66cab0d58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1c1a737b28b04249ae4c03b66cab0d58", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c1a737b28b04249ae4c03b66cab0d58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBackupRestore-746712313 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 1c1a737b28b04249ae4c03b66cab0d58 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBackupRestore-746712313 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBackupRestore-746712313-project Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 1785cf695fdd4d99b3b94a4ffeed2920 Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBackupRestore-746712313-project Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 could not be found. Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '281b6b2e-48b6-4abe-bfdb-62d693169db6'} Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 could not be found. Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 could not be found. Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:53:56.653948 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:53:56.658138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:53:56.658138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:53:56.658138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:53:56.658138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:53:56.658138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:53:56.658138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 could not be found. Oct 27 10:53:56.658138 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:53:56.658138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Returning 404 to user: Instance 281b6b2e-48b6-4abe-bfdb-62d693169db6 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:53:56.658138 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63641311-6f51-4883-ab48-517263a3846d tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6" status: 404 len: 111 microversion: 2.1 time: 0.033196 Oct 27 10:53:56.659575 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3453/6709] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:56 2022] GET /compute/v2.1/servers/281b6b2e-48b6-4abe-bfdb-62d693169db6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:53:57.059195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:57.060056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:57.069741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:57.070393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:57.070837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:57.071518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:57.072114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:57.072532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:57.221288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:57.239990 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-53e2dff0-74b5-41f6-afb5-1c60a5c2a046 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1266 microversion: 2.1 time: 0.184278 Oct 27 10:53:57.241302 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3257/6710] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:57 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:57.360692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cecad88a-485d-4af2-a8fd-57865ae639ba tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] Calling method '.version_select at 0x7f6d5b75cf70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:57.419496 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cecad88a-485d-4af2-a8fd-57865ae639ba tempest-TestVolumeBackupRestore-746712313 tempest-TestVolumeBackupRestore-746712313-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1586343301" status: 202 len: 0 microversion: 2.1 time: 0.064544 Oct 27 10:53:57.423928 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3454/6711] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 10:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1586343301 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:53:58.272549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:58.273411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:58.286529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:58.290763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:58.292102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:58.294002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:58.297614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:58.299140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:58.568112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:58.577843 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-880666b1-58c2-4721-b7c3-6567b8cc6904 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1266 microversion: 2.1 time: 0.317879 Oct 27 10:53:58.578819 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3258/6712] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:58 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:59.603076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:59.603713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:59.619629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:59.620144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:59.620588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:59.621350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:59.621814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:59.622249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:59.939120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:59.952297 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-805ef142-2811-4b35-b138-9d1cdbe4ca6c tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1266 microversion: 2.1 time: 0.354020 Oct 27 10:53:59.957305 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3455/6713] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:59 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:00.150508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1993321c-f937-4bed-ae87-647442f2a76e req-c934d004-6d2f-4594-9f4b-08c9d6897ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e84a8f-8ba1-43d9-aced-0685cf7c4fa9", "name": "network-vif-plugged", "status": "completed", "tag": "8a0b94bc-3114-40f7-9733-1b614bcb444d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:54:00.169852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1993321c-f937-4bed-ae87-647442f2a76e req-c934d004-6d2f-4594-9f4b-08c9d6897ae8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:00.170591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1993321c-f937-4bed-ae87-647442f2a76e req-c934d004-6d2f-4594-9f4b-08c9d6897ae8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:00.173583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1993321c-f937-4bed-ae87-647442f2a76e req-c934d004-6d2f-4594-9f4b-08c9d6897ae8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:00.201715 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1993321c-f937-4bed-ae87-647442f2a76e req-c934d004-6d2f-4594-9f4b-08c9d6897ae8 service nova] Creating event network-vif-plugged:8a0b94bc-3114-40f7-9733-1b614bcb444d for instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 on n-h2-854663-10 Oct 27 10:54:00.219155 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1993321c-f937-4bed-ae87-647442f2a76e req-c934d004-6d2f-4594-9f4b-08c9d6897ae8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072049 Oct 27 10:54:00.220303 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3259/6714] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:54:00.984383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:00.985219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:01.004215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:01.005894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:01.006645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:01.008410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:01.009974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:01.010709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:01.317474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:01.321500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:54:01.329155 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12ed366a-58d4-4bb8-9d9a-257d5d0d2f11 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1266 microversion: 2.1 time: 0.353100 Oct 27 10:54:01.340774 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3456/6715] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:00 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:02.370892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:02.371627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:02.398109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:02.398648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:02.399098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:02.400395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:02.400913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:02.405254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:02.469092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:54:02.641467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:02.656764 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9715a5e8-1635-4f74-8310-b8087b86c96a tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1452 microversion: 2.1 time: 0.299058 Oct 27 10:54:02.669808 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3260/6716] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:02 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1452 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:02.682204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:02.683599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:02.687634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:54:02.695325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:02.696541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:02.697386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:02.698529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:02.699245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:02.700592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:02.877940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:02.896189 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-040a104f-d067-427c-9836-6bd39deb391e tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1452 microversion: 2.1 time: 0.217031 Oct 27 10:54:02.897633 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3457/6717] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:02 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1452 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:54:07.987204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9833280d-a823-4a73-a2c6-7cbd3d8ded69 req-ef7d725d-a331-44db-9d23-265853dfe375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20e84a8f-8ba1-43d9-aced-0685cf7c4fa9", "tag": "8a0b94bc-3114-40f7-9733-1b614bcb444d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:54:08.012416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9833280d-a823-4a73-a2c6-7cbd3d8ded69 req-ef7d725d-a331-44db-9d23-265853dfe375 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:08.012931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9833280d-a823-4a73-a2c6-7cbd3d8ded69 req-ef7d725d-a331-44db-9d23-265853dfe375 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:08.013368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9833280d-a823-4a73-a2c6-7cbd3d8ded69 req-ef7d725d-a331-44db-9d23-265853dfe375 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:08.060911 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9833280d-a823-4a73-a2c6-7cbd3d8ded69 req-ef7d725d-a331-44db-9d23-265853dfe375 service nova] Creating event network-changed:8a0b94bc-3114-40f7-9733-1b614bcb444d for instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 on n-h2-854663-10 Oct 27 10:54:08.067559 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9833280d-a823-4a73-a2c6-7cbd3d8ded69 req-ef7d725d-a331-44db-9d23-265853dfe375 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087604 Oct 27 10:54:08.069884 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3261/6718] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:54:09.838415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47973af6-4024-43ba-9d2a-5b5633b09ef2 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Action: 'create', calling method: .version_select at 0x7f6d638e5790>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1147848928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo5yPnQM/b+l2GyESUT86sjYZMaFu21hha9Xib/hDZU0yNXDOuXwKo6Q9/ZYXC1CHoDZrsCR0lf8NLkBK6ZdMY4STfVwfK9UmWP0c89BIXfx7YyxvO6SoCY3I9nWE96gw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:54:09.866672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-47973af6-4024-43ba-9d2a-5b5633b09ef2 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Getting quotas for project db2a3d03d22146c099a2325b9dfb6d33. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:54:09.895154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-47973af6-4024-43ba-9d2a-5b5633b09ef2 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Getting quotas for user 6b275eb711bb4cddb5fbd80834422862 and project db2a3d03d22146c099a2325b9dfb6d33. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:54:09.933888 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47973af6-4024-43ba-9d2a-5b5633b09ef2 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.319057 Oct 27 10:54:09.939466 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3458/6719] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 10:54:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:54:11.595574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1248286488", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1147848928", "security_groups": [{"name": "tempest-secgroup-smoke-1530249791"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "29ac3d58-f37b-4187-a00e-71ca0d1562c8"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:54:11.609947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:54:11.782402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] validate_networks() for [('29ac3d58-f37b-4187-a00e-71ca0d1562c8', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:54:12.671428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Getting quotas for project db2a3d03d22146c099a2325b9dfb6d33. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:54:12.678619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Getting quotas for user 6b275eb711bb4cddb5fbd80834422862 and project db2a3d03d22146c099a2325b9dfb6d33. Resources: dict_keys(['metadata_items']) {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:54:12.700644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:54:12.701939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:54:12.702550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:54:12.703029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:54:12.703579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:54:12.715234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:12.715760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:12.716359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:12.717268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:12.717718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:12.718355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:12.741183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Getting quotas for project db2a3d03d22146c099a2325b9dfb6d33. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:54:12.748122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Getting quotas for user 6b275eb711bb4cddb5fbd80834422862 and project db2a3d03d22146c099a2325b9dfb6d33. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:54:12.763918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:54:12.767170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:54:12.832759 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5b5b12c5-45cb-4322-8be1-a815180b2607 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.241383 Oct 27 10:54:12.833812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3262/6720] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:54:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:54:12.846568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d96010e1-6268-4e10-898d-c42b5957511d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:12.847254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d96010e1-6268-4e10-898d-c42b5957511d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:12.892425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:54:13.024031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d96010e1-6268-4e10-898d-c42b5957511d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:13.039671 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d96010e1-6268-4e10-898d-c42b5957511d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1303 microversion: 2.1 time: 0.198000 Oct 27 10:54:13.053754 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3459/6721] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:12 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1303 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:14.065925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:14.067287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:14.075868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:14.076364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:14.076837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:14.077631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:14.078183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:14.078634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:14.154782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:14.165230 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d5f35769-a07a-491e-8739-f98bdde4f644 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1355 microversion: 2.1 time: 0.103189 Oct 27 10:54:14.166029 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3263/6722] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:14 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:15.190810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:15.191727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:15.205133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:15.206072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:15.206676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:15.207650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:15.208270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:15.208898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:15.317031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:15.330048 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61d16b64-258f-46f3-a036-5b859ce6c3db tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1361 microversion: 2.1 time: 0.143591 Oct 27 10:54:15.331493 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3460/6723] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:15 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:16.354183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:16.354936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:16.362150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:16.363366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:16.363883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:16.364820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:16.365343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:16.365834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:16.485549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f1c9d1db-584c-4ac9-9d67-5511d3af187c req-b1713c45-b867-4122-a2d7-a0091fb9dd85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943a3ce3-f89e-4450-b3e0-b22d5ed5533f", "tag": "2e7d41da-66cf-475f-9ccb-40e7049d0d11"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:54:16.498103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1c9d1db-584c-4ac9-9d67-5511d3af187c req-b1713c45-b867-4122-a2d7-a0091fb9dd85 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:16.498594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1c9d1db-584c-4ac9-9d67-5511d3af187c req-b1713c45-b867-4122-a2d7-a0091fb9dd85 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:16.499273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1c9d1db-584c-4ac9-9d67-5511d3af187c req-b1713c45-b867-4122-a2d7-a0091fb9dd85 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:16.525780 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f1c9d1db-584c-4ac9-9d67-5511d3af187c req-b1713c45-b867-4122-a2d7-a0091fb9dd85 service nova] Creating event network-changed:2e7d41da-66cf-475f-9ccb-40e7049d0d11 for instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f on n-h1-854663-10 Oct 27 10:54:16.534351 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f1c9d1db-584c-4ac9-9d67-5511d3af187c req-b1713c45-b867-4122-a2d7-a0091fb9dd85 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053176 Oct 27 10:54:16.535031 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3461/6724] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:54:16.620037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:16.630259 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f33780f-80be-4df9-9728-bf37e13dbc68 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1429 microversion: 2.1 time: 0.280193 Oct 27 10:54:16.644703 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3264/6725] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:16 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1429 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:54:17.655939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:17.656650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:17.663354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:17.663869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:17.664317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:17.665078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:17.665528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:17.666008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:17.818972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:17.828876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-91a71e86-a2b9-4bb3-9366-5747b0c1f83c tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1429 microversion: 2.1 time: 0.178180 Oct 27 10:54:17.829538 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3462/6726] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:17 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1429 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:18.856510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:18.858150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:18.870764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:18.871641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:18.872093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:18.873785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:18.874530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:18.876726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:19.047076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:19.061802 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c04354c-1e27-462b-9ec5-29e21f7b764e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1429 microversion: 2.1 time: 0.210725 Oct 27 10:54:19.063646 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3265/6727] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:18 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1429 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:20.089104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:20.089744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:20.098472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:20.098979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:20.099484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:20.100200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:20.100680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:20.101113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:20.258003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:20.266822 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2219d70-1467-4703-883a-b6cbb103331e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1429 microversion: 2.1 time: 0.182615 Oct 27 10:54:20.267413 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3463/6728] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:20 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1429 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:20.792927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a0460a31-dd03-4a96-9244-63dd5a5ab25e req-e02abc1c-4dc1-453f-aa7e-ce9799d8bc82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943a3ce3-f89e-4450-b3e0-b22d5ed5533f", "name": "network-vif-plugged", "status": "completed", "tag": "2e7d41da-66cf-475f-9ccb-40e7049d0d11"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:54:20.805167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a0460a31-dd03-4a96-9244-63dd5a5ab25e req-e02abc1c-4dc1-453f-aa7e-ce9799d8bc82 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:20.805651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a0460a31-dd03-4a96-9244-63dd5a5ab25e req-e02abc1c-4dc1-453f-aa7e-ce9799d8bc82 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:20.806084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a0460a31-dd03-4a96-9244-63dd5a5ab25e req-e02abc1c-4dc1-453f-aa7e-ce9799d8bc82 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:20.818743 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a0460a31-dd03-4a96-9244-63dd5a5ab25e req-e02abc1c-4dc1-453f-aa7e-ce9799d8bc82 service nova] Creating event network-vif-plugged:2e7d41da-66cf-475f-9ccb-40e7049d0d11 for instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f on n-h1-854663-10 Oct 27 10:54:20.824229 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a0460a31-dd03-4a96-9244-63dd5a5ab25e req-e02abc1c-4dc1-453f-aa7e-ce9799d8bc82 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037170 Oct 27 10:54:20.825051 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3266/6729] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:54:21.290302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:21.290941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:21.298982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:21.299506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:21.299975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:21.300703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:21.301219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:21.302031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:21.444508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:21.452853 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-886ff740-2eec-4969-b78a-ec33d605edb5 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1429 microversion: 2.1 time: 0.166817 Oct 27 10:54:21.453541 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3464/6730] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:21 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1429 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:22.477271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:22.477948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:22.484533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:22.485050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:22.485538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:22.486284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:22.486729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:22.487146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:22.633900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:22.642371 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-646a6e41-9158-46a7-8356-48c335c8e776 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1609 microversion: 2.1 time: 0.170302 Oct 27 10:54:22.642950 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3267/6731] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:22 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1609 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:22.667458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:22.668086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:22.675403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:22.675960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:22.676411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:22.677683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:22.678088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:22.678523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:22.830425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:22.845811 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94bf7d5b-3602-4d1a-96dd-6a20d3ff0474 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1609 microversion: 2.1 time: 0.182129 Oct 27 10:54:22.846795 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3465/6732] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:22 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1609 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:22.868814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:54:22.869449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:54:22.871488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:54:22.872171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:54:22.877992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:22.878513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:22.878905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:22.879664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:22.880147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:22.880653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:23.026447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:54:23.039215 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-246df42f-5b34-4bc3-bdd1-0f79e7223be3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1609 microversion: 2.1 time: 0.174262 Oct 27 10:54:23.040031 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3268/6733] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:54:22 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1609 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:54:25.010961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:54:25.016231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-dfc76751-6772-494e-b635-08c6c19c3127 req-1a600bf5-452a-4d65-99f7-1a8d147133da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943a3ce3-f89e-4450-b3e0-b22d5ed5533f", "tag": "2e7d41da-66cf-475f-9ccb-40e7049d0d11"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:54:25.027140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dfc76751-6772-494e-b635-08c6c19c3127 req-1a600bf5-452a-4d65-99f7-1a8d147133da service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:54:25.027640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dfc76751-6772-494e-b635-08c6c19c3127 req-1a600bf5-452a-4d65-99f7-1a8d147133da service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:54:25.028174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dfc76751-6772-494e-b635-08c6c19c3127 req-1a600bf5-452a-4d65-99f7-1a8d147133da service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:54:25.040996 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-dfc76751-6772-494e-b635-08c6c19c3127 req-1a600bf5-452a-4d65-99f7-1a8d147133da service nova] Creating event network-changed:2e7d41da-66cf-475f-9ccb-40e7049d0d11 for instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f on n-h1-854663-10 Oct 27 10:54:25.046172 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-dfc76751-6772-494e-b635-08c6c19c3127 req-1a600bf5-452a-4d65-99f7-1a8d147133da service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036160 Oct 27 10:54:25.046878 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3466/6734] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:03.561544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-99b05a45-0623-4038-a278-97e88cba7f7d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:03.562038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-99b05a45-0623-4038-a278-97e88cba7f7d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:03.564328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:03.565114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=40 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:03.571794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b05a45-0623-4038-a278-97e88cba7f7d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:03.572330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b05a45-0623-4038-a278-97e88cba7f7d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:03.572867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b05a45-0623-4038-a278-97e88cba7f7d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:03.573625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b05a45-0623-4038-a278-97e88cba7f7d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:03.574116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b05a45-0623-4038-a278-97e88cba7f7d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:03.574603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b05a45-0623-4038-a278-97e88cba7f7d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:03.601879 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-99b05a45-0623-4038-a278-97e88cba7f7d tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.044425 Oct 27 10:55:03.602673 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3269/6735] 10.222.0.76 () {58 vars in 1293 bytes} [Thu Oct 27 10:55:03 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:37.012962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:37.013752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=34 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:37.016785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2f4d79a9-2409-4822-aabc-e5fd59ccea8b req-8eeda9ce-3284-495b-b0d0-6af588a628a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20e84a8f-8ba1-43d9-aced-0685cf7c4fa9", "tag": "8a0b94bc-3114-40f7-9733-1b614bcb444d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:37.018984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:37.019564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:37.022266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:37.023155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:37.028849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:37.029587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:37.030030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:37.030193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2f4d79a9-2409-4822-aabc-e5fd59ccea8b req-8eeda9ce-3284-495b-b0d0-6af588a628a3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:37.030674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2f4d79a9-2409-4822-aabc-e5fd59ccea8b req-8eeda9ce-3284-495b-b0d0-6af588a628a3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:37.030904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:37.031276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2f4d79a9-2409-4822-aabc-e5fd59ccea8b req-8eeda9ce-3284-495b-b0d0-6af588a628a3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:37.031505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:37.031952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:37.043442 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2f4d79a9-2409-4822-aabc-e5fd59ccea8b req-8eeda9ce-3284-495b-b0d0-6af588a628a3 service nova] Creating event network-changed:8a0b94bc-3114-40f7-9733-1b614bcb444d for instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 on n-h2-854663-10 Oct 27 10:55:37.048977 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2f4d79a9-2409-4822-aabc-e5fd59ccea8b req-8eeda9ce-3284-495b-b0d0-6af588a628a3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036588 Oct 27 10:55:37.049841 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3270/6736] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:55:37.061617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:55:37.172222 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39ed97a6-7c9a-40f5-b3a2-3ec6e506ad61 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 204 len: 0 microversion: 2.1 time: 0.162386 Oct 27 10:55:37.173288 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3467/6737] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:55:37 2022] DELETE /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:55:37.182318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:37.183209 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:37.190831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:37.191583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:37.192246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:37.193225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:37.193751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:37.194222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:37.337238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:37.345590 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fde88260-aa99-45d3-ac6e-c4d2ead5f949 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1576 microversion: 2.1 time: 0.167643 Oct 27 10:55:37.346188 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3271/6738] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:37 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:38.370562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:38.371302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:38.379837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:38.380547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:38.381166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:38.382097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:38.382820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:38.383630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:38.523913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:38.532598 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc468e7b-d2d6-4953-8eef-77eb659ffd01 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1576 microversion: 2.1 time: 0.166795 Oct 27 10:55:38.533228 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3468/6739] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:38 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:39.290458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e80dd0f3-da67-48b1-8c33-8912a0207e16 req-bab7f878-987c-4bd2-8da2-0994c35eb432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e84a8f-8ba1-43d9-aced-0685cf7c4fa9", "name": "network-vif-deleted", "tag": "8a0b94bc-3114-40f7-9733-1b614bcb444d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:39.300575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e80dd0f3-da67-48b1-8c33-8912a0207e16 req-bab7f878-987c-4bd2-8da2-0994c35eb432 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:39.301353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e80dd0f3-da67-48b1-8c33-8912a0207e16 req-bab7f878-987c-4bd2-8da2-0994c35eb432 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:39.301784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e80dd0f3-da67-48b1-8c33-8912a0207e16 req-bab7f878-987c-4bd2-8da2-0994c35eb432 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:39.313441 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e80dd0f3-da67-48b1-8c33-8912a0207e16 req-bab7f878-987c-4bd2-8da2-0994c35eb432 service nova] Creating event network-vif-deleted:8a0b94bc-3114-40f7-9733-1b614bcb444d for instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 on n-h2-854663-10 Oct 27 10:55:39.318491 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e80dd0f3-da67-48b1-8c33-8912a0207e16 req-bab7f878-987c-4bd2-8da2-0994c35eb432 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166060 Oct 27 10:55:39.319422 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3272/6740] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:39.556072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:39.556897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:39.564848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:39.565544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:39.565996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:39.566761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:39.567228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:39.567733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:39.636300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:39.644728 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0cf43cb-329f-4194-9279-14f7ba2d6bc5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1225 microversion: 2.1 time: 0.092624 Oct 27 10:55:39.645382 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3469/6741] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:39 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:40.669302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:40.669958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:40.677233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:40.677715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:40.678148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:40.678828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:40.679280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:40.679701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:40.747096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:40.755292 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4b155c3-6a89-4285-a7dc-3bbc6391ece5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1225 microversion: 2.1 time: 0.091279 Oct 27 10:55:40.768686 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3273/6742] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:40 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:41.779254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:41.779912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:41.787109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:41.787618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:41.788078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:41.788907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:41.789396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:41.789836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:41.856032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:41.864441 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1433af5d-55db-49d6-a7f7-e2f674ba5cd7 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1225 microversion: 2.1 time: 0.089611 Oct 27 10:55:41.865175 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3470/6743] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:41 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:42.889884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:42.890478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:42.898016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:42.898501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:42.898932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:42.899629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:42.900078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:42.900501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:42.964850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:42.973583 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b20047b7-f11f-4026-ba69-cec5c10ed5a5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 200 len: 1225 microversion: 2.1 time: 0.088182 Oct 27 10:55:42.974135 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3274/6744] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:42 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:43.996477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:43.997141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:44.005045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:44.005546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:44.005987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:44.006697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:44.007162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:44.007600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:44.022301 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 could not be found. Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 HTTP/1.1 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 could not be found. Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '20e84a8f-8ba1-43d9-aced-0685cf7c4fa9'} Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 could not be found. Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 could not be found. Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:44.023987 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 could not be found. Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2d483f0-fb80-4290-ab6a-94f2b5102b3f tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9" status: 404 len: 111 microversion: 2.1 time: 0.033016 Oct 27 10:55:44.028121 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3471/6745] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:43 2022] GET /compute/v2.1/servers/20e84a8f-8ba1-43d9-aced-0685cf7c4fa9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:55:50.702381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e89f1c4c-c553-4946-8e3d-c56105d01045 req-59217ac3-62a6-4981-9869-ab4fba4df9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e02ca22-f27a-44d7-af7f-c0cc31bd9990", "tag": "0e73757f-0146-4199-ae95-89112a1508b7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:50.711736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:50.712235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:50.719055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:50.719536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:50.719966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:50.720683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:50.721128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:50.721549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:50.724033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e89f1c4c-c553-4946-8e3d-c56105d01045 req-59217ac3-62a6-4981-9869-ab4fba4df9d6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:50.724454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e89f1c4c-c553-4946-8e3d-c56105d01045 req-59217ac3-62a6-4981-9869-ab4fba4df9d6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:50.724941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e89f1c4c-c553-4946-8e3d-c56105d01045 req-59217ac3-62a6-4981-9869-ab4fba4df9d6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:50.736857 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e89f1c4c-c553-4946-8e3d-c56105d01045 req-59217ac3-62a6-4981-9869-ab4fba4df9d6 service nova] Creating event network-changed:0e73757f-0146-4199-ae95-89112a1508b7 for instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 on n-h1-854663-10 Oct 27 10:55:50.742221 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e89f1c4c-c553-4946-8e3d-c56105d01045 req-59217ac3-62a6-4981-9869-ab4fba4df9d6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043609 Oct 27 10:55:50.745318 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3472/6746] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:50.747544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:55:50.843569 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c42cf5d3-f289-40df-a6b3-6faf43b289fe tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 204 len: 0 microversion: 2.1 time: 0.146916 Oct 27 10:55:50.848086 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3275/6747] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:55:50 2022] DELETE /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:55:50.854543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:50.855276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:50.865744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:50.866249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:50.866698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:50.867415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:50.868358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:50.869168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:51.005405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:51.013748 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41e73bb2-7e87-465e-89a2-5afa0841a331 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1577 microversion: 2.1 time: 0.164060 Oct 27 10:55:51.014414 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3473/6748] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:50 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:55:52.040090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:52.041160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:52.052359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:52.052958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:52.053453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:52.054288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:52.054797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:52.055278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:52.199476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:52.213986 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5915eb3-2e1e-4c7d-badb-798075948c6d tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1577 microversion: 2.1 time: 0.179169 Oct 27 10:55:52.214895 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3276/6749] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:52 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:53.108576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d7dbb969-8837-4cc6-b0a4-a5bb72d448ce req-03a3d3d3-2d2b-4cc2-a48a-58bc8ca1e4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e02ca22-f27a-44d7-af7f-c0cc31bd9990", "name": "network-vif-deleted", "tag": "0e73757f-0146-4199-ae95-89112a1508b7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:53.120109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d7dbb969-8837-4cc6-b0a4-a5bb72d448ce req-03a3d3d3-2d2b-4cc2-a48a-58bc8ca1e4b9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:53.120828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d7dbb969-8837-4cc6-b0a4-a5bb72d448ce req-03a3d3d3-2d2b-4cc2-a48a-58bc8ca1e4b9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:53.121109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d7dbb969-8837-4cc6-b0a4-a5bb72d448ce req-03a3d3d3-2d2b-4cc2-a48a-58bc8ca1e4b9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:53.133801 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d7dbb969-8837-4cc6-b0a4-a5bb72d448ce req-03a3d3d3-2d2b-4cc2-a48a-58bc8ca1e4b9 service nova] Creating event network-vif-deleted:0e73757f-0146-4199-ae95-89112a1508b7 for instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 on n-h1-854663-10 Oct 27 10:55:53.139208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d7dbb969-8837-4cc6-b0a4-a5bb72d448ce req-03a3d3d3-2d2b-4cc2-a48a-58bc8ca1e4b9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034341 Oct 27 10:55:53.139856 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3474/6750] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:53.239909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:53.240571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:53.247813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:53.248262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:53.248688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:53.249475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:53.249922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:53.250338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:53.316028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:53.324097 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c1979f28-391d-420a-bc81-0b7a45ffbe44 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1225 microversion: 2.1 time: 0.088098 Oct 27 10:55:53.324732 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3277/6751] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:53 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:54.349196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:54.349771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:54.356564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:54.357097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:54.357542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:54.358378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:54.358846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:54.359278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:54.428125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:54.436669 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a721b8d-2e3f-499f-9246-f1a328e67481 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1225 microversion: 2.1 time: 0.092966 Oct 27 10:55:54.437315 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3475/6752] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:54 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:55.460024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:55.460605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:55.468008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:55.468489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:55.468959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:55.469803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:55.470262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:55.470688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:55.542425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:55.551324 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52c0954e-901a-4f5e-9020-882f2a3e24b4 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1225 microversion: 2.1 time: 0.094888 Oct 27 10:55:55.551945 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3278/6753] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:55 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:56.575309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:56.575920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:56.583541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:56.584052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:56.584482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:56.585282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:56.585753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:56.586200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:56.651379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:56.660836 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d794dddb-8ea3-45da-9ab0-038ec8b640fb tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1225 microversion: 2.1 time: 0.089451 Oct 27 10:55:56.661365 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3476/6754] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:56 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:57.684463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:57.685104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:57.692587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:57.693110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:57.693545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:57.694241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:57.694886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:57.695299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:57.727996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:57.728555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:57.729064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:57.729522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lazy-loading 'fault' on Instance uuid 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:55:57.772882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e16c7669eb34fa49714040f728210e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e99c27693094793bfcf910ff5798d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:57.781642 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b4c24381-21e9-455c-b416-0fa081da21bc tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 200 len: 1230 microversion: 2.1 time: 0.101198 Oct 27 10:55:57.782216 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3279/6755] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:57 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:58.805925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:58.806558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 0e02ca22-f27a-44d7-af7f-c0cc31bd9990] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:58.814227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:58.814725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:58.815170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:58.815874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:58.816338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:58.816807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:58.830949 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 could not be found. Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 HTTP/1.1 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 could not be found. Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '0e02ca22-f27a-44d7-af7f-c0cc31bd9990'} Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 could not be found. Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 could not be found. Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:58.832602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 could not be found. Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 0e02ca22-f27a-44d7-af7f-c0cc31bd9990 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20d5d49f-9e91-4b88-9501-cb58cd697f64 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990" status: 404 len: 111 microversion: 2.1 time: 0.032144 Oct 27 10:55:58.837056 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3477/6756] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:58 2022] GET /compute/v2.1/servers/0e02ca22-f27a-44d7-af7f-c0cc31bd9990 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:55:59.296777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:59.297409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:59.304562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:59.305071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:59.305510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:59.306192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:59.306640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:59.307062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:59.320645 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 HTTP/1.1 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '83b793bd-5e88-4400-9755-5f3bd8ec3736'} Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:55:59.322343 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8425241f-fb8f-4cd9-bc98-df5e5ecc3e52 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 404 len: 111 microversion: 2.1 time: 0.030959 Oct 27 10:55:59.326583 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3280/6757] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:55:59 2022] DELETE /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:55:59.333087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:59.333846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] [instance: 83b793bd-5e88-4400-9755-5f3bd8ec3736] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:59.340129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:59.340629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:59.341106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:59.341841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:59.342308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:59.342777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:59.356700 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] HTTP exception thrown: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Request method failure captured: Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 HTTP/1.1 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmBJdZJwojWsE58y35rhqGDWbeGkpWh35svTz58Scu9-VxB-4H0P7JqSlElPYt_xa1iEQgIbUMxzxGGzotiPUk3Yzvk_jA_D0AgdWr9utxCFEXJxFilMDvCMi9iSQI0ye07-BJK4Nu4Eh7F7ie-E6wlRbqhefHCBb3NEojNhKESqxLU Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3e99c27693094793bfcf910ff5798d08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3e99c27693094793bfcf910ff5798d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 3e99c27693094793bfcf910ff5798d08 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-744081927 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6e16c7669eb34fa49714040f728210e4 Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-744081927-project Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '83b793bd-5e88-4400-9755-5f3bd8ec3736'} Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:59.358253 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Returning 404 to user: Instance 83b793bd-5e88-4400-9755-5f3bd8ec3736 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f89d90a-f979-42a8-b93e-65c6e7982ff5 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736" status: 404 len: 111 microversion: 2.1 time: 0.030883 Oct 27 10:55:59.362810 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3478/6758] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:59 2022] GET /compute/v2.1/servers/83b793bd-5e88-4400-9755-5f3bd8ec3736 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:56:02.792251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f8dea521-70c1-4493-bca0-c588c3d26082 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] Calling method '.version_select at 0x7f6d5a2f5040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:56:02.823649 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f8dea521-70c1-4493-bca0-c588c3d26082 tempest-TestVolumeBootPattern-744081927 tempest-TestVolumeBootPattern-744081927-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1830090047" status: 202 len: 0 microversion: 2.1 time: 0.035314 Oct 27 10:56:02.824556 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3281/6759] 10.222.0.76 () {58 vars in 1263 bytes} [Thu Oct 27 10:56:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1830090047 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:59:07.249628 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0fef263e-49f6-40e0-92a9-76f7527873a5] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:59:07.251329 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96cdc9e5-e02f-4d91-99be-23d737d0e4ff] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:59:07.252250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:07.253504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:07.255650 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:59:07.256280 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 10:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f (ip 10.222.0.76) !!! Oct 27 10:59:07.257848 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:59:07.258025 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 10:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f (ip 10.222.0.76) !!! Oct 27 10:59:07.259377 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:59:07.259487 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 10:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f (ip 10.222.0.76) !!! Oct 27 10:59:07.263666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:07.264178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:07.279561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:07.280064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:07.280515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:07.281265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:07.281733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:07.282174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:07.311456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:59:07.401208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1824afa0-105e-4633-a806-a88a4b5497c7 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "DELETE /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 204 len: 0 microversion: 2.1 time: 0.155336 Oct 27 10:59:07.402044 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3479/6760] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:59:07 2022] DELETE /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:59:07.408272 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecd0d1de-c8ef-468a-a3de-2649f8270da1] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:59:07.409689 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3317bcd0-7139-4b6a-a168-7c5e11e5c085] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:59:07.410306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:07.411371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:07.412529 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:59:07.412872 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 10:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f (ip 10.222.0.76) !!! Oct 27 10:59:07.415697 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:59:07.415853 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 10:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f (ip 10.222.0.76) !!! Oct 27 10:59:07.417269 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:59:07.417359 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 10:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f (ip 10.222.0.76) !!! Oct 27 10:59:07.427829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:07.428480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:07.439809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:07.440297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:07.440759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:07.441469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:07.441922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:07.442353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:07.741756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:59:07.750185 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce50ab87-f4fb-41d2-9d26-a9b77c5e8c3a tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1734 microversion: 2.1 time: 0.343927 Oct 27 10:59:07.750766 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3282/6761] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:07 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1734 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:59:08.778892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:08.779664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:08.794658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:08.795144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:08.795595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:08.796317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:08.796809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:08.797252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:08.805576 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [96cdc9e5-e02f-4d91-99be-23d737d0e4ff] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 47142. Oct 27 10:59:08.808060 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [0fef263e-49f6-40e0-92a9-76f7527873a5] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 47140. Oct 27 10:59:09.006337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:59:09.017387 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d85f8ff5-0446-4e55-b6f4-af3443c0fd57 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1734 microversion: 2.1 time: 0.245393 Oct 27 10:59:09.018204 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3480/6762] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:08 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1734 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:09.830166 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [3317bcd0-7139-4b6a-a168-7c5e11e5c085] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 47152. Oct 27 10:59:09.851464 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecd0d1de-c8ef-468a-a3de-2649f8270da1] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 47150. Oct 27 10:59:09.951344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8d770ed6-03a3-4ad3-b6a6-8df8bf1359d8 req-5f7d9f23-9d21-4549-8da7-699c33ceebf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943a3ce3-f89e-4450-b3e0-b22d5ed5533f", "name": "network-vif-deleted", "tag": "2e7d41da-66cf-475f-9ccb-40e7049d0d11"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:59:09.962133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8d770ed6-03a3-4ad3-b6a6-8df8bf1359d8 req-5f7d9f23-9d21-4549-8da7-699c33ceebf2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:09.962931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8d770ed6-03a3-4ad3-b6a6-8df8bf1359d8 req-5f7d9f23-9d21-4549-8da7-699c33ceebf2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:09.963600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8d770ed6-03a3-4ad3-b6a6-8df8bf1359d8 req-5f7d9f23-9d21-4549-8da7-699c33ceebf2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:09.978911 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8d770ed6-03a3-4ad3-b6a6-8df8bf1359d8 req-5f7d9f23-9d21-4549-8da7-699c33ceebf2 service nova] Creating event network-vif-deleted:2e7d41da-66cf-475f-9ccb-40e7049d0d11 for instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f on n-h1-854663-10 Oct 27 10:59:09.986361 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8d770ed6-03a3-4ad3-b6a6-8df8bf1359d8 req-5f7d9f23-9d21-4549-8da7-699c33ceebf2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172672 Oct 27 10:59:09.986983 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3283/6763] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:59:10.154264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:10.154925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:10.161115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:10.161615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:10.162066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:10.162771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:10.163238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:10.163676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:10.196038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:10.196940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:10.197437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:10.197894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lazy-loading 'fault' on Instance uuid 943a3ce3-f89e-4450-b3e0-b22d5ed5533f {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:59:10.247386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b275eb711bb4cddb5fbd80834422862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2a3d03d22146c099a2325b9dfb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:59:10.255293 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5adeb427-2fd6-4786-9b70-54931f7d490e tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 200 len: 1389 microversion: 2.1 time: 0.216824 Oct 27 10:59:10.255882 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3481/6764] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:10 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 1389 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:11.283080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:11.284087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:11.293416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:11.293904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:11.294337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:11.295031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:11.295482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:11.295907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:11.310097 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] HTTP exception thrown: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Request method failure captured: Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f HTTP/1.1 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmNIS3jwfkVOk6XSEAIP53t1jYSOjWBV-NS7kNvJNXi5ReRyEvam89YfxChqJ_lSgkb-9pT9h3R2rbwKaaey5E9HjyrqNbb8a1HP-HsLiOtvT41hdElO1bybSaRenfxolGSgI7PY4ATgWUykzCQRkEpbGtsFMuDJOlv4IKTdMlupdWU Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: db2a3d03d22146c099a2325b9dfb6d33 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestServerBasicOps-1622812483 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/db2a3d03d22146c099a2325b9dfb6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/db2a3d03d22146c099a2325b9dfb6d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_db2a3d03d22146c099a2325b9dfb6d33", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/db2a3d03d22146c099a2325b9dfb6d33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestServerBasicOps-1622812483 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: db2a3d03d22146c099a2325b9dfb6d33 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestServerBasicOps-1622812483 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestServerBasicOps-1622812483-project Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6b275eb711bb4cddb5fbd80834422862 Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestServerBasicOps-1622812483-project Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '943a3ce3-f89e-4450-b3e0-b22d5ed5533f'} Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:59:11.311752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Returning 404 to user: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2d4a90c2-1a1b-4094-97d6-6491d2f311f3 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 404 len: 111 microversion: 2.1 time: 0.036580 Oct 27 10:59:11.316249 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3284/6765] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:11 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:59:11.781765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:11.782320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:11.789874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:11.790370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:11.790825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:11.791534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:11.792002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:11.792451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:11.809962 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] HTTP exception thrown: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Request method failure captured: Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f HTTP/1.1 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmNIS3jwfkVOk6XSEAIP53t1jYSOjWBV-NS7kNvJNXi5ReRyEvam89YfxChqJ_lSgkb-9pT9h3R2rbwKaaey5E9HjyrqNbb8a1HP-HsLiOtvT41hdElO1bybSaRenfxolGSgI7PY4ATgWUykzCQRkEpbGtsFMuDJOlv4IKTdMlupdWU Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: db2a3d03d22146c099a2325b9dfb6d33 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestServerBasicOps-1622812483 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/db2a3d03d22146c099a2325b9dfb6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/db2a3d03d22146c099a2325b9dfb6d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_db2a3d03d22146c099a2325b9dfb6d33", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/db2a3d03d22146c099a2325b9dfb6d33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestServerBasicOps-1622812483 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: db2a3d03d22146c099a2325b9dfb6d33 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestServerBasicOps-1622812483 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestServerBasicOps-1622812483-project Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6b275eb711bb4cddb5fbd80834422862 Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestServerBasicOps-1622812483-project Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '943a3ce3-f89e-4450-b3e0-b22d5ed5533f'} Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:59:11.811660 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Returning 404 to user: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48a9dabd-72af-4589-ba43-ea2f0efc1e9f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "DELETE /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 404 len: 111 microversion: 2.1 time: 0.035369 Oct 27 10:59:11.815716 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3482/6766] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:59:11 2022] DELETE /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:59:11.822256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:11.822936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] [instance: 943a3ce3-f89e-4450-b3e0-b22d5ed5533f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:11.829168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:11.829648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:11.830063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:11.830750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:11.831196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:11.831614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:11.845585 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] HTTP exception thrown: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Request method failure captured: Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f HTTP/1.1 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmNIS3jwfkVOk6XSEAIP53t1jYSOjWBV-NS7kNvJNXi5ReRyEvam89YfxChqJ_lSgkb-9pT9h3R2rbwKaaey5E9HjyrqNbb8a1HP-HsLiOtvT41hdElO1bybSaRenfxolGSgI7PY4ATgWUykzCQRkEpbGtsFMuDJOlv4IKTdMlupdWU Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: db2a3d03d22146c099a2325b9dfb6d33 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestServerBasicOps-1622812483 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/db2a3d03d22146c099a2325b9dfb6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/db2a3d03d22146c099a2325b9dfb6d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_db2a3d03d22146c099a2325b9dfb6d33", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/db2a3d03d22146c099a2325b9dfb6d33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestServerBasicOps-1622812483 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: db2a3d03d22146c099a2325b9dfb6d33 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestServerBasicOps-1622812483 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestServerBasicOps-1622812483-project Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6b275eb711bb4cddb5fbd80834422862 Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestServerBasicOps-1622812483-project Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '943a3ce3-f89e-4450-b3e0-b22d5ed5533f'} Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:59:11.847139 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Returning 404 to user: Instance 943a3ce3-f89e-4450-b3e0-b22d5ed5533f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b6e4101-8166-4100-9c0c-b56df39ad78f tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f" status: 404 len: 111 microversion: 2.1 time: 0.030453 Oct 27 10:59:11.851434 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3285/6767] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:11 2022] GET /compute/v2.1/servers/943a3ce3-f89e-4450-b3e0-b22d5ed5533f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:59:12.019186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce30dfef-eb39-4ed5-9c7e-58e3ac8b91a6 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] Calling method '.version_select at 0x7f6d638014c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:12.046753 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce30dfef-eb39-4ed5-9c7e-58e3ac8b91a6 tempest-TestServerBasicOps-1622812483 tempest-TestServerBasicOps-1622812483-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1147848928" status: 202 len: 0 microversion: 2.1 time: 0.031454 Oct 27 10:59:12.051502 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3483/6768] 10.222.0.76 () {58 vars in 1254 bytes} [Thu Oct 27 10:59:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1147848928 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:59:29.814702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:29.815480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:29.961613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-995e9b10-5d35-472c-9b44-ecd43555e388 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:29.963904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-995e9b10-5d35-472c-9b44-ecd43555e388 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:29.964401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-995e9b10-5d35-472c-9b44-ecd43555e388 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:29.964875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-995e9b10-5d35-472c-9b44-ecd43555e388 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:29.965880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-995e9b10-5d35-472c-9b44-ecd43555e388 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:29.966346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-995e9b10-5d35-472c-9b44-ecd43555e388 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:29.966775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-995e9b10-5d35-472c-9b44-ecd43555e388 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:29.991885 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-995e9b10-5d35-472c-9b44-ecd43555e388 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.183423 Oct 27 10:59:30.005193 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3286/6769] 10.222.0.76 () {58 vars in 1185 bytes} [Thu Oct 27 10:59:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:59:30.114106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1699248140", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "availability_zone": "nova:n-h1-854663-10", "networks": [{"uuid": "635fc088-ef2c-438a-8553-d10cc54b4658"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:59:30.128886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:30.129761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:30.191465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] validate_networks() for [('635fc088-ef2c-438a-8553-d10cc54b4658', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:59:30.705338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:59:30.706634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:59:30.707205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:59:30.708249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:59:30.708725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:59:30.719557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:30.720091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:30.720543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:30.721326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:30.721792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:30.722285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:30.740873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Getting quotas for project 0df6b0255da142918e1de3f687ddcda6. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:59:30.746463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Getting quotas for user e8436746414a43fb8087412b849615ec and project 0df6b0255da142918e1de3f687ddcda6. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:59:30.759016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:59:30.761479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:59:30.810621 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32023f9a-1c2c-4894-b0c1-0513a4482954 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700575 Oct 27 10:59:30.811255 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3484/6770] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:59:30.822354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ad6ce52-7a17-4f72-a620-7fcae042e11b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:30.823205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ad6ce52-7a17-4f72-a620-7fcae042e11b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:31.202651 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ad6ce52-7a17-4f72-a620-7fcae042e11b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1329 microversion: 2.1 time: 0.384076 Oct 27 10:59:31.203224 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3287/6771] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:30 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1329 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:32.227686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b1d19c4-4a09-4d1d-8545-51f84bcde0fe tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:32.228709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b1d19c4-4a09-4d1d-8545-51f84bcde0fe tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:32.293472 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b1d19c4-4a09-4d1d-8545-51f84bcde0fe tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1329 microversion: 2.1 time: 0.070899 Oct 27 10:59:32.294138 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3485/6772] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:32 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1329 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:33.320987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f11850a6-aba5-4455-8897-8071b9c1c7c3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:33.321619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f11850a6-aba5-4455-8897-8071b9c1c7c3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:33.385326 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f11850a6-aba5-4455-8897-8071b9c1c7c3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1329 microversion: 2.1 time: 0.068778 Oct 27 10:59:33.385923 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3288/6773] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:33 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1329 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:34.409047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d9d22106-eafa-4d3e-841c-d8fc4938561a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:34.409912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d9d22106-eafa-4d3e-841c-d8fc4938561a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:34.478778 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d9d22106-eafa-4d3e-841c-d8fc4938561a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1329 microversion: 2.1 time: 0.073944 Oct 27 10:59:34.479463 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3486/6774] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:34 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1329 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:35.502300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-848ab668-e232-47a6-8897-1e8cf24545a0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:35.502922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-848ab668-e232-47a6-8897-1e8cf24545a0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:35.510405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-848ab668-e232-47a6-8897-1e8cf24545a0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:35.511135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-848ab668-e232-47a6-8897-1e8cf24545a0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:35.512027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-848ab668-e232-47a6-8897-1e8cf24545a0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:35.512637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-848ab668-e232-47a6-8897-1e8cf24545a0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:35.513146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-848ab668-e232-47a6-8897-1e8cf24545a0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:35.513542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-848ab668-e232-47a6-8897-1e8cf24545a0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:35.602772 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-848ab668-e232-47a6-8897-1e8cf24545a0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1346 microversion: 2.1 time: 0.104192 Oct 27 10:59:35.604006 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3289/6775] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:35 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:36.627684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e40ef54-e8ab-47f3-b610-581a4ed5e52b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:36.628323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e40ef54-e8ab-47f3-b610-581a4ed5e52b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:36.636260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e40ef54-e8ab-47f3-b610-581a4ed5e52b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:36.636787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e40ef54-e8ab-47f3-b610-581a4ed5e52b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:36.637442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e40ef54-e8ab-47f3-b610-581a4ed5e52b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:36.638167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e40ef54-e8ab-47f3-b610-581a4ed5e52b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:36.638619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e40ef54-e8ab-47f3-b610-581a4ed5e52b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:36.639228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e40ef54-e8ab-47f3-b610-581a4ed5e52b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:36.709105 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e40ef54-e8ab-47f3-b610-581a4ed5e52b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1424 microversion: 2.1 time: 0.085212 Oct 27 10:59:36.709837 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3487/6776] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:36 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:37.512373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0dcc4813-9e79-4e90-be2d-8bef53f04a46 req-0264972a-d80b-4290-a6b6-01380c6f6d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3446ee8-32e6-4cda-933a-a62707a9e49c", "tag": "14d411e7-9513-4798-b526-c7c6721f4894"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:59:37.524404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0dcc4813-9e79-4e90-be2d-8bef53f04a46 req-0264972a-d80b-4290-a6b6-01380c6f6d45 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:37.525238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0dcc4813-9e79-4e90-be2d-8bef53f04a46 req-0264972a-d80b-4290-a6b6-01380c6f6d45 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:37.525795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0dcc4813-9e79-4e90-be2d-8bef53f04a46 req-0264972a-d80b-4290-a6b6-01380c6f6d45 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:37.537843 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0dcc4813-9e79-4e90-be2d-8bef53f04a46 req-0264972a-d80b-4290-a6b6-01380c6f6d45 service nova] Creating event network-changed:14d411e7-9513-4798-b526-c7c6721f4894 for instance a3446ee8-32e6-4cda-933a-a62707a9e49c on n-h1-854663-10 Oct 27 10:59:37.543323 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0dcc4813-9e79-4e90-be2d-8bef53f04a46 req-0264972a-d80b-4290-a6b6-01380c6f6d45 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035335 Oct 27 10:59:37.544027 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3290/6777] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:59:37.735715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99e282c1-98d9-4685-85ca-fa1bc2856040 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:37.736248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99e282c1-98d9-4685-85ca-fa1bc2856040 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:37.743734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99e282c1-98d9-4685-85ca-fa1bc2856040 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:37.744229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99e282c1-98d9-4685-85ca-fa1bc2856040 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:37.744692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99e282c1-98d9-4685-85ca-fa1bc2856040 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:37.745447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99e282c1-98d9-4685-85ca-fa1bc2856040 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:37.746135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99e282c1-98d9-4685-85ca-fa1bc2856040 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:37.746566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99e282c1-98d9-4685-85ca-fa1bc2856040 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:37.876951 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99e282c1-98d9-4685-85ca-fa1bc2856040 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1466 microversion: 2.1 time: 0.145027 Oct 27 10:59:37.877532 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3488/6778] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:37 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1466 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:38.901147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e89ac17-3578-45eb-bc8a-7cf84857a22a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:38.901894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e89ac17-3578-45eb-bc8a-7cf84857a22a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:38.908933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e89ac17-3578-45eb-bc8a-7cf84857a22a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:38.909400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e89ac17-3578-45eb-bc8a-7cf84857a22a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:38.909874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e89ac17-3578-45eb-bc8a-7cf84857a22a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:38.910568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e89ac17-3578-45eb-bc8a-7cf84857a22a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:38.911009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e89ac17-3578-45eb-bc8a-7cf84857a22a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:38.911429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e89ac17-3578-45eb-bc8a-7cf84857a22a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:39.052311 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e89ac17-3578-45eb-bc8a-7cf84857a22a tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1466 microversion: 2.1 time: 0.156213 Oct 27 10:59:39.052962 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3291/6779] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:38 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:40.079914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d338fa9-582a-4180-aad8-1c487d21217d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:40.081011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d338fa9-582a-4180-aad8-1c487d21217d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:40.091447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d338fa9-582a-4180-aad8-1c487d21217d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:40.091954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d338fa9-582a-4180-aad8-1c487d21217d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:40.092411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d338fa9-582a-4180-aad8-1c487d21217d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:40.093453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d338fa9-582a-4180-aad8-1c487d21217d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:40.094468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d338fa9-582a-4180-aad8-1c487d21217d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:40.094918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d338fa9-582a-4180-aad8-1c487d21217d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:40.234090 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d338fa9-582a-4180-aad8-1c487d21217d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1466 microversion: 2.1 time: 0.160708 Oct 27 10:59:40.234836 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3489/6780] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:40 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:41.261551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae08af8d-eebe-4eb3-9f08-acbdd481fa77 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:41.262180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae08af8d-eebe-4eb3-9f08-acbdd481fa77 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:41.264194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:41.269904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae08af8d-eebe-4eb3-9f08-acbdd481fa77 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:41.270381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae08af8d-eebe-4eb3-9f08-acbdd481fa77 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:41.270813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae08af8d-eebe-4eb3-9f08-acbdd481fa77 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:41.271506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae08af8d-eebe-4eb3-9f08-acbdd481fa77 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:41.271933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae08af8d-eebe-4eb3-9f08-acbdd481fa77 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:41.272352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae08af8d-eebe-4eb3-9f08-acbdd481fa77 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:41.418256 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae08af8d-eebe-4eb3-9f08-acbdd481fa77 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1466 microversion: 2.1 time: 0.162804 Oct 27 10:59:41.418842 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3292/6781] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:41 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1466 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:42.271072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:42.343456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7a309847-d524-431a-808e-970c2b0f7ff8 req-89f44756-9b52-47ef-8f62-127d35ab2419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3446ee8-32e6-4cda-933a-a62707a9e49c", "name": "network-vif-plugged", "status": "completed", "tag": "14d411e7-9513-4798-b526-c7c6721f4894"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:59:42.353283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7a309847-d524-431a-808e-970c2b0f7ff8 req-89f44756-9b52-47ef-8f62-127d35ab2419 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:42.353797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7a309847-d524-431a-808e-970c2b0f7ff8 req-89f44756-9b52-47ef-8f62-127d35ab2419 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:42.354223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7a309847-d524-431a-808e-970c2b0f7ff8 req-89f44756-9b52-47ef-8f62-127d35ab2419 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:42.366217 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7a309847-d524-431a-808e-970c2b0f7ff8 req-89f44756-9b52-47ef-8f62-127d35ab2419 service nova] Creating event network-vif-plugged:14d411e7-9513-4798-b526-c7c6721f4894 for instance a3446ee8-32e6-4cda-933a-a62707a9e49c on n-h1-854663-10 Oct 27 10:59:42.371533 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7a309847-d524-431a-808e-970c2b0f7ff8 req-89f44756-9b52-47ef-8f62-127d35ab2419 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105045 Oct 27 10:59:42.372144 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3490/6782] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:59:42.442475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65c9d0de-d897-4c77-84a7-c84ad0de2fe0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:42.443057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-65c9d0de-d897-4c77-84a7-c84ad0de2fe0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:42.451449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c9d0de-d897-4c77-84a7-c84ad0de2fe0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:42.451943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c9d0de-d897-4c77-84a7-c84ad0de2fe0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:42.452382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c9d0de-d897-4c77-84a7-c84ad0de2fe0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:42.453137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c9d0de-d897-4c77-84a7-c84ad0de2fe0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:42.453593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c9d0de-d897-4c77-84a7-c84ad0de2fe0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:42.454022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65c9d0de-d897-4c77-84a7-c84ad0de2fe0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:42.586657 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65c9d0de-d897-4c77-84a7-c84ad0de2fe0 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1466 microversion: 2.1 time: 0.148620 Oct 27 10:59:42.587277 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3293/6783] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:42 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1466 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:43.622452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-298906ba-9233-441d-93bf-b94b041c3da5 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:43.623487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-298906ba-9233-441d-93bf-b94b041c3da5 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:43.630426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298906ba-9233-441d-93bf-b94b041c3da5 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:43.631557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298906ba-9233-441d-93bf-b94b041c3da5 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:43.632019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298906ba-9233-441d-93bf-b94b041c3da5 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:43.632766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298906ba-9233-441d-93bf-b94b041c3da5 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:43.633235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298906ba-9233-441d-93bf-b94b041c3da5 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:43.633665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298906ba-9233-441d-93bf-b94b041c3da5 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:43.774351 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-298906ba-9233-441d-93bf-b94b041c3da5 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1466 microversion: 2.1 time: 0.159513 Oct 27 10:59:43.774950 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3491/6784] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:43 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1466 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:44.800974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8a4d28a5-f3ea-4d9b-916d-c3b41c24725d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:44.801680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a4d28a5-f3ea-4d9b-916d-c3b41c24725d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:44.803836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:44.811544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a4d28a5-f3ea-4d9b-916d-c3b41c24725d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:44.812107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a4d28a5-f3ea-4d9b-916d-c3b41c24725d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:44.812621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a4d28a5-f3ea-4d9b-916d-c3b41c24725d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:44.813470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a4d28a5-f3ea-4d9b-916d-c3b41c24725d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:44.813999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a4d28a5-f3ea-4d9b-916d-c3b41c24725d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:44.814493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a4d28a5-f3ea-4d9b-916d-c3b41c24725d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:44.953096 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8a4d28a5-f3ea-4d9b-916d-c3b41c24725d tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1650 microversion: 2.1 time: 0.157087 Oct 27 10:59:44.953673 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3294/6785] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:44 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1650 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:44.975881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-27888323-b36a-4855-8c2e-1bd9c89f2b12 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:44.976626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-27888323-b36a-4855-8c2e-1bd9c89f2b12 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:44.978704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:44.985316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27888323-b36a-4855-8c2e-1bd9c89f2b12 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:44.985818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27888323-b36a-4855-8c2e-1bd9c89f2b12 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:44.986269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27888323-b36a-4855-8c2e-1bd9c89f2b12 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:44.986977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27888323-b36a-4855-8c2e-1bd9c89f2b12 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:44.987442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27888323-b36a-4855-8c2e-1bd9c89f2b12 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:44.987882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27888323-b36a-4855-8c2e-1bd9c89f2b12 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:45.121118 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-27888323-b36a-4855-8c2e-1bd9c89f2b12 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1650 microversion: 2.1 time: 0.149022 Oct 27 10:59:45.121721 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3492/6786] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:44 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1650 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:45.143440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea7c3d4b-21f5-4035-ae07-268cccec720c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:45.144056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ea7c3d4b-21f5-4035-ae07-268cccec720c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:45.150370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7c3d4b-21f5-4035-ae07-268cccec720c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:45.150850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7c3d4b-21f5-4035-ae07-268cccec720c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:45.151286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7c3d4b-21f5-4035-ae07-268cccec720c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:45.151978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7c3d4b-21f5-4035-ae07-268cccec720c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:45.152429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7c3d4b-21f5-4035-ae07-268cccec720c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:45.152898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea7c3d4b-21f5-4035-ae07-268cccec720c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:45.295968 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea7c3d4b-21f5-4035-ae07-268cccec720c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1650 microversion: 2.1 time: 0.156029 Oct 27 10:59:45.296778 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3295/6787] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:45 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1650 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:45.372568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1188661947", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "availability_zone": "nova:n-h2-854663-10", "networks": [{"uuid": "635fc088-ef2c-438a-8553-d10cc54b4658"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:59:45.433839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] validate_networks() for [('635fc088-ef2c-438a-8553-d10cc54b4658', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:59:45.812616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:59:45.813084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:59:45.813575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:59:45.813993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:59:45.814419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:59:45.824458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:45.824981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:45.825419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:45.826168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:45.826688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:45.827076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:45.845571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Getting quotas for project 0df6b0255da142918e1de3f687ddcda6. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:59:45.851493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Getting quotas for user e8436746414a43fb8087412b849615ec and project 0df6b0255da142918e1de3f687ddcda6. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:59:45.865095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:59:45.867407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:59:45.916362 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ca26701-f8cc-40df-b90c-a64f6a96c4c9 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547515 Oct 27 10:59:45.917052 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3493/6788] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 10:59:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:59:45.929022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-146226d2-dc0b-4049-b50f-9019b09339dd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:45.929610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-146226d2-dc0b-4049-b50f-9019b09339dd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:45.991023 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-146226d2-dc0b-4049-b50f-9019b09339dd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1329 microversion: 2.1 time: 0.065851 Oct 27 10:59:45.991649 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3296/6789] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:45 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1329 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:47.016676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d48e2080-3c64-4c8e-9c6b-26801d5070fd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:47.017360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d48e2080-3c64-4c8e-9c6b-26801d5070fd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:47.026231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d48e2080-3c64-4c8e-9c6b-26801d5070fd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:47.026745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d48e2080-3c64-4c8e-9c6b-26801d5070fd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:47.027203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d48e2080-3c64-4c8e-9c6b-26801d5070fd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:47.027928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d48e2080-3c64-4c8e-9c6b-26801d5070fd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:47.028401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d48e2080-3c64-4c8e-9c6b-26801d5070fd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:47.028885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d48e2080-3c64-4c8e-9c6b-26801d5070fd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:47.129401 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d48e2080-3c64-4c8e-9c6b-26801d5070fd tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1426 microversion: 2.1 time: 0.118452 Oct 27 10:59:47.140359 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3494/6790] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:47 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1426 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:48.154462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fc7735a-0c4e-4589-9df2-c38df0f28543 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:48.156027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2fc7735a-0c4e-4589-9df2-c38df0f28543 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:48.164962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc7735a-0c4e-4589-9df2-c38df0f28543 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:48.165474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc7735a-0c4e-4589-9df2-c38df0f28543 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:48.165903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc7735a-0c4e-4589-9df2-c38df0f28543 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:48.166617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc7735a-0c4e-4589-9df2-c38df0f28543 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:48.167056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc7735a-0c4e-4589-9df2-c38df0f28543 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:48.167477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc7735a-0c4e-4589-9df2-c38df0f28543 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:48.365457 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fc7735a-0c4e-4589-9df2-c38df0f28543 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1466 microversion: 2.1 time: 0.214907 Oct 27 10:59:48.366042 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3297/6791] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:48 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1466 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:48.446707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8ebac59c-0c17-4cd6-896e-b01a2b8ca0e6 req-8ffaf927-5531-47df-8346-298c7f026739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe3108f-4d59-4999-a188-125369525846", "tag": "2539dacf-6488-46bb-853c-24f4b817701c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:59:48.460694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ebac59c-0c17-4cd6-896e-b01a2b8ca0e6 req-8ffaf927-5531-47df-8346-298c7f026739 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:48.461270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ebac59c-0c17-4cd6-896e-b01a2b8ca0e6 req-8ffaf927-5531-47df-8346-298c7f026739 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:48.461684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ebac59c-0c17-4cd6-896e-b01a2b8ca0e6 req-8ffaf927-5531-47df-8346-298c7f026739 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:48.474881 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8ebac59c-0c17-4cd6-896e-b01a2b8ca0e6 req-8ffaf927-5531-47df-8346-298c7f026739 service nova] Creating event network-changed:2539dacf-6488-46bb-853c-24f4b817701c for instance afe3108f-4d59-4999-a188-125369525846 on n-h2-854663-10 Oct 27 10:59:48.480840 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8ebac59c-0c17-4cd6-896e-b01a2b8ca0e6 req-8ffaf927-5531-47df-8346-298c7f026739 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038862 Oct 27 10:59:48.481443 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3495/6792] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:59:49.392053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7ef51bfb-2d25-42cf-b2b2-6246811d3967 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:49.392703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7ef51bfb-2d25-42cf-b2b2-6246811d3967 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:49.400090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef51bfb-2d25-42cf-b2b2-6246811d3967 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:49.400578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef51bfb-2d25-42cf-b2b2-6246811d3967 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:49.401063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef51bfb-2d25-42cf-b2b2-6246811d3967 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:49.401759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef51bfb-2d25-42cf-b2b2-6246811d3967 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:49.402210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef51bfb-2d25-42cf-b2b2-6246811d3967 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:49.402654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef51bfb-2d25-42cf-b2b2-6246811d3967 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:49.539020 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7ef51bfb-2d25-42cf-b2b2-6246811d3967 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1466 microversion: 2.1 time: 0.152379 Oct 27 10:59:49.539571 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3298/6793] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:49 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1466 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:50.565983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39360e2a-8665-4e1f-9057-be21874d7c5e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:50.566828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39360e2a-8665-4e1f-9057-be21874d7c5e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:50.576688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39360e2a-8665-4e1f-9057-be21874d7c5e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:50.577525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39360e2a-8665-4e1f-9057-be21874d7c5e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:50.577998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39360e2a-8665-4e1f-9057-be21874d7c5e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:50.578730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39360e2a-8665-4e1f-9057-be21874d7c5e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:50.579201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39360e2a-8665-4e1f-9057-be21874d7c5e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:50.579639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39360e2a-8665-4e1f-9057-be21874d7c5e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:50.723865 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39360e2a-8665-4e1f-9057-be21874d7c5e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1466 microversion: 2.1 time: 0.163080 Oct 27 10:59:50.724632 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3496/6794] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:50 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1466 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:51.747987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c0e26ab7-d0b6-42be-9ff1-c327a822fe41 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:51.748527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c0e26ab7-d0b6-42be-9ff1-c327a822fe41 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:51.756058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0e26ab7-d0b6-42be-9ff1-c327a822fe41 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:51.756545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0e26ab7-d0b6-42be-9ff1-c327a822fe41 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:51.757005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0e26ab7-d0b6-42be-9ff1-c327a822fe41 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:51.757733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0e26ab7-d0b6-42be-9ff1-c327a822fe41 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:51.758183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0e26ab7-d0b6-42be-9ff1-c327a822fe41 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:51.758604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0e26ab7-d0b6-42be-9ff1-c327a822fe41 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:51.891133 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c0e26ab7-d0b6-42be-9ff1-c327a822fe41 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1466 microversion: 2.1 time: 0.147401 Oct 27 10:59:51.891710 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3299/6795] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:51 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1466 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:52.918453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9f1d407-461b-44e7-9b3c-baf8ae297c0c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:52.919351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9f1d407-461b-44e7-9b3c-baf8ae297c0c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:52.928007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1d407-461b-44e7-9b3c-baf8ae297c0c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:52.928515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1d407-461b-44e7-9b3c-baf8ae297c0c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:52.929083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1d407-461b-44e7-9b3c-baf8ae297c0c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:52.929787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1d407-461b-44e7-9b3c-baf8ae297c0c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:52.930251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1d407-461b-44e7-9b3c-baf8ae297c0c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:52.930695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f1d407-461b-44e7-9b3c-baf8ae297c0c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:53.065150 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9f1d407-461b-44e7-9b3c-baf8ae297c0c tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1466 microversion: 2.1 time: 0.152720 Oct 27 10:59:53.065744 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3497/6796] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:52 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1466 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:53.839385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4d2604b0-fb66-491b-a174-a2bdd15766cb req-234e8055-6f87-44fa-8e85-a4f7cb1528c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe3108f-4d59-4999-a188-125369525846", "name": "network-vif-plugged", "status": "completed", "tag": "2539dacf-6488-46bb-853c-24f4b817701c"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:59:53.850355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4d2604b0-fb66-491b-a174-a2bdd15766cb req-234e8055-6f87-44fa-8e85-a4f7cb1528c0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:53.850848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4d2604b0-fb66-491b-a174-a2bdd15766cb req-234e8055-6f87-44fa-8e85-a4f7cb1528c0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:53.851260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4d2604b0-fb66-491b-a174-a2bdd15766cb req-234e8055-6f87-44fa-8e85-a4f7cb1528c0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:53.862792 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4d2604b0-fb66-491b-a174-a2bdd15766cb req-234e8055-6f87-44fa-8e85-a4f7cb1528c0 service nova] Creating event network-vif-plugged:2539dacf-6488-46bb-853c-24f4b817701c for instance afe3108f-4d59-4999-a188-125369525846 on n-h2-854663-10 Oct 27 10:59:53.867892 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4d2604b0-fb66-491b-a174-a2bdd15766cb req-234e8055-6f87-44fa-8e85-a4f7cb1528c0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032356 Oct 27 10:59:53.868508 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3300/6797] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:59:54.095070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6ab5d0d-14d9-4157-a0dd-49d98e92e803 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:54.095709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6ab5d0d-14d9-4157-a0dd-49d98e92e803 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:54.102782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ab5d0d-14d9-4157-a0dd-49d98e92e803 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:54.103284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ab5d0d-14d9-4157-a0dd-49d98e92e803 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:54.103733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ab5d0d-14d9-4157-a0dd-49d98e92e803 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:54.104443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ab5d0d-14d9-4157-a0dd-49d98e92e803 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:54.104946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ab5d0d-14d9-4157-a0dd-49d98e92e803 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:54.105388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ab5d0d-14d9-4157-a0dd-49d98e92e803 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:54.245292 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6ab5d0d-14d9-4157-a0dd-49d98e92e803 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1466 microversion: 2.1 time: 0.154834 Oct 27 10:59:54.246105 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3498/6798] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:54 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1466 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:55.272918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b976bea7-758a-42ec-9ff7-1950aa0f169b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:55.273502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b976bea7-758a-42ec-9ff7-1950aa0f169b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:55.280724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b976bea7-758a-42ec-9ff7-1950aa0f169b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.281249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b976bea7-758a-42ec-9ff7-1950aa0f169b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.281704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b976bea7-758a-42ec-9ff7-1950aa0f169b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.282466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b976bea7-758a-42ec-9ff7-1950aa0f169b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.282934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b976bea7-758a-42ec-9ff7-1950aa0f169b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.283407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b976bea7-758a-42ec-9ff7-1950aa0f169b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.433457 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b976bea7-758a-42ec-9ff7-1950aa0f169b tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1651 microversion: 2.1 time: 0.165801 Oct 27 10:59:55.434235 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3301/6799] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:55 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1651 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:55.458955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18a824bb-ebef-4407-8eaf-e20090950ed8 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:55.459589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18a824bb-ebef-4407-8eaf-e20090950ed8 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:55.467008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18a824bb-ebef-4407-8eaf-e20090950ed8 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.467550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18a824bb-ebef-4407-8eaf-e20090950ed8 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.467998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18a824bb-ebef-4407-8eaf-e20090950ed8 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.468697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18a824bb-ebef-4407-8eaf-e20090950ed8 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.469200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18a824bb-ebef-4407-8eaf-e20090950ed8 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.469738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18a824bb-ebef-4407-8eaf-e20090950ed8 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.610417 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18a824bb-ebef-4407-8eaf-e20090950ed8 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1651 microversion: 2.1 time: 0.154765 Oct 27 10:59:55.612984 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3499/6800] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:55 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1651 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:55.634340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69e3bb6c-4b8f-4bb8-b0bb-c22d9a9cf94e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:55.634951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-69e3bb6c-4b8f-4bb8-b0bb-c22d9a9cf94e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:55.640976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69e3bb6c-4b8f-4bb8-b0bb-c22d9a9cf94e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.641504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69e3bb6c-4b8f-4bb8-b0bb-c22d9a9cf94e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.641932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69e3bb6c-4b8f-4bb8-b0bb-c22d9a9cf94e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.642615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69e3bb6c-4b8f-4bb8-b0bb-c22d9a9cf94e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.643058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69e3bb6c-4b8f-4bb8-b0bb-c22d9a9cf94e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.643475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69e3bb6c-4b8f-4bb8-b0bb-c22d9a9cf94e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.775374 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-69e3bb6c-4b8f-4bb8-b0bb-c22d9a9cf94e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1651 microversion: 2.1 time: 0.144368 Oct 27 10:59:55.776501 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3302/6801] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:55 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1651 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:55.799011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:55.799525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:55.806315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.806776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.807227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.807935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.808443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.808986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.834182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:55.836909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:59:55.861633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:55.921171 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6e447e3-cd7d-4c8a-8aa9-0953c9351ba3 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "DELETE /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 204 len: 0 microversion: 2.1 time: 0.125793 Oct 27 10:59:55.921794 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3500/6802] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:59:55 2022] DELETE /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:59:55.930924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6dcedde7-8e6b-49ad-95fb-1d53a2c66b91 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:55.931545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6dcedde7-8e6b-49ad-95fb-1d53a2c66b91 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:55.937906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6dcedde7-8e6b-49ad-95fb-1d53a2c66b91 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.938389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6dcedde7-8e6b-49ad-95fb-1d53a2c66b91 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.938827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6dcedde7-8e6b-49ad-95fb-1d53a2c66b91 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.939517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6dcedde7-8e6b-49ad-95fb-1d53a2c66b91 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:55.939975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6dcedde7-8e6b-49ad-95fb-1d53a2c66b91 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:55.940399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6dcedde7-8e6b-49ad-95fb-1d53a2c66b91 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:55.988138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:56.078439 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6dcedde7-8e6b-49ad-95fb-1d53a2c66b91 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1657 microversion: 2.1 time: 0.151266 Oct 27 10:59:56.079230 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3303/6803] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:55 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:57.107495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d18cfd8b-5008-4ae8-a70c-a0ce294eedfb tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:57.108806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d18cfd8b-5008-4ae8-a70c-a0ce294eedfb tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:57.121227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18cfd8b-5008-4ae8-a70c-a0ce294eedfb tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:57.122051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18cfd8b-5008-4ae8-a70c-a0ce294eedfb tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:57.122816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18cfd8b-5008-4ae8-a70c-a0ce294eedfb tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:57.124013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18cfd8b-5008-4ae8-a70c-a0ce294eedfb tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:57.124889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18cfd8b-5008-4ae8-a70c-a0ce294eedfb tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:57.125614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d18cfd8b-5008-4ae8-a70c-a0ce294eedfb tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:57.318071 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d18cfd8b-5008-4ae8-a70c-a0ce294eedfb tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 200 len: 1657 microversion: 2.1 time: 0.217620 Oct 27 10:59:57.318666 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3501/6804] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:57 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 1657 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:57.670087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-41ef30e7-afac-4728-86b3-bee2a7fc824f req-d0adbe93-db81-46b0-8b6c-775ad3192619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe3108f-4d59-4999-a188-125369525846", "name": "network-vif-deleted", "tag": "2539dacf-6488-46bb-853c-24f4b817701c"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:59:57.681821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-41ef30e7-afac-4728-86b3-bee2a7fc824f req-d0adbe93-db81-46b0-8b6c-775ad3192619 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:57.682235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-41ef30e7-afac-4728-86b3-bee2a7fc824f req-d0adbe93-db81-46b0-8b6c-775ad3192619 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:57.682843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-41ef30e7-afac-4728-86b3-bee2a7fc824f req-d0adbe93-db81-46b0-8b6c-775ad3192619 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:57.698224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-41ef30e7-afac-4728-86b3-bee2a7fc824f req-d0adbe93-db81-46b0-8b6c-775ad3192619 service nova] Creating event network-vif-deleted:2539dacf-6488-46bb-853c-24f4b817701c for instance afe3108f-4d59-4999-a188-125369525846 on n-h2-854663-10 Oct 27 10:59:57.703583 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-41ef30e7-afac-4728-86b3-bee2a7fc824f req-d0adbe93-db81-46b0-8b6c-775ad3192619 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038125 Oct 27 10:59:57.707361 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3304/6805] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 10:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:59:58.342095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:58.342873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: afe3108f-4d59-4999-a188-125369525846] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:58.350674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:58.351177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:58.351628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:58.352375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:58.352881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:58.353331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:58.367479 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] HTTP exception thrown: Instance afe3108f-4d59-4999-a188-125369525846 could not be found. Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Request method failure captured: Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 HTTP/1.1 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmSRIVpsGzVnFzdqbW_g7PpI7_kw-5iig7qmV2ZSxTv-dM3kJMN_1PDWdDBscNwiFe-pxbMS0GfrgSBR2H7HKjCRcU-R3AXRoSSJvolgzQ2KX8lQUHQbIQeQ_90Xt7SmFp5YZnycCancgceVMrWPpyH6-46zANNIxtjPo-mHFj5ore4 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0df6b0255da142918e1de3f687ddcda6 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestServerMultinode-436750590 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0df6b0255da142918e1de3f687ddcda6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0df6b0255da142918e1de3f687ddcda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0df6b0255da142918e1de3f687ddcda6", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0df6b0255da142918e1de3f687ddcda6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestServerMultinode-436750590 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0df6b0255da142918e1de3f687ddcda6 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestServerMultinode-436750590 Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestServerMultinode-436750590-project-admin Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: e8436746414a43fb8087412b849615ec Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestServerMultinode-436750590-project-admin Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance afe3108f-4d59-4999-a188-125369525846 could not be found. Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'afe3108f-4d59-4999-a188-125369525846'} Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe3108f-4d59-4999-a188-125369525846 could not be found. Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe3108f-4d59-4999-a188-125369525846 could not be found. Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:59:58.369212 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe3108f-4d59-4999-a188-125369525846 could not be found. Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Returning 404 to user: Instance afe3108f-4d59-4999-a188-125369525846 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43ed99fd-56af-408b-a436-46de9be37d35 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846" status: 404 len: 111 microversion: 2.1 time: 0.032498 Oct 27 10:59:58.373617 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3502/6806] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:58 2022] GET /compute/v2.1/servers/afe3108f-4d59-4999-a188-125369525846 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:59:58.380433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:58.381769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:58.390971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:58.391626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:58.392189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:58.393417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:58.393938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:58.394546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:58.425918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:59:58.521431 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1826ef8a-5fac-46d5-92f4-30962caa3b4e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "DELETE /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 204 len: 0 microversion: 2.1 time: 0.144983 Oct 27 10:59:58.522000 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3305/6807] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 10:59:58 2022] DELETE /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:59:58.530736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1437989-8a8e-426b-998c-af65b40c312e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:58.531391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1437989-8a8e-426b-998c-af65b40c312e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:58.537965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1437989-8a8e-426b-998c-af65b40c312e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:58.538504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1437989-8a8e-426b-998c-af65b40c312e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:58.538955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1437989-8a8e-426b-998c-af65b40c312e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:58.539667 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1437989-8a8e-426b-998c-af65b40c312e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:58.540140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1437989-8a8e-426b-998c-af65b40c312e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:58.540584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1437989-8a8e-426b-998c-af65b40c312e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:58.676910 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1437989-8a8e-426b-998c-af65b40c312e tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1656 microversion: 2.1 time: 0.150011 Oct 27 10:59:58.677496 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3503/6808] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:58 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:59:59.700378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df7b00c8-83b7-4c2e-bb5f-e4cd6fda3280 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:59:59.701043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df7b00c8-83b7-4c2e-bb5f-e4cd6fda3280 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:59:59.708407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df7b00c8-83b7-4c2e-bb5f-e4cd6fda3280 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:59.708926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df7b00c8-83b7-4c2e-bb5f-e4cd6fda3280 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:59.709363 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df7b00c8-83b7-4c2e-bb5f-e4cd6fda3280 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:59.710064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df7b00c8-83b7-4c2e-bb5f-e4cd6fda3280 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:59:59.710515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df7b00c8-83b7-4c2e-bb5f-e4cd6fda3280 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:59:59.710939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-df7b00c8-83b7-4c2e-bb5f-e4cd6fda3280 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:59:59.729468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:59:59.851179 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df7b00c8-83b7-4c2e-bb5f-e4cd6fda3280 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1656 microversion: 2.1 time: 0.155063 Oct 27 10:59:59.851758 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3306/6809] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 10:59:59 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:00.474530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-512965bb-9474-4602-aedb-a09df0166f18 req-2e1312f8-0d48-4b4b-bb77-07d835662630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3446ee8-32e6-4cda-933a-a62707a9e49c", "name": "network-vif-deleted", "tag": "14d411e7-9513-4798-b526-c7c6721f4894"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:00.481252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:00.487480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-512965bb-9474-4602-aedb-a09df0166f18 req-2e1312f8-0d48-4b4b-bb77-07d835662630 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:00.488253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-512965bb-9474-4602-aedb-a09df0166f18 req-2e1312f8-0d48-4b4b-bb77-07d835662630 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:00.488711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-512965bb-9474-4602-aedb-a09df0166f18 req-2e1312f8-0d48-4b4b-bb77-07d835662630 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:00.494024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:00.503549 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-512965bb-9474-4602-aedb-a09df0166f18 req-2e1312f8-0d48-4b4b-bb77-07d835662630 service nova] Creating event network-vif-deleted:14d411e7-9513-4798-b526-c7c6721f4894 for instance a3446ee8-32e6-4cda-933a-a62707a9e49c on n-h1-854663-10 Oct 27 11:00:00.509627 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-512965bb-9474-4602-aedb-a09df0166f18 req-2e1312f8-0d48-4b4b-bb77-07d835662630 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038845 Oct 27 11:00:00.512873 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3504/6810] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:00:00.875074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:00.875669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:00.878751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:00.884287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:00.884791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:00.885222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:00.885916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:00.886364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:00.886785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:00.926113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:00.926353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:00.926815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:00.927322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lazy-loading 'fault' on Instance uuid a3446ee8-32e6-4cda-933a-a62707a9e49c {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:00:00.982145 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb66760c-235f-48cb-8bcf-576fc9eff501 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 200 len: 1456 microversion: 2.1 time: 0.110838 Oct 27 11:00:00.982724 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3307/6811] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:00 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 1456 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:02.009809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:02.010249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] [instance: a3446ee8-32e6-4cda-933a-a62707a9e49c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:02.018987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:02.019489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:02.019936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:02.020649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:02.021165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:02.021601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:02.036611 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] HTTP exception thrown: Instance a3446ee8-32e6-4cda-933a-a62707a9e49c could not be found. Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Request method failure captured: Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c HTTP/1.1 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmSRIVpsGzVnFzdqbW_g7PpI7_kw-5iig7qmV2ZSxTv-dM3kJMN_1PDWdDBscNwiFe-pxbMS0GfrgSBR2H7HKjCRcU-R3AXRoSSJvolgzQ2KX8lQUHQbIQeQ_90Xt7SmFp5YZnycCancgceVMrWPpyH6-46zANNIxtjPo-mHFj5ore4 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0df6b0255da142918e1de3f687ddcda6 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestServerMultinode-436750590 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0df6b0255da142918e1de3f687ddcda6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0df6b0255da142918e1de3f687ddcda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0df6b0255da142918e1de3f687ddcda6", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0df6b0255da142918e1de3f687ddcda6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestServerMultinode-436750590 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0df6b0255da142918e1de3f687ddcda6 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestServerMultinode-436750590 Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestServerMultinode-436750590-project-admin Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: e8436746414a43fb8087412b849615ec Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestServerMultinode-436750590-project-admin Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance a3446ee8-32e6-4cda-933a-a62707a9e49c could not be found. Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'a3446ee8-32e6-4cda-933a-a62707a9e49c'} Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3446ee8-32e6-4cda-933a-a62707a9e49c could not be found. Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3446ee8-32e6-4cda-933a-a62707a9e49c could not be found. Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:02.038330 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3446ee8-32e6-4cda-933a-a62707a9e49c could not be found. Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] Returning 404 to user: Instance a3446ee8-32e6-4cda-933a-a62707a9e49c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3e5a85b-9940-4eef-bf54-6cf90825f978 tempest-TestServerMultinode-436750590 tempest-TestServerMultinode-436750590-project-admin] 10.222.0.76 "GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c" status: 404 len: 111 microversion: 2.1 time: 0.036729 Oct 27 11:00:02.042353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3505/6812] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:02 2022] GET /compute/v2.1/servers/a3446ee8-32e6-4cda-933a-a62707a9e49c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:00:20.787811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:20.788551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:20.917361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-819864778", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:20.969942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] validate_networks() for None {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:00:21.241937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:00:21.242330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:00:21.242802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:00:21.243211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:00:21.243623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:00:21.253453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:21.254484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:21.254933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:21.255666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:21.256119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:21.256546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:21.276040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Getting quotas for project b74fa2c6fd5040c5b14755654f86f10f. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:00:21.281889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Getting quotas for user 997af9618dbc46e6a31c3f3574de0ac3 and project b74fa2c6fd5040c5b14755654f86f10f. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:00:21.297807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:00:21.301670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:00:21.352853 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77c95629-3a5e-49f4-af36-6832a6bed259 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570101 Oct 27 11:00:21.357315 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3308/6813] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:00:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:00:21.370317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-622801ec-3b45-4841-821d-1e0fa3206ebc tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:21.371075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-622801ec-3b45-4841-821d-1e0fa3206ebc tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:21.373744 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:21.374678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:21.435699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-622801ec-3b45-4841-821d-1e0fa3206ebc tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:21.443197 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-622801ec-3b45-4841-821d-1e0fa3206ebc tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1221 microversion: 2.1 time: 0.077001 Oct 27 11:00:21.443802 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3506/6814] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:21 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:22.468809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:22.469403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:22.477530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:22.478015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:22.478519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:22.479289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:22.480100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:22.480541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:22.550446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:22.559227 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3c5672c2-df9a-471a-a452-86856956467d tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1281 microversion: 2.1 time: 0.096109 Oct 27 11:00:22.560692 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3309/6815] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:22 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:23.584379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:23.585027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:23.594046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:23.594551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:23.595002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:23.595723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:23.596312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:23.596808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:23.737233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:23.746928 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4cae4095-20b5-4e58-8b8e-18662bfe9c01 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1321 microversion: 2.1 time: 0.166981 Oct 27 11:00:23.747878 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3507/6816] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:23 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:24.513171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-cba60262-d701-44a9-9ecf-b28068ab93fe req-ad7a046b-f4f5-493a-933b-9d3d52bc0a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "432289eb-ab25-4b5f-9c6e-c049a8038680", "tag": "7d281518-4fc0-428c-a388-6f4f47281d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:24.526106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cba60262-d701-44a9-9ecf-b28068ab93fe req-ad7a046b-f4f5-493a-933b-9d3d52bc0a3b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:24.526855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cba60262-d701-44a9-9ecf-b28068ab93fe req-ad7a046b-f4f5-493a-933b-9d3d52bc0a3b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:24.527485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cba60262-d701-44a9-9ecf-b28068ab93fe req-ad7a046b-f4f5-493a-933b-9d3d52bc0a3b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:24.539839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-cba60262-d701-44a9-9ecf-b28068ab93fe req-ad7a046b-f4f5-493a-933b-9d3d52bc0a3b service nova] Creating event network-changed:7d281518-4fc0-428c-a388-6f4f47281d62 for instance 432289eb-ab25-4b5f-9c6e-c049a8038680 on n-h1-854663-10 Oct 27 11:00:24.544754 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-cba60262-d701-44a9-9ecf-b28068ab93fe req-ad7a046b-f4f5-493a-933b-9d3d52bc0a3b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035752 Oct 27 11:00:24.545931 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3310/6817] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:00:24.771501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:24.772135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:24.781116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:24.781792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:24.782289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:24.783061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:24.783488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:24.783941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:24.930356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:24.940053 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7cb9003-a8f9-49a6-a7d4-c03388eaf252 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1321 microversion: 2.1 time: 0.172653 Oct 27 11:00:24.940768 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3508/6818] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:24 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:25.967959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:25.968987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:25.978544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:25.979680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:25.980301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:25.981398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:25.982038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:25.982635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:26.123304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:26.131370 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f80ced4-cca7-460e-869e-a98bf525f882 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1321 microversion: 2.1 time: 0.170831 Oct 27 11:00:26.131950 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3311/6819] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:25 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:27.159409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:27.160467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:27.171935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:27.172818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:27.173964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:27.175105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:27.176033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:27.176938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:27.314483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:27.322604 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59a75cf7-cae1-4c39-a989-11ea076956d1 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1321 microversion: 2.1 time: 0.170021 Oct 27 11:00:27.323202 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3509/6820] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:27 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:28.348695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:28.349632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:28.357237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:28.357714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:28.358150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:28.358849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:28.359294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:28.359714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:28.492947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:28.501403 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8631f445-a656-44c6-9f40-1209c3b8902c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1321 microversion: 2.1 time: 0.158749 Oct 27 11:00:28.502106 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3312/6821] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:28 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:29.526611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:29.527279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:29.535072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:29.535603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:29.536080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:29.536866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:29.537357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:29.537922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:29.690027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:29.698071 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-884f3fe5-ad95-495a-8cb7-2c063430f859 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1321 microversion: 2.1 time: 0.176028 Oct 27 11:00:29.698647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3510/6822] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:29 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:30.516085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9e468ee7-c837-4391-b72b-15fbb0d389af req-3f1e203c-c088-4286-a01e-e1af54196265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432289eb-ab25-4b5f-9c6e-c049a8038680", "name": "network-vif-plugged", "status": "completed", "tag": "7d281518-4fc0-428c-a388-6f4f47281d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:30.526075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e468ee7-c837-4391-b72b-15fbb0d389af req-3f1e203c-c088-4286-a01e-e1af54196265 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:30.526550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e468ee7-c837-4391-b72b-15fbb0d389af req-3f1e203c-c088-4286-a01e-e1af54196265 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:30.526971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e468ee7-c837-4391-b72b-15fbb0d389af req-3f1e203c-c088-4286-a01e-e1af54196265 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:30.538657 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9e468ee7-c837-4391-b72b-15fbb0d389af req-3f1e203c-c088-4286-a01e-e1af54196265 service nova] Creating event network-vif-plugged:7d281518-4fc0-428c-a388-6f4f47281d62 for instance 432289eb-ab25-4b5f-9c6e-c049a8038680 on n-h1-854663-10 Oct 27 11:00:30.544099 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9e468ee7-c837-4391-b72b-15fbb0d389af req-3f1e203c-c088-4286-a01e-e1af54196265 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032635 Oct 27 11:00:30.544711 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3313/6823] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:00:30.721301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:30.721940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:30.729461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:30.729967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:30.730423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:30.731127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:30.731595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:30.732037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:30.879936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:30.888756 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17473c91-7fe8-4b80-bd51-a6262ef5702c tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1321 microversion: 2.1 time: 0.171571 Oct 27 11:00:30.889343 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3511/6824] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:30 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:31.908706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:31.909498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:31.914580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:31.915282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:31.922429 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:31.922912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:31.923713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:31.924387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:31.924888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:31.925384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:32.068156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:32.076367 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1da00aa1-34fb-4a68-bf13-ae23d68a28ac tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1470 microversion: 2.1 time: 0.168699 Oct 27 11:00:32.076947 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3314/6825] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:31 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:32.103855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:32.162382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43d93e6f-bf36-4143-8e01-189ff490f370 tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Calling method '.version_select at 0x7f6d5a8b1280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:32.235650 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43d93e6f-bf36-4143-8e01-189ff490f370 tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/824596db41ef475eafa4037fc794bdf1" status: 200 len: 371 microversion: 2.1 time: 0.137683 Oct 27 11:00:32.236232 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3512/6826] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 11:00:32 2022] GET /compute/v2.1/os-quota-sets/824596db41ef475eafa4037fc794bdf1 => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:00:32.251169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff13b7d3-4573-4db9-9e56-c43cd01be52c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1461242456", "id": 1061574858, "os-flavor-access:is_public": "True"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:32.278866 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff13b7d3-4573-4db9-9e56-c43cd01be52c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.033485 Oct 27 11:00:32.279647 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3315/6827] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:00:32 2022] POST /compute/v2.1/flavors => generated 438 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:00:32.292653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1061574858"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:32.295076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:32.301920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:32.302444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:32.302881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:32.303702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:32.304161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:32.304646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:32.403600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c3182d6bea034ccea0715b75717442cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824596db41ef475eafa4037fc794bdf1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:32.410559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1461242456 {{(pid=120720) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:00:32.418052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:32.418541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:32.418981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:32.419721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:32.420178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:32.420617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:32.443946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Getting quotas for project b74fa2c6fd5040c5b14755654f86f10f. Resources: {'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:00:32.449467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Getting quotas for user 997af9618dbc46e6a31c3f3574de0ac3 and project b74fa2c6fd5040c5b14755654f86f10f. Resources: {'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:00:32.464853 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.api [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] ram quota exceeded for 824596db41ef475eafa4037fc794bdf1, tried to resize instance. Oct 27 11:00:32.465409 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Request method failure captured: Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680/action HTTP/1.1 Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 39 Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmTE_44DEl1GdpZq2kCn3cRqgPJCMV-EF1oryNUnT73bTuXVQi70y7OHR835ww8wf309cC9G-3YZ7NGAwejHYlCaoISYYtaj3hWS1Tg9y2qGCHk0NVvX0geRktvcvRTQnBViMYrgnKBG1mSvW8fELk1PfxToafrfWAYehPPF3lydJpY Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 824596db41ef475eafa4037fc794bdf1 Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1764473340 Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,admin,reader Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,admin,reader Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/824596db41ef475eafa4037fc794bdf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/824596db41ef475eafa4037fc794bdf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_824596db41ef475eafa4037fc794bdf1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/824596db41ef475eafa4037fc794bdf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1764473340 Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 824596db41ef475eafa4037fc794bdf1 Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1764473340 Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersAdminNegativeTestJSON-1764473340-project-admin Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: c3182d6bea034ccea0715b75717442cd Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1764473340-project-admin Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: {"resize": {"flavorRef": "1061574858"}} Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '432289eb-ab25-4b5f-9c6e-c049a8038680', 'body': {'resize': {'flavorRef': '1061574858'}}} Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 11:00:32.467391 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14512d64-8636-415c-ae1b-7e7f42f778df tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680/action" status: 403 len: 118 microversion: 2.1 time: 0.180341 Oct 27 11:00:32.471791 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3513/6828] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:00:32 2022] POST /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680/action => generated 118 bytes in 182 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:00:32.478076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d29cd4ee-4e3a-4ae4-9c7c-b13828fca7d9 tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:32.497898 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d29cd4ee-4e3a-4ae4-9c7c-b13828fca7d9 tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1061574858" status: 202 len: 0 microversion: 2.1 time: 0.023777 Oct 27 11:00:32.498573 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3316/6829] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 11:00:32 2022] DELETE /compute/v2.1/flavors/1061574858 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:00:32.507110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd769919-474e-442e-a928-e851077e1f09 tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:32.527653 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd769919-474e-442e-a928-e851077e1f09 tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024611 Oct 27 11:00:32.528204 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3514/6830] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 11:00:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:32.549138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4dbf3598-8f1a-4fdd-883a-576e1bcd7c0e tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Calling method '.version_select at 0x7f6d5acbf940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:32.620862 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4dbf3598-8f1a-4fdd-883a-576e1bcd7c0e tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "GET /compute/v2.1/os-quota-sets/824596db41ef475eafa4037fc794bdf1" status: 200 len: 371 microversion: 2.1 time: 0.075910 Oct 27 11:00:32.621431 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3317/6831] 10.222.0.76 () {58 vars in 1242 bytes} [Thu Oct 27 11:00:32 2022] GET /compute/v2.1/os-quota-sets/824596db41ef475eafa4037fc794bdf1 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:00:32.639488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5401b1d3-c507-4595-8cd0-5a9ea9ecdc3d tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-871756112", "id": 1350646495, "os-flavor-access:is_public": "True"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:32.666113 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5401b1d3-c507-4595-8cd0-5a9ea9ecdc3d tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.032182 Oct 27 11:00:32.667087 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3515/6832] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:00:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:00:32.679640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1350646495"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:32.682051 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:32.688273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:32.688785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:32.689224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:32.689922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:32.690371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:32.690793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:32.890232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c3182d6bea034ccea0715b75717442cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824596db41ef475eafa4037fc794bdf1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:32.896623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-871756112 {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:00:32.903738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:32.904206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:32.904636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:32.905392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:32.905836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:32.906249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:32.929346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Getting quotas for project b74fa2c6fd5040c5b14755654f86f10f. Resources: {'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:00:32.934577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Getting quotas for user 997af9618dbc46e6a31c3f3574de0ac3 and project b74fa2c6fd5040c5b14755654f86f10f. Resources: {'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:00:32.947143 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.compute.api [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] cores quota exceeded for 824596db41ef475eafa4037fc794bdf1, tried to resize instance. Oct 27 11:00:32.947966 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Request method failure captured: Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680/action HTTP/1.1 Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 39 Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmTE_44DEl1GdpZq2kCn3cRqgPJCMV-EF1oryNUnT73bTuXVQi70y7OHR835ww8wf309cC9G-3YZ7NGAwejHYlCaoISYYtaj3hWS1Tg9y2qGCHk0NVvX0geRktvcvRTQnBViMYrgnKBG1mSvW8fELk1PfxToafrfWAYehPPF3lydJpY Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 824596db41ef475eafa4037fc794bdf1 Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1764473340 Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,admin,reader Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,admin,reader Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/824596db41ef475eafa4037fc794bdf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/824596db41ef475eafa4037fc794bdf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_824596db41ef475eafa4037fc794bdf1", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/824596db41ef475eafa4037fc794bdf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1764473340 Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 824596db41ef475eafa4037fc794bdf1 Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1764473340 Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersAdminNegativeTestJSON-1764473340-project-admin Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: c3182d6bea034ccea0715b75717442cd Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1764473340-project-admin Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: {"resize": {"flavorRef": "1350646495"}} Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '432289eb-ab25-4b5f-9c6e-c049a8038680', 'body': {'resize': {'flavorRef': '1350646495'}}} Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 11:00:32.963569 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-02b61c41-4c1a-4dc6-aa8d-9ed9302dbb4c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "POST /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680/action" status: 403 len: 113 microversion: 2.1 time: 0.289474 Oct 27 11:00:32.968099 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3318/6833] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:00:32 2022] POST /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680/action => generated 113 bytes in 291 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:00:32.973958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-998c84f0-584d-42b8-a6c1-8b4673313c76 tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:32.993537 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-998c84f0-584d-42b8-a6c1-8b4673313c76 tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "DELETE /compute/v2.1/flavors/1350646495" status: 202 len: 0 microversion: 2.1 time: 0.023262 Oct 27 11:00:32.994165 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3516/6834] 10.222.0.76 () {58 vars in 1161 bytes} [Thu Oct 27 11:00:32 2022] DELETE /compute/v2.1/flavors/1350646495 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:00:33.002317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c1e8ee2d-4da9-498f-9df2-300a73154a9c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:33.026511 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c1e8ee2d-4da9-498f-9df2-300a73154a9c tempest-ServersAdminNegativeTestJSON-1764473340 tempest-ServersAdminNegativeTestJSON-1764473340-project-admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027875 Oct 27 11:00:33.027055 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3319/6835] 10.222.0.76 () {58 vars in 1146 bytes} [Thu Oct 27 11:00:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:33.050618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:33.051181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:33.060275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:33.061058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:33.061683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:33.062757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:33.063417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:33.064067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:33.091866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:00:33.183662 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ac1549f-f7e2-47b3-8d14-4d52cf0cade6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "DELETE /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 204 len: 0 microversion: 2.1 time: 0.139193 Oct 27 11:00:33.184700 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3517/6836] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:00:33 2022] DELETE /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:00:33.193448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:33.194402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:33.201697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:33.202176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:33.202621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:33.203326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:33.203780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:33.204201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:33.347673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:33.356160 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e66f6510-cf96-419b-9501-f48de0cd4cc6 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1476 microversion: 2.1 time: 0.167426 Oct 27 11:00:33.356766 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3320/6837] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:33 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:00:34.384920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:34.385679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:34.393123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:34.393653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:34.394104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:34.394822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:34.395302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:34.395771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:34.539026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:34.547295 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79412b00-3efc-49cb-96ba-0e455ec43f3f tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1476 microversion: 2.1 time: 0.167226 Oct 27 11:00:34.547871 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3518/6838] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:34 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:35.285815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b7ffbe44-7610-4431-80e7-080a16ff9c56 req-832e7a37-45c9-4d30-9f9e-01bb9fd907c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432289eb-ab25-4b5f-9c6e-c049a8038680", "name": "network-vif-deleted", "tag": "7d281518-4fc0-428c-a388-6f4f47281d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:35.296886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7ffbe44-7610-4431-80e7-080a16ff9c56 req-832e7a37-45c9-4d30-9f9e-01bb9fd907c1 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:35.297372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7ffbe44-7610-4431-80e7-080a16ff9c56 req-832e7a37-45c9-4d30-9f9e-01bb9fd907c1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:35.297809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7ffbe44-7610-4431-80e7-080a16ff9c56 req-832e7a37-45c9-4d30-9f9e-01bb9fd907c1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:35.310943 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b7ffbe44-7610-4431-80e7-080a16ff9c56 req-832e7a37-45c9-4d30-9f9e-01bb9fd907c1 service nova] Creating event network-vif-deleted:7d281518-4fc0-428c-a388-6f4f47281d62 for instance 432289eb-ab25-4b5f-9c6e-c049a8038680 on n-h1-854663-10 Oct 27 11:00:35.316963 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b7ffbe44-7610-4431-80e7-080a16ff9c56 req-832e7a37-45c9-4d30-9f9e-01bb9fd907c1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034798 Oct 27 11:00:35.318071 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3321/6839] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:00:35.571871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:35.572471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:35.579947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:35.580426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:35.580988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:35.581711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:35.582174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:35.582613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:35.617409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:35.618217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:35.618666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:35.619134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lazy-loading 'fault' on Instance uuid 432289eb-ab25-4b5f-9c6e-c049a8038680 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:00:35.662602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997af9618dbc46e6a31c3f3574de0ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74fa2c6fd5040c5b14755654f86f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:35.670753 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-febbb3bf-df26-4bf5-a6b0-8d809247eaf2 tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 200 len: 1311 microversion: 2.1 time: 0.102927 Oct 27 11:00:35.671376 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3519/6840] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:35 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:36.696508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:36.697133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] [instance: 432289eb-ab25-4b5f-9c6e-c049a8038680] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:36.706073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:36.706739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:36.707368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:36.708339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:36.708901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:36.709547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:36.728888 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] HTTP exception thrown: Instance 432289eb-ab25-4b5f-9c6e-c049a8038680 could not be found. Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Request method failure captured: Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 HTTP/1.1 Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmTE20c5gmH27-yvf3K1Gih3DPdlZgVKu0V9y-7_MvjEHZJznEA246eJ7fBnG5n6SiZNNO5DwT-IXDLm2C-fSMcdUunO7D45UamsC7QkpIhXoeAMHajDAnGRXKJiJgwu4xMAm-tfGqQZZnzg0mAbG-FdMryNd8puZniiRW_DFw_OpYE Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: b74fa2c6fd5040c5b14755654f86f10f Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-244315489 Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b74fa2c6fd5040c5b14755654f86f10f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b74fa2c6fd5040c5b14755654f86f10f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b74fa2c6fd5040c5b14755654f86f10f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b74fa2c6fd5040c5b14755654f86f10f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersAdminNegativeTestJSON-244315489 Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: b74fa2c6fd5040c5b14755654f86f10f Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-244315489 Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersAdminNegativeTestJSON-244315489-project Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 997af9618dbc46e6a31c3f3574de0ac3 Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersAdminNegativeTestJSON-244315489-project Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 432289eb-ab25-4b5f-9c6e-c049a8038680 could not be found. Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '432289eb-ab25-4b5f-9c6e-c049a8038680'} Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 432289eb-ab25-4b5f-9c6e-c049a8038680 could not be found. Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 432289eb-ab25-4b5f-9c6e-c049a8038680 could not be found. Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:36.730557 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 432289eb-ab25-4b5f-9c6e-c049a8038680 could not be found. Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] Returning 404 to user: Instance 432289eb-ab25-4b5f-9c6e-c049a8038680 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa84c225-ddd2-414b-a172-1ef305764ddd tempest-ServersAdminNegativeTestJSON-244315489 tempest-ServersAdminNegativeTestJSON-244315489-project] 10.222.0.76 "GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680" status: 404 len: 111 microversion: 2.1 time: 0.040990 Oct 27 11:00:36.734835 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3322/6841] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:36 2022] GET /compute/v2.1/servers/432289eb-ab25-4b5f-9c6e-c049a8038680 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:00:43.081647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:43.082464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:43.206835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-235165175", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9a9b45ea-a5aa-4b8a-bad6-6110b82ae809"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:43.264641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] validate_networks() for [('9a9b45ea-a5aa-4b8a-bad6-6110b82ae809', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:00:43.669976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:00:43.670412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:00:43.670902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:00:43.671365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:00:43.671789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:00:43.682015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:43.682516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:43.682963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:43.683708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:43.684163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:43.684610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:43.702441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Getting quotas for project ff84f7e66282400ca6765a90a98f4f2d. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:00:43.708217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Getting quotas for user f2c9feb1126246ff87bae8bf3e4ebe3e and project ff84f7e66282400ca6765a90a98f4f2d. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:00:43.722142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:00:43.724542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:00:43.773193 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5da03297-6a1b-43be-aa45-679f6bd9c792 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696443 Oct 27 11:00:43.773945 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3520/6842] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:00:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:00:43.785305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-565c482f-a114-4ec7-b3da-4023d6aa7529 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:43.785910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-565c482f-a114-4ec7-b3da-4023d6aa7529 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:43.789945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:43.790898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:43.862908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-565c482f-a114-4ec7-b3da-4023d6aa7529 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:43.870358 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-565c482f-a114-4ec7-b3da-4023d6aa7529 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1214 microversion: 2.1 time: 0.088901 Oct 27 11:00:43.870941 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3323/6843] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:43 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:44.894874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:44.896084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:44.907694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:44.908199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:44.908650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:44.909500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:44.909998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:44.910408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:44.986099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:44.998501 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1970af4-f5aa-408f-af5e-b753a14ad9c6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1274 microversion: 2.1 time: 0.108646 Oct 27 11:00:44.999534 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3521/6844] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:44 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:00:46.022691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:46.023351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:46.031246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:46.031655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:46.032094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:46.033059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:46.033518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:46.033950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:46.217234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:46.227106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4f5aa611-b4a9-456d-a7e3-88680bfc41a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1314 microversion: 2.1 time: 0.208788 Oct 27 11:00:46.227685 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3324/6845] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:46 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:46.494060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c5a2fc2e-f476-46db-8cc9-9d65bb0b9698 req-35ab8987-c057-4eb0-b89c-db9f32cf1bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f928ef-14d9-4ea2-99e9-50d8df12f0f5", "tag": "fe7bf414-be36-46da-9851-65496cb38c62"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:46.506764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a2fc2e-f476-46db-8cc9-9d65bb0b9698 req-35ab8987-c057-4eb0-b89c-db9f32cf1bb4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:46.507584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a2fc2e-f476-46db-8cc9-9d65bb0b9698 req-35ab8987-c057-4eb0-b89c-db9f32cf1bb4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:46.508359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a2fc2e-f476-46db-8cc9-9d65bb0b9698 req-35ab8987-c057-4eb0-b89c-db9f32cf1bb4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:46.531799 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c5a2fc2e-f476-46db-8cc9-9d65bb0b9698 req-35ab8987-c057-4eb0-b89c-db9f32cf1bb4 service nova] Creating event network-changed:fe7bf414-be36-46da-9851-65496cb38c62 for instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 on n-h1-854663-10 Oct 27 11:00:46.539112 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c5a2fc2e-f476-46db-8cc9-9d65bb0b9698 req-35ab8987-c057-4eb0-b89c-db9f32cf1bb4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048858 Oct 27 11:00:46.540450 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3522/6846] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:00:47.252526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:47.253107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:47.261400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:47.261987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:47.262601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:47.263630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:47.264249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:47.264853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:47.411031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:47.419091 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-794ad83e-fa0b-4025-832a-dc636e6ed2ba tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1314 microversion: 2.1 time: 0.170630 Oct 27 11:00:47.419673 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3325/6847] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:47 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:48.444653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:48.445471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:48.453695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:48.454184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:48.454634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:48.455347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:48.455859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:48.456288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:48.593455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:48.601417 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3f21eca-5ccd-45f6-bd10-9d8b2d430e54 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1314 microversion: 2.1 time: 0.162184 Oct 27 11:00:48.602108 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3523/6848] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:48 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:49.625054 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:49.625644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:49.633639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:49.634134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:49.634566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:49.635257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:49.635697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:49.636120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:49.778205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:49.786496 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7c28250-6313-4a54-b71a-88a65f3071e9 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1314 microversion: 2.1 time: 0.165404 Oct 27 11:00:49.787048 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3326/6849] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:49 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:50.601343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d5e4a8ca-b663-4ede-b6c2-d8d537a1a43c req-88b54c55-6a93-49f9-89e7-9a710a23ca8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f928ef-14d9-4ea2-99e9-50d8df12f0f5", "name": "network-vif-plugged", "status": "completed", "tag": "fe7bf414-be36-46da-9851-65496cb38c62"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:50.614260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d5e4a8ca-b663-4ede-b6c2-d8d537a1a43c req-88b54c55-6a93-49f9-89e7-9a710a23ca8b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:50.614757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d5e4a8ca-b663-4ede-b6c2-d8d537a1a43c req-88b54c55-6a93-49f9-89e7-9a710a23ca8b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:50.615196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d5e4a8ca-b663-4ede-b6c2-d8d537a1a43c req-88b54c55-6a93-49f9-89e7-9a710a23ca8b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:50.629744 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d5e4a8ca-b663-4ede-b6c2-d8d537a1a43c req-88b54c55-6a93-49f9-89e7-9a710a23ca8b service nova] Creating event network-vif-plugged:fe7bf414-be36-46da-9851-65496cb38c62 for instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 on n-h1-854663-10 Oct 27 11:00:50.634959 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d5e4a8ca-b663-4ede-b6c2-d8d537a1a43c req-88b54c55-6a93-49f9-89e7-9a710a23ca8b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037511 Oct 27 11:00:50.635569 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3524/6850] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:00:50.814206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:50.814888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:50.818723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:50.824851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:50.825328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:50.825761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:50.826454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:50.826897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:50.827317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:50.832689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=72 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:50.963781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:50.972312 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e81e4fd2-b6f1-4807-ad12-8a86ea76f442 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1314 microversion: 2.1 time: 0.164852 Oct 27 11:00:50.972933 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3327/6851] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:50 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:51.997395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:51.998133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:52.000243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:52.006215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:52.006712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:52.007233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:52.008050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:52.008511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:52.008976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:52.012841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:52.153481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:52.161544 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb37b437-0c9c-44be-bfd4-a5b01500f5a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1500 microversion: 2.1 time: 0.169622 Oct 27 11:00:52.162123 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3525/6852] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:51 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:52.185329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:00:52.187742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:52.194852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:52.195265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:52.195813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:52.196515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:52.196994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:52.197412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:52.230228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:52.235816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Old instance type m1.heat2, new instance type m1.heat {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:00:52.242280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:00:52.242899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:00:52.243360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:00:52.243762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:00:52.244168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:00:52.324638 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e790472-2bd2-46c9-b9f2-f253c5cf7526 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "POST /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5/action" status: 202 len: 0 microversion: 2.1 time: 0.143512 Oct 27 11:00:52.325399 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3328/6853] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:00:52 2022] POST /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:00:52.334037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:52.334815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:52.341229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:52.341733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:52.342178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:52.342895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:52.343358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:52.343831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:52.479076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:52.487227 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3adb1c2-2cfc-4f58-b8ad-eb9c9cc55598 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1509 microversion: 2.1 time: 0.157212 Oct 27 11:00:52.488138 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3526/6854] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:52 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:53.512229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:53.512881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:53.520149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:53.520847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:53.521296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:53.522127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:53.522584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:53.523011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:53.669601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:53.678289 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-615c2f97-941e-421d-a26f-735b5519df88 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1509 microversion: 2.1 time: 0.171032 Oct 27 11:00:53.678858 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3329/6855] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:53 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:54.705700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:54.706546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:54.710214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:54.711661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:54.723014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:54.723542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:54.723916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:54.724648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:54.725193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:54.725722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:54.871491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:54.879633 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-456b5cb7-f0fc-4348-941e-ac8b6916c5c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.180976 Oct 27 11:00:54.880212 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3527/6856] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:54 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:55.914427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:55.915558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:55.917544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:00:55.924691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:55.925218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:55.925656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:55.926358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:55.926812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:55.927236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:56.071080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:56.079468 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc5e65e0-0182-45e7-bb94-70b745ca6e23 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.171638 Oct 27 11:00:56.080061 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3330/6857] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:55 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:57.107800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:57.108620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:57.119469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:57.119967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:57.120418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:57.121196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:57.121696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:57.122134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:57.270391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:57.278804 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2e8b6bd-5f30-479a-9250-3fa0340a323a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.178288 Oct 27 11:00:57.279388 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3528/6858] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:57 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:58.303881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:58.304503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:58.313666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:58.314242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:58.314773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:58.315597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:58.316124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:58.316648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:58.459467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:58.468116 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c7ba947c-60b9-4869-9ce6-1f58b313f16c tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.169014 Oct 27 11:00:58.468695 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3331/6859] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:58 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:00:59.495369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:00:59.496034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:00:59.504059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:59.504624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:59.505146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:59.505946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:00:59.506461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:00:59.506951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:00:59.650634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:00:59.659227 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddbee99e-42dc-40d9-9de3-2829361f56ce tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.170201 Oct 27 11:00:59.659805 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3529/6860] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:00:59 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:00.682878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:00.683405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:00.690592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:00.691068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:00.691500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:00.692185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:00.692634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:00.693092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:00.835885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:00.845390 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3cd4e9a2-e071-4a56-8101-66ec7de2e767 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.166909 Oct 27 11:01:00.845979 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3332/6861] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:00 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:01.871272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:01.871877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:01.879275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:01.879771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:01.880218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:01.880957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:01.881414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:01.881852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:02.022871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:02.031706 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17e2b1b5-6be1-49bf-ae88-2ad57c713d4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.165395 Oct 27 11:01:02.032576 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3530/6862] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:01 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:03.060202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:03.060839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:03.068246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:03.068763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:03.069205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:03.069914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:03.070366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:03.070784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:03.211411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:03.220096 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa33bf5a-14d2-4b66-96aa-2f95938c9853 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.164186 Oct 27 11:01:03.220693 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3333/6863] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:03 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:04.244367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:04.245044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:04.252156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:04.252833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:04.253298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:04.254001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:04.254467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:04.254901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:04.407409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:04.416598 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e569ba72-67c4-42a6-b407-525199fd96a2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.176399 Oct 27 11:01:04.417129 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3531/6864] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:04 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:05.439879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:05.440586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:05.448437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:05.448949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:05.449453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:05.450239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:05.450723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:05.451147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:05.600438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:05.609079 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ca582e7a-14b2-4bdd-b097-a7316e285160 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.173307 Oct 27 11:01:05.609679 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3334/6865] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:05 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:06.632346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:06.633014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:06.641002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:06.641515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:06.641960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:06.642671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:06.643134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:06.643570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:06.797692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:06.806487 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5ce89e9-52dd-4051-ab21-c880e8ea1a5d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.178247 Oct 27 11:01:06.807075 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3532/6866] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:06 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:07.831189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:07.831798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:07.839970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:07.840565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:07.841078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:07.841808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:07.842284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:07.842686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:07.988078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:08.000980 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b7a75400-6fe4-4075-a484-bf7d35d3da27 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.173383 Oct 27 11:01:08.001844 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3335/6867] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:07 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:09.031773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:09.032436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:09.039759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:09.040278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:09.040779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:09.041516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:09.042000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:09.042456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:09.191261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:09.199496 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec1bcb5c-ef12-408e-b2cf-99ca750d6446 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.173057 Oct 27 11:01:09.200055 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3533/6868] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:09 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:10.227658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:10.228611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:10.237599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:10.238086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:10.238522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:10.239247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:10.239696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:10.240123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:10.378456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:10.390439 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25b52a8b-7537-4ca4-be02-f28395ac9315 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.169342 Oct 27 11:01:10.391054 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3336/6869] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:10 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:11.414865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:11.415497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:11.423482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:11.423984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:11.424445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:11.425194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:11.425657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:11.426098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:11.566215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:11.579091 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14013628-1e1c-41a4-a97f-5de27098786a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.167962 Oct 27 11:01:11.579837 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3534/6870] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:11 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:12.606720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:12.607810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:12.619455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:12.620251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:12.621029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:12.622163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:12.622913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:12.623611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:12.772536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:12.781114 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-612c3639-a08c-423c-99bb-b0593eeb3606 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.180924 Oct 27 11:01:12.781657 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3337/6871] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:12 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:13.809731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:13.810754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:13.823043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:13.823857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:13.824603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:13.825817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:13.826585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:13.827307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:13.962151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:13.970851 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a0dfe80-a227-4e75-9175-7fe3dfc54c77 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.167654 Oct 27 11:01:13.971457 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3535/6872] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:13 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:14.994106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:14.994688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:15.002453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:15.002934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:15.003372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:15.004056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:15.004501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:15.004951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:15.140957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:15.149197 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f2b73d2d-62bc-486e-b964-099a28a573d1 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.159126 Oct 27 11:01:15.149773 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3338/6873] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:14 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:16.175582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:16.176251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:16.183758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:16.184256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:16.184697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:16.185440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:16.185896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:16.186315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:16.350189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:16.362324 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ff23615-1d54-46f5-baa6-4e8e6b394234 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.192153 Oct 27 11:01:16.363040 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3536/6874] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:16 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:17.395492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:17.396235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:17.406724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:17.407427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:17.408147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:17.409673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:17.409873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:17.410421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:17.546738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:17.556411 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bd1b1d93-e0d5-4b72-b249-7bfd1386321b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.167258 Oct 27 11:01:17.557018 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3339/6875] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:17 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:18.580172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:18.580794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:18.588654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:18.589196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:18.589669 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:18.590379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:18.590845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:18.591291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:18.732694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:18.741321 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df8bae09-a5c6-4b58-a611-42c98b151f91 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.165177 Oct 27 11:01:18.741899 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3537/6876] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:18 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:19.769448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:19.770024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:19.777570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:19.778060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:19.778494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:19.779338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:19.779650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:19.780059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:19.927937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:19.936456 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4953f1e6-f000-4c05-a9ea-8804fff53f4e tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.173723 Oct 27 11:01:19.937133 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3340/6877] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:19 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:20.963694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:20.964415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:20.973580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:20.974244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:20.974781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:20.975733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:20.976402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:20.976990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:21.114592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:21.123258 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80fd2c05-850c-4a79-870a-5d8e4bc91894 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1514 microversion: 2.1 time: 0.165142 Oct 27 11:01:21.123843 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3538/6878] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:20 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:22.146675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:22.147261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:22.150064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=32 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:22.156272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:22.156777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:22.157200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:22.157903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:22.158355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:22.158780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:22.161527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:22.396210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7f5fd0e5-0ae9-4385-b140-03c61357ad4d req-d9e4e6b8-3a25-4bb0-9732-35477dfebd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f928ef-14d9-4ea2-99e9-50d8df12f0f5", "name": "network-vif-unplugged", "status": "completed", "tag": "fe7bf414-be36-46da-9851-65496cb38c62"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:01:22.401663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=28 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:22.413919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f5fd0e5-0ae9-4385-b140-03c61357ad4d req-d9e4e6b8-3a25-4bb0-9732-35477dfebd9a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:22.413919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f5fd0e5-0ae9-4385-b140-03c61357ad4d req-d9e4e6b8-3a25-4bb0-9732-35477dfebd9a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:22.413919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f5fd0e5-0ae9-4385-b140-03c61357ad4d req-d9e4e6b8-3a25-4bb0-9732-35477dfebd9a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:22.415183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=84 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:22.424971 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7f5fd0e5-0ae9-4385-b140-03c61357ad4d req-d9e4e6b8-3a25-4bb0-9732-35477dfebd9a service nova] Creating event network-vif-unplugged:fe7bf414-be36-46da-9851-65496cb38c62 for instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 on n-h2-854663-10 Oct 27 11:01:22.431147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-7f5fd0e5-0ae9-4385-b140-03c61357ad4d req-d9e4e6b8-3a25-4bb0-9732-35477dfebd9a service nova] Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:01:22.443447 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7f5fd0e5-0ae9-4385-b140-03c61357ad4d req-d9e4e6b8-3a25-4bb0-9732-35477dfebd9a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118435 Oct 27 11:01:22.444117 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3539/6879] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:01:22.692121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:22.700922 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2603e7b1-4c9c-409a-ab99-c514a2925a26 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1513 microversion: 2.1 time: 0.558304 Oct 27 11:01:22.701529 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3341/6880] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:22 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1513 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:23.729622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:23.730253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:23.737294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:23.737792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:23.738271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:23.738957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:23.739457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:23.739902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:23.894057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:23.902495 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4e38fea-6399-4cb6-b9b8-a83840e13a6b tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1511 microversion: 2.1 time: 0.179649 Oct 27 11:01:23.903099 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3540/6881] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:23 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:24.688181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a3dc6525-99b3-4fc6-b0b2-499d77b24fba req-cb81375b-79b8-4e83-a41c-edacb691112c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f928ef-14d9-4ea2-99e9-50d8df12f0f5", "tag": "fe7bf414-be36-46da-9851-65496cb38c62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:01:24.707615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a3dc6525-99b3-4fc6-b0b2-499d77b24fba req-cb81375b-79b8-4e83-a41c-edacb691112c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:24.708156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a3dc6525-99b3-4fc6-b0b2-499d77b24fba req-cb81375b-79b8-4e83-a41c-edacb691112c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:24.708928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a3dc6525-99b3-4fc6-b0b2-499d77b24fba req-cb81375b-79b8-4e83-a41c-edacb691112c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:24.723381 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a3dc6525-99b3-4fc6-b0b2-499d77b24fba req-cb81375b-79b8-4e83-a41c-edacb691112c service nova] Creating event network-changed:fe7bf414-be36-46da-9851-65496cb38c62 for instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 on n-h2-854663-10 Oct 27 11:01:24.730110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-a3dc6525-99b3-4fc6-b0b2-499d77b24fba req-cb81375b-79b8-4e83-a41c-edacb691112c service nova] Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:01:24.744582 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a3dc6525-99b3-4fc6-b0b2-499d77b24fba req-cb81375b-79b8-4e83-a41c-edacb691112c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066990 Oct 27 11:01:24.745616 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3342/6882] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:01:24.930128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:24.932329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:24.941837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:24.942457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:24.942970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:24.944089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:24.944765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:24.945281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:25.185745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:25.193650 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c87f07c-7a6f-496d-8901-99ca9e02b3f2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1511 microversion: 2.1 time: 0.271246 Oct 27 11:01:25.194353 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3541/6883] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:24 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:26.218623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:26.219355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:26.225967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:26.226454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:26.226891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:26.227595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:26.228047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:26.228471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:26.369702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:26.379866 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3620672f-111c-49f5-9b2d-d27718c63bc6 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1508 microversion: 2.1 time: 0.166181 Oct 27 11:01:26.380608 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3343/6884] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:26 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:26.402591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:26.403258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:26.410748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:26.411248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:26.411764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:26.412515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:26.413170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:26.413612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:26.440538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:01:26.494975 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.api [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Found an unconfirmed migration during delete, id: 16, status: finished Oct 27 11:01:28.288648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-800aa276-817e-472e-9364-34a2b0f655bd req-7a7ad395-0900-4bab-8f18-129f62577711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f928ef-14d9-4ea2-99e9-50d8df12f0f5", "name": "network-vif-plugged", "status": "completed", "tag": "fe7bf414-be36-46da-9851-65496cb38c62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:01:28.299712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-800aa276-817e-472e-9364-34a2b0f655bd req-7a7ad395-0900-4bab-8f18-129f62577711 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:28.300175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-800aa276-817e-472e-9364-34a2b0f655bd req-7a7ad395-0900-4bab-8f18-129f62577711 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:28.300880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-800aa276-817e-472e-9364-34a2b0f655bd req-7a7ad395-0900-4bab-8f18-129f62577711 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:28.313100 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-800aa276-817e-472e-9364-34a2b0f655bd req-7a7ad395-0900-4bab-8f18-129f62577711 service nova] Creating event network-vif-plugged:fe7bf414-be36-46da-9851-65496cb38c62 for instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 on n-h2-854663-10 Oct 27 11:01:28.318308 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-800aa276-817e-472e-9364-34a2b0f655bd req-7a7ad395-0900-4bab-8f18-129f62577711 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033538 Oct 27 11:01:28.318901 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3344/6885] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:01:28.627559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08055c4d-9065-4f44-8b0a-f0936a2de95f tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 204 len: 0 microversion: 2.1 time: 2.228395 Oct 27 11:01:28.628157 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3542/6886] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:01:26 2022] DELETE /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 0 bytes in 2230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:01:28.637566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:28.638270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:28.644653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:28.645176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:28.645638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:28.646331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:28.646803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:28.647248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:28.784223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:28.792547 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c524711e-181a-4466-aa4f-97425748d7c5 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1500 microversion: 2.1 time: 0.159590 Oct 27 11:01:28.793173 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3345/6887] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:28 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:29.822539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:29.823730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:29.836219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:29.836727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:29.837209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:29.837920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:29.838368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:29.838848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:30.058735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c9feb1126246ff87bae8bf3e4ebe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff84f7e66282400ca6765a90a98f4f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:30.066718 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6634f7e8-a54d-46df-b7dd-7e39c490385d tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 200 len: 1500 microversion: 2.1 time: 0.251738 Oct 27 11:01:30.067338 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3543/6888] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:29 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 1500 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:30.455905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c1e30701-debb-4982-a5e2-a5356dd9a59e req-6f486b0f-a9f9-4bc5-8d58-ad456293e21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f928ef-14d9-4ea2-99e9-50d8df12f0f5", "name": "network-vif-deleted", "tag": "fe7bf414-be36-46da-9851-65496cb38c62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:01:30.466942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c1e30701-debb-4982-a5e2-a5356dd9a59e req-6f486b0f-a9f9-4bc5-8d58-ad456293e21a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:30.467708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c1e30701-debb-4982-a5e2-a5356dd9a59e req-6f486b0f-a9f9-4bc5-8d58-ad456293e21a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:30.468315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c1e30701-debb-4982-a5e2-a5356dd9a59e req-6f486b0f-a9f9-4bc5-8d58-ad456293e21a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:30.480743 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c1e30701-debb-4982-a5e2-a5356dd9a59e req-6f486b0f-a9f9-4bc5-8d58-ad456293e21a service nova] Creating event network-vif-deleted:fe7bf414-be36-46da-9851-65496cb38c62 for instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 on n-h2-854663-10 Oct 27 11:01:30.486017 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c1e30701-debb-4982-a5e2-a5356dd9a59e req-6f486b0f-a9f9-4bc5-8d58-ad456293e21a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033950 Oct 27 11:01:30.486667 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3346/6889] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:01:31.093768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:31.095048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:31.104575 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:31.105107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:31.105561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:31.106271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:31.106736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:31.107211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:31.121432 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] HTTP exception thrown: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Request method failure captured: Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 HTTP/1.1 Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmTaZ76f4moisiU30D1Bh_-cno7TxRcpX0mIu21dUZiVxsmynBT34eBpBh8HnKzqcgMHoIfN4DVMsPte_DhHWm0pLAVp_jsuja-KbzoFO3v-kpu5tC7nfWUuZwZ9F1DnqeJT9BeuZ-1FBe65sS78SgnUYNr7JusZpefAph9blst1sco Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ff84f7e66282400ca6765a90a98f4f2d Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1819561512 Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ff84f7e66282400ca6765a90a98f4f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ff84f7e66282400ca6765a90a98f4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ff84f7e66282400ca6765a90a98f4f2d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ff84f7e66282400ca6765a90a98f4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1819561512 Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ff84f7e66282400ca6765a90a98f4f2d Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819561512 Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1819561512-project Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: f2c9feb1126246ff87bae8bf3e4ebe3e Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1819561512-project Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b3f928ef-14d9-4ea2-99e9-50d8df12f0f5'} Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:01:31.123125 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Returning 404 to user: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3526531-c965-435d-b332-ce2d08deb72a tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 404 len: 111 microversion: 2.1 time: 0.037484 Oct 27 11:01:31.127398 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3544/6890] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:31 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:01:31.139913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:31.140493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:31.147538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:31.148012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:31.148450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:31.149159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:31.149601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:31.150015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:31.163688 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] HTTP exception thrown: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Request method failure captured: Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 HTTP/1.1 Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmTaZ76f4moisiU30D1Bh_-cno7TxRcpX0mIu21dUZiVxsmynBT34eBpBh8HnKzqcgMHoIfN4DVMsPte_DhHWm0pLAVp_jsuja-KbzoFO3v-kpu5tC7nfWUuZwZ9F1DnqeJT9BeuZ-1FBe65sS78SgnUYNr7JusZpefAph9blst1sco Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: ff84f7e66282400ca6765a90a98f4f2d Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1819561512 Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ff84f7e66282400ca6765a90a98f4f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ff84f7e66282400ca6765a90a98f4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ff84f7e66282400ca6765a90a98f4f2d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ff84f7e66282400ca6765a90a98f4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1819561512 Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: ff84f7e66282400ca6765a90a98f4f2d Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819561512 Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1819561512-project Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: f2c9feb1126246ff87bae8bf3e4ebe3e Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1819561512-project Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'b3f928ef-14d9-4ea2-99e9-50d8df12f0f5'} Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:01:31.165930 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Returning 404 to user: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab4867d0-e39c-4d4f-a78c-3c385abcd7f7 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 404 len: 111 microversion: 2.1 time: 0.032006 Oct 27 11:01:31.170322 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3347/6891] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:01:31 2022] DELETE /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 11:01:31.176833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:31.177466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] [instance: b3f928ef-14d9-4ea2-99e9-50d8df12f0f5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:31.184208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:31.184718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:31.185177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:31.185876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:31.186338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:31.186774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:31.200733 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] HTTP exception thrown: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Request method failure captured: Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 HTTP/1.1 Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmTaZ76f4moisiU30D1Bh_-cno7TxRcpX0mIu21dUZiVxsmynBT34eBpBh8HnKzqcgMHoIfN4DVMsPte_DhHWm0pLAVp_jsuja-KbzoFO3v-kpu5tC7nfWUuZwZ9F1DnqeJT9BeuZ-1FBe65sS78SgnUYNr7JusZpefAph9blst1sco Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: ff84f7e66282400ca6765a90a98f4f2d Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1819561512 Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ff84f7e66282400ca6765a90a98f4f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ff84f7e66282400ca6765a90a98f4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ff84f7e66282400ca6765a90a98f4f2d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ff84f7e66282400ca6765a90a98f4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1819561512 Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: ff84f7e66282400ca6765a90a98f4f2d Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819561512 Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1819561512-project Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: f2c9feb1126246ff87bae8bf3e4ebe3e Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1819561512-project Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'b3f928ef-14d9-4ea2-99e9-50d8df12f0f5'} Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:01:31.202266 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] Returning 404 to user: Instance b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1589b8c5-d790-4256-a7fa-08b7ea1ef2c2 tempest-DeleteServersTestJSON-1819561512 tempest-DeleteServersTestJSON-1819561512-project] 10.222.0.76 "GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5" status: 404 len: 111 microversion: 2.1 time: 0.031272 Oct 27 11:01:31.206366 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3545/6892] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:31 2022] GET /compute/v2.1/servers/b3f928ef-14d9-4ea2-99e9-50d8df12f0f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:01:39.812520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-41875362", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9ea2ea41-2b3c-4e14-af74-54ff12df1f3d"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:01:39.897384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] validate_networks() for [('9ea2ea41-2b3c-4e14-af74-54ff12df1f3d', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:01:40.321149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:01:40.321581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:01:40.322062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:01:40.322468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:01:40.322882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:01:40.335853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:40.336367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:40.337195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:40.337941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:40.338580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:40.339012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:40.365023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Getting quotas for project 4055b626f0d244f7afd6b690e66106a2. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:01:40.374208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Getting quotas for user 990a087321c84a81956782c5a63ea794 and project 4055b626f0d244f7afd6b690e66106a2. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:01:40.392979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:01:40.395763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:01:40.449331 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-89240eed-487a-489e-9e6d-e3010e2ce6a1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758174 Oct 27 11:01:40.450316 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3348/6893] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:01:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 11:01:40.461646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7eb074d-b60d-4ee9-a388-4ca5e21f0bc8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:40.462906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7eb074d-b60d-4ee9-a388-4ca5e21f0bc8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:40.526270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7eb074d-b60d-4ee9-a388-4ca5e21f0bc8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:40.535434 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7eb074d-b60d-4ee9-a388-4ca5e21f0bc8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1216 microversion: 2.1 time: 0.076998 Oct 27 11:01:40.537690 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3546/6894] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:40 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:41.561351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:41.561939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:41.570472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:41.570995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:41.571475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:41.572259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:41.572746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:41.573226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:41.644702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:41.653922 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e10105cd-32ce-4f69-a421-b3a4a6358b2c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1276 microversion: 2.1 time: 0.097303 Oct 27 11:01:41.654632 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3349/6895] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:41 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:01:42.679652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:42.681533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:42.690732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:42.695040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:42.697421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:42.700904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:42.702263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:42.703781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:42.704591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:42.873382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:42.881740 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a4a2565-8208-4ea1-8152-e1ffb6fcc317 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1316 microversion: 2.1 time: 0.206281 Oct 27 11:01:42.895062 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3547/6896] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:42 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:43.379050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4fc8294e-d290-4e8b-995f-f2053f7d1107 req-a09639a9-7115-4737-9012-13ef9c42bd5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e175476c-2cfc-4ca2-b7bd-4476c5e336c5", "tag": "7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:01:43.391173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4fc8294e-d290-4e8b-995f-f2053f7d1107 req-a09639a9-7115-4737-9012-13ef9c42bd5b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:43.391655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4fc8294e-d290-4e8b-995f-f2053f7d1107 req-a09639a9-7115-4737-9012-13ef9c42bd5b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:43.392092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4fc8294e-d290-4e8b-995f-f2053f7d1107 req-a09639a9-7115-4737-9012-13ef9c42bd5b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:43.406431 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4fc8294e-d290-4e8b-995f-f2053f7d1107 req-a09639a9-7115-4737-9012-13ef9c42bd5b service nova] Creating event network-changed:7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9 for instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 on n-h1-854663-10 Oct 27 11:01:43.411874 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4fc8294e-d290-4e8b-995f-f2053f7d1107 req-a09639a9-7115-4737-9012-13ef9c42bd5b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041018 Oct 27 11:01:43.412412 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3350/6897] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:01:43.906326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:43.907149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:43.914723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:43.915225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:43.915756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:43.916386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:43.916911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:43.917586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:44.050081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:44.058437 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b52b1485-e009-4c8c-a9fe-56037fba8216 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1316 microversion: 2.1 time: 0.156962 Oct 27 11:01:44.059022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3548/6898] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:43 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:45.083642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:45.084347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:45.091625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:45.092120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:45.092559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:45.093327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:45.093791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:45.094285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:45.233659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:45.241906 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3474dc48-3f75-4f22-9cf7-57a3c7e94064 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1316 microversion: 2.1 time: 0.163392 Oct 27 11:01:45.242771 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3351/6899] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:45 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:46.266010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:46.266746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:46.276738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:46.277246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:46.277700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:46.278460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:46.278926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:46.279368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:46.422677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:46.432797 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9fde001-fedd-4b58-af30-45d63618fe90 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1316 microversion: 2.1 time: 0.171379 Oct 27 11:01:46.433339 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3549/6900] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:46 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:47.455974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:47.456594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:47.464241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:47.464763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:47.465247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:47.465973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:47.466427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:47.466849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:47.608689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:47.620697 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dad666a9-508f-4234-8a03-a145b58aa47e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1316 microversion: 2.1 time: 0.168746 Oct 27 11:01:47.621279 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3352/6901] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:47 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:48.653970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:48.655555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:48.662152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:48.662660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:48.663113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:48.663825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:48.664289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:48.664761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:48.800331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:48.808630 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-635c7fa4-857f-4170-9477-b476545bad59 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1316 microversion: 2.1 time: 0.159616 Oct 27 11:01:48.818858 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3550/6902] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:48 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:48.851115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a4d9989b-61ef-4432-9c31-940e8cbe5361 req-e22660dc-9ffd-48b8-886b-b8e610646c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e175476c-2cfc-4ca2-b7bd-4476c5e336c5", "name": "network-vif-plugged", "status": "completed", "tag": "7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:01:48.862750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a4d9989b-61ef-4432-9c31-940e8cbe5361 req-e22660dc-9ffd-48b8-886b-b8e610646c42 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:48.864176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a4d9989b-61ef-4432-9c31-940e8cbe5361 req-e22660dc-9ffd-48b8-886b-b8e610646c42 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:48.864611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a4d9989b-61ef-4432-9c31-940e8cbe5361 req-e22660dc-9ffd-48b8-886b-b8e610646c42 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:48.876757 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a4d9989b-61ef-4432-9c31-940e8cbe5361 req-e22660dc-9ffd-48b8-886b-b8e610646c42 service nova] Creating event network-vif-plugged:7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9 for instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 on n-h1-854663-10 Oct 27 11:01:48.883334 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a4d9989b-61ef-4432-9c31-940e8cbe5361 req-e22660dc-9ffd-48b8-886b-b8e610646c42 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036352 Oct 27 11:01:48.883941 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3353/6903] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:01:49.832367 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:49.833090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:49.841422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:49.841993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:49.842516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:49.843330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:49.843773 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:49.844281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:49.990477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:50.000574 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b4ad68f0-610b-4382-846d-7e7009a1063a tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1316 microversion: 2.1 time: 0.172587 Oct 27 11:01:50.001204 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3551/6904] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:49 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:51.028460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:51.029605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:51.033931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:51.034940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:51.044149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.044634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.045127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.045821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.046276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.046700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.188814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:51.197201 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16b51b70-40ee-42b6-be70-b20c9529ceb5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1506 microversion: 2.1 time: 0.175436 Oct 27 11:01:51.197785 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3354/6905] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:51 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:51.220925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:51.221572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:51.223581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:51.230091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.230585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.231054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.231755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.232215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.232649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.377174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:51.385583 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96482adf-fe11-4074-9800-35b8531b24cd tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1506 microversion: 2.1 time: 0.168602 Oct 27 11:01:51.386140 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3552/6906] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:51 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:51.408006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0cb3a68c-7837-49ce-8a0a-af0e21acb737 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:01:51.410456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0cb3a68c-7837-49ce-8a0a-af0e21acb737 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:51.416878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cb3a68c-7837-49ce-8a0a-af0e21acb737 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.417445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cb3a68c-7837-49ce-8a0a-af0e21acb737 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.418063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cb3a68c-7837-49ce-8a0a-af0e21acb737 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.418760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cb3a68c-7837-49ce-8a0a-af0e21acb737 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.419206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cb3a68c-7837-49ce-8a0a-af0e21acb737 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.419630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cb3a68c-7837-49ce-8a0a-af0e21acb737 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.497126 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0cb3a68c-7837-49ce-8a0a-af0e21acb737 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "PUT /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1078 microversion: 2.1 time: 0.093010 Oct 27 11:01:51.497761 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3355/6907] 10.222.0.76 () {60 vars in 1256 bytes} [Thu Oct 27 11:01:51 2022] PUT /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1078 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:51.516350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:51.517082 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:51.523294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.523790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.524264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.524996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.525468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.525889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.664055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:51.672605 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-177bab48-778f-414f-97e2-b21e6c8bba66 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1504 microversion: 2.1 time: 0.159942 Oct 27 11:01:51.673239 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3553/6908] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:51 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:51.695073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:51.695677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:51.702254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.702766 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.703203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.703924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.704348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.704813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.836070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:51.844133 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13469a74-98ce-441b-ac0e-142742c084b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1504 microversion: 2.1 time: 0.153014 Oct 27 11:01:51.844750 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3356/6909] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:51 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:51.866578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:01:51.869001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:51.875582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.876091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.876528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.877246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:51.877699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:51.878125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:51.907018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:51.912481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Old instance type m1.heat2, new instance type m1.heat {{(pid=120720) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:01:51.919286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:01:51.919699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:01:51.920173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:01:51.920588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:01:51.921026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:01:52.000933 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec921072-79de-46e5-b257-9cdc651c6374 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "POST /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5/action" status: 202 len: 0 microversion: 2.1 time: 0.138320 Oct 27 11:01:52.001615 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3554/6910] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:01:51 2022] POST /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:01:52.009790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:52.010405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:52.016515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:52.017028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:52.017457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:52.018183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:52.018615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:52.019303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:52.156531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:52.164788 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dbae871e-2a44-4f66-a54c-1e1949ccca73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1515 microversion: 2.1 time: 0.158882 Oct 27 11:01:52.165348 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3357/6911] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:52 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:53.189799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:53.190462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:53.192422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:53.198788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:53.199393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:53.200123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:53.201201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:53.201696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:53.202106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:53.336591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:53.345048 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-34d470bc-1578-4e74-98c1-adbde65cd40f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1515 microversion: 2.1 time: 0.160045 Oct 27 11:01:53.345603 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3555/6912] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:53 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:54.372984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:54.373513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:54.376223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:54.381751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:54.382235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:54.382673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:54.383353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:54.383805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:54.384235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:54.387626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:01:54.524072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:54.532791 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1357255-e1c2-4315-9159-377f6bc31638 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.166481 Oct 27 11:01:54.533365 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3358/6913] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:54 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:55.565472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:55.566256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:55.575611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:55.576232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:55.576963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:55.577717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:55.578188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:55.578627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:55.715471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:55.727637 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25d8e6d5-9792-46ae-b320-db4c75b68c42 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.167008 Oct 27 11:01:55.729033 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3556/6914] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:55 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:56.754824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:56.755484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:56.763520 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:56.764140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:56.764630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:56.765439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:56.765943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:56.766421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:56.916378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:56.926612 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0cf738f5-8b62-4ee2-ab60-9a350014b1e7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.176339 Oct 27 11:01:56.927179 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3359/6915] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:56 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:57.955122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:57.955892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:57.964973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:57.965588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:57.966140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:57.967012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:57.967665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:57.968210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:58.124055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:58.132646 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-291af64e-1a95-40a2-9014-2d47eb0c3f44 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.183597 Oct 27 11:01:58.133255 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3557/6916] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:57 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:01:59.168099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:01:59.169033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:01:59.177365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:59.177843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:59.178273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:59.178956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:01:59.179399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:01:59.179820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:01:59.316843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:01:59.329103 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce6ea3e0-0ed8-4047-b88b-938e6c397071 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.167035 Oct 27 11:01:59.329685 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3360/6917] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:01:59 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:00.356228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:00.357168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:00.367069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:00.367567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:00.368016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:00.368768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:00.369270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:00.369713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:00.508868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:00.516951 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a30ae30b-3078-4271-bc15-18d2f2e41dd8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.167516 Oct 27 11:02:00.517628 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3558/6918] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:00 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:01.553022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:01.553937 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:01.564488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:01.565098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:01.565542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:01.566243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:01.566695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:01.567117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:01.707992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:01.716213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b8549c57-5e39-4384-a0ee-7ee5e65a0bcb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.169616 Oct 27 11:02:01.716814 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3361/6919] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:01 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:02.739541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:02.740148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:02.747795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:02.748296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:02.748783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:02.749494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:02.749960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:02.750449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:02.901812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:02.912511 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5c4883e-1cb9-4844-a2bf-b55da6eee7ac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.177051 Oct 27 11:02:02.913131 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3559/6920] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:02 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:03.941194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:03.941790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:03.949284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:03.949769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:03.950204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:03.950900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:03.951346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:03.951769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:04.099679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:04.108194 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be63e98b-3599-405d-9998-99f90bebe0ec tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.173857 Oct 27 11:02:04.108769 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3362/6921] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:03 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:05.135247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:05.136131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:05.146329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:05.146826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:05.147281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:05.147978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:05.148443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:05.148918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:05.294428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:05.305026 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-522b0448-0cca-4fd6-8947-a1ea335644b5 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.175876 Oct 27 11:02:05.305624 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3560/6922] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:05 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:06.336752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:06.337809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:06.349184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:06.349665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:06.350110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:06.350801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:06.351283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:06.351732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:06.490130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:06.503176 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83b29d24-c264-41a9-b5c8-1fb2e95bf8a7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.172784 Oct 27 11:02:06.504037 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3363/6923] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:06 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:07.527707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:07.528359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:07.535651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:07.536131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:07.536608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:07.537386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:07.537873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:07.538291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:07.673518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:07.685473 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4afec7f0-e639-43e4-abaa-a629f29da71c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.161617 Oct 27 11:02:07.686270 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3561/6924] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:07 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:08.714175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:08.714730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:08.725256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:08.725739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:08.726171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:08.726863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:08.727304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:08.727725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:08.877267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:08.885735 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0024f31-578e-43ec-ae74-0e112a7c5f43 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.178361 Oct 27 11:02:08.886314 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3364/6925] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:08 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:09.914219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:09.914814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:09.921725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:09.922597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:09.923061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:09.923796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:09.924280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:09.924772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:09.929052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:10.069776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:10.078171 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1be6968-f6f5-4990-b08d-d39885bb8f13 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.171036 Oct 27 11:02:10.078751 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3562/6926] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:09 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:11.106322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:11.107298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:11.117718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:11.118203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:11.118640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:11.119335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:11.119784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:11.120211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:11.261478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:11.269491 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e95702d3-6e9d-49b1-9948-3ad2b7faa817 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.170321 Oct 27 11:02:11.270052 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3365/6927] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:11 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:12.298067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:12.299083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:12.310071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:12.310836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:12.311555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:12.312624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:12.313397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:12.314077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:12.459836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:12.468339 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e10ec297-7962-4808-900e-20433d4be219 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.176807 Oct 27 11:02:12.468962 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3563/6928] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:12 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:13.495821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:13.496467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:13.504335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:13.504941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:13.505410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:13.506132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:13.506601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:13.507046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:13.646635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:13.654878 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb7f105a-542c-42da-a8e1-5d6317402231 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.165205 Oct 27 11:02:13.655459 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3366/6929] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:13 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:14.683063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:14.683649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:14.691195 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:14.691691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:14.692134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:14.692881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:14.693343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:14.693776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:14.839419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:14.848169 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df7858a4-63cb-433b-8a56-ad378c4b1a4d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.171445 Oct 27 11:02:14.848770 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3564/6930] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:14 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:15.878643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:15.879265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:15.887137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:15.887624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:15.888060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:15.888798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:15.889254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:15.889676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:16.034988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:16.045407 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62d588ca-a34b-4db4-872a-270cc7d5c377 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.170833 Oct 27 11:02:16.045979 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3367/6931] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:15 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:17.072701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:17.073361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:17.080643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:17.081171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:17.081620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:17.082311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:17.082782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:17.083213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:17.230218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:17.238446 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-86617306-66e6-48c8-a96c-8d66b323487e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.171985 Oct 27 11:02:17.239032 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3565/6932] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:17 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:18.261973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:18.262573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:18.269884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:18.270367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:18.270803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:18.271503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:18.271949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:18.272371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:18.411452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:18.420733 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34d02d8c-122c-432c-a933-4629bb6d6ec6 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.162675 Oct 27 11:02:18.421279 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3368/6933] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:18 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:19.447904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:19.448540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:19.456009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:19.456503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:19.456994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:19.457729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:19.458198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:19.458637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:19.598430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:19.610136 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ab5897c-cd2c-40e0-8093-e8410801b6b1 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.168682 Oct 27 11:02:19.610973 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3566/6934] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:19 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:20.640552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:20.641620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:20.652345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:20.652865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:20.653297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:20.654000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:20.654446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:20.654902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:20.797693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:20.805743 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b827dd97-e1cc-4586-8a83-abaabf7269a2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1520 microversion: 2.1 time: 0.172159 Oct 27 11:02:20.806334 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3369/6935] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:20 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:21.372961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3574360e-d24a-4d47-8cbc-dbc1fba92c04 req-a466ae9d-d108-44d3-8280-094a235adacf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e175476c-2cfc-4ca2-b7bd-4476c5e336c5", "name": "network-vif-unplugged", "status": "completed", "tag": "7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:21.384042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3574360e-d24a-4d47-8cbc-dbc1fba92c04 req-a466ae9d-d108-44d3-8280-094a235adacf service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:21.384595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3574360e-d24a-4d47-8cbc-dbc1fba92c04 req-a466ae9d-d108-44d3-8280-094a235adacf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:21.385339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3574360e-d24a-4d47-8cbc-dbc1fba92c04 req-a466ae9d-d108-44d3-8280-094a235adacf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:21.404183 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3574360e-d24a-4d47-8cbc-dbc1fba92c04 req-a466ae9d-d108-44d3-8280-094a235adacf service nova] Creating event network-vif-unplugged:7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9 for instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 on n-h2-854663-10 Oct 27 11:02:21.410637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-3574360e-d24a-4d47-8cbc-dbc1fba92c04 req-a466ae9d-d108-44d3-8280-094a235adacf service nova] Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:02:21.422907 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3574360e-d24a-4d47-8cbc-dbc1fba92c04 req-a466ae9d-d108-44d3-8280-094a235adacf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053659 Oct 27 11:02:21.423630 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3567/6936] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:02:21.833431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:21.835400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:21.843923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:21.844435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:21.844933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:21.845694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:21.846147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:21.846603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:22.086751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:22.096123 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-190abf34-7c25-45da-b1f7-6da2563fd1bc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1519 microversion: 2.1 time: 0.269070 Oct 27 11:02:22.096748 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3370/6937] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:21 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:23.123929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:23.124805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:23.133760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:23.134422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:23.135086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:23.135954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:23.136440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:23.136923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:23.273591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:23.281521 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe6e4cc4-d04e-4391-a7ff-5da0226d6634 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1517 microversion: 2.1 time: 0.164643 Oct 27 11:02:23.282106 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3568/6938] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:23 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:23.439362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-514abd77-4af5-41ce-a292-552aaf67a200 req-336ec543-b380-4621-9a74-a90f6371048c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e175476c-2cfc-4ca2-b7bd-4476c5e336c5", "tag": "7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:23.450397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-514abd77-4af5-41ce-a292-552aaf67a200 req-336ec543-b380-4621-9a74-a90f6371048c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:23.450876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-514abd77-4af5-41ce-a292-552aaf67a200 req-336ec543-b380-4621-9a74-a90f6371048c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:23.451307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-514abd77-4af5-41ce-a292-552aaf67a200 req-336ec543-b380-4621-9a74-a90f6371048c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:23.463471 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-514abd77-4af5-41ce-a292-552aaf67a200 req-336ec543-b380-4621-9a74-a90f6371048c service nova] Creating event network-changed:7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9 for instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 on n-h2-854663-10 Oct 27 11:02:23.469277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-514abd77-4af5-41ce-a292-552aaf67a200 req-336ec543-b380-4621-9a74-a90f6371048c service nova] Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:02:23.480408 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-514abd77-4af5-41ce-a292-552aaf67a200 req-336ec543-b380-4621-9a74-a90f6371048c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044837 Oct 27 11:02:23.481051 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3371/6939] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:02:24.309199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:24.309979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:24.313239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=28 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:24.319616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:24.320206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:24.320731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:24.321591 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:24.322139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:24.322775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:24.465346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:24.473607 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-429d0fee-6c4e-40b8-b761-41094c3cfdb2 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1514 microversion: 2.1 time: 0.170312 Oct 27 11:02:24.474166 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3569/6940] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:24 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:24.497975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-51bc271a-379d-4423-bf82-a259c5e67a1f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:24.498578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-51bc271a-379d-4423-bf82-a259c5e67a1f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:24.500598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=28 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:24.506310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51bc271a-379d-4423-bf82-a259c5e67a1f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:24.506790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51bc271a-379d-4423-bf82-a259c5e67a1f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:24.507219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51bc271a-379d-4423-bf82-a259c5e67a1f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:24.507912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51bc271a-379d-4423-bf82-a259c5e67a1f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:24.508354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51bc271a-379d-4423-bf82-a259c5e67a1f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:24.508801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51bc271a-379d-4423-bf82-a259c5e67a1f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:24.511815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=82 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:24.571568 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-51bc271a-379d-4423-bf82-a259c5e67a1f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "POST /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5/action" status: 204 len: 0 microversion: 2.1 time: 0.078693 Oct 27 11:02:24.572492 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3372/6941] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:02:24 2022] POST /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:02:24.581006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:24.581754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:24.588393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:24.588927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:24.589905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:24.590141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:24.590547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:24.591003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:24.732565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:24.741240 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f13491c-81dd-4a56-bb64-e021511def3f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1514 microversion: 2.1 time: 0.164279 Oct 27 11:02:24.741836 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3570/6942] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:24 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:25.768075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:25.768672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:25.776656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:25.777160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:25.777582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:25.778279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:25.778722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:25.779151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:25.951038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:25.959845 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2dc743c9-512b-43a4-b951-9d54f6caebf7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1514 microversion: 2.1 time: 0.197903 Oct 27 11:02:25.960409 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3373/6943] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:25 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:26.653088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2f85fe25-ef60-4ab7-aa55-457124bf5970 req-dbf5d968-2b96-409d-a5fe-6f580874055e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e175476c-2cfc-4ca2-b7bd-4476c5e336c5", "name": "network-vif-plugged", "status": "completed", "tag": "7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:26.664463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f85fe25-ef60-4ab7-aa55-457124bf5970 req-dbf5d968-2b96-409d-a5fe-6f580874055e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:26.664977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f85fe25-ef60-4ab7-aa55-457124bf5970 req-dbf5d968-2b96-409d-a5fe-6f580874055e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:26.665508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f85fe25-ef60-4ab7-aa55-457124bf5970 req-dbf5d968-2b96-409d-a5fe-6f580874055e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:26.678539 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2f85fe25-ef60-4ab7-aa55-457124bf5970 req-dbf5d968-2b96-409d-a5fe-6f580874055e service nova] Creating event network-vif-plugged:7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9 for instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 on n-h2-854663-10 Oct 27 11:02:26.683638 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2f85fe25-ef60-4ab7-aa55-457124bf5970 req-dbf5d968-2b96-409d-a5fe-6f580874055e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034322 Oct 27 11:02:26.684447 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3571/6944] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:02:26.987066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:26.987897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:26.997435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:26.997913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:26.998350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:26.999067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:26.999487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:26.999907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:27.141998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:27.149995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f589445f-41d0-4d1f-8753-4365f9591aa0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1506 microversion: 2.1 time: 0.168304 Oct 27 11:02:27.150628 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3374/6945] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:26 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:27.175552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:27.176287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:27.183132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:27.183628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:27.184255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:27.184982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:27.185447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:27.185865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:27.324057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:27.332545 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e9ed17f-a44b-497e-b42c-f8859d688765 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1506 microversion: 2.1 time: 0.163234 Oct 27 11:02:27.333131 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3572/6946] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:27 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:27.358176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-822ade08-622a-4c07-8e39-4dc840cfd661 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Action: 'create', calling method: .version_select at 0x7f6d5a911820>, body: {"keypair": {"name": "tempest-keypair-1628429411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGrkh3j/yv/FI4hbm77yPV5KIX4SsFvaOjpFjWdZG8hvZi21irxCk89Z+uGpo9j0HKMtUVRqL4QVr4Ed/yxV9zHglizR5VvSnszoJHFyYbPccs2uCN/AyClHy93Evaykw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:27.374598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-822ade08-622a-4c07-8e39-4dc840cfd661 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Getting quotas for project 4055b626f0d244f7afd6b690e66106a2. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:02:27.379839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-822ade08-622a-4c07-8e39-4dc840cfd661 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Getting quotas for user 990a087321c84a81956782c5a63ea794 and project 4055b626f0d244f7afd6b690e66106a2. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:02:27.393888 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-822ade08-622a-4c07-8e39-4dc840cfd661 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 11:02:28.406517 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-822ade08-622a-4c07-8e39-4dc840cfd661 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 47996. Oct 27 11:02:28.431086 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-822ade08-622a-4c07-8e39-4dc840cfd661 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.076714 Oct 27 11:02:28.431684 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3375/6947] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:02:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:02:29.675047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:29.675753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:29.679209 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:02:29.679381 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:02:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 (ip 10.222.0.76) !!! Oct 27 11:02:29.686099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:29.686602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:29.687050 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:29.687762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:29.688227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:29.688702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:29.827787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:29.835864 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e90fe57-0d6a-4bd9-812e-b8356127fca7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 200 len: 1506 microversion: 2.1 time: 0.165237 Oct 27 11:02:29.836449 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3573/6948] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:29 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:29.860463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:29.861065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:29.867705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:29.868182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:29.868608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:29.869328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:29.869768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:29.870169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:29.895750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:02:29.979253 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f53d8122-3e9b-4214-a4d9-20bcbda07995 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 204 len: 0 microversion: 2.1 time: 0.124352 Oct 27 11:02:29.980060 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3376/6949] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:02:29 2022] DELETE /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:02:30.034841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-960380948", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "9ea2ea41-2b3c-4e14-af74-54ff12df1f3d"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:30.089673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] validate_networks() for [('9ea2ea41-2b3c-4e14-af74-54ff12df1f3d', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:02:30.824170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:02:30.825588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:02:30.825588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:02:30.826099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:02:30.826759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:02:30.840812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:30.841315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:30.841765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:30.842505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:30.842974 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:30.843389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:30.861543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Getting quotas for project 4055b626f0d244f7afd6b690e66106a2. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:02:30.866908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Getting quotas for user 990a087321c84a81956782c5a63ea794 and project 4055b626f0d244f7afd6b690e66106a2. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:02:30.880551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:02:30.882949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:02:30.931986 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0661ae1-2884-47b3-8689-13cfe86a5987 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901003 Oct 27 11:02:30.932644 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3574/6950] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:02:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:02:30.945072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58a61039-2b0a-4e8e-b3c0-d3e091158d91 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:30.945777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58a61039-2b0a-4e8e-b3c0-d3e091158d91 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:31.005390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58a61039-2b0a-4e8e-b3c0-d3e091158d91 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:31.013249 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58a61039-2b0a-4e8e-b3c0-d3e091158d91 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1217 microversion: 2.1 time: 0.072543 Oct 27 11:02:31.013986 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3377/6951] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:30 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:31.718320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a55ed3e6-541b-48cc-bbfe-53c1cc8cb7d9 req-5836b6a3-f677-44a0-adf7-ad424f31bc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e175476c-2cfc-4ca2-b7bd-4476c5e336c5", "name": "network-vif-deleted", "tag": "7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:31.729689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a55ed3e6-541b-48cc-bbfe-53c1cc8cb7d9 req-5836b6a3-f677-44a0-adf7-ad424f31bc28 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:31.730172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a55ed3e6-541b-48cc-bbfe-53c1cc8cb7d9 req-5836b6a3-f677-44a0-adf7-ad424f31bc28 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:31.730733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a55ed3e6-541b-48cc-bbfe-53c1cc8cb7d9 req-5836b6a3-f677-44a0-adf7-ad424f31bc28 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:31.742254 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a55ed3e6-541b-48cc-bbfe-53c1cc8cb7d9 req-5836b6a3-f677-44a0-adf7-ad424f31bc28 service nova] Creating event network-vif-deleted:7c4034d3-95b5-4c4a-a368-1e2f5a07f9c9 for instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 on n-h2-854663-10 Oct 27 11:02:31.747862 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a55ed3e6-541b-48cc-bbfe-53c1cc8cb7d9 req-5836b6a3-f677-44a0-adf7-ad424f31bc28 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034645 Oct 27 11:02:31.748503 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3575/6952] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:02:32.037482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:32.039663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:32.048061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:32.049048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:32.049654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:32.050684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:32.051292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:32.051875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:32.134656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:32.145051 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77f4b57d-a12c-490f-8a73-979106b090d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1277 microversion: 2.1 time: 0.111609 Oct 27 11:02:32.146252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3378/6953] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:32 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:33.170874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:33.171587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:33.178627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:33.179128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:33.179600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:33.180379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:33.180872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:33.181307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:33.385915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:33.394340 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-197a00b8-66c0-4a96-9ef6-30237da28adc tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1317 microversion: 2.1 time: 0.228995 Oct 27 11:02:33.394929 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3576/6954] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:33 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:33.764273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1bcd99e3-e3dd-414c-a4f8-bd9aa9a7f8e5 req-f9932835-1421-4e1e-bcfc-2cda107bb51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "118bb971-1fca-4bc2-8d20-1fa224f90f82", "tag": "d90e9314-8246-4004-9102-d7fc6e70770c"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:33.777175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1bcd99e3-e3dd-414c-a4f8-bd9aa9a7f8e5 req-f9932835-1421-4e1e-bcfc-2cda107bb51a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:33.777882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1bcd99e3-e3dd-414c-a4f8-bd9aa9a7f8e5 req-f9932835-1421-4e1e-bcfc-2cda107bb51a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:33.778309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1bcd99e3-e3dd-414c-a4f8-bd9aa9a7f8e5 req-f9932835-1421-4e1e-bcfc-2cda107bb51a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:33.790148 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1bcd99e3-e3dd-414c-a4f8-bd9aa9a7f8e5 req-f9932835-1421-4e1e-bcfc-2cda107bb51a service nova] Creating event network-changed:d90e9314-8246-4004-9102-d7fc6e70770c for instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 on n-h2-854663-10 Oct 27 11:02:33.795468 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1bcd99e3-e3dd-414c-a4f8-bd9aa9a7f8e5 req-f9932835-1421-4e1e-bcfc-2cda107bb51a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035171 Oct 27 11:02:33.797232 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3379/6955] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:02:34.420421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:34.421084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:34.429209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:34.429705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:34.430145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:34.430852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:34.431312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:34.431747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:34.578461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:34.586741 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c04a9ec2-7da1-40dc-81f6-34d9eb69af6c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1317 microversion: 2.1 time: 0.171763 Oct 27 11:02:34.587554 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3577/6956] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:34 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:35.613183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:35.613949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:35.622666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:35.623201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:35.623680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:35.624503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:35.624981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:35.625466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:35.766964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:35.774987 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3702011a-ec28-45e0-90e4-52a1eecf786b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1317 microversion: 2.1 time: 0.167355 Oct 27 11:02:35.775563 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3380/6957] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:35 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:36.804811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:36.805413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:36.813400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:36.813931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:36.814384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:36.815103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:36.815573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:36.816008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:36.958426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:36.967573 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8be9378a-163e-430c-b6c7-c7b86560d1db tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1317 microversion: 2.1 time: 0.166793 Oct 27 11:02:36.968163 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3578/6958] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:36 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:37.991540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:37.992168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:37.999771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:38.000251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:38.000714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:38.001420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:38.001881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:38.002284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:38.138189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:38.146519 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-61658a65-4e5b-48bf-a82a-1b1079c97618 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1317 microversion: 2.1 time: 0.159052 Oct 27 11:02:38.147117 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3381/6959] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:37 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:38.737811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2f3154f0-75fb-473b-ae84-f9274af8edfc req-7eba7001-9e6b-4a9a-8795-35b636fd9348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118bb971-1fca-4bc2-8d20-1fa224f90f82", "name": "network-vif-plugged", "status": "completed", "tag": "d90e9314-8246-4004-9102-d7fc6e70770c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:38.749774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f3154f0-75fb-473b-ae84-f9274af8edfc req-7eba7001-9e6b-4a9a-8795-35b636fd9348 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:38.750285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f3154f0-75fb-473b-ae84-f9274af8edfc req-7eba7001-9e6b-4a9a-8795-35b636fd9348 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:38.750754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f3154f0-75fb-473b-ae84-f9274af8edfc req-7eba7001-9e6b-4a9a-8795-35b636fd9348 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:38.762526 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2f3154f0-75fb-473b-ae84-f9274af8edfc req-7eba7001-9e6b-4a9a-8795-35b636fd9348 service nova] Creating event network-vif-plugged:d90e9314-8246-4004-9102-d7fc6e70770c for instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 on n-h2-854663-10 Oct 27 11:02:38.768228 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2f3154f0-75fb-473b-ae84-f9274af8edfc req-7eba7001-9e6b-4a9a-8795-35b636fd9348 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Oct 27 11:02:38.769053 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3579/6960] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:02:39.172696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:39.173467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:39.183274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:39.183981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:39.184546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:39.185773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:39.186265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:39.186731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:39.339255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:39.347664 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a61d75b-a886-4ea1-bd26-27fd21e7a08e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1317 microversion: 2.1 time: 0.181077 Oct 27 11:02:39.348260 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3382/6961] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:39 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:40.377885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:40.378902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:40.389682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:40.390338 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:40.390848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:40.391543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:40.392012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:40.392437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:40.395121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=89 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:40.525892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:40.534561 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bdb39450-8093-4e27-a948-90a972181f27 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1506 microversion: 2.1 time: 0.165803 Oct 27 11:02:40.535137 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3580/6962] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:40 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:40.567657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:40.568243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:40.574850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:40.575328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:40.575759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:40.576442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:40.576924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:40.577595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:40.710994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:40.719225 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9fa6583-b367-4682-b97a-07ba50895290 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1506 microversion: 2.1 time: 0.155814 Oct 27 11:02:40.719799 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3383/6963] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:40 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:40.744378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:02:40.747688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:40.754389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:40.754855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:40.755298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:40.755993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:40.756450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:40.756905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:40.788432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:40.794156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Old instance type m1.heat2, new instance type m1.heat {{(pid=120720) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:02:40.801731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:02:40.802152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:02:40.802643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:02:40.803054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:02:40.803471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:02:40.856170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:40.881203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:40.883061 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a179f4f-c7a3-471b-9ff8-dbaa3f18b333 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "POST /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82/action" status: 202 len: 0 microversion: 2.1 time: 0.144719 Oct 27 11:02:40.884943 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3581/6964] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:02:40 2022] POST /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:02:40.892845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:40.893796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:40.900101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:40.900599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:40.901072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:40.901866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:40.902223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:40.902878 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:41.009487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:41.044487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:41.053313 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-27951501-a02a-4f8c-9d67-c15d587eb95b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1513 microversion: 2.1 time: 0.164835 Oct 27 11:02:41.053902 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3384/6965] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:40 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:42.079443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:42.080081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:42.086706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:42.087206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:42.087689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:42.088399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:42.088911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:42.089351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:42.241721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:42.250104 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c40ebefa-c3f8-4b9d-82bb-70dde1311a34 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1513 microversion: 2.1 time: 0.176995 Oct 27 11:02:42.250837 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3582/6966] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:42 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:43.273353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:43.273975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:43.281325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:43.281803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:43.282237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:43.282981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:43.283433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:43.283850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:43.431371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:43.442349 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ba367b7d-8741-4a4b-bd6f-9f8c3a7721ef tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.172608 Oct 27 11:02:43.443197 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3385/6967] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:43 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:44.470937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:44.472080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:44.483998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:44.484885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:44.485687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:44.486819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:44.487279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:44.487721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:44.639395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:44.648278 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5cb5fdc2-3b4e-4c24-bbec-8f85e1a70ca8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.184119 Oct 27 11:02:44.648859 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3583/6968] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:44 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:45.670993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:45.671562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:45.679342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:45.679833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:45.680274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:45.680992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:45.681443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:45.681870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:45.829421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:45.842758 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0fbd5d7-70a6-404c-8a0e-0811280bfe4e tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.175619 Oct 27 11:02:45.843514 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3386/6969] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:45 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:46.868255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:46.868926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:46.876346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:46.876883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:46.877334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:46.878057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:46.878550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:46.878986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:47.016448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:47.024870 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d226b32c-1bf3-4665-9366-4d6ecf319e94 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.160614 Oct 27 11:02:47.025490 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3584/6970] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:46 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:48.061877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:48.062863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:48.071396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:48.071877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:48.072309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:48.073030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:48.073480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:48.073902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:48.223143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:48.235294 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d4a10e0d-6efd-45d5-a3ec-54ced7fc6004 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.179949 Oct 27 11:02:48.235884 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3387/6971] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:48 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:49.263370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:49.264411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:49.273646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:49.274148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:49.274606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:49.275316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:49.275788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:49.276228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:49.422249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:49.430472 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-697dce8e-3d7d-41ce-bed5-18233b9a0226 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.173815 Oct 27 11:02:49.431059 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3585/6972] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:49 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:50.457384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:50.458001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:50.467158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:50.467815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:50.468408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:50.469388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:50.469996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:50.470560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:50.494538 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:50.613792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:50.625549 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e9135599-5c6f-4b3b-83f4-14f17e65dbd0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.173980 Oct 27 11:02:50.626143 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3388/6973] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:50 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:51.656045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:51.656620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:51.664426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:51.664950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:51.665434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:51.666159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:51.666627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:51.667066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:51.820892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:51.829241 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dba78aea-3268-4f8f-b72e-7f1f7d923d73 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.177315 Oct 27 11:02:51.829831 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3586/6974] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:51 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:52.858780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:52.859854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:52.869244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:52.869728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:52.870163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:52.870863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:52.871310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:52.871736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:53.016481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:53.029130 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef0a97c7-c4ce-4623-a52e-eda1a020a079 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.177409 Oct 27 11:02:53.029934 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3389/6975] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:52 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:02:54.055811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:54.056438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:54.064022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:54.064490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:54.065002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:54.065707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:54.066168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:54.066604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:54.208892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:54.217036 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02961b00-30dc-41ad-849a-8f8978242749 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.165364 Oct 27 11:02:54.217621 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3587/6976] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:54 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:55.239752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:55.240348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:55.243496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:55.249813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:55.250360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:55.250828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:55.251515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:55.251957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:55.252374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:55.400554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:55.410708 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6c3301c-f0e5-4c7c-a744-1627bf61b636 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.174927 Oct 27 11:02:55.411255 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3390/6977] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:55 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:56.435125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:56.435702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:56.438513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:02:56.444036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:56.444532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:56.445003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:56.445689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:56.446143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:56.446571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:56.598919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:56.607772 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb1e31bf-c62e-44f4-a040-2854253d5974 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.176685 Oct 27 11:02:56.608332 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3588/6978] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:56 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:57.633976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:57.634661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:57.642113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:57.642599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:57.643024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:57.643732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:57.644176 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:57.644591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:57.813343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:57.823644 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35487e02-e88b-44ce-8471-f315a0f69400 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.193883 Oct 27 11:02:57.824233 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3391/6979] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:57 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:02:58.852401 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:02:58.853612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:02:58.865595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:58.866474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:58.866932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:58.867649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:02:58.868114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:02:58.868552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:02:59.017604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:02:59.026255 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79f78e3d-da90-414a-b5b4-bfeb6e13c460 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.180849 Oct 27 11:02:59.026841 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3589/6980] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:02:58 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:00.054684 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:00.055636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:00.067420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:00.068227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:00.069009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:00.070020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:00.070476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:00.070902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:00.212590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:00.225241 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-26016c37-d422-4dd3-8cee-3f81964cc886 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.176806 Oct 27 11:03:00.226432 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3392/6981] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:00 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:01.257799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:01.258536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:01.265789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:01.266283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:01.266734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:01.267433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:01.267893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:01.268325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:01.402809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:01.411003 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e843989-2d9a-4df8-86f0-93f64f1be215 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.159156 Oct 27 11:03:01.411618 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3590/6982] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:01 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:02.438628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:02.439326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:02.450086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:02.450548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:02.451023 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:02.452017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:02.452591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:02.453251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:02.596029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:02.607995 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c0aac98a-c720-4532-9402-055d0ce69eac tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.175387 Oct 27 11:03:02.608768 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3393/6983] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:02 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:03.637583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:03.638341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:03.647576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:03.648242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:03.648990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:03.649937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:03.650525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:03.651101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:03.795097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:03.803929 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53b17c2d-adfa-4c05-8ac0-e72a6eca0361 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.171774 Oct 27 11:03:03.804545 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3591/6984] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:03 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:04.831490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:04.832470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:04.841631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:04.842115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:04.842552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:04.843256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:04.843699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:04.844123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:04.987212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:05.000503 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91ee6f6d-8f2f-4825-baca-9be7f2f2fd71 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.175425 Oct 27 11:03:05.001380 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3394/6985] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:04 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:06.030554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:06.031532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:06.041901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:06.042395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:06.042839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:06.043539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:06.044002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:06.044437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:06.185961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:06.194065 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00fe4bce-dd26-48c8-9bcd-f368ad8468c0 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.170370 Oct 27 11:03:06.194848 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3592/6986] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:06 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:07.217326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:07.217964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:07.225055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:07.225539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:07.225969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:07.226650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:07.227143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:07.227556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:07.368260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:07.376578 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3eb5477-1d10-47bf-b0e5-134271e5f7d4 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.163259 Oct 27 11:03:07.377199 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3395/6987] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:07 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:08.403072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:08.403846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:08.411942 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:08.412479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:08.413019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:08.413806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:08.414316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:08.414973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:08.549748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:08.559660 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bac547f-a466-4eab-85a3-37d80c6dde28 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.161789 Oct 27 11:03:08.560239 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3593/6988] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:08 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:09.584132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:09.584769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:09.592344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:09.592861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:09.593298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:09.593996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:09.594439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:09.596191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:09.740917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:09.749186 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc7e04ee-a665-49d6-8253-fab839fddda3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1518 microversion: 2.1 time: 0.169705 Oct 27 11:03:09.749874 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3396/6989] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:09 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:10.225995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9aa44d66-296e-48eb-a1b6-148ebbdf52ab req-48c5de32-f77e-473f-86b3-c36c2a9e9fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118bb971-1fca-4bc2-8d20-1fa224f90f82", "name": "network-vif-unplugged", "status": "completed", "tag": "d90e9314-8246-4004-9102-d7fc6e70770c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:10.236094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9aa44d66-296e-48eb-a1b6-148ebbdf52ab req-48c5de32-f77e-473f-86b3-c36c2a9e9fb3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:10.236643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9aa44d66-296e-48eb-a1b6-148ebbdf52ab req-48c5de32-f77e-473f-86b3-c36c2a9e9fb3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:10.237105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9aa44d66-296e-48eb-a1b6-148ebbdf52ab req-48c5de32-f77e-473f-86b3-c36c2a9e9fb3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:10.249579 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9aa44d66-296e-48eb-a1b6-148ebbdf52ab req-48c5de32-f77e-473f-86b3-c36c2a9e9fb3 service nova] Creating event network-vif-unplugged:d90e9314-8246-4004-9102-d7fc6e70770c for instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 on n-h1-854663-10 Oct 27 11:03:10.255064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-9aa44d66-296e-48eb-a1b6-148ebbdf52ab req-48c5de32-f77e-473f-86b3-c36c2a9e9fb3 service nova] Instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:03:10.266855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9aa44d66-296e-48eb-a1b6-148ebbdf52ab req-48c5de32-f77e-473f-86b3-c36c2a9e9fb3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044641 Oct 27 11:03:10.267828 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3594/6990] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:03:10.774708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:10.775960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:10.782692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:10.783177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:10.783612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:10.784304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:10.784774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:10.785195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:10.923526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:10.931770 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-744e49a6-46b9-44ae-adbe-7d28ea73eb0b tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1517 microversion: 2.1 time: 0.161378 Oct 27 11:03:10.932350 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3397/6991] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:10 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:11.962726 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:11.963906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:11.974596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:11.975415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:11.976168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:11.977474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:11.977943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:11.978384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:11.981128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:03:12.133402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:12.141591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4d9e5c3-60ff-49da-84a0-6465322a8600 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1515 microversion: 2.1 time: 0.187871 Oct 27 11:03:12.142172 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3595/6992] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:11 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:12.287608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-04e53c0f-8dc8-449f-8b9e-88bad030418e req-dc824436-963e-4397-882e-8b3582eebf25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "118bb971-1fca-4bc2-8d20-1fa224f90f82", "tag": "d90e9314-8246-4004-9102-d7fc6e70770c"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:12.305237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04e53c0f-8dc8-449f-8b9e-88bad030418e req-dc824436-963e-4397-882e-8b3582eebf25 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:12.305728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04e53c0f-8dc8-449f-8b9e-88bad030418e req-dc824436-963e-4397-882e-8b3582eebf25 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:12.306185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-04e53c0f-8dc8-449f-8b9e-88bad030418e req-dc824436-963e-4397-882e-8b3582eebf25 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:12.318656 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-04e53c0f-8dc8-449f-8b9e-88bad030418e req-dc824436-963e-4397-882e-8b3582eebf25 service nova] Creating event network-changed:d90e9314-8246-4004-9102-d7fc6e70770c for instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 on n-h1-854663-10 Oct 27 11:03:12.324824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-04e53c0f-8dc8-449f-8b9e-88bad030418e req-dc824436-963e-4397-882e-8b3582eebf25 service nova] Instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:03:12.335623 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-04e53c0f-8dc8-449f-8b9e-88bad030418e req-dc824436-963e-4397-882e-8b3582eebf25 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054568 Oct 27 11:03:12.336371 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3398/6993] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:03:13.168408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:13.169046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:13.176134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:13.176629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:13.177106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:13.177802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:13.178267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:13.178700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:13.313845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:13.322028 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4be47c77-7ef1-4891-b29f-e9208bb95be9 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1512 microversion: 2.1 time: 0.159358 Oct 27 11:03:13.322647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3596/6994] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:13 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:13.346292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b11057f2-082a-47a8-951f-de35eb170807 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:13.346824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b11057f2-082a-47a8-951f-de35eb170807 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:13.353753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11057f2-082a-47a8-951f-de35eb170807 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:13.354232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11057f2-082a-47a8-951f-de35eb170807 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:13.354667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11057f2-082a-47a8-951f-de35eb170807 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:13.355361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11057f2-082a-47a8-951f-de35eb170807 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:13.355810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11057f2-082a-47a8-951f-de35eb170807 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:13.356230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11057f2-082a-47a8-951f-de35eb170807 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:13.420547 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b11057f2-082a-47a8-951f-de35eb170807 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "POST /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82/action" status: 204 len: 0 microversion: 2.1 time: 0.079503 Oct 27 11:03:13.421253 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3399/6995] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:03:13 2022] POST /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:03:13.430482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:13.431493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:13.438051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:13.438640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:13.439085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:13.439870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:13.440392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:13.441452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:13.691304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:13.700234 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-719bc093-a2fc-4e31-bbe2-91f888f75e07 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1512 microversion: 2.1 time: 0.273667 Oct 27 11:03:13.700848 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3597/6996] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:13 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:14.724981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:14.725679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:14.732124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:14.732605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:14.733068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:14.733753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:14.734203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:14.734618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:14.875457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:14.884166 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-946f08c1-eb12-477c-8b89-956ac7ba20cb tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1512 microversion: 2.1 time: 0.164355 Oct 27 11:03:14.884796 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3400/6997] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:14 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:15.910204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:15.910943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:15.921206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:15.922183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:15.922782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:15.923722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:15.924339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:15.925005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.069409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:16.080310 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c984bfc6-7f05-4bc4-99bf-120d92d6a3c3 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1504 microversion: 2.1 time: 0.175897 Oct 27 11:03:16.080927 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3598/6998] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:15 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:16.103436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:16.104055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:16.111147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.111655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.112085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.112795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.113239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.113653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.256713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:16.265616 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6553dba-fe3f-4b17-9bdf-57e4f72cb06f tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1504 microversion: 2.1 time: 0.166157 Oct 27 11:03:16.266197 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3401/6999] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:16 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:16.287756 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:16.288382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:16.294722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.295211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.295650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.296344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.297160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.297589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.437931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:16.446591 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fbd66e9-db13-47d9-b5d0-bb8aff4ffc5d tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1504 microversion: 2.1 time: 0.162488 Oct 27 11:03:16.447089 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3599/7000] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:16 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:16.470365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:16.470866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:16.477291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.477785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.478224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.478922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.479378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.479807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.508805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:03:16.562034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:03:16.595411 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83f1c9c0-715e-477a-9a7b-6c319e38aaab tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "DELETE /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 204 len: 0 microversion: 2.1 time: 0.128672 Oct 27 11:03:16.597178 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3402/7001] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:03:16 2022] DELETE /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:03:16.613287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:16.613804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:16.620110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.620677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.621165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.621879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.622594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.623042 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.651120 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:03:16.697425 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.compute.api [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Instance is already in deleting state, ignoring this request Oct 27 11:03:16.698205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f27bc84-8731-4168-8a4b-085b475fd929 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "DELETE /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 204 len: 0 microversion: 2.1 time: 0.089046 Oct 27 11:03:16.698778 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3600/7002] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:03:16 2022] DELETE /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:03:16.707640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:16.708342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:16.714835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.715370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.715786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.716470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:16.716953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:16.717375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:16.865466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:16.874860 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-74839679-32b0-41fc-b509-1dd1efa9a2e8 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1510 microversion: 2.1 time: 0.171488 Oct 27 11:03:16.875411 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3403/7003] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:16 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:17.257495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-19cdf70d-0cd1-4a65-a050-860ab2b2a341 req-a81ae797-d656-4941-a44c-a15418f38d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118bb971-1fca-4bc2-8d20-1fa224f90f82", "name": "network-vif-plugged", "status": "completed", "tag": "d90e9314-8246-4004-9102-d7fc6e70770c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:17.269043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-19cdf70d-0cd1-4a65-a050-860ab2b2a341 req-a81ae797-d656-4941-a44c-a15418f38d09 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:17.269628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-19cdf70d-0cd1-4a65-a050-860ab2b2a341 req-a81ae797-d656-4941-a44c-a15418f38d09 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:17.270059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-19cdf70d-0cd1-4a65-a050-860ab2b2a341 req-a81ae797-d656-4941-a44c-a15418f38d09 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:17.281923 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-19cdf70d-0cd1-4a65-a050-860ab2b2a341 req-a81ae797-d656-4941-a44c-a15418f38d09 service nova] Creating event network-vif-plugged:d90e9314-8246-4004-9102-d7fc6e70770c for instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 on n-h1-854663-10 Oct 27 11:03:17.286881 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-19cdf70d-0cd1-4a65-a050-860ab2b2a341 req-a81ae797-d656-4941-a44c-a15418f38d09 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033330 Oct 27 11:03:17.287479 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3601/7004] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:03:17.907945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:17.908513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:17.916178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:17.916691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:17.917150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:17.917856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:17.918317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:17.918751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:18.055139 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a087321c84a81956782c5a63ea794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4055b626f0d244f7afd6b690e66106a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:18.063485 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-99b9a37a-efb1-4209-a933-dc7565d45431 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 200 len: 1510 microversion: 2.1 time: 0.159670 Oct 27 11:03:18.064126 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3404/7005] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:17 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:18.509408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b4309d3e-c95f-4414-9fc9-56a019da0dec req-94e5e3ea-d07e-40bf-9204-12cdccdafbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118bb971-1fca-4bc2-8d20-1fa224f90f82", "name": "network-vif-deleted", "tag": "d90e9314-8246-4004-9102-d7fc6e70770c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:18.522967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b4309d3e-c95f-4414-9fc9-56a019da0dec req-94e5e3ea-d07e-40bf-9204-12cdccdafbc5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:18.523769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b4309d3e-c95f-4414-9fc9-56a019da0dec req-94e5e3ea-d07e-40bf-9204-12cdccdafbc5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:18.524433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b4309d3e-c95f-4414-9fc9-56a019da0dec req-94e5e3ea-d07e-40bf-9204-12cdccdafbc5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:18.537408 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b4309d3e-c95f-4414-9fc9-56a019da0dec req-94e5e3ea-d07e-40bf-9204-12cdccdafbc5 service nova] Creating event network-vif-deleted:d90e9314-8246-4004-9102-d7fc6e70770c for instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 on n-h1-854663-10 Oct 27 11:03:18.544239 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b4309d3e-c95f-4414-9fc9-56a019da0dec req-94e5e3ea-d07e-40bf-9204-12cdccdafbc5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040729 Oct 27 11:03:18.545089 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3602/7006] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:03:19.089105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:19.089724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: 118bb971-1fca-4bc2-8d20-1fa224f90f82] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:19.097334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:19.097819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:19.098256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:19.098980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:19.099433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:19.099856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:19.114771 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] HTTP exception thrown: Instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 could not be found. Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Request method failure captured: Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 HTTP/1.1 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmUTrMeJUm54CSYi8jjQdGx9LCjIUe6m01fsDaHJVa0VNIeGUzdBlXw-_wybFUcb-nDpCXZtwgP_TUoGBhMStf0a8EV8VYUgM8bDAtq_FqPx2QQPSbhWl6wDDuucUP6cWv9OgickDjnNIMYqSx4ajHLLc1hQzME_LvLsLlmbT0WPZmE Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 4055b626f0d244f7afd6b690e66106a2 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerDiskConfigTestJSON-71729680 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4055b626f0d244f7afd6b690e66106a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4055b626f0d244f7afd6b690e66106a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4055b626f0d244f7afd6b690e66106a2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4055b626f0d244f7afd6b690e66106a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerDiskConfigTestJSON-71729680 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 4055b626f0d244f7afd6b690e66106a2 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-71729680 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerDiskConfigTestJSON-71729680-project Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 990a087321c84a81956782c5a63ea794 Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerDiskConfigTestJSON-71729680-project Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 could not be found. Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '118bb971-1fca-4bc2-8d20-1fa224f90f82'} Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 could not be found. Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 could not be found. Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:03:19.116415 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 could not be found. Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Returning 404 to user: Instance 118bb971-1fca-4bc2-8d20-1fa224f90f82 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-460d2fce-c561-4771-ba95-f7104a2fb7c7 tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82" status: 404 len: 111 microversion: 2.1 time: 0.033844 Oct 27 11:03:19.121285 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3405/7007] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:19 2022] GET /compute/v2.1/servers/118bb971-1fca-4bc2-8d20-1fa224f90f82 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:03:19.127377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-274f3c7b-5c16-4494-96c6-2ad794af146c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '.version_select at 0x7f6d5a7c3dc0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:19.155262 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-274f3c7b-5c16-4494-96c6-2ad794af146c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628429411" status: 202 len: 0 microversion: 2.1 time: 0.032157 Oct 27 11:03:19.155845 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3603/7008] 10.222.0.76 () {58 vars in 1221 bytes} [Thu Oct 27 11:03:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628429411 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:03:19.798663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:19.799163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:19.805665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:19.806205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:19.806636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:19.807305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:19.807739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:19.808156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:19.822165 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] HTTP exception thrown: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Request method failure captured: Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 HTTP/1.1 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmUTrMeJUm54CSYi8jjQdGx9LCjIUe6m01fsDaHJVa0VNIeGUzdBlXw-_wybFUcb-nDpCXZtwgP_TUoGBhMStf0a8EV8VYUgM8bDAtq_FqPx2QQPSbhWl6wDDuucUP6cWv9OgickDjnNIMYqSx4ajHLLc1hQzME_LvLsLlmbT0WPZmE Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 4055b626f0d244f7afd6b690e66106a2 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerDiskConfigTestJSON-71729680 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4055b626f0d244f7afd6b690e66106a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4055b626f0d244f7afd6b690e66106a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4055b626f0d244f7afd6b690e66106a2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4055b626f0d244f7afd6b690e66106a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerDiskConfigTestJSON-71729680 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 4055b626f0d244f7afd6b690e66106a2 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-71729680 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerDiskConfigTestJSON-71729680-project Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 990a087321c84a81956782c5a63ea794 Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerDiskConfigTestJSON-71729680-project Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e175476c-2cfc-4ca2-b7bd-4476c5e336c5'} Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:03:19.823733 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Returning 404 to user: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-059a5980-32c0-4c7d-9d47-2d210ab5e16c tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 404 len: 111 microversion: 2.1 time: 0.030763 Oct 27 11:03:19.827806 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3406/7009] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:03:19 2022] DELETE /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:03:19.835110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:19.835896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] [instance: e175476c-2cfc-4ca2-b7bd-4476c5e336c5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:19.846474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:19.846971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:19.847421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:19.848123 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:19.848618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:19.849093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:19.863154 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] HTTP exception thrown: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Request method failure captured: Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 HTTP/1.1 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmUTrMeJUm54CSYi8jjQdGx9LCjIUe6m01fsDaHJVa0VNIeGUzdBlXw-_wybFUcb-nDpCXZtwgP_TUoGBhMStf0a8EV8VYUgM8bDAtq_FqPx2QQPSbhWl6wDDuucUP6cWv9OgickDjnNIMYqSx4ajHLLc1hQzME_LvLsLlmbT0WPZmE Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 4055b626f0d244f7afd6b690e66106a2 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerDiskConfigTestJSON-71729680 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4055b626f0d244f7afd6b690e66106a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4055b626f0d244f7afd6b690e66106a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4055b626f0d244f7afd6b690e66106a2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4055b626f0d244f7afd6b690e66106a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerDiskConfigTestJSON-71729680 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 4055b626f0d244f7afd6b690e66106a2 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-71729680 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerDiskConfigTestJSON-71729680-project Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 990a087321c84a81956782c5a63ea794 Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerDiskConfigTestJSON-71729680-project Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'e175476c-2cfc-4ca2-b7bd-4476c5e336c5'} Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:03:19.864893 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] Returning 404 to user: Instance e175476c-2cfc-4ca2-b7bd-4476c5e336c5 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9742e564-a23e-4d17-80a0-ed22b75555aa tempest-ServerDiskConfigTestJSON-71729680 tempest-ServerDiskConfigTestJSON-71729680-project] 10.222.0.76 "GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5" status: 404 len: 111 microversion: 2.1 time: 0.036160 Oct 27 11:03:19.869768 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3604/7010] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:19 2022] GET /compute/v2.1/servers/e175476c-2cfc-4ca2-b7bd-4476c5e336c5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:03:28.978170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-514160c7-8c10-4e85-9a0c-7da6e6213957 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'create', calling method: .version_select at 0x7f6d5a8fb4c0>, body: {"keypair": {"name": "tempest-keypair-99605006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqo5sAz9ovOHYxY8e8RI4b7r6YYbeYIP63rdhdWRiUeRbBMrjV+Sr1/kja5NNujEphwAEWWfyObgvH0zPDo4hysiVUvnZ3uKI5ClnPkoyp+S9hP4fL3WnqZiaM9b5a8Fg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:28.983681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:03:28.995776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-514160c7-8c10-4e85-9a0c-7da6e6213957 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:03:29.001298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-514160c7-8c10-4e85-9a0c-7da6e6213957 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for user 59897473b3f44b6394a0dc9f53d85be4 and project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:03:29.031009 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-514160c7-8c10-4e85-9a0c-7da6e6213957 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.177243 Oct 27 11:03:29.031607 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3407/7011] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:03:28 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:03:30.348630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-30267881", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd104410-d9ba-4653-9650-239e04e3ba4d"}], "security_groups": [{"name": "tempest-securitygroup--323560069"}], "key_name": "tempest-keypair-99605006", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:30.359624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:03:30.360436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:03:30.472794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] validate_networks() for [('bd104410-d9ba-4653-9650-239e04e3ba4d', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:03:30.863962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:03:30.864417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:03:30.865152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:03:30.865564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:03:30.865985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:03:30.875677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:30.876170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:30.876613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:30.877456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:30.877918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:30.878349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:30.896257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:03:30.902282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for user 59897473b3f44b6394a0dc9f53d85be4 and project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:03:30.916936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:03:30.919305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:03:30.968824 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5829f7e9-85bb-4f13-b058-5b7a8bcbaf3a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.624585 Oct 27 11:03:30.969647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3605/7012] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:03:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:03:30.977452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=16 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:03:30.982644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b00de715-5310-4727-aa2a-f352b00a02c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:30.983237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b00de715-5310-4727-aa2a-f352b00a02c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:31.039675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b00de715-5310-4727-aa2a-f352b00a02c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:31.047662 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b00de715-5310-4727-aa2a-f352b00a02c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1235 microversion: 2.1 time: 0.070994 Oct 27 11:03:31.048584 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3408/7013] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:30 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1235 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:32.075394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:32.076138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:32.083183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:32.083699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:32.084182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:32.084922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:32.085418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:32.085983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:32.157176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:32.183982 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d788169-cb0f-4edc-80db-2f2803e553f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1287 microversion: 2.1 time: 0.115511 Oct 27 11:03:32.184596 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3606/7014] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:32 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:33.207701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:33.209075 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:33.217238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:33.217648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:33.218083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:33.218794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:33.219536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:33.219966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:33.360295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:33.368631 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67e2023c-efb6-4ac3-bd4c-8b0d3ad02d0c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1360 microversion: 2.1 time: 0.164580 Oct 27 11:03:33.369252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3409/7015] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:33 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:33.735189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-da16bdea-7f04-4cf3-a5da-4994a76ef92f req-7f5c2bfe-382a-4cf9-abb1-67c78ae1bb35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe8a304-7663-4c6e-b8cc-f761415b13eb", "tag": "d7fbc209-7575-4e88-9608-f2bfb99cd6c7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:33.746783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-da16bdea-7f04-4cf3-a5da-4994a76ef92f req-7f5c2bfe-382a-4cf9-abb1-67c78ae1bb35 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:33.747498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-da16bdea-7f04-4cf3-a5da-4994a76ef92f req-7f5c2bfe-382a-4cf9-abb1-67c78ae1bb35 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:33.748154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-da16bdea-7f04-4cf3-a5da-4994a76ef92f req-7f5c2bfe-382a-4cf9-abb1-67c78ae1bb35 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:33.760982 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-da16bdea-7f04-4cf3-a5da-4994a76ef92f req-7f5c2bfe-382a-4cf9-abb1-67c78ae1bb35 service nova] Creating event network-changed:d7fbc209-7575-4e88-9608-f2bfb99cd6c7 for instance afe8a304-7663-4c6e-b8cc-f761415b13eb on n-h1-854663-10 Oct 27 11:03:33.766762 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-da16bdea-7f04-4cf3-a5da-4994a76ef92f req-7f5c2bfe-382a-4cf9-abb1-67c78ae1bb35 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036021 Oct 27 11:03:33.767811 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3607/7016] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:03:34.395195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:34.395799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:34.406171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:34.406783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:34.407357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:34.408382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:34.409018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:34.409610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:34.545177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:34.553540 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d47ea8a-97f7-439b-a197-fb65458fb05e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1360 microversion: 2.1 time: 0.164774 Oct 27 11:03:34.554114 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3410/7017] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:34 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:35.577568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:35.578275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:35.585774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:35.586261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:35.586702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:35.587402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:35.587945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:35.588378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:35.731755 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:35.739920 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99741eaf-9b43-4976-94ba-62d2c7eca8fe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1360 microversion: 2.1 time: 0.166818 Oct 27 11:03:35.740549 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3608/7018] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:35 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:36.765321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:36.765933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:36.775283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:36.775892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:36.776328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:36.777065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:36.777515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:36.777936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:36.912220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:36.924526 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec31e7e8-bbd9-4ff5-8208-11bd3bc29ab2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1360 microversion: 2.1 time: 0.163944 Oct 27 11:03:36.925359 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3411/7019] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:36 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:37.950274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:37.950887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:37.958973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:37.959688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:37.960129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:37.960897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:37.961365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:37.961835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:38.093372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:38.101934 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f438fc8-e60d-4180-8d99-330fa5057def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1360 microversion: 2.1 time: 0.156945 Oct 27 11:03:38.102528 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3609/7020] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:37 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:39.126452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:39.127122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:39.134857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:39.135457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:39.135907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:39.136643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:39.137162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:39.137626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:39.276364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:39.284386 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9196e2f6-0668-47bb-85c2-94a2fc374e0e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1360 microversion: 2.1 time: 0.162263 Oct 27 11:03:39.285226 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3412/7021] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:39 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:39.376270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-46e1a6d2-23c9-4db1-b913-3b70d1195ea3 req-503537c6-d621-4ab4-afa6-3a6e7cd89c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe8a304-7663-4c6e-b8cc-f761415b13eb", "name": "network-vif-plugged", "status": "completed", "tag": "d7fbc209-7575-4e88-9608-f2bfb99cd6c7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:39.386912 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-46e1a6d2-23c9-4db1-b913-3b70d1195ea3 req-503537c6-d621-4ab4-afa6-3a6e7cd89c2a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:39.388191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-46e1a6d2-23c9-4db1-b913-3b70d1195ea3 req-503537c6-d621-4ab4-afa6-3a6e7cd89c2a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:39.388673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-46e1a6d2-23c9-4db1-b913-3b70d1195ea3 req-503537c6-d621-4ab4-afa6-3a6e7cd89c2a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:39.400948 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-46e1a6d2-23c9-4db1-b913-3b70d1195ea3 req-503537c6-d621-4ab4-afa6-3a6e7cd89c2a service nova] Creating event network-vif-plugged:d7fbc209-7575-4e88-9608-f2bfb99cd6c7 for instance afe8a304-7663-4c6e-b8cc-f761415b13eb on n-h1-854663-10 Oct 27 11:03:39.406561 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-46e1a6d2-23c9-4db1-b913-3b70d1195ea3 req-503537c6-d621-4ab4-afa6-3a6e7cd89c2a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034000 Oct 27 11:03:39.407208 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3610/7022] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:03:40.309780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:40.310399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:40.317005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:40.317498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:40.317940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:40.318636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:40.319093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:40.319521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:40.457847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:40.466309 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d8bc820-f532-49d2-822d-b0f65d6d5ef2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1360 microversion: 2.1 time: 0.161054 Oct 27 11:03:40.466889 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3413/7023] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:40 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:41.490696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:41.491403 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:41.494389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:03:41.495300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:03:41.501780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:41.502275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:41.502723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:41.503423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:41.503884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:41.504312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:41.647197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:03:41.655462 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6257e08f-d099-4072-b945-bc67000640f3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1547 microversion: 2.1 time: 0.169210 Oct 27 11:03:41.656042 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3611/7024] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:03:41 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:03:41.678842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77ac1c1d-1df0-4aee-b174-24ed5744d182 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:03:41.679396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77ac1c1d-1df0-4aee-b174-24ed5744d182 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:03:41.681531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:03:41.688743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac1c1d-1df0-4aee-b174-24ed5744d182 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:41.689203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac1c1d-1df0-4aee-b174-24ed5744d182 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:41.689646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac1c1d-1df0-4aee-b174-24ed5744d182 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:41.690349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac1c1d-1df0-4aee-b174-24ed5744d182 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:41.690824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac1c1d-1df0-4aee-b174-24ed5744d182 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:41.691232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77ac1c1d-1df0-4aee-b174-24ed5744d182 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:41.776092 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77ac1c1d-1df0-4aee-b174-24ed5744d182 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100623 Oct 27 11:03:41.777439 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3414/7025] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 11:03:41 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:03:43.103445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c1cd9bea-a173-4605-ba82-01f68e0357f1 req-1c7fa1e1-36c8-434f-a6b6-07a0b433556f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe8a304-7663-4c6e-b8cc-f761415b13eb", "tag": "d7fbc209-7575-4e88-9608-f2bfb99cd6c7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:03:43.114171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c1cd9bea-a173-4605-ba82-01f68e0357f1 req-1c7fa1e1-36c8-434f-a6b6-07a0b433556f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:03:43.114662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c1cd9bea-a173-4605-ba82-01f68e0357f1 req-1c7fa1e1-36c8-434f-a6b6-07a0b433556f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:03:43.115099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c1cd9bea-a173-4605-ba82-01f68e0357f1 req-1c7fa1e1-36c8-434f-a6b6-07a0b433556f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:03:43.127863 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c1cd9bea-a173-4605-ba82-01f68e0357f1 req-1c7fa1e1-36c8-434f-a6b6-07a0b433556f service nova] Creating event network-changed:d7fbc209-7575-4e88-9608-f2bfb99cd6c7 for instance afe8a304-7663-4c6e-b8cc-f761415b13eb on n-h1-854663-10 Oct 27 11:03:43.133060 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c1cd9bea-a173-4605-ba82-01f68e0357f1 req-1c7fa1e1-36c8-434f-a6b6-07a0b433556f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033360 Oct 27 11:03:43.134096 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3612/7026] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:04:19.284853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:04:19.286155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=34 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:04:19.287830 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:04:19.288043 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:04:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb (ip 10.222.0.76) !!! Oct 27 11:04:19.293436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:19.294050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:19.302950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:19.303488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:19.303929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:19.304604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:19.305074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:19.305495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:19.517574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:19.530285 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7abd3f94-93b0-4bee-8daa-45b1f41d5e89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1666 microversion: 2.1 time: 0.248348 Oct 27 11:04:19.531064 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3415/7027] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:19 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1666 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:19.554008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:04:19.554709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=32 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:04:19.560034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:19.560769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:19.568637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:19.569155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:19.569599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:19.570295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:19.570751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:19.571181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:19.789652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:19.802148 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-541e7f39-2e27-460c-85ba-21df79a91eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1666 microversion: 2.1 time: 0.250107 Oct 27 11:04:19.802969 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3613/7028] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:19 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1666 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:19.825229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:19.825790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:19.832186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:19.832689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:19.833132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:19.833817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:19.834389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:19.834843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:19.970666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:19.980905 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3799258d-b41a-4105-a01f-cbb05dec60e0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1666 microversion: 2.1 time: 0.159729 Oct 27 11:04:19.981481 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3416/7029] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:19 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:20.004132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:04:20.006553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:20.013262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:20.013873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:20.014319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:20.015094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:20.015543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:20.015995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:20.046878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:20.052644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Old instance type m1.heat2, new instance type m1.heat {{(pid=120720) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:04:20.059999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:04:20.060430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:04:20.060951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:04:20.061368 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:04:20.061789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:04:20.130022 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f61a5f72-9507-4ddf-9cbf-dfbf16010773 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb/action" status: 202 len: 0 microversion: 2.1 time: 0.129813 Oct 27 11:04:20.130546 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3614/7030] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:04:19 2022] POST /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:04:20.139187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:20.139842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:20.146189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:20.146789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:20.147230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:20.147922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:20.148369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:20.148805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:20.290953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:20.301237 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96ecb2c9-7370-4d72-a75a-85bcbc18a4ee tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1675 microversion: 2.1 time: 0.165898 Oct 27 11:04:20.310824 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3417/7031] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:20 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:21.326342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:21.326897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:21.337215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:21.337720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:21.338215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:21.338926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:21.339387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:21.339816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:21.476702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:21.484754 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d45891c-8ab0-4027-889c-4272239febc2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1675 microversion: 2.1 time: 0.163330 Oct 27 11:04:21.485310 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3615/7032] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:21 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:22.510576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:22.511228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:22.519628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:22.520160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:22.520709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:22.521487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:22.522001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:22.522468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:22.677864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:22.685969 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dce6cc77-d1ae-4da9-a4ed-8f6f7fb8ac97 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.180286 Oct 27 11:04:22.686600 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3418/7033] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:22 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:23.722778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:23.723700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:23.732128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:23.732614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:23.733100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:23.733801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:23.734292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:23.734722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:23.868976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:23.880174 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3b61dd4-fa7a-466e-be53-c8b5dfaaa49a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.163913 Oct 27 11:04:23.881137 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3616/7034] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:23 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:24.908495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:24.909552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:24.921650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:24.922465 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:24.923182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:24.924322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:24.925179 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:24.925869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:25.076533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:25.088119 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-266da0da-0b99-4b32-a58a-5f8c0dedc3d1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.186212 Oct 27 11:04:25.088694 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3419/7035] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:24 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:26.112036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:26.112676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:26.120620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:26.121162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:26.121611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:26.122325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:26.122792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:26.123229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:26.262166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:26.270478 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-720a1e56-da5f-44e6-83ed-69ad7a5c6dd0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.162791 Oct 27 11:04:26.271056 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3617/7036] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:26 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:27.296729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:27.297526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:27.306452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:27.306939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:27.307374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:27.308062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:27.308510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:27.308962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:27.458022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:27.466497 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-422056bc-de29-400b-b0f3-65767daf461f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.175430 Oct 27 11:04:27.467075 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3420/7037] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:27 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:28.491138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:28.491938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:28.499615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:28.500240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:28.501001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:28.501734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:28.502363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:28.503081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:28.671418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:28.681730 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef7d8d90-b341-4b84-9bda-a87c619729c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.194611 Oct 27 11:04:28.682315 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3618/7038] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:28 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:29.708234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:29.709189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:29.719104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:29.719745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:29.720332 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:29.721299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:29.721900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:29.722468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:29.873478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:29.882111 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e639b046-9ad6-484a-8bab-9182633446dc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.179156 Oct 27 11:04:29.882781 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3421/7039] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:29 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:30.909914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:30.910915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:30.923653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:30.924467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:30.925251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:30.926405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:30.927170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:30.927885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:31.085013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:31.093513 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-646f9f99-8bec-4869-920b-0947b83e28c1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.190231 Oct 27 11:04:31.094089 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3619/7040] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:30 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:32.117942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:32.118529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:32.126374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:32.126883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:32.127340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:32.128066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:32.128536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:32.129022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:32.266975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:32.278677 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-036bed1c-a831-4e9d-80d8-3462044e0ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.164987 Oct 27 11:04:32.279446 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3422/7041] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:32 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:33.306428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:33.307455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:33.317782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:33.318281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:33.318717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:33.319423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:33.319856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:33.320310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:33.471147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:33.479242 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95780cf8-0b44-4672-837d-84799e01c279 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.179576 Oct 27 11:04:33.479823 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3620/7042] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:33 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:34.503662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:34.504276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:34.511731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:34.512216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:34.512653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:34.513382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:34.513833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:34.514257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:34.652315 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:34.660914 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ccdaa982-043e-4782-8106-9014b37fd038 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.161302 Oct 27 11:04:34.661486 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3423/7043] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:34 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:35.693258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:35.693917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:35.702281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:35.702772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:35.703211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:35.703910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:35.704369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:35.704836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:35.847464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:35.855741 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-801940a3-fde2-4e53-a8c1-8c02237f087b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.167159 Oct 27 11:04:35.856341 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3621/7044] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:35 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:36.889953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:36.890613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:36.898629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:36.899161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:36.899640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:36.900401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:36.901055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:36.901600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:37.040224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:37.049240 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f49e8018-4fc1-4a90-a135-3468097e5507 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.163929 Oct 27 11:04:37.049833 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3424/7045] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:36 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:38.074340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:38.074958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:38.082536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:38.083038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:38.083491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:38.084202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:38.084697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:38.085129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:38.234127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:38.242250 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8412a7ab-1330-490c-a11b-e8c33718b56f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.172756 Oct 27 11:04:38.242828 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3622/7046] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:38 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:39.266215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:39.266793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:39.274186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:39.274677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:39.275112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:39.275807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:39.276259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:39.276688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:39.419951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:39.428594 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b0168f3-d537-4e7c-a584-44d6a7d649b4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.166374 Oct 27 11:04:39.429212 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3425/7047] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:39 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:40.452336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:40.453009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:40.459527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:40.460024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:40.460469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:40.461199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:40.461659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:40.462093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:40.614381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:40.627049 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02b4edf5-a158-4dbe-aaa7-13792580bc3b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.178720 Oct 27 11:04:40.627835 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3623/7048] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:40 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:41.654790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:41.655790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:41.666011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:41.666760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:41.667457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:41.668754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:41.669337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:41.670013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:41.809640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:41.821724 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c7da680-34d2-45dd-b8c2-45b4a0061c9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.173077 Oct 27 11:04:41.822487 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3426/7049] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:41 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:42.846708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:42.847323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:42.854678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:42.855170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:42.855612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:42.856309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:42.856799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:42.857233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:42.999890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:43.008379 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c1ffe58-0e7e-4bf7-a67d-22b48850fa9f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.165909 Oct 27 11:04:43.009008 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3624/7050] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:42 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:44.031707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:44.032365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:44.039666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:44.040147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:44.040594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:44.041314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:44.041757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:44.042173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:44.181750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:44.190972 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-722bb0a0-b798-40e6-8010-e6c9b08f96da tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1680 microversion: 2.1 time: 0.163289 Oct 27 11:04:44.191568 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3427/7051] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:44 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:44.682429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-12c88447-7fea-46c2-9afd-ac03292cf4d1 req-86733281-f6a1-43bd-ad95-330419f64c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe8a304-7663-4c6e-b8cc-f761415b13eb", "name": "network-vif-unplugged", "status": "completed", "tag": "d7fbc209-7575-4e88-9608-f2bfb99cd6c7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:04:44.695185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-12c88447-7fea-46c2-9afd-ac03292cf4d1 req-86733281-f6a1-43bd-ad95-330419f64c69 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:44.695777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-12c88447-7fea-46c2-9afd-ac03292cf4d1 req-86733281-f6a1-43bd-ad95-330419f64c69 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:44.696271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-12c88447-7fea-46c2-9afd-ac03292cf4d1 req-86733281-f6a1-43bd-ad95-330419f64c69 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:44.709586 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-12c88447-7fea-46c2-9afd-ac03292cf4d1 req-86733281-f6a1-43bd-ad95-330419f64c69 service nova] Creating event network-vif-unplugged:d7fbc209-7575-4e88-9608-f2bfb99cd6c7 for instance afe8a304-7663-4c6e-b8cc-f761415b13eb on n-h2-854663-10 Oct 27 11:04:44.715132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-12c88447-7fea-46c2-9afd-ac03292cf4d1 req-86733281-f6a1-43bd-ad95-330419f64c69 service nova] Instance afe8a304-7663-4c6e-b8cc-f761415b13eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:04:44.726669 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-12c88447-7fea-46c2-9afd-ac03292cf4d1 req-86733281-f6a1-43bd-ad95-330419f64c69 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048318 Oct 27 11:04:44.727565 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3625/7052] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:04:45.215630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:45.216424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:45.224632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:45.225462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:45.225962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:45.226850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:45.227825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:45.228404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:45.459253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:45.471528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8baacf66-3ebd-4354-8e3b-37197fc9d406 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1679 microversion: 2.1 time: 0.259588 Oct 27 11:04:45.472409 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3428/7053] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:45 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:46.504747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:46.505964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:46.517280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:46.517770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:46.518211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:46.518939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:46.519400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:46.519829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:46.660198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:46.672504 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d86d1a3-b0a7-43e1-8586-6967b9355dd1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1677 microversion: 2.1 time: 0.175208 Oct 27 11:04:46.673095 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3626/7054] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:46 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:46.756890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-609e60ef-a109-4509-b2b2-5b7f1b7a9a61 req-0ee8c01f-4537-4eb7-8c19-d805b49e56b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe8a304-7663-4c6e-b8cc-f761415b13eb", "tag": "d7fbc209-7575-4e88-9608-f2bfb99cd6c7"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:04:46.767648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-609e60ef-a109-4509-b2b2-5b7f1b7a9a61 req-0ee8c01f-4537-4eb7-8c19-d805b49e56b5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:46.768121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-609e60ef-a109-4509-b2b2-5b7f1b7a9a61 req-0ee8c01f-4537-4eb7-8c19-d805b49e56b5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:46.768544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-609e60ef-a109-4509-b2b2-5b7f1b7a9a61 req-0ee8c01f-4537-4eb7-8c19-d805b49e56b5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:46.781069 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-609e60ef-a109-4509-b2b2-5b7f1b7a9a61 req-0ee8c01f-4537-4eb7-8c19-d805b49e56b5 service nova] Creating event network-changed:d7fbc209-7575-4e88-9608-f2bfb99cd6c7 for instance afe8a304-7663-4c6e-b8cc-f761415b13eb on n-h2-854663-10 Oct 27 11:04:46.786938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-609e60ef-a109-4509-b2b2-5b7f1b7a9a61 req-0ee8c01f-4537-4eb7-8c19-d805b49e56b5 service nova] Instance afe8a304-7663-4c6e-b8cc-f761415b13eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:04:46.798448 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-609e60ef-a109-4509-b2b2-5b7f1b7a9a61 req-0ee8c01f-4537-4eb7-8c19-d805b49e56b5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045305 Oct 27 11:04:46.799022 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3429/7055] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:04:47.696220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:47.697808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:47.706334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:47.707192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:47.707997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:47.709340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:47.710021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:47.710909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:47.868873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:47.882296 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77815579-6654-4c4f-bcd7-66fe0cd37bfd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1674 microversion: 2.1 time: 0.190266 Oct 27 11:04:47.883035 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3627/7056] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:47 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:47.907212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2bacb95f-18e3-45ee-a604-0738da819a74 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:04:47.907852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2bacb95f-18e3-45ee-a604-0738da819a74 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:47.914460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bacb95f-18e3-45ee-a604-0738da819a74 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:47.914948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bacb95f-18e3-45ee-a604-0738da819a74 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:47.915416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bacb95f-18e3-45ee-a604-0738da819a74 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:47.916142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bacb95f-18e3-45ee-a604-0738da819a74 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:47.916595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bacb95f-18e3-45ee-a604-0738da819a74 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:47.917061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bacb95f-18e3-45ee-a604-0738da819a74 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:47.970355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:04:47.987648 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2bacb95f-18e3-45ee-a604-0738da819a74 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb/action" status: 204 len: 0 microversion: 2.1 time: 0.085862 Oct 27 11:04:47.988274 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3430/7057] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:04:47 2022] POST /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:04:47.996825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:47.997450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:48.003641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:48.004116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:48.004812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:48.005529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:48.005969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:48.006402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:48.028474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:04:48.151389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:48.160005 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8b7c667-c8c9-43da-9545-e170c1428225 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1674 microversion: 2.1 time: 0.167119 Oct 27 11:04:48.160609 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3628/7058] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:47 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:49.188501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:49.189360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:49.195922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:49.196404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:49.196874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:49.197570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:49.198025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:49.198448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:49.344731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:49.354665 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-129e0877-8fa8-4b42-a87e-2f6dda50a1e7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1674 microversion: 2.1 time: 0.173594 Oct 27 11:04:49.355880 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3431/7059] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:49 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:49.430222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5894ca12-34a7-4e26-aa76-7b01176e5e8d req-779c996d-42bc-4be0-ace4-75b39b50b7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe8a304-7663-4c6e-b8cc-f761415b13eb", "name": "network-vif-plugged", "status": "completed", "tag": "d7fbc209-7575-4e88-9608-f2bfb99cd6c7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:04:49.440202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5894ca12-34a7-4e26-aa76-7b01176e5e8d req-779c996d-42bc-4be0-ace4-75b39b50b7e9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:49.440718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5894ca12-34a7-4e26-aa76-7b01176e5e8d req-779c996d-42bc-4be0-ace4-75b39b50b7e9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:49.441166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5894ca12-34a7-4e26-aa76-7b01176e5e8d req-779c996d-42bc-4be0-ace4-75b39b50b7e9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:49.454262 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5894ca12-34a7-4e26-aa76-7b01176e5e8d req-779c996d-42bc-4be0-ace4-75b39b50b7e9 service nova] Creating event network-vif-plugged:d7fbc209-7575-4e88-9608-f2bfb99cd6c7 for instance afe8a304-7663-4c6e-b8cc-f761415b13eb on n-h2-854663-10 Oct 27 11:04:49.460189 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5894ca12-34a7-4e26-aa76-7b01176e5e8d req-779c996d-42bc-4be0-ace4-75b39b50b7e9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121617 Oct 27 11:04:49.461064 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3629/7060] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:04:50.382271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:50.383340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:50.387812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=35 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:04:50.395173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:50.395652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:50.396107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:50.396835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:50.397297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:50.397715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:50.541451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:50.549986 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-508522c5-7c3b-4310-9cb1-b9e0b7a50224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1666 microversion: 2.1 time: 0.174336 Oct 27 11:04:50.550565 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3432/7061] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:50 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1666 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:50.574376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:50.575094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:50.577113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=39 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:04:50.583234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:50.583733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:50.584185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:50.584923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:50.585394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:50.585852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:50.726902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:50.739706 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99463e40-a13f-4a51-b8e5-15c3fe68c76c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1666 microversion: 2.1 time: 0.170595 Oct 27 11:04:50.740488 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3630/7062] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:50 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:50.766830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:50.767438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:50.773633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:50.774117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:50.774546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:50.775228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:50.775675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:50.776092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:50.910135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:50.918693 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-142e07be-eedd-4472-8617-c0746fa71ba9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1666 microversion: 2.1 time: 0.155777 Oct 27 11:04:50.919293 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3433/7063] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:50 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:50.942212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:50.942718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:50.949494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:50.950010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:50.950449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:50.951331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:50.951805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:50.952238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:50.977731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:04:51.069381 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-814bcb99-3a56-4fea-95e4-783ae7fb9a59 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 204 len: 0 microversion: 2.1 time: 0.130683 Oct 27 11:04:51.070267 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3631/7064] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:04:50 2022] DELETE /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:04:51.080087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:51.080715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:51.087309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:51.087790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:51.088221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:51.088975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:51.089426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:51.089845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:51.240267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:51.252958 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da35382e-1aca-4634-8f0f-e148e40db7c9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1672 microversion: 2.1 time: 0.177878 Oct 27 11:04:51.253540 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3434/7065] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:51 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:52.281854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:52.282897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:52.296874 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:52.297691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:52.298444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:52.299865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:52.300599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:52.301077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:52.518619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:52.527114 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-211d0d30-7093-4fb3-8158-0660c2188348 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1672 microversion: 2.1 time: 0.252659 Oct 27 11:04:52.527686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3632/7066] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:52 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1672 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:53.330791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ff69e60d-a5bf-4d81-a3d2-9cbbb6cc6d2b req-833f0558-3491-4ee9-bd55-ec83c98652e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe8a304-7663-4c6e-b8cc-f761415b13eb", "name": "network-vif-deleted", "tag": "d7fbc209-7575-4e88-9608-f2bfb99cd6c7"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:04:53.349708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ff69e60d-a5bf-4d81-a3d2-9cbbb6cc6d2b req-833f0558-3491-4ee9-bd55-ec83c98652e6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:53.350455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ff69e60d-a5bf-4d81-a3d2-9cbbb6cc6d2b req-833f0558-3491-4ee9-bd55-ec83c98652e6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:53.351190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ff69e60d-a5bf-4d81-a3d2-9cbbb6cc6d2b req-833f0558-3491-4ee9-bd55-ec83c98652e6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:53.364614 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ff69e60d-a5bf-4d81-a3d2-9cbbb6cc6d2b req-833f0558-3491-4ee9-bd55-ec83c98652e6 service nova] Creating event network-vif-deleted:d7fbc209-7575-4e88-9608-f2bfb99cd6c7 for instance afe8a304-7663-4c6e-b8cc-f761415b13eb on n-h2-854663-10 Oct 27 11:04:53.371379 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ff69e60d-a5bf-4d81-a3d2-9cbbb6cc6d2b req-833f0558-3491-4ee9-bd55-ec83c98652e6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044068 Oct 27 11:04:53.375492 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3435/7067] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:04:53.551396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:53.552073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:53.559852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:53.560442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:53.561019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:53.561846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:53.562389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:53.562927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:53.595241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:53.595741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:53.596189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:53.596757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lazy-loading 'fault' on Instance uuid afe8a304-7663-4c6e-b8cc-f761415b13eb {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:04:53.642090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:53.650377 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6aad514e-1d63-4b57-877a-c1bd779c3b1d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 200 len: 1325 microversion: 2.1 time: 0.103382 Oct 27 11:04:53.651160 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3633/7068] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:53 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:54.678842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:54.679555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:54.686438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:54.686921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:54.687358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:54.688050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:54.688500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:54.688939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:54.702991 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb HTTP/1.1 Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'afe8a304-7663-4c6e-b8cc-f761415b13eb'} Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:04:54.704645 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d1e39173-262b-48f6-84a0-b120e464e7ce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 404 len: 111 microversion: 2.1 time: 0.034056 Oct 27 11:04:54.709565 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3436/7069] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:54 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:04:54.720253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:54.720907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:54.728318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:54.728859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:54.729304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:54.730010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:54.730477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:54.730917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:54.745569 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb HTTP/1.1 Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'afe8a304-7663-4c6e-b8cc-f761415b13eb'} Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:04:54.747287 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79217772-0e6a-4c60-bc0b-adf14906e10a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 404 len: 111 microversion: 2.1 time: 0.032453 Oct 27 11:04:54.751509 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3634/7070] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:54 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:04:54.800774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2118999349", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "bd104410-d9ba-4653-9650-239e04e3ba4d"}], "security_groups": [{"name": "tempest-securitygroup--323560069"}], "key_name": "tempest-keypair-99605006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:04:54.916750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] validate_networks() for [('bd104410-d9ba-4653-9650-239e04e3ba4d', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:04:55.678159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:04:55.678607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:04:55.679069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:04:55.679666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:04:55.679879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:04:55.691224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:55.691813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:55.692267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:55.693037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:55.693496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:55.693926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:55.711725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:04:55.717508 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for user 59897473b3f44b6394a0dc9f53d85be4 and project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:04:55.731208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:04:55.733628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:04:55.793216 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-83b914f7-3395-4ace-a38a-90f819e065f6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.996722 Oct 27 11:04:55.793863 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3437/7071] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:04:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:04:55.806059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b985fedf-144d-4e0f-a038-2e36ee22fe8a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:55.807308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b985fedf-144d-4e0f-a038-2e36ee22fe8a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:55.863949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b985fedf-144d-4e0f-a038-2e36ee22fe8a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:55.872484 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b985fedf-144d-4e0f-a038-2e36ee22fe8a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1237 microversion: 2.1 time: 0.070431 Oct 27 11:04:55.873076 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3635/7072] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:55 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:56.897226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:56.897776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:56.904047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:56.904535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:56.905036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:56.905749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:56.906319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:56.906957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:56.982068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:56.992133 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6abc06a3-c7e2-4cda-9443-f311625301fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1297 microversion: 2.1 time: 0.100357 Oct 27 11:04:56.993342 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3438/7073] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:56 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:58.016945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:58.017469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:58.025340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:58.025838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:58.026410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:58.026984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:58.027465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:58.027884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:58.261030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:58.269495 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e6f7ae8d-c8b1-4e73-a48e-2c0ce0d5e40c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1362 microversion: 2.1 time: 0.256498 Oct 27 11:04:58.270122 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3636/7074] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:58 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:04:58.425822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5d7ead0c-a2e8-4d56-b3d2-da021e6bc626 req-27af65a4-f897-478e-89b2-d922d402b628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769b7ba3-40c8-4499-b06d-1082b1192960", "tag": "9ca7d329-f734-4800-a5ac-f047d122f6b8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:04:58.436961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5d7ead0c-a2e8-4d56-b3d2-da021e6bc626 req-27af65a4-f897-478e-89b2-d922d402b628 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:58.437436 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5d7ead0c-a2e8-4d56-b3d2-da021e6bc626 req-27af65a4-f897-478e-89b2-d922d402b628 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:58.437892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5d7ead0c-a2e8-4d56-b3d2-da021e6bc626 req-27af65a4-f897-478e-89b2-d922d402b628 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:58.449740 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5d7ead0c-a2e8-4d56-b3d2-da021e6bc626 req-27af65a4-f897-478e-89b2-d922d402b628 service nova] Creating event network-changed:9ca7d329-f734-4800-a5ac-f047d122f6b8 for instance 769b7ba3-40c8-4499-b06d-1082b1192960 on n-h2-854663-10 Oct 27 11:04:58.454554 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5d7ead0c-a2e8-4d56-b3d2-da021e6bc626 req-27af65a4-f897-478e-89b2-d922d402b628 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032707 Oct 27 11:04:58.455147 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3439/7075] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:04:59.298405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:04:59.299462 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:04:59.307424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:59.307921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:59.308360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:59.309092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:04:59.309554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:04:59.309987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:04:59.464748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:04:59.475294 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2cfdd60-457c-45e9-a1e3-8fd89256111a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1362 microversion: 2.1 time: 0.183962 Oct 27 11:04:59.475872 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3637/7076] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:04:59 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:00.503446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:00.504242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:00.511819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:00.512337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:00.512847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:00.513600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:00.514082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:00.514529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:00.654736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:00.663161 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93f3f3ca-dc39-4b88-a1a1-25e7851c9690 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1362 microversion: 2.1 time: 0.167129 Oct 27 11:05:00.663751 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3440/7077] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:00 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:01.687585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:01.688196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:01.695498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:01.695999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:01.696441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:01.697193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:01.697654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:01.698083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:01.827433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:01.835745 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-452c7495-ab42-416e-853c-6dae258171b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1362 microversion: 2.1 time: 0.152115 Oct 27 11:05:01.836298 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3638/7078] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:01 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:02.862784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:02.863392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:02.870398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:02.870880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:02.871310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:02.871997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:02.872447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:02.872909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:03.017156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:03.026126 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce968ace-46b4-4e2c-b3ef-dc1266396ccb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1362 microversion: 2.1 time: 0.169630 Oct 27 11:05:03.026674 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3441/7079] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:02 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:03.454725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-255d60a5-24c5-43d7-be4f-e89f5f97a224 req-130fb816-814d-419b-8098-9002a3298602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769b7ba3-40c8-4499-b06d-1082b1192960", "name": "network-vif-plugged", "status": "completed", "tag": "9ca7d329-f734-4800-a5ac-f047d122f6b8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:05:03.468991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-255d60a5-24c5-43d7-be4f-e89f5f97a224 req-130fb816-814d-419b-8098-9002a3298602 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:03.469697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-255d60a5-24c5-43d7-be4f-e89f5f97a224 req-130fb816-814d-419b-8098-9002a3298602 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:03.470238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-255d60a5-24c5-43d7-be4f-e89f5f97a224 req-130fb816-814d-419b-8098-9002a3298602 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:03.484385 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-255d60a5-24c5-43d7-be4f-e89f5f97a224 req-130fb816-814d-419b-8098-9002a3298602 service nova] Creating event network-vif-plugged:9ca7d329-f734-4800-a5ac-f047d122f6b8 for instance 769b7ba3-40c8-4499-b06d-1082b1192960 on n-h2-854663-10 Oct 27 11:05:03.489661 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-255d60a5-24c5-43d7-be4f-e89f5f97a224 req-130fb816-814d-419b-8098-9002a3298602 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040487 Oct 27 11:05:03.490228 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3639/7080] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:05:04.055824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:04.056960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:04.067449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:04.067930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:04.068361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:04.069076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:04.069521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:04.069940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:04.213798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:04.221966 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff1f8728-8db9-437d-9b60-baa7b0615453 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1362 microversion: 2.1 time: 0.173006 Oct 27 11:05:04.222812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3442/7081] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:04 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:05.254563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:05.256850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:05.269482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:05.269990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:05.270443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:05.271158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:05.271620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:05.272057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:05.407204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:05.416816 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3dcd5672-bf7f-4aed-b18d-5f69835a4ed4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1549 microversion: 2.1 time: 0.172806 Oct 27 11:05:05.417410 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3640/7082] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:05 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:05.441322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d64a7659-0908-4227-b890-3f36bcaafc0b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:05.441852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d64a7659-0908-4227-b890-3f36bcaafc0b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:05.449562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64a7659-0908-4227-b890-3f36bcaafc0b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:05.450038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64a7659-0908-4227-b890-3f36bcaafc0b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:05.450470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64a7659-0908-4227-b890-3f36bcaafc0b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:05.451160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64a7659-0908-4227-b890-3f36bcaafc0b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:05.451611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64a7659-0908-4227-b890-3f36bcaafc0b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:05.452027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d64a7659-0908-4227-b890-3f36bcaafc0b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:05.531849 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d64a7659-0908-4227-b890-3f36bcaafc0b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094999 Oct 27 11:05:05.532457 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3443/7083] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 11:05:05 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:05:06.557173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:05:06.633053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3b1841c1-a67e-4fab-9801-ced35b5c7853 req-8c42c99e-284b-4dee-a4ce-760bae007e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769b7ba3-40c8-4499-b06d-1082b1192960", "tag": "9ca7d329-f734-4800-a5ac-f047d122f6b8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:05:06.643180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3b1841c1-a67e-4fab-9801-ced35b5c7853 req-8c42c99e-284b-4dee-a4ce-760bae007e1c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:06.643776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3b1841c1-a67e-4fab-9801-ced35b5c7853 req-8c42c99e-284b-4dee-a4ce-760bae007e1c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:06.644220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3b1841c1-a67e-4fab-9801-ced35b5c7853 req-8c42c99e-284b-4dee-a4ce-760bae007e1c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:06.655559 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3b1841c1-a67e-4fab-9801-ced35b5c7853 req-8c42c99e-284b-4dee-a4ce-760bae007e1c service nova] Creating event network-changed:9ca7d329-f734-4800-a5ac-f047d122f6b8 for instance 769b7ba3-40c8-4499-b06d-1082b1192960 on n-h2-854663-10 Oct 27 11:05:06.660570 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3b1841c1-a67e-4fab-9801-ced35b5c7853 req-8c42c99e-284b-4dee-a4ce-760bae007e1c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107852 Oct 27 11:05:06.661173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3641/7084] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:05:41.817702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:05:41.818484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:05:41.821493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:05:41.822174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=60 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:05:41.827414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6d6e50b-0e97-4185-bccc-39d380c0eaf2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:05:41.835762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6d6e50b-0e97-4185-bccc-39d380c0eaf2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:41.836284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6d6e50b-0e97-4185-bccc-39d380c0eaf2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:41.836946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6d6e50b-0e97-4185-bccc-39d380c0eaf2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:41.860486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6d6e50b-0e97-4185-bccc-39d380c0eaf2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Going to try to stop instance {{(pid=120719) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 11:05:41.905814 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6d6e50b-0e97-4185-bccc-39d380c0eaf2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/action" status: 202 len: 0 microversion: 2.1 time: 0.088727 Oct 27 11:05:41.906429 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3444/7085] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:05:41 2022] POST /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:05:41.913503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:05:41.914377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:05:41.918522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:41.919197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:41.928906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:41.929228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:41.929736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:41.930456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:41.930918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:41.931348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:42.077999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:42.086416 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21a6153d-e03e-4eb1-b7f8-e546ede6f559 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.175276 Oct 27 11:05:42.087009 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3642/7086] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:41 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:43.114781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:43.115533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:43.122296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:43.122774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:43.123201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:43.123886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:43.124327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:43.124778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:43.256488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:43.264600 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae48ba48-1bd8-4d19-be86-eeb34cacf25f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.156811 Oct 27 11:05:43.265202 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3445/7087] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:43 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:44.289616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:44.290273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:44.298114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:44.298611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:44.299057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:44.299762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:44.300203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:44.300651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:44.515003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:44.524504 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f94de021-ed34-45bd-a108-11627d5dd0c5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.238725 Oct 27 11:05:44.525118 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3643/7088] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:44 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:45.556528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:45.557241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:45.565342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:45.565949 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:45.566386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:45.567088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:45.567577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:45.568001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:45.713034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:45.721590 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50f7c624-781d-425a-bc0b-027d121c6de5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.169460 Oct 27 11:05:45.722178 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3446/7089] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:45 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:46.749554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:46.750437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:46.762261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:46.763066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:46.763795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:46.765059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:46.765824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:46.766601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:46.905671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:46.914120 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81299434-46ed-4cca-a20b-bfa1bd3356a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.171171 Oct 27 11:05:46.914709 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3644/7090] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:46 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:47.940480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:47.941319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:47.949929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:47.950517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:47.951035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:47.951870 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:47.952418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:47.952998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:48.096606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:48.105103 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5169792f-261f-4168-b3c4-345f8cc28b52 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.169714 Oct 27 11:05:48.105685 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3447/7091] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:47 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:49.130101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:49.130831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:49.139362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:49.139940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:49.140461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:49.141327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:49.141898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:49.142460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:49.278028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:49.288495 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f05707cc-bcbc-4afe-98c4-981ce601c8c2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.163060 Oct 27 11:05:49.289123 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3645/7092] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:49 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:50.316191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:50.316917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:50.325065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:50.325608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:50.326102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:50.326874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:50.327372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:50.327846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:50.467219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:50.479203 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6fd8a18-5c35-4d57-8844-a121663ed59d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.168923 Oct 27 11:05:50.479816 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3448/7093] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:50 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:51.509376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:51.510385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:51.520887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:51.521395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:51.521850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:51.522572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:51.523075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:51.523579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:51.667803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:51.676706 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb075f4d-9cb8-406f-b4bd-cf9329d00b77 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.173985 Oct 27 11:05:51.677544 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3646/7094] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:51 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:52.707123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:52.707772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:52.715752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:52.716235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:52.716882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:52.717394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:52.717846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:52.718266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:52.853251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:52.861987 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef918937-6502-4f1b-895e-9fea56e84fb9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.160217 Oct 27 11:05:52.862593 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3449/7095] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:52 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:53.886639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:53.887281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:53.894816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:53.895331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:53.895796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:53.897292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:53.898432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:53.898881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:54.042740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:54.051134 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0bb164d7-0763-4b94-87f7-b6d2e8bd2ee7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.168600 Oct 27 11:05:54.051739 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3647/7096] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:53 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:55.079868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:55.080854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:55.088526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:55.089050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:55.089488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:55.090199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:55.090654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:55.091082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:55.300154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:55.308319 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a352a25f-c526-412a-975c-8068680fa045 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.234936 Oct 27 11:05:55.308923 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3450/7097] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:55 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:56.335647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:56.336730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:56.348092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:56.348592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:56.349079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:56.349788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:56.350251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:56.350692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:56.538098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:56.550476 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98d5dc5e-44c2-484b-ae55-49aa5a8bcd05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.221364 Oct 27 11:05:56.551049 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3648/7098] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:56 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:57.574777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:57.575371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:57.582758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:57.583279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:57.583795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:57.584484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:57.584970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:57.585427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:57.720340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:57.728857 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6bb21b86-df57-4d8c-b77e-b1bd5e594b82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1655 microversion: 2.1 time: 0.157915 Oct 27 11:05:57.729440 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3451/7099] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:57 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:57.752140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:05:57.754482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:57.762145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:57.762760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:57.763212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:57.763948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:57.764405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:57.764873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:57.797037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:57.802923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Old instance type m1.heat2, new instance type m1.heat {{(pid=120720) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:05:57.810186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:05:57.810582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:05:57.811100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:05:57.811513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:05:57.811934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:05:57.879309 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8dc8b7be-ea93-44c8-9633-41c31ddfded3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/action" status: 202 len: 0 microversion: 2.1 time: 0.131316 Oct 27 11:05:57.880096 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3649/7100] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:05:57 2022] POST /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:05:57.889100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:57.889339 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:57.896057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:57.896548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:57.897041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:57.897741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:57.898190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:57.898614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:58.036432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:58.044541 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1cc2cfc-dfb4-4300-adb7-b2288980e501 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.159811 Oct 27 11:05:58.045326 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3452/7101] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:57 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:05:59.069584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:05:59.070421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:05:59.078275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:59.078778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:59.079230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:59.079975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:05:59.080434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:05:59.080918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:05:59.218330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:05:59.227988 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-04b1bce6-ff7f-476f-b122-5c0703329a4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1678 microversion: 2.1 time: 0.163774 Oct 27 11:05:59.228568 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3650/7102] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:05:59 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:00.254978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:00.255765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:00.267758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:00.268375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:00.268927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:00.270065 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:00.270617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:00.271161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:00.767802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:00.775761 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d2b34cb-19d0-471e-ae65-92c3a781d7a5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1683 microversion: 2.1 time: 0.526932 Oct 27 11:06:00.776345 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3453/7103] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:00 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1683 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:01.800146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:01.800846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:01.803212 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:06:01.803368 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:06:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 (ip 10.222.0.76) !!! Oct 27 11:06:01.810940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:01.811442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:01.811893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:01.812621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:01.813113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:01.813548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:02.041500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:02.050147 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f16f1e8a-0a90-477d-b772-d14f44924faa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1683 microversion: 2.1 time: 0.254100 Oct 27 11:06:02.050711 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3651/7104] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:01 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1683 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:02.351955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-6ec73dea-d22a-4f49-bc8e-ae16858f0896 req-94644a1a-c01a-4547-8c79-6e99bfb16ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769b7ba3-40c8-4499-b06d-1082b1192960", "name": "network-vif-unplugged", "status": "completed", "tag": "9ca7d329-f734-4800-a5ac-f047d122f6b8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:02.363201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6ec73dea-d22a-4f49-bc8e-ae16858f0896 req-94644a1a-c01a-4547-8c79-6e99bfb16ba9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:02.363650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6ec73dea-d22a-4f49-bc8e-ae16858f0896 req-94644a1a-c01a-4547-8c79-6e99bfb16ba9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:02.364180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-6ec73dea-d22a-4f49-bc8e-ae16858f0896 req-94644a1a-c01a-4547-8c79-6e99bfb16ba9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:02.376783 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-6ec73dea-d22a-4f49-bc8e-ae16858f0896 req-94644a1a-c01a-4547-8c79-6e99bfb16ba9 service nova] Creating event network-vif-unplugged:9ca7d329-f734-4800-a5ac-f047d122f6b8 for instance 769b7ba3-40c8-4499-b06d-1082b1192960 on n-h1-854663-10 Oct 27 11:06:02.382285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-6ec73dea-d22a-4f49-bc8e-ae16858f0896 req-94644a1a-c01a-4547-8c79-6e99bfb16ba9 service nova] Instance 769b7ba3-40c8-4499-b06d-1082b1192960 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:06:02.393636 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-6ec73dea-d22a-4f49-bc8e-ae16858f0896 req-94644a1a-c01a-4547-8c79-6e99bfb16ba9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045861 Oct 27 11:06:02.394516 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3454/7105] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:06:03.075568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:03.076392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:03.084146 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:03.084649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:03.085128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:03.085956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:03.086442 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:03.086878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:03.228020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:03.236094 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-133dc1ba-9725-46ec-bc86-1aedc04ed663 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1682 microversion: 2.1 time: 0.165070 Oct 27 11:06:03.236695 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3652/7106] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:03 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:04.263940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:04.264648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:04.271442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:04.271932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:04.272378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:04.273118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:04.273572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:04.274002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:04.407327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:04.408885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e317cc97-7ae0-42de-a5f8-626b5be8b9de req-d0cd72b4-254c-461a-9af7-08c8bdd11c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769b7ba3-40c8-4499-b06d-1082b1192960", "tag": "9ca7d329-f734-4800-a5ac-f047d122f6b8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:04.417095 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-003134a1-958d-4a9b-aa8c-3d576fe598db tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1680 microversion: 2.1 time: 0.159040 Oct 27 11:06:04.417687 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3455/7107] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:04 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:04.420803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e317cc97-7ae0-42de-a5f8-626b5be8b9de req-d0cd72b4-254c-461a-9af7-08c8bdd11c27 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:04.421290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e317cc97-7ae0-42de-a5f8-626b5be8b9de req-d0cd72b4-254c-461a-9af7-08c8bdd11c27 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:04.421889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e317cc97-7ae0-42de-a5f8-626b5be8b9de req-d0cd72b4-254c-461a-9af7-08c8bdd11c27 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:04.434466 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e317cc97-7ae0-42de-a5f8-626b5be8b9de req-d0cd72b4-254c-461a-9af7-08c8bdd11c27 service nova] Creating event network-changed:9ca7d329-f734-4800-a5ac-f047d122f6b8 for instance 769b7ba3-40c8-4499-b06d-1082b1192960 on n-h1-854663-10 Oct 27 11:06:04.439894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-e317cc97-7ae0-42de-a5f8-626b5be8b9de req-d0cd72b4-254c-461a-9af7-08c8bdd11c27 service nova] Instance 769b7ba3-40c8-4499-b06d-1082b1192960 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:06:04.451226 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e317cc97-7ae0-42de-a5f8-626b5be8b9de req-d0cd72b4-254c-461a-9af7-08c8bdd11c27 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046099 Oct 27 11:06:04.451831 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3653/7108] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:06:05.441762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:05.442394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:05.449847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:05.450340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:05.450777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:05.451475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:05.451929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:05.452356 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:05.591783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:05.600414 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c019624f-5a9b-4f5b-a284-2ef161c9de81 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1676 microversion: 2.1 time: 0.162696 Oct 27 11:06:05.601061 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3456/7109] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:05 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:05.625431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b8769438-0c05-423b-8515-03e533d4c13a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:05.626129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b8769438-0c05-423b-8515-03e533d4c13a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:05.633406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8769438-0c05-423b-8515-03e533d4c13a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:05.633978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8769438-0c05-423b-8515-03e533d4c13a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:05.634540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8769438-0c05-423b-8515-03e533d4c13a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:05.635272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8769438-0c05-423b-8515-03e533d4c13a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:05.635745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8769438-0c05-423b-8515-03e533d4c13a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:05.636189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8769438-0c05-423b-8515-03e533d4c13a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:05.699994 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b8769438-0c05-423b-8515-03e533d4c13a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/action" status: 204 len: 0 microversion: 2.1 time: 0.079719 Oct 27 11:06:05.700762 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3654/7110] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:06:05 2022] POST /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:06:05.709310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:05.709936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:05.716355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:05.716948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:05.717336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:05.718071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:05.718517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:05.719155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:05.931630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:05.939971 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a423325f-421c-4cbe-be2a-d9207134873f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1676 microversion: 2.1 time: 0.234627 Oct 27 11:06:05.940610 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3457/7111] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:05 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:06:06.965596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:06.966387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:06.972780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:06.973271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:06.973707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:06.974410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:06.974865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:06.975295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:07.115198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:07.124136 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-27251b83-ca20-4c36-bb75-87842365815a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1676 microversion: 2.1 time: 0.163913 Oct 27 11:06:07.125055 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3655/7112] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:06 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:08.127838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-527f3194-c780-4d1b-8f6c-4fef725bcfb1 req-b428fc6a-60ac-444b-a949-6647ec8d6899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769b7ba3-40c8-4499-b06d-1082b1192960", "name": "network-vif-plugged", "status": "completed", "tag": "9ca7d329-f734-4800-a5ac-f047d122f6b8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:08.142106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-527f3194-c780-4d1b-8f6c-4fef725bcfb1 req-b428fc6a-60ac-444b-a949-6647ec8d6899 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:08.142106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-527f3194-c780-4d1b-8f6c-4fef725bcfb1 req-b428fc6a-60ac-444b-a949-6647ec8d6899 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:08.142567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-527f3194-c780-4d1b-8f6c-4fef725bcfb1 req-b428fc6a-60ac-444b-a949-6647ec8d6899 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:08.148792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:08.150275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:08.155220 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-527f3194-c780-4d1b-8f6c-4fef725bcfb1 req-b428fc6a-60ac-444b-a949-6647ec8d6899 service nova] Creating event network-vif-plugged:9ca7d329-f734-4800-a5ac-f047d122f6b8 for instance 769b7ba3-40c8-4499-b06d-1082b1192960 on n-h1-854663-10 Oct 27 11:06:08.157789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:08.158300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:08.158882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:08.160805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:08.161325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:08.161442 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-527f3194-c780-4d1b-8f6c-4fef725bcfb1 req-b428fc6a-60ac-444b-a949-6647ec8d6899 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037706 Oct 27 11:06:08.161768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:08.162066 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3458/7113] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:06:08.180287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:08.308994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:08.317580 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a32df164-7ed5-439f-9f5e-8882af20e527 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1655 microversion: 2.1 time: 0.173437 Oct 27 11:06:08.318162 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3656/7114] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:08 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1655 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:08.344213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:08.345314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:08.355364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:08.356072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:08.356615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:08.357691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:08.358286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:08.358902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:08.504834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:08.517362 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d379f1e-362e-4b45-ad2a-d41708a94c42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1655 microversion: 2.1 time: 0.179913 Oct 27 11:06:08.518148 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3459/7115] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:08 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1655 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:08.551490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b11fb3b4-ff40-44b3-a32d-7cf25252c38f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:08.561618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b11fb3b4-ff40-44b3-a32d-7cf25252c38f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:08.562330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b11fb3b4-ff40-44b3-a32d-7cf25252c38f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:08.562951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b11fb3b4-ff40-44b3-a32d-7cf25252c38f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:08.589687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b11fb3b4-ff40-44b3-a32d-7cf25252c38f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Going to try to start instance {{(pid=120720) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 11:06:08.639489 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b11fb3b4-ff40-44b3-a32d-7cf25252c38f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/action" status: 202 len: 0 microversion: 2.1 time: 0.094878 Oct 27 11:06:08.640113 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3657/7116] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:06:08 2022] POST /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:06:08.648611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:08.649483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:08.655851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:08.656407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:08.656896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:08.657578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:08.658346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:08.658903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:08.678963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:08.807261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:08.817257 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b5d7fdac-d0aa-48fc-9c33-a022a78a2cbf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1664 microversion: 2.1 time: 0.172504 Oct 27 11:06:08.817865 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3460/7117] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:08 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:09.842827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:09.843580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:09.850404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:09.850887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:09.851571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:09.852304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:09.852896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:09.853339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:10.002924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:10.011780 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b76ef55-6a6b-4e6d-a021-bd0c32d5bbce tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1668 microversion: 2.1 time: 0.174535 Oct 27 11:06:10.012376 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3658/7118] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:09 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:10.036085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:10.036722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:10.043262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:10.043751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:10.044189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:10.045696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:10.046161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:10.046588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:10.072583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:06:10.156634 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7ef40ee2-bb13-4e35-ab00-cad2c2872064 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 204 len: 0 microversion: 2.1 time: 0.124556 Oct 27 11:06:10.157263 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3461/7119] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:06:10 2022] DELETE /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:06:10.166476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:10.167104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:10.174379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:10.174878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:10.175320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:10.176045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:10.176503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:10.176970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:10.308154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:10.316471 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca3e99d9-b613-4e57-a7c2-5c9141409903 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1674 microversion: 2.1 time: 0.154173 Oct 27 11:06:10.317420 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3659/7120] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:10 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:11.341893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:11.342746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:11.350271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:11.350765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:11.351205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:11.351905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:11.352361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:11.352825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:11.512269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:11.520981 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05fe6472-ac15-4457-ac85-7348724c92c0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1674 microversion: 2.1 time: 0.183970 Oct 27 11:06:11.521560 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3462/7121] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:11 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:12.547319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:12.548066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:12.551070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=41 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:12.556845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:12.557445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:12.557940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:12.558733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:12.559264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:12.559701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:12.628585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:12.636888 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-289a1eea-1643-40cf-8b5b-bba0e5552c13 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 200 len: 1607 microversion: 2.1 time: 0.095399 Oct 27 11:06:12.637491 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3660/7122] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:12 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 1607 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:12.925130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-166c590e-3186-4e18-a77f-907d91b5524e req-cdfbd937-a0be-44f9-9fdf-fe8bbaa5caa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769b7ba3-40c8-4499-b06d-1082b1192960", "name": "network-vif-deleted", "tag": "9ca7d329-f734-4800-a5ac-f047d122f6b8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:12.937441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:12.940775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-166c590e-3186-4e18-a77f-907d91b5524e req-cdfbd937-a0be-44f9-9fdf-fe8bbaa5caa2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:12.941258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-166c590e-3186-4e18-a77f-907d91b5524e req-cdfbd937-a0be-44f9-9fdf-fe8bbaa5caa2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:12.941692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-166c590e-3186-4e18-a77f-907d91b5524e req-cdfbd937-a0be-44f9-9fdf-fe8bbaa5caa2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:12.958707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-166c590e-3186-4e18-a77f-907d91b5524e req-cdfbd937-a0be-44f9-9fdf-fe8bbaa5caa2 service nova] Creating event network-vif-deleted:9ca7d329-f734-4800-a5ac-f047d122f6b8 for instance 769b7ba3-40c8-4499-b06d-1082b1192960 on n-h1-854663-10 Oct 27 11:06:12.964751 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-166c590e-3186-4e18-a77f-907d91b5524e req-cdfbd937-a0be-44f9-9fdf-fe8bbaa5caa2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113044 Oct 27 11:06:12.965596 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3463/7123] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:06:13.660796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:13.661413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:13.668655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:13.669188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:13.669965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:13.670673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:13.671151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:13.671581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:13.685566 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 HTTP/1.1 Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '769b7ba3-40c8-4499-b06d-1082b1192960'} Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:06:13.687326 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1be55a32-e7eb-4ee9-8258-56fd2720d8b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 404 len: 111 microversion: 2.1 time: 0.032359 Oct 27 11:06:13.692114 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3661/7124] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:13 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:06:13.705444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:13.706150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:13.712703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:13.713188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:13.713643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:13.714330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:13.714775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:13.715195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:13.729013 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 HTTP/1.1 Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '769b7ba3-40c8-4499-b06d-1082b1192960'} Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:06:13.730669 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5519416b-1a3d-4866-9f0f-ec1c48ef4262 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 404 len: 111 microversion: 2.1 time: 0.031100 Oct 27 11:06:13.735048 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3464/7125] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:13 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:06:13.783635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1982573640", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "bd104410-d9ba-4653-9650-239e04e3ba4d"}], "security_groups": [{"name": "tempest-securitygroup--323560069"}], "key_name": "tempest-keypair-99605006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:13.900020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] validate_networks() for [('bd104410-d9ba-4653-9650-239e04e3ba4d', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:06:14.372847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:06:14.373384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:06:14.374214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:06:14.374877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:06:14.375448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:06:14.385221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:14.385721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:14.386182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:14.386926 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:14.387414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:14.387852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:14.405324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:06:14.411274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for user 59897473b3f44b6394a0dc9f53d85be4 and project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:06:14.424896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:06:14.427311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:06:14.478505 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44082811-0840-4b72-8e79-9c7446f354fd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.698894 Oct 27 11:06:14.479121 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3662/7126] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:06:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:06:14.494079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58c33199-f0c7-4cf3-b206-092d9972b91c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:14.494850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58c33199-f0c7-4cf3-b206-092d9972b91c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:14.552992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58c33199-f0c7-4cf3-b206-092d9972b91c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:14.562260 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58c33199-f0c7-4cf3-b206-092d9972b91c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1237 microversion: 2.1 time: 0.073341 Oct 27 11:06:14.562834 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3465/7127] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:14 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:15.587068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:15.587695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:15.595842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:15.596335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:15.596819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:15.597654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:15.598153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:15.598553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:15.674663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:15.682808 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2dde5854-f74e-4ce0-91e2-ff9c2775e1c7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1307 microversion: 2.1 time: 0.100580 Oct 27 11:06:15.683568 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3663/7128] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:15 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:16.707860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:16.708424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:16.715891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:16.716373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:16.716936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:16.717525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:16.717968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:16.718385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:16.922729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:16.931132 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87717a5e-93d9-49b7-9e5b-053f01435f4e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1362 microversion: 2.1 time: 0.227337 Oct 27 11:06:16.931801 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3466/7129] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:16 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:17.074075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-db4704be-d392-4b70-9f7f-c51ecf1dd893 req-946b766b-d79a-42df-8890-29a7714ac1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:17.084361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-db4704be-d392-4b70-9f7f-c51ecf1dd893 req-946b766b-d79a-42df-8890-29a7714ac1f5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:17.084891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-db4704be-d392-4b70-9f7f-c51ecf1dd893 req-946b766b-d79a-42df-8890-29a7714ac1f5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:17.085348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-db4704be-d392-4b70-9f7f-c51ecf1dd893 req-946b766b-d79a-42df-8890-29a7714ac1f5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:17.097923 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-db4704be-d392-4b70-9f7f-c51ecf1dd893 req-946b766b-d79a-42df-8890-29a7714ac1f5 service nova] Creating event network-changed:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h2-854663-10 Oct 27 11:06:17.104409 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-db4704be-d392-4b70-9f7f-c51ecf1dd893 req-946b766b-d79a-42df-8890-29a7714ac1f5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035651 Oct 27 11:06:17.105229 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3664/7130] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:06:17.955615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:17.956151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:17.963770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:17.964255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:17.964694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:17.965417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:17.965868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:17.966287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:18.111902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:18.121051 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9cfc4cd-974a-4108-ba76-f826c7b69abd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1362 microversion: 2.1 time: 0.169456 Oct 27 11:06:18.121667 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3467/7131] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:17 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:19.149166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:19.149764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:19.156770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:19.157267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:19.157712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:19.158410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:19.158875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:19.159304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:19.309576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:19.319593 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b82302f4-dfdd-4776-bd5d-91d68d2b1e3f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1362 microversion: 2.1 time: 0.176505 Oct 27 11:06:19.320183 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3665/7132] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:19 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:20.343800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:20.344572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:20.352205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:20.352704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:20.353171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:20.353882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:20.354503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:20.354939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:20.494902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:20.507056 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fdc3c0c4-598e-461d-8bb0-a5be0beff0aa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1362 microversion: 2.1 time: 0.166988 Oct 27 11:06:20.507906 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3468/7133] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:20 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:21.535193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:21.535803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:21.543256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:21.543754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:21.544201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:21.545281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:21.545739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:21.546170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:21.686706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:21.696760 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-914c96c9-6825-41cd-b1b1-c8160587476d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1362 microversion: 2.1 time: 0.168063 Oct 27 11:06:21.697424 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3666/7134] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:21 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:21.858816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-fa9a7ccd-1be6-4351-867b-a74f591f7648 req-f0b95ab6-d589-4531-b8a0-9993871c6114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "name": "network-vif-plugged", "status": "completed", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:21.870609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fa9a7ccd-1be6-4351-867b-a74f591f7648 req-f0b95ab6-d589-4531-b8a0-9993871c6114 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:21.871095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fa9a7ccd-1be6-4351-867b-a74f591f7648 req-f0b95ab6-d589-4531-b8a0-9993871c6114 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:21.871525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fa9a7ccd-1be6-4351-867b-a74f591f7648 req-f0b95ab6-d589-4531-b8a0-9993871c6114 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:21.885355 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-fa9a7ccd-1be6-4351-867b-a74f591f7648 req-f0b95ab6-d589-4531-b8a0-9993871c6114 service nova] Creating event network-vif-plugged:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h2-854663-10 Oct 27 11:06:21.890365 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-fa9a7ccd-1be6-4351-867b-a74f591f7648 req-f0b95ab6-d589-4531-b8a0-9993871c6114 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035370 Oct 27 11:06:21.890969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3469/7135] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:06:22.723629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:22.724423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:22.734785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:22.735459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:22.736121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:22.737170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:22.738074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:22.738599 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:22.889470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:22.897764 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0620c159-e33c-4d97-826e-f7d9ea10b986 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1362 microversion: 2.1 time: 0.180685 Oct 27 11:06:22.898347 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3667/7136] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:22 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:23.928494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:23.929697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:23.940468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:23.941230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:23.941667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:23.942364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:23.942816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:23.943244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:24.085388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:24.093736 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-815f419e-3c3a-43d3-bac2-1147b28eac49 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1549 microversion: 2.1 time: 0.174251 Oct 27 11:06:24.094314 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3470/7137] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:23 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:24.117700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05298bcc-ac27-4c80-bcbf-93bc88c78441 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:24.118271 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05298bcc-ac27-4c80-bcbf-93bc88c78441 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:24.125911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05298bcc-ac27-4c80-bcbf-93bc88c78441 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:24.126407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05298bcc-ac27-4c80-bcbf-93bc88c78441 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:24.126852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05298bcc-ac27-4c80-bcbf-93bc88c78441 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:24.127557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05298bcc-ac27-4c80-bcbf-93bc88c78441 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:24.128018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05298bcc-ac27-4c80-bcbf-93bc88c78441 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:24.128508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05298bcc-ac27-4c80-bcbf-93bc88c78441 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:24.212394 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05298bcc-ac27-4c80-bcbf-93bc88c78441 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098899 Oct 27 11:06:24.213050 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3668/7138] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 11:06:24 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:06:25.207858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:25.272793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2ba41d02-8493-46cf-9dcd-07c05c5ab57d req-e5d21f32-1c0f-4466-a3fd-78f1a3f4330d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:25.283217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2ba41d02-8493-46cf-9dcd-07c05c5ab57d req-e5d21f32-1c0f-4466-a3fd-78f1a3f4330d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:25.283709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2ba41d02-8493-46cf-9dcd-07c05c5ab57d req-e5d21f32-1c0f-4466-a3fd-78f1a3f4330d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:25.284148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2ba41d02-8493-46cf-9dcd-07c05c5ab57d req-e5d21f32-1c0f-4466-a3fd-78f1a3f4330d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:25.296829 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2ba41d02-8493-46cf-9dcd-07c05c5ab57d req-e5d21f32-1c0f-4466-a3fd-78f1a3f4330d service nova] Creating event network-changed:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h2-854663-10 Oct 27 11:06:25.301836 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2ba41d02-8493-46cf-9dcd-07c05c5ab57d req-e5d21f32-1c0f-4466-a3fd-78f1a3f4330d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099298 Oct 27 11:06:25.302414 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3471/7139] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:06:55.665877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:55.667029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:55.670209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:55.671092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:55.677778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:06:55.681126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:55.693310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:55.693805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:55.694250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:55.694966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:55.695454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:55.695875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:55.730137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:55.735924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120720) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:06:55.743570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:06:55.744005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:06:55.744495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:06:55.744935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:06:55.745360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:06:55.812444 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a80ceb91-7b40-4ff1-9794-9c781608476a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f/action" status: 202 len: 0 microversion: 2.1 time: 0.147882 Oct 27 11:06:55.813113 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3669/7140] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:06:55 2022] POST /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:06:55.820002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=19 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:55.820780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:06:55.825136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:55.826034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:55.832776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:55.833264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:55.833701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:55.834407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:55.834859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:55.835284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:55.973146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:55.981374 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ccb304d7-9385-4e5e-99e7-c007095617e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1677 microversion: 2.1 time: 0.163577 Oct 27 11:06:55.981978 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3472/7141] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:55 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:06:57.006046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:57.006693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:57.014176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:57.014643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:57.015114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:57.015822 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:57.016279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:57.016720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:57.162357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:57.171035 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1841f4aa-7f81-4aff-a948-032773f83c27 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1677 microversion: 2.1 time: 0.170007 Oct 27 11:06:57.171580 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3670/7142] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:56 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:58.198584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:58.199546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:58.210890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:58.211373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:58.211803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:58.212499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:58.212975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:58.213399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:58.360685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:58.369193 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb04ab81-46e0-4a25-9c09-3466fa5db232 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.177458 Oct 27 11:06:58.369768 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3473/7143] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:58 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:06:59.403384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:06:59.403384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:06:59.410310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:59.411372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:59.412130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:59.413413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:06:59.413909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:06:59.414354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:06:59.553633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:06:59.561678 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5810371-0d22-4208-be58-2301e828788e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.170835 Oct 27 11:06:59.562274 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3671/7144] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:06:59 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:00.588362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:00.589101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:00.596475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:00.597000 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:00.597435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:00.598131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:00.598580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:00.599002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:00.730983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:00.738910 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b9c40520-87ae-4327-8e6c-d94d12bf22e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.155293 Oct 27 11:07:00.739500 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3474/7145] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:00 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:01.764553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:01.765323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:01.776151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:01.777016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:01.777730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:01.778813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:01.779627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:01.780322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:01.932596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:01.941355 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e00168cb-3971-4731-8e12-dfe6b9197621 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.182026 Oct 27 11:07:01.941932 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3672/7146] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:01 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:02.966833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:02.967619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:02.977081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:02.977573 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:02.978019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:02.978702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:02.979151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:02.979575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:03.134889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:03.143085 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7968e40c-112a-4db6-b257-ae4e29f9cfc7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.181645 Oct 27 11:07:03.143675 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3475/7147] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:02 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:04.167168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:04.167836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:04.175567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:04.176069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:04.176517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:04.177265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:04.177733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:04.178169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:04.313316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:04.325255 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6dfd791a-1be2-4951-9508-d552e3b5dffc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.162086 Oct 27 11:07:04.326032 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3673/7148] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:04 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:05.357103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:05.357802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:05.364902 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:05.365384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:05.365822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:05.366518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:05.366967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:05.367383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:05.508298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:05.516846 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c033cf05-d58e-436d-826a-007bbe4f8b17 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.165283 Oct 27 11:07:05.517421 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3476/7149] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:05 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:06.550513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:06.551547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:06.561305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:06.561812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:06.562265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:06.562983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:06.563426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:06.563975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:06.704961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:06.713557 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-901e51b8-c2cd-49b9-a409-7d910753b3b5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.170120 Oct 27 11:07:06.714278 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3674/7150] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:06 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:07.742307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:07.743208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:07.752462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:07.752970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:07.753406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:07.754135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:07.754582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:07.755005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:07.903040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:07.911329 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0e46cbf-ec11-482d-9608-541712f5078f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.175873 Oct 27 11:07:07.911904 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3477/7151] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:07 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:08.941033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:08.942116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:08.952140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:08.952572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:08.953051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:08.953801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:08.954308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:08.954753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:09.092619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:09.104757 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76e21bf0-603d-4156-aad0-c98a11da8e55 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1682 microversion: 2.1 time: 0.171828 Oct 27 11:07:09.105550 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3675/7152] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:08 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:10.130005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:10.130584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:10.137457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:10.137942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:10.138432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:10.139145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:10.139599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:10.140029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:10.238031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ca84071c-9354-4892-b734-5e5a7f6427f8 req-cf021840-6bc7-4705-b231-24b81e4073c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "name": "network-vif-unplugged", "status": "completed", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:10.253493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ca84071c-9354-4892-b734-5e5a7f6427f8 req-cf021840-6bc7-4705-b231-24b81e4073c0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:10.254239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ca84071c-9354-4892-b734-5e5a7f6427f8 req-cf021840-6bc7-4705-b231-24b81e4073c0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:10.254531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ca84071c-9354-4892-b734-5e5a7f6427f8 req-cf021840-6bc7-4705-b231-24b81e4073c0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:10.269399 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ca84071c-9354-4892-b734-5e5a7f6427f8 req-cf021840-6bc7-4705-b231-24b81e4073c0 service nova] Creating event network-vif-unplugged:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h1-854663-10 Oct 27 11:07:10.275399 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-ca84071c-9354-4892-b734-5e5a7f6427f8 req-cf021840-6bc7-4705-b231-24b81e4073c0 service nova] Instance db222a92-d08b-4020-b523-3b2041e7f55f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:07:10.288048 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ca84071c-9354-4892-b734-5e5a7f6427f8 req-cf021840-6bc7-4705-b231-24b81e4073c0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053930 Oct 27 11:07:10.288698 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3676/7153] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:10.289747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:10.298626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c2df126-eca6-42ca-849d-609df9d6751a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1681 microversion: 2.1 time: 0.172971 Oct 27 11:07:10.299233 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3478/7154] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:10 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:11.327111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:11.327879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:11.335897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:11.336402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:11.336871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:11.337582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:11.338060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:11.338486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:11.474858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:11.483232 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2fefcfbc-c060-4530-a884-84908681dc32 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1681 microversion: 2.1 time: 0.163547 Oct 27 11:07:11.483813 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3677/7155] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:11 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:12.338147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f19f0eba-c61b-4ad5-aa2c-752d14044554 req-a459ed24-558a-4240-80d4-d6cf7efbe49d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:12.355040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f19f0eba-c61b-4ad5-aa2c-752d14044554 req-a459ed24-558a-4240-80d4-d6cf7efbe49d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:12.355808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f19f0eba-c61b-4ad5-aa2c-752d14044554 req-a459ed24-558a-4240-80d4-d6cf7efbe49d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:12.356480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f19f0eba-c61b-4ad5-aa2c-752d14044554 req-a459ed24-558a-4240-80d4-d6cf7efbe49d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:12.369524 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f19f0eba-c61b-4ad5-aa2c-752d14044554 req-a459ed24-558a-4240-80d4-d6cf7efbe49d service nova] Creating event network-changed:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h1-854663-10 Oct 27 11:07:12.375800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-f19f0eba-c61b-4ad5-aa2c-752d14044554 req-a459ed24-558a-4240-80d4-d6cf7efbe49d service nova] Instance db222a92-d08b-4020-b523-3b2041e7f55f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:07:12.387053 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f19f0eba-c61b-4ad5-aa2c-752d14044554 req-a459ed24-558a-4240-80d4-d6cf7efbe49d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055365 Oct 27 11:07:12.387662 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3479/7156] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:12.516167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:12.516784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:12.524314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:12.524833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:12.525286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:12.526077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:12.526549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:12.526995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:12.745030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:12.753665 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd915873-996d-4f54-9ecf-0c4fbbb9c711 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1679 microversion: 2.1 time: 0.241998 Oct 27 11:07:12.754255 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3678/7157] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:12 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:13.783086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:13.783877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:13.791916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:13.792496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:13.793057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:13.793880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:13.794752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:13.795302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:13.934303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:13.942797 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1976cf4e-18af-4438-8f61-493562e9a4b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1676 microversion: 2.1 time: 0.167196 Oct 27 11:07:13.943344 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3480/7158] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:13 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:13.965798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:13.966377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:13.973807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:13.974312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:13.974763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:13.975468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:13.975934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:13.976370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:14.016961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:14.017598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:14.018230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:14.019332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:14.020017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:14.020697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:14.045453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:07:14.050979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for user 59897473b3f44b6394a0dc9f53d85be4 and project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:07:14.170072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44f1e1d8-06a7-461a-b74e-efc0408343ac tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f/action" status: 202 len: 0 microversion: 2.1 time: 0.207614 Oct 27 11:07:14.171066 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3679/7159] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:07:13 2022] POST /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:07:14.178914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:14.179537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:14.191712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:14.192196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:14.192624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:14.193550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:14.194002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:14.194418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:14.333816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:14.342224 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13a4057f-c074-4e5a-89f2-fce070e33080 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1675 microversion: 2.1 time: 0.167176 Oct 27 11:07:14.343205 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3481/7160] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:14 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:15.370690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:15.371634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:15.380046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:15.380552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:15.381033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:15.381746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:15.382229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:15.382672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:15.539160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:15.548072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ceadd55f-b49f-47ab-a684-3674627eed99 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1675 microversion: 2.1 time: 0.184433 Oct 27 11:07:15.548655 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3680/7161] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:15 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:16.571810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:16.573225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:16.576347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9e9ac1a1-bb41-4edd-abd8-b17985493e5d req-8bf2472b-f3fc-4da2-b2e2-ef0a96b1943e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "name": "network-vif-plugged", "status": "completed", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:16.583333 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:16.583834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:16.584278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:16.585018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:16.585480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:16.585915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:16.589444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e9ac1a1-bb41-4edd-abd8-b17985493e5d req-8bf2472b-f3fc-4da2-b2e2-ef0a96b1943e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:16.589928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e9ac1a1-bb41-4edd-abd8-b17985493e5d req-8bf2472b-f3fc-4da2-b2e2-ef0a96b1943e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:16.590368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e9ac1a1-bb41-4edd-abd8-b17985493e5d req-8bf2472b-f3fc-4da2-b2e2-ef0a96b1943e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:16.605656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:07:16.607476 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9e9ac1a1-bb41-4edd-abd8-b17985493e5d req-8bf2472b-f3fc-4da2-b2e2-ef0a96b1943e service nova] Creating event network-vif-plugged:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h1-854663-10 Oct 27 11:07:16.613580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-9e9ac1a1-bb41-4edd-abd8-b17985493e5d req-8bf2472b-f3fc-4da2-b2e2-ef0a96b1943e service nova] Instance db222a92-d08b-4020-b523-3b2041e7f55f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:07:16.624942 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9e9ac1a1-bb41-4edd-abd8-b17985493e5d req-8bf2472b-f3fc-4da2-b2e2-ef0a96b1943e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105944 Oct 27 11:07:16.625552 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3482/7162] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:16.746024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:16.756189 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ef1b08b-a0d7-4db8-bd7b-d900347077b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1675 microversion: 2.1 time: 0.188498 Oct 27 11:07:16.756817 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3681/7163] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:16 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:07:17.569971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-560644dc-b0ba-425d-b2e9-ba266b9599a6 req-be520547-9172-4d91-a68e-021b3e8a57d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "name": "network-vif-unplugged", "status": "completed", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:17.579709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-560644dc-b0ba-425d-b2e9-ba266b9599a6 req-be520547-9172-4d91-a68e-021b3e8a57d1 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:17.580329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-560644dc-b0ba-425d-b2e9-ba266b9599a6 req-be520547-9172-4d91-a68e-021b3e8a57d1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:17.580608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-560644dc-b0ba-425d-b2e9-ba266b9599a6 req-be520547-9172-4d91-a68e-021b3e8a57d1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:17.593374 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-560644dc-b0ba-425d-b2e9-ba266b9599a6 req-be520547-9172-4d91-a68e-021b3e8a57d1 service nova] Creating event network-vif-unplugged:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h2-854663-10 Oct 27 11:07:17.598980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-560644dc-b0ba-425d-b2e9-ba266b9599a6 req-be520547-9172-4d91-a68e-021b3e8a57d1 service nova] Instance db222a92-d08b-4020-b523-3b2041e7f55f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:07:17.610618 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-560644dc-b0ba-425d-b2e9-ba266b9599a6 req-be520547-9172-4d91-a68e-021b3e8a57d1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098939 Oct 27 11:07:17.611436 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3483/7164] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:17.779700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:17.780516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:17.788799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:17.789416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:17.789968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:17.790813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:17.791406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:17.791938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:18.012289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:18.020725 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a84c3b34-f8fd-4237-a8ef-bbfa8a2454f4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1675 microversion: 2.1 time: 0.245137 Oct 27 11:07:18.021313 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3682/7165] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:17 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:19.052744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:19.053640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:19.063294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:19.063776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:19.064205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:19.064942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:19.065394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:19.065812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:19.212361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:19.221027 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-184114d4-0096-4cff-9bed-a40c833b642f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1675 microversion: 2.1 time: 0.178047 Oct 27 11:07:19.221609 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3484/7166] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:19 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:19.635053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-02c95efd-cc88-433c-b5f3-1060dfd5cc99 req-5fa23c5a-d113-49f2-8c63-fc9ac0b811a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:19.647858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-02c95efd-cc88-433c-b5f3-1060dfd5cc99 req-5fa23c5a-d113-49f2-8c63-fc9ac0b811a8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:19.648352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-02c95efd-cc88-433c-b5f3-1060dfd5cc99 req-5fa23c5a-d113-49f2-8c63-fc9ac0b811a8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:19.648844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-02c95efd-cc88-433c-b5f3-1060dfd5cc99 req-5fa23c5a-d113-49f2-8c63-fc9ac0b811a8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:19.660826 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-02c95efd-cc88-433c-b5f3-1060dfd5cc99 req-5fa23c5a-d113-49f2-8c63-fc9ac0b811a8 service nova] Creating event network-changed:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h2-854663-10 Oct 27 11:07:19.666461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-02c95efd-cc88-433c-b5f3-1060dfd5cc99 req-5fa23c5a-d113-49f2-8c63-fc9ac0b811a8 service nova] Instance db222a92-d08b-4020-b523-3b2041e7f55f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:07:19.680337 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-02c95efd-cc88-433c-b5f3-1060dfd5cc99 req-5fa23c5a-d113-49f2-8c63-fc9ac0b811a8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051614 Oct 27 11:07:19.681107 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3683/7167] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:20.245821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:20.247837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:20.257920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.259113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.259651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:20.260447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.268175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.272535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:20.425019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:20.433344 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-32ff3604-852b-4101-b234-4a3c89478cf6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1668 microversion: 2.1 time: 0.192824 Oct 27 11:07:20.433921 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3485/7168] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:20 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1668 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:20.458268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:20.459167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:20.468325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.468865 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.469287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:20.469996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.470467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.470908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:20.610997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:20.619157 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5ee8067-7b2c-46b8-a5ad-cd263b6d6789 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1668 microversion: 2.1 time: 0.166522 Oct 27 11:07:20.619745 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3684/7169] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:20 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:20.641882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:20.642490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:20.648479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.649022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.649463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:20.650162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.650610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.651033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:20.786217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:20.798366 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cbcd9037-da75-4cc4-8653-9d5de3522dde tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1668 microversion: 2.1 time: 0.160555 Oct 27 11:07:20.798965 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3486/7170] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:20 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:20.821477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:20.822055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:20.829404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.829902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.830356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:20.831054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.831519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.831954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:20.858830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:07:20.944229 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9b9247e8-4731-4d7d-b628-0a2c0c01ef65 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 204 len: 0 microversion: 2.1 time: 0.126189 Oct 27 11:07:20.945128 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3685/7171] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:07:20 2022] DELETE /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:07:20.955002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:20.955623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:20.961883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.962377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.962816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:20.963513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:20.963964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:20.964388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:21.099606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:21.107828 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-57c7d54a-07e8-4558-9781-89626e0285a9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1674 microversion: 2.1 time: 0.158008 Oct 27 11:07:21.108460 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3487/7172] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:20 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:22.132324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:22.133089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:22.140566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:22.141170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:22.141655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:22.142387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:22.142837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:22.143257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:22.252111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-65b76c4f-79ab-4509-8812-74692308bc0e req-c066c165-a76c-471a-bda9-a4736231c45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "name": "network-vif-plugged", "status": "completed", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:22.275134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65b76c4f-79ab-4509-8812-74692308bc0e req-c066c165-a76c-471a-bda9-a4736231c45b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:22.275783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65b76c4f-79ab-4509-8812-74692308bc0e req-c066c165-a76c-471a-bda9-a4736231c45b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:22.276467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65b76c4f-79ab-4509-8812-74692308bc0e req-c066c165-a76c-471a-bda9-a4736231c45b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:22.290597 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-65b76c4f-79ab-4509-8812-74692308bc0e req-c066c165-a76c-471a-bda9-a4736231c45b service nova] Creating event network-vif-plugged:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h2-854663-10 Oct 27 11:07:22.296488 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-65b76c4f-79ab-4509-8812-74692308bc0e req-c066c165-a76c-471a-bda9-a4736231c45b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048593 Oct 27 11:07:22.297797 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3488/7173] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:22.365914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:22.374344 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2fef42d0-cd29-4f66-816e-5603fb96f132 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1674 microversion: 2.1 time: 0.246336 Oct 27 11:07:22.375191 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3686/7174] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:22 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1674 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:23.122614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b335b0bb-132b-4a1c-8a43-17c1dae28774 req-33edda18-235f-4ea3-9310-98bc1acd37da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db222a92-d08b-4020-b523-3b2041e7f55f", "name": "network-vif-deleted", "tag": "522f46df-c706-4c10-b170-1b3edc1c7d62"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:23.135416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b335b0bb-132b-4a1c-8a43-17c1dae28774 req-33edda18-235f-4ea3-9310-98bc1acd37da service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:23.136192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b335b0bb-132b-4a1c-8a43-17c1dae28774 req-33edda18-235f-4ea3-9310-98bc1acd37da service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:23.136833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b335b0bb-132b-4a1c-8a43-17c1dae28774 req-33edda18-235f-4ea3-9310-98bc1acd37da service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:23.149953 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b335b0bb-132b-4a1c-8a43-17c1dae28774 req-33edda18-235f-4ea3-9310-98bc1acd37da service nova] Creating event network-vif-deleted:522f46df-c706-4c10-b170-1b3edc1c7d62 for instance db222a92-d08b-4020-b523-3b2041e7f55f on n-h2-854663-10 Oct 27 11:07:23.154869 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b335b0bb-132b-4a1c-8a43-17c1dae28774 req-33edda18-235f-4ea3-9310-98bc1acd37da service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036418 Oct 27 11:07:23.155615 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3489/7175] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:23.398826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:23.399509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:23.407214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:23.407717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:23.408171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:23.408955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:23.409427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:23.410070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:23.447468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:23.447968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:23.448421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:23.448925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lazy-loading 'fault' on Instance uuid db222a92-d08b-4020-b523-3b2041e7f55f {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:07:23.497678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:23.506336 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0448cada-0197-463e-8cda-c5be987bfb72 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 200 len: 1327 microversion: 2.1 time: 0.111745 Oct 27 11:07:23.506936 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3687/7176] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:23 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:24.534410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:24.535182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:24.542611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:24.543146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:24.543625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:24.544775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:24.545276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:24.545819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:24.560928 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f HTTP/1.1 Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'db222a92-d08b-4020-b523-3b2041e7f55f'} Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:07:24.562821 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b3d595d-0ebe-44cf-ae23-13ce32d951b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 404 len: 111 microversion: 2.1 time: 0.036611 Oct 27 11:07:24.567100 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3490/7177] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:24 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:07:24.580860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:07:24.586422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:24.587061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:24.593594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:24.594097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:24.594552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:24.595258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:24.595723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:24.596167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:24.610086 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f HTTP/1.1 Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'db222a92-d08b-4020-b523-3b2041e7f55f'} Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:07:24.611750 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3cceb3c9-6f1b-4698-92d2-df6a48c99220 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 404 len: 111 microversion: 2.1 time: 0.033346 Oct 27 11:07:24.619022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3688/7178] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:24 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:07:24.664475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1598640243", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "bd104410-d9ba-4653-9650-239e04e3ba4d"}], "security_groups": [{"name": "tempest-securitygroup--323560069"}], "key_name": "tempest-keypair-99605006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:24.782669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] validate_networks() for [('bd104410-d9ba-4653-9650-239e04e3ba4d', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:07:25.600606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:07:25.601259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:07:25.601528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:07:25.601934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:07:25.602342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:07:25.614879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:25.615366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:25.615806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:25.616553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:25.617018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:25.617420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:25.640613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:07:25.646308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for user 59897473b3f44b6394a0dc9f53d85be4 and project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:07:25.658910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:07:25.661290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:07:25.711967 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [dd897b98-c2cd-416d-a47a-9e5fdab299ae] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 11:07:26.721760 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [dd897b98-c2cd-416d-a47a-9e5fdab299ae] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 48826. Oct 27 11:07:26.726767 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ad6362a-7740-4260-afd7-58959909b6b1 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.066501 Oct 27 11:07:26.727439 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3491/7179] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:07:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:07:26.739101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-951276b3-ce14-45f1-b12d-c022ef454c4a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:26.740407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-951276b3-ce14-45f1-b12d-c022ef454c4a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:26.743312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:07:26.804060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-951276b3-ce14-45f1-b12d-c022ef454c4a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:26.814985 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-951276b3-ce14-45f1-b12d-c022ef454c4a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1237 microversion: 2.1 time: 0.079814 Oct 27 11:07:26.815556 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3689/7180] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:26 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:27.841621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:27.842231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:27.844345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:07:27.851572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:27.852178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:27.852579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:27.853326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:27.853778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:27.854197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:27.859780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:07:27.924866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:27.933434 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bbe6410e-ca74-4aa3-af5b-223712cf1195 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1289 microversion: 2.1 time: 0.098162 Oct 27 11:07:27.934017 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3492/7181] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:27 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:28.957168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:28.957968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:28.966061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:28.966557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:28.967001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:28.967708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:28.968168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:28.968603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:29.102731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:29.110668 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17ba960c-b49b-4679-a1a5-b44608ffafbe tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1362 microversion: 2.1 time: 0.157869 Oct 27 11:07:29.111521 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3690/7182] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:28 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:29.345340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c623b951-43d1-4ce7-90d4-0a68906a63f1 req-58a677b3-7a88-4d08-8f45-393a452a533e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:29.359612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c623b951-43d1-4ce7-90d4-0a68906a63f1 req-58a677b3-7a88-4d08-8f45-393a452a533e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:29.360203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c623b951-43d1-4ce7-90d4-0a68906a63f1 req-58a677b3-7a88-4d08-8f45-393a452a533e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:29.360650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c623b951-43d1-4ce7-90d4-0a68906a63f1 req-58a677b3-7a88-4d08-8f45-393a452a533e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:29.374702 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c623b951-43d1-4ce7-90d4-0a68906a63f1 req-58a677b3-7a88-4d08-8f45-393a452a533e service nova] Creating event network-changed:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h1-854663-10 Oct 27 11:07:29.381442 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c623b951-43d1-4ce7-90d4-0a68906a63f1 req-58a677b3-7a88-4d08-8f45-393a452a533e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039393 Oct 27 11:07:29.382038 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3493/7183] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:30.136882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:30.137678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:30.146792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:30.147421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:30.147982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:30.148920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:30.149507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:30.150058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:30.284354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:30.296070 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d831059-d941-43bb-98fc-c8ab63d45aaf tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1362 microversion: 2.1 time: 0.163948 Oct 27 11:07:30.296878 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3691/7184] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:30 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:31.326847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:31.327550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:31.335214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:31.335707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:31.336141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:31.336884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:31.337336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:31.337767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:31.474927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:31.487134 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d14d9adb-4d79-4e08-83b9-4c017ded4ce2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1362 microversion: 2.1 time: 0.164333 Oct 27 11:07:31.487866 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3494/7185] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:31 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:32.514701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:32.515303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:32.526188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:32.526876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:32.527436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:32.528513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:32.529215 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:32.529846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:32.666029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:32.674762 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee2b1353-2f19-4cda-8ccc-c7277b3be2dd tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1362 microversion: 2.1 time: 0.166325 Oct 27 11:07:32.675533 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3692/7186] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:32 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:33.700180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:33.700835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:33.708883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:33.709390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:33.709824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:33.710534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:33.710992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:33.711417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:33.866877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:33.876655 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73df31f7-04af-49f8-8e24-a256f93f5b2b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1362 microversion: 2.1 time: 0.180587 Oct 27 11:07:33.877330 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3495/7187] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:33 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:34.397111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8ebf4342-9d1f-49af-9535-6f6821c0c949 req-1a1978b6-34c5-4926-b479-1f1c9f414633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:34.408984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ebf4342-9d1f-49af-9535-6f6821c0c949 req-1a1978b6-34c5-4926-b479-1f1c9f414633 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:34.409503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ebf4342-9d1f-49af-9535-6f6821c0c949 req-1a1978b6-34c5-4926-b479-1f1c9f414633 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:34.410883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ebf4342-9d1f-49af-9535-6f6821c0c949 req-1a1978b6-34c5-4926-b479-1f1c9f414633 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:34.425094 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8ebf4342-9d1f-49af-9535-6f6821c0c949 req-1a1978b6-34c5-4926-b479-1f1c9f414633 service nova] Creating event network-vif-plugged:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h1-854663-10 Oct 27 11:07:34.430199 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8ebf4342-9d1f-49af-9535-6f6821c0c949 req-1a1978b6-34c5-4926-b479-1f1c9f414633 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036929 Oct 27 11:07:34.430796 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3693/7188] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:34.909104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:34.909780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:34.917671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:34.918202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:34.918686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:34.919802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:34.920318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:34.920815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:35.061685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:35.071327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd1610d9-a6ef-4c4d-960e-c6022939caf0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1362 microversion: 2.1 time: 0.166701 Oct 27 11:07:35.071881 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3496/7189] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:34 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:36.098240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:36.099131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:36.106919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:36.107470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:36.107967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:36.108909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:36.109579 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:36.110116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:36.245268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:07:36.253614 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd07233d-ab3c-4c1a-b117-6ccb16c510af tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1549 microversion: 2.1 time: 0.161384 Oct 27 11:07:36.254161 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3694/7190] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:07:36 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:07:36.280325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a41407a7-83f7-403a-b826-3a488b83c10d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:07:36.280866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a41407a7-83f7-403a-b826-3a488b83c10d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:07:36.282952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:07:36.283644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:07:36.290396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a41407a7-83f7-403a-b826-3a488b83c10d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:36.290874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a41407a7-83f7-403a-b826-3a488b83c10d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:36.291312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a41407a7-83f7-403a-b826-3a488b83c10d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:36.292006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a41407a7-83f7-403a-b826-3a488b83c10d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:36.292457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a41407a7-83f7-403a-b826-3a488b83c10d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:36.292917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a41407a7-83f7-403a-b826-3a488b83c10d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:36.376540 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a41407a7-83f7-403a-b826-3a488b83c10d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099797 Oct 27 11:07:36.377591 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3497/7191] 10.222.0.76 () {58 vars in 1275 bytes} [Thu Oct 27 11:07:36 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:07:37.359971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5d7fe164-1131-4db6-a5b2-fcc4330b2792 req-96639a9b-dcb3-4f91-ac1e-13f9706f0e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:07:37.365177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:07:37.371913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5d7fe164-1131-4db6-a5b2-fcc4330b2792 req-96639a9b-dcb3-4f91-ac1e-13f9706f0e54 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:07:37.372527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5d7fe164-1131-4db6-a5b2-fcc4330b2792 req-96639a9b-dcb3-4f91-ac1e-13f9706f0e54 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:07:37.373074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5d7fe164-1131-4db6-a5b2-fcc4330b2792 req-96639a9b-dcb3-4f91-ac1e-13f9706f0e54 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:07:37.385424 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5d7fe164-1131-4db6-a5b2-fcc4330b2792 req-96639a9b-dcb3-4f91-ac1e-13f9706f0e54 service nova] Creating event network-changed:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h1-854663-10 Oct 27 11:07:37.390546 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5d7fe164-1131-4db6-a5b2-fcc4330b2792 req-96639a9b-dcb3-4f91-ac1e-13f9706f0e54 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034386 Oct 27 11:07:37.391148 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3695/7192] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:08:19.597375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=11 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:08:19.598243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=29 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:08:19.602595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:19.603214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:19.610479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:19.610959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:19.611395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:19.612088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:19.612540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:19.613015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:19.760450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:19.769104 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-325ed2f3-b801-46c1-be07-60b48235675f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1668 microversion: 2.1 time: 0.174473 Oct 27 11:08:19.769709 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3498/7193] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:19 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:19.797939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=15 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:08:19.798763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:08:19.803731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd05ad52-bde0-44f9-bec7-e56f62787e36 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46a02ca4-cbce-41f9-8738-e3dff4c77c18"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:08:19.806278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd05ad52-bde0-44f9-bec7-e56f62787e36 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:19.822169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd05ad52-bde0-44f9-bec7-e56f62787e36 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:19.822676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd05ad52-bde0-44f9-bec7-e56f62787e36 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:19.823160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd05ad52-bde0-44f9-bec7-e56f62787e36 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:19.823878 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd05ad52-bde0-44f9-bec7-e56f62787e36 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:19.824348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd05ad52-bde0-44f9-bec7-e56f62787e36 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:19.824821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd05ad52-bde0-44f9-bec7-e56f62787e36 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:20.101903 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd05ad52-bde0-44f9-bec7-e56f62787e36 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307250 Oct 27 11:08:20.102645 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3696/7194] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 11:08:19 2022] POST /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:08:32.121996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:08:32.124335 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:32.127156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:08:32.127825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:08:32.133872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:32.134354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:32.134809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:32.135499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:32.135948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:32.136413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:32.165026 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:32.174968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Old instance type m1.heat2, new instance type m1.heat {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:08:32.182700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:08:32.183123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:08:32.183598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:08:32.184004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:08:32.184415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:08:32.257611 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef57234b-c609-4b25-9852-efb09fb04e57 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.139579 Oct 27 11:08:32.258135 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3499/7195] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:08:32 2022] POST /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:08:32.264809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:08:32.265684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:08:32.269898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:32.270683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:32.278160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:32.278660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:32.279099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:32.279806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:32.280255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:32.280713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:32.423498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:32.438496 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ac1f563-4fda-4d29-aeec-16f4db49e457 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1723 microversion: 2.1 time: 0.175618 Oct 27 11:08:32.439106 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3697/7196] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:32 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:33.464489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:33.465105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:33.476698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:33.477220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:33.477701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:33.478407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:33.478920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:33.479328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:33.642372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:33.652695 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-533b7800-095e-435a-8da7-91944cd5b7d8 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1723 microversion: 2.1 time: 0.193590 Oct 27 11:08:33.653717 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3500/7197] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:33 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:34.681158 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:34.682196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:34.689759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:34.690266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:34.690718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:34.691435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:34.691905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:34.692354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:34.833069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:34.842076 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79906541-52ab-4df5-9cc7-2e4849c038ec tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.167288 Oct 27 11:08:34.842664 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3698/7198] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:34 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:35.867425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:35.868145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:35.875707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:35.876306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:35.876785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:35.877550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:35.878007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:35.878431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:36.029045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:36.037959 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f25cccc-c81a-423c-ae75-4a4cd08c9852 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.175030 Oct 27 11:08:36.038535 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3501/7199] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:35 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:37.066582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:37.067552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:37.077165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:37.077668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:37.078121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:37.078833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:37.079287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:37.079727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:37.215488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:37.226581 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02db8d74-303a-48b5-8985-f501b5c6d772 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.166378 Oct 27 11:08:37.227449 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3699/7200] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:37 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:38.254736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:38.255654 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:38.265304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:38.265793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:38.266221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:38.266912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:38.267337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:38.267795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:38.409590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:38.418724 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf53835d-d02a-4787-a90b-016e039cd07b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.170779 Oct 27 11:08:38.419319 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3502/7201] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:38 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:39.443296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:39.443929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:39.454421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:39.454923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:39.455366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:39.456079 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:39.456615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:39.457160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:39.601991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:39.611004 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fea95cfa-913b-4697-a43b-ec548b4381d2 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.172086 Oct 27 11:08:39.611603 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3700/7202] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:39 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:40.640628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:40.641289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:40.650645 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:40.651186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:40.651671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:40.652444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:40.652972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:40.653437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:40.804419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:40.814281 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c4d84c9-c1f5-470e-b229-ed76efb54a5c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.178644 Oct 27 11:08:40.814863 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3503/7203] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:40 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:41.841148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:41.841766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:41.849317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:41.849809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:41.850258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:41.850982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:41.851415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:41.851847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:42.000325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:42.011050 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe571f31-81f0-4da2-8bfd-0b0fa5a633d5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.175335 Oct 27 11:08:42.011645 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3701/7204] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:41 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:43.038806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:43.039816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:43.048504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:43.049009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:43.049442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:43.050133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:43.050581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:43.050987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:43.194786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:43.204068 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-174a5aa6-f102-4bda-80cf-ae62985a4d96 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.171871 Oct 27 11:08:43.204646 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3504/7205] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:43 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:44.228764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:44.229402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:44.237290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:44.237782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:44.238241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:44.238938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:44.239380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:44.239816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:44.377251 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:44.386071 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eecb6bce-2581-4e8b-9bdc-5e5606e7cbfc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.161598 Oct 27 11:08:44.386652 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3702/7206] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:44 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:45.411180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:45.411832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:45.420777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:45.421322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:45.421808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:45.422676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:45.423181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:45.423653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:45.571843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:45.584442 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-626752fe-5d9b-462b-be7b-41a1338ce413 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.177432 Oct 27 11:08:45.585258 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3505/7207] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:45 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:46.612899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:46.613514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:46.621639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:46.622189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:46.622688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:46.623473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:46.623992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:46.624709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:46.762645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:46.771635 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3647d4f2-0c89-4a6f-ad8e-39e21fee2e9a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.163814 Oct 27 11:08:46.772226 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3703/7208] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:46 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:47.796829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:47.797476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:47.805748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:47.806285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:47.806775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:47.807537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:47.808038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:47.808506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:47.951133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:47.960552 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ed1d8ef-be1e-4fd0-b796-5e4a702461fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.168586 Oct 27 11:08:47.961204 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3506/7209] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:47 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:48.987567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:48.988184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:48.996428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:48.997014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:48.997508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:48.998476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:48.998972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:48.999455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:49.162540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:49.172480 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1087899e-83a7-4165-b3ae-d421846b5e68 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.190190 Oct 27 11:08:49.173101 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3704/7210] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:48 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:50.197185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:50.197726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:50.204828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:50.205323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:50.205848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:50.206668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:50.207126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:50.207553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:50.347710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:50.356177 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c87c4d6-f23b-4bbd-8d84-e9450303c82d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.163175 Oct 27 11:08:50.356742 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3507/7211] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:50 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:51.381105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:51.381742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:51.389233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:51.389869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:51.390405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:51.391126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:51.391592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:51.392145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:51.529474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:51.538462 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de7db9a9-5016-441b-ba8a-f4276bb75100 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.161548 Oct 27 11:08:51.539022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3705/7212] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:51 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:52.566991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:52.567778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:52.578221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:52.578707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:52.579147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:52.579838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:52.580294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:52.580731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:52.724867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:52.733988 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96fef796-1c93-43e8-8308-67fe07f9f09a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.173308 Oct 27 11:08:52.734578 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3508/7213] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:52 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:53.767506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:53.768407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:53.780121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:53.780988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:53.781473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:53.782206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:53.782663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:53.783093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:53.941616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:53.950447 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d446103d-4155-46e6-a6cb-1cbf01fe34b3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.189723 Oct 27 11:08:53.951022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3706/7214] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:53 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:54.978563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:54.979541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:54.991947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:54.992814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:54.993540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:54.994692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:54.995450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:54.996167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:55.133813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:55.142901 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ad8ec5e0-eb25-4cb2-8780-16dd8087cf4d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.171152 Oct 27 11:08:55.143480 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3509/7215] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:54 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:56.170997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:56.173246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:56.185574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:56.186415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:56.187142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:56.188358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:56.189145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:56.189980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:56.339379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:56.348365 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7be788e7-e40d-4e64-b2e7-18437b8ed42d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.184871 Oct 27 11:08:56.349499 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3707/7216] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:56 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:57.376705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:57.377756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:57.389755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:57.390569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:57.391294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:57.392424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:57.393220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:57.394037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:57.540256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:57.549641 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8690fb36-27c2-47b8-8fe6-c5515dc67704 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.179648 Oct 27 11:08:57.550259 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3510/7217] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:57 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:58.575318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:58.576013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:58.585659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:58.586240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:58.586862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:58.587837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:58.588448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:58.589104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:58.735459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:58.744806 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a63e881a-f169-48f8-ac4e-045bdb8b6629 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.174984 Oct 27 11:08:58.745420 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3708/7218] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:58 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:08:59.772096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:08:59.772753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:08:59.781049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:59.781578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:59.782059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:59.782827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:08:59.783320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:08:59.783790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:08:59.927825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:08:59.940750 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff6889db-6fb5-4516-9021-cd9931cd80e5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.174098 Oct 27 11:08:59.941552 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3511/7219] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:08:59 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:00.968876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:00.969762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:00.978340 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:00.978847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:00.979284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:00.979983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:00.980433 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:00.980902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:01.114846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:01.123401 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6ba19cd-25d1-4b59-a570-fb42a75b9108 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.161267 Oct 27 11:09:01.123978 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3709/7220] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:00 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:02.149657 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:02.150366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:02.153510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=31 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:09:02.160318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:02.160930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:02.161450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:02.162268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:02.162799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:02.163296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:02.166586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:09:02.307919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:02.316545 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-006ee140-178e-442a-b699-db1eeb3ff886 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.171865 Oct 27 11:09:02.317551 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3512/7221] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:02 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:03.342032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:03.342700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:03.345982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=27 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:09:03.352423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:03.352972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:03.353426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:03.354143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:03.354614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:03.355053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:03.358025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=79 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:09:03.489122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:03.497804 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10998104-ba15-4878-a691-6ee92f4de878 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.160269 Oct 27 11:09:03.498362 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3710/7222] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:03 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:04.525448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:04.526108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:04.535247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:04.535940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:04.536478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:04.537397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:04.537969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:04.538513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:04.686414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:04.697442 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e57885a7-caee-4b42-bafa-56ef9cba6def tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.177798 Oct 27 11:09:04.698021 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3513/7223] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:04 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:05.721943 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:05.722532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:05.729883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:05.730410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:05.730850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:05.731560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:05.732023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:05.732465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:05.885740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:05.894588 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7db32fa3-36b2-4158-a3c1-35301fa6e31c tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.176950 Oct 27 11:09:05.895175 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3711/7224] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:05 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:06.919570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:06.920203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:06.928540 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:06.929064 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:06.929504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:06.930211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:06.930668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:06.931093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:07.070917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:07.079686 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15f43067-b355-44b7-b751-1968003d2e46 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.164576 Oct 27 11:09:07.080406 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3514/7225] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:06 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:08.104313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:08.105001 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:08.112565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:08.113105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:08.113551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:08.114423 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:08.114992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:08.115491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:08.252634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:08.261532 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-586eef95-bc74-461a-9558-35f10f41cfd7 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1728 microversion: 2.1 time: 0.161675 Oct 27 11:09:08.262084 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3712/7226] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:08 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:09.286412 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:09.287185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:09.294478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:09.294973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:09.295761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:09.296470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:09.296940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:09.297387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:09.508168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:09.516886 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-767d59b2-d8c8-4cf0-b624-7961eb4d19fb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1727 microversion: 2.1 time: 0.234575 Oct 27 11:09:09.517470 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3515/7227] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:09 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1727 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:09.530908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3465d130-a626-47ea-b2d6-349f1a8eefae req-ef522b9a-2be0-4701-a3f7-6a8dee78325a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "name": "network-vif-unplugged", "status": "completed", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:09:09.542825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3465d130-a626-47ea-b2d6-349f1a8eefae req-ef522b9a-2be0-4701-a3f7-6a8dee78325a service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:09.543420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3465d130-a626-47ea-b2d6-349f1a8eefae req-ef522b9a-2be0-4701-a3f7-6a8dee78325a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:09.544061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3465d130-a626-47ea-b2d6-349f1a8eefae req-ef522b9a-2be0-4701-a3f7-6a8dee78325a service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:09.557832 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3465d130-a626-47ea-b2d6-349f1a8eefae req-ef522b9a-2be0-4701-a3f7-6a8dee78325a service nova] Creating event network-vif-unplugged:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h2-854663-10 Oct 27 11:09:09.563604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-3465d130-a626-47ea-b2d6-349f1a8eefae req-ef522b9a-2be0-4701-a3f7-6a8dee78325a service nova] Instance e708e115-b1d2-45c9-8b44-780f8228f4cf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:09:09.574968 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3465d130-a626-47ea-b2d6-349f1a8eefae req-ef522b9a-2be0-4701-a3f7-6a8dee78325a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048734 Oct 27 11:09:09.575824 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3713/7228] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:09:10.541659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:10.542272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:10.549475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:10.549957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:10.550396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:10.551096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:10.551545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:10.551970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:10.694251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:10.702894 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5337fc69-2825-4488-85f4-c5ee06ff804e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1727 microversion: 2.1 time: 0.165564 Oct 27 11:09:10.703487 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3516/7229] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:10 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:11.593023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1f2d693d-73d6-4c8c-af4d-e6edc5472492 req-111ffd9a-6f19-4f57-b48e-f619092f8e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:09:11.603616 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f2d693d-73d6-4c8c-af4d-e6edc5472492 req-111ffd9a-6f19-4f57-b48e-f619092f8e41 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:11.604038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f2d693d-73d6-4c8c-af4d-e6edc5472492 req-111ffd9a-6f19-4f57-b48e-f619092f8e41 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:11.604486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f2d693d-73d6-4c8c-af4d-e6edc5472492 req-111ffd9a-6f19-4f57-b48e-f619092f8e41 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:11.619981 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1f2d693d-73d6-4c8c-af4d-e6edc5472492 req-111ffd9a-6f19-4f57-b48e-f619092f8e41 service nova] Creating event network-changed:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h2-854663-10 Oct 27 11:09:11.625655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-1f2d693d-73d6-4c8c-af4d-e6edc5472492 req-111ffd9a-6f19-4f57-b48e-f619092f8e41 service nova] Instance e708e115-b1d2-45c9-8b44-780f8228f4cf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:09:11.636915 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1f2d693d-73d6-4c8c-af4d-e6edc5472492 req-111ffd9a-6f19-4f57-b48e-f619092f8e41 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048869 Oct 27 11:09:11.637524 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3714/7230] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:09:11.726521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:11.728483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:11.735990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:11.736717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:11.738611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:11.739500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:11.740228 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:11.740965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:11.960397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:11.971936 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f2e3b3ee-66ed-417a-8d45-b165eaef37d3 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.249379 Oct 27 11:09:11.986293 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3517/7231] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:11 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:13.001277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:13.001990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:13.009032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:13.009525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:13.009968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:13.010716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:13.011178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:13.011614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:13.151154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:13.159937 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48cb21ff-0343-4873-a115-e550b7eddfeb tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.163863 Oct 27 11:09:13.160399 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3715/7232] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:12 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:14.183987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:14.184603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:14.192127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:14.192873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:14.193132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:14.194195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:14.194405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:14.194877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:14.329178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:14.337975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-854d1162-f66b-4332-b1b5-52b74da35c88 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.158220 Oct 27 11:09:14.338592 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3518/7233] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:14 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:15.362183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:15.362832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:15.370531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:15.371032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:15.371477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:15.372187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:15.372650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:15.373154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:15.512457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:15.521431 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ede1652f-370b-416f-bacc-894845bc0e01 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.163893 Oct 27 11:09:15.522071 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3716/7234] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:15 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:16.549466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:16.550494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:16.559318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:16.559818 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:16.560259 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:16.561015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:16.561474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:16.561905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:16.703531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:16.712106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d94068a3-8cfa-4e5b-8beb-4fb92441d184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.169460 Oct 27 11:09:16.712649 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3519/7235] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:16 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:17.741731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:17.742327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:17.749807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:17.750303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:17.750750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:17.751455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:17.751914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:17.752370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:17.891483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:17.900916 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a445ed7d-d3b5-4b7e-8d68-3477c539eaa9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.163259 Oct 27 11:09:17.901509 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3717/7236] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:17 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:18.926381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:18.927016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:18.935071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:18.935600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:18.936057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:18.936868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:18.937495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:18.937888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:19.076962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:19.089875 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-401980d1-090c-4d28-ac63-a52a7c8bfa58 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.167558 Oct 27 11:09:19.090651 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3520/7237] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:18 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:20.118130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:20.118916 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:20.126848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:20.127347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:20.127794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:20.128494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:20.129058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:20.129468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:20.266398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:20.275290 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff2f057a-e8b1-45f1-9ba3-289914a0ed3d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.163886 Oct 27 11:09:20.275877 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3718/7238] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:20 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:21.310918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:21.311903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:21.323256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:21.323746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:21.324185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:21.324932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:21.325386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:21.325821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:21.816279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:21.825363 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-47abb385-ec82-403d-a98f-179815dc2230 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.521275 Oct 27 11:09:21.825974 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3521/7239] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:21 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:22.859074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:22.859808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:22.867194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:22.868206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:22.868206 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:22.868973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:22.869443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:22.870273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:23.010005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:23.018948 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29c0a48c-28a3-46b7-a7ae-2deddeeb831d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1725 microversion: 2.1 time: 0.164258 Oct 27 11:09:23.019545 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3719/7240] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:22 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:24.044652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:24.045292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:24.053635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:24.054162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:24.054640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:24.055383 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:24.055875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:24.056466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:24.206474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:24.217525 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e270a086-0f9f-47e6-ade9-90d95d317d89 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1722 microversion: 2.1 time: 0.177847 Oct 27 11:09:24.218127 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3522/7241] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:24 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:24.243631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:09:24.244321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:24.251532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:24.252027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:24.252470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:24.253205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:24.253666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:24.254098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:24.295314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:24.296076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:24.296513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:24.297284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:24.297745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:24.298175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:24.321720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:09:24.327476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Getting quotas for user 59897473b3f44b6394a0dc9f53d85be4 and project 0791cc2d697b435eb6a3b066c16f809e. Resources: {'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:09:24.439017 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c74c303-b6dc-4309-902e-4cc320df82b0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "POST /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.201689 Oct 27 11:09:24.439707 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3720/7242] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:09:24 2022] POST /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:09:24.448464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:24.449116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:24.455433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:24.455934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:24.456374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:24.457113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:24.457543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:24.457975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:24.652631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:24.663714 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3c3f1be9-dc58-4f98-b708-ca6245a4ee82 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.219415 Oct 27 11:09:24.664312 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3523/7243] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:24 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:25.119826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-aed1df6c-3300-4488-8e5d-7e40a5b68b93 req-9ada9f25-c146-4dfd-9050-05b16bd3ad43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:09:25.133391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-aed1df6c-3300-4488-8e5d-7e40a5b68b93 req-9ada9f25-c146-4dfd-9050-05b16bd3ad43 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:25.134352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-aed1df6c-3300-4488-8e5d-7e40a5b68b93 req-9ada9f25-c146-4dfd-9050-05b16bd3ad43 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:25.135024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-aed1df6c-3300-4488-8e5d-7e40a5b68b93 req-9ada9f25-c146-4dfd-9050-05b16bd3ad43 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:25.150093 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-aed1df6c-3300-4488-8e5d-7e40a5b68b93 req-9ada9f25-c146-4dfd-9050-05b16bd3ad43 service nova] Creating event network-vif-plugged:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h2-854663-10 Oct 27 11:09:25.158253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-aed1df6c-3300-4488-8e5d-7e40a5b68b93 req-9ada9f25-c146-4dfd-9050-05b16bd3ad43 service nova] Instance e708e115-b1d2-45c9-8b44-780f8228f4cf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:09:25.171666 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-aed1df6c-3300-4488-8e5d-7e40a5b68b93 req-9ada9f25-c146-4dfd-9050-05b16bd3ad43 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055402 Oct 27 11:09:25.172877 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3721/7244] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:09:25.688530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:25.689132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:25.696442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:25.697050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:25.697506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:25.698185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:25.698634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:25.699052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:25.838516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:25.847536 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc70623d-2f3b-49d0-9275-0becd41c1626 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.163212 Oct 27 11:09:25.848116 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3524/7245] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:25 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:26.882166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:26.882981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:26.891106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:26.891590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:26.892040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:26.892785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:26.893255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:26.893701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:27.038072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:27.047299 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-daed4a9f-8452-4ea0-b914-b8bab4cc2c45 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.172064 Oct 27 11:09:27.047873 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3722/7246] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:26 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:28.130805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:28.131410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:28.138800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:28.139283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:28.139716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:28.140410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:28.140886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:28.141333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:28.276222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:28.284903 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5a52de6-127b-401c-8f4b-ee17de55c31e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.158300 Oct 27 11:09:28.285455 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3525/7247] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:28 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:29.309940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:29.310581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:29.317782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:29.318288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:29.318742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:29.319457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:29.319934 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:29.320374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:29.456295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:29.465116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffbaa0ef-bb5f-4696-9000-bc3dda538601 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.159412 Oct 27 11:09:29.465690 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3723/7248] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:29 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:29.732719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9e8f8a04-0e9a-4588-9249-3773a9b5ce21 req-25614d27-58c6-4d93-86df-c1158ee59b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "name": "network-vif-unplugged", "status": "completed", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:09:29.744462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e8f8a04-0e9a-4588-9249-3773a9b5ce21 req-25614d27-58c6-4d93-86df-c1158ee59b1e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:29.744990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e8f8a04-0e9a-4588-9249-3773a9b5ce21 req-25614d27-58c6-4d93-86df-c1158ee59b1e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:29.745817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e8f8a04-0e9a-4588-9249-3773a9b5ce21 req-25614d27-58c6-4d93-86df-c1158ee59b1e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:29.758093 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9e8f8a04-0e9a-4588-9249-3773a9b5ce21 req-25614d27-58c6-4d93-86df-c1158ee59b1e service nova] Creating event network-vif-unplugged:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h1-854663-10 Oct 27 11:09:29.763872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-9e8f8a04-0e9a-4588-9249-3773a9b5ce21 req-25614d27-58c6-4d93-86df-c1158ee59b1e service nova] Instance e708e115-b1d2-45c9-8b44-780f8228f4cf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:09:29.775297 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9e8f8a04-0e9a-4588-9249-3773a9b5ce21 req-25614d27-58c6-4d93-86df-c1158ee59b1e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046901 Oct 27 11:09:29.776136 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3526/7249] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:09:30.489238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:30.489950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:30.497508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:30.498016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:30.498454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:30.499166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:30.499625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:30.500078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:30.639212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:30.641658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:09:30.649450 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3135190f-ed25-43e0-940c-0c1f7e35598e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.164138 Oct 27 11:09:30.650185 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3724/7250] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:30 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:31.674942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:31.675663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:31.682561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:31.683048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:31.683485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:31.684291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:31.684850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:31.685290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:31.817530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5fe1b0a5-c615-401a-b751-5312755e0b68 req-8c0add62-f5b2-4245-9b41-6250148236bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:09:31.820049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:31.829764 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc4f2155-b2ac-4c36-b7e8-dd65230f0a31 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.160391 Oct 27 11:09:31.830776 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3527/7251] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:31 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:31.841825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5fe1b0a5-c615-401a-b751-5312755e0b68 req-8c0add62-f5b2-4245-9b41-6250148236bd service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:31.842328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5fe1b0a5-c615-401a-b751-5312755e0b68 req-8c0add62-f5b2-4245-9b41-6250148236bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:31.842906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5fe1b0a5-c615-401a-b751-5312755e0b68 req-8c0add62-f5b2-4245-9b41-6250148236bd service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:31.856072 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5fe1b0a5-c615-401a-b751-5312755e0b68 req-8c0add62-f5b2-4245-9b41-6250148236bd service nova] Creating event network-changed:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h1-854663-10 Oct 27 11:09:31.861887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-5fe1b0a5-c615-401a-b751-5312755e0b68 req-8c0add62-f5b2-4245-9b41-6250148236bd service nova] Instance e708e115-b1d2-45c9-8b44-780f8228f4cf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:09:31.872909 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5fe1b0a5-c615-401a-b751-5312755e0b68 req-8c0add62-f5b2-4245-9b41-6250148236bd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059347 Oct 27 11:09:31.873535 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3725/7252] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:09:32.855154 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:32.855808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:32.858928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=32 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:09:32.864935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:32.865400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:32.865848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:32.866575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:32.867046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:32.867470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:32.870268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=94 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:09:33.010543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:33.019794 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c2baff9-d8c2-4245-b29f-b52d74f9d799 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.168657 Oct 27 11:09:33.020401 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3528/7253] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:32 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:34.045991 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:34.046733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:34.048771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:09:34.055190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:34.055697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:34.056131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:34.056919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:34.057417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:34.057891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:34.202464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:34.213895 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-047a9676-9dd1-460a-afe2-a43bec2dcd6b tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.173625 Oct 27 11:09:34.214867 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3726/7254] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:34 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:35.239357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:35.239963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:35.247881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:35.248366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:35.248875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:35.249535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:35.249984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:35.250408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:35.392611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:35.401399 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-28e2861d-d37a-4f62-b134-66f06ea554d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.166120 Oct 27 11:09:35.402252 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3529/7255] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:35 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:36.425806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:36.426466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:36.428417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:09:36.436351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:36.436950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:36.437395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:36.438126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:36.438603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:36.439141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:36.592637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:36.601480 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f9f9383-6a75-4179-9015-9072660382d6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.179754 Oct 27 11:09:36.602074 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3727/7256] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:36 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:37.627741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:37.628698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:37.637952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:37.639269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:37.639973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:37.641050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:37.641690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:37.642293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:37.787305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:37.800719 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa23adc1-cca4-4d56-ba6d-24c57112fc37 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.177758 Oct 27 11:09:37.801365 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3530/7257] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:37 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:38.829301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:38.830011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:38.837771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:38.838318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:38.838785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:38.839608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:38.840072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:38.840567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:38.993296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:39.002256 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e786a6c8-7c6b-4b15-9c63-48aaec79c24e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.178505 Oct 27 11:09:39.002862 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3728/7258] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:38 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:40.029165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:40.029769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:40.036458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:40.036977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:40.037419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:40.038111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:40.038557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:40.038981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:40.176796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:40.185498 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c7819c4-089a-4341-bc4d-8ec9e19b378e tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.162915 Oct 27 11:09:40.186083 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3531/7259] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:40 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:41.213650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:41.214825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:41.226748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:41.227571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:41.228313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:41.229608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:41.230354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:41.231125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:41.379302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:41.388439 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e0e33c6-39ae-4e5a-8ab2-ed40658f5796 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.181374 Oct 27 11:09:41.389107 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3729/7260] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:41 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:42.420112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:42.421683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:42.429379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:42.429871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:42.430297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:42.431017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:42.431500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:42.431928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:42.580952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:42.589844 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7644642-41ec-4eec-a054-40bdc31946fa tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1721 microversion: 2.1 time: 0.176997 Oct 27 11:09:42.590347 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3532/7261] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:42 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:43.614738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:43.615374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:43.623151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:43.623733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:43.624179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:43.624929 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:43.625395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:43.625826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:43.758229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:43.767048 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-587c6e5b-7154-4fad-820f-bb71941f3913 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1714 microversion: 2.1 time: 0.156514 Oct 27 11:09:43.767671 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3730/7262] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:43 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:43.792765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:43.793489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:43.805414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:43.806119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:43.806784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:43.807843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:43.808506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:43.809213 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:43.955380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:43.969662 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e630429b-83dc-41c8-b847-8c82c59c2e05 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1714 microversion: 2.1 time: 0.182744 Oct 27 11:09:43.970502 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3533/7263] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:43 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1714 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:43.997725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:43.998348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:44.005132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:44.005627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:44.006076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:44.006775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:44.007233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:44.007670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:44.151688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:44.164297 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5850f56-f7a1-4c58-bd72-5755fe7606df tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1714 microversion: 2.1 time: 0.170267 Oct 27 11:09:44.165068 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3731/7264] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:43 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1714 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:44.187905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:44.188401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:44.194687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:44.195140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:44.195575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:44.196814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:44.196814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:44.197140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:44.222532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:09:44.305124 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86cafd5f-430a-4ff7-9637-d8d4c22d5054 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 204 len: 0 microversion: 2.1 time: 0.120787 Oct 27 11:09:44.305864 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3534/7265] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:09:44 2022] DELETE /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:09:44.314602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:44.315232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:44.321800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:44.322389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:44.322839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:44.323552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:44.324308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:44.324814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:44.462095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:44.470771 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1457f2be-badb-42ba-8697-fcdca049b40f tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1720 microversion: 2.1 time: 0.160266 Oct 27 11:09:44.471352 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3732/7266] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:44 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:45.089842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-330763b8-06ed-41fb-9eaf-8b0874784c1d req-949b0bfe-9d3a-45b1-8910-3d899bf9629d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:09:45.103743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-330763b8-06ed-41fb-9eaf-8b0874784c1d req-949b0bfe-9d3a-45b1-8910-3d899bf9629d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:45.104907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-330763b8-06ed-41fb-9eaf-8b0874784c1d req-949b0bfe-9d3a-45b1-8910-3d899bf9629d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:45.105354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-330763b8-06ed-41fb-9eaf-8b0874784c1d req-949b0bfe-9d3a-45b1-8910-3d899bf9629d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:45.116964 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-330763b8-06ed-41fb-9eaf-8b0874784c1d req-949b0bfe-9d3a-45b1-8910-3d899bf9629d service nova] Creating event network-vif-plugged:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h1-854663-10 Oct 27 11:09:45.122168 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-330763b8-06ed-41fb-9eaf-8b0874784c1d req-949b0bfe-9d3a-45b1-8910-3d899bf9629d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036441 Oct 27 11:09:45.123050 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3535/7267] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:09:45.499213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:45.500249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:45.511877 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:45.512745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:45.513546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:45.514561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:45.515013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:45.515466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:45.654811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:45.663380 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48f0a52e-3708-4f7a-95ed-a84e07f6e482 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1720 microversion: 2.1 time: 0.170724 Oct 27 11:09:45.663932 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3733/7268] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:45 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:46.688690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:46.689500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:46.696776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:46.697619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:46.698050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:46.698757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:46.699206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:46.699622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:46.773052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:46.782127 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6fab4cd-205e-43b7-9e78-80fb12f8e2cc tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1653 microversion: 2.1 time: 0.098174 Oct 27 11:09:46.782729 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3536/7269] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:46 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1653 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:46.935837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-bb867711-9882-4e0f-a1dc-f072273625c3 req-9fadc445-bebb-470c-9b02-fb19cbceb6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e708e115-b1d2-45c9-8b44-780f8228f4cf", "name": "network-vif-deleted", "tag": "7e8c28f6-6c67-4cec-a838-7827c41a2d4a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:09:46.946344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bb867711-9882-4e0f-a1dc-f072273625c3 req-9fadc445-bebb-470c-9b02-fb19cbceb6d0 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:46.947394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bb867711-9882-4e0f-a1dc-f072273625c3 req-9fadc445-bebb-470c-9b02-fb19cbceb6d0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:46.947394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bb867711-9882-4e0f-a1dc-f072273625c3 req-9fadc445-bebb-470c-9b02-fb19cbceb6d0 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:46.960964 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-bb867711-9882-4e0f-a1dc-f072273625c3 req-9fadc445-bebb-470c-9b02-fb19cbceb6d0 service nova] Creating event network-vif-deleted:7e8c28f6-6c67-4cec-a838-7827c41a2d4a for instance e708e115-b1d2-45c9-8b44-780f8228f4cf on n-h1-854663-10 Oct 27 11:09:46.968246 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-bb867711-9882-4e0f-a1dc-f072273625c3 req-9fadc445-bebb-470c-9b02-fb19cbceb6d0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035456 Oct 27 11:09:46.969399 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3734/7270] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:09:47.807456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:47.808851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:47.817578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:47.818396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:47.818926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:47.819710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:47.820234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:47.820768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:47.900043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:47.910693 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2d339810-de3f-4bc7-8ff5-86b65dd97d51 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1368 microversion: 2.1 time: 0.107142 Oct 27 11:09:47.911569 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3537/7271] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:47 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:48.936829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:48.937882 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:48.945526 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:48.946032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:48.946484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:48.947202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:48.947662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:48.948103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:49.015540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:49.024280 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-410a76fd-a01c-4ec9-b3fa-43778ed9dbc6 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1368 microversion: 2.1 time: 0.092871 Oct 27 11:09:49.024915 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3735/7272] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:48 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:50.048162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:50.048799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:50.056162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:50.056690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:50.057134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:50.057842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:50.058299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:50.059088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:50.124285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:50.132811 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac47cfe9-d860-49b5-a160-c80de566b184 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1368 microversion: 2.1 time: 0.089324 Oct 27 11:09:50.133384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3538/7273] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:50 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:51.157660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:51.158289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:51.165572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:51.166127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:51.166670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:51.167506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:51.168016 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:51.168471 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:51.203249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:51.203739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:51.204194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:51.204695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lazy-loading 'fault' on Instance uuid e708e115-b1d2-45c9-8b44-780f8228f4cf {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:09:51.246704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59897473b3f44b6394a0dc9f53d85be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791cc2d697b435eb6a3b066c16f809e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:09:51.255911 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c29ec159-9708-462d-96ed-92f45a0ceb23 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 200 len: 1373 microversion: 2.1 time: 0.102534 Oct 27 11:09:51.256411 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3736/7274] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:51 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 1373 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:09:52.283547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:52.284495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:52.295449 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:52.296283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:52.296756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:52.297466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:52.297924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:52.298347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:52.312348 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf HTTP/1.1 Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e708e115-b1d2-45c9-8b44-780f8228f4cf'} Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:52.314191 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff538c4b-be7c-4c25-8594-446124b56325 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 404 len: 111 microversion: 2.1 time: 0.038508 Oct 27 11:09:52.318982 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3539/7275] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:52 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:52.378091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:52.380355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:52.387746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:52.388253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:52.388702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:52.389555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:52.390026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:52.390469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:52.403850 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/os-volume_attachments HTTP/1.1 Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': 'e708e115-b1d2-45c9-8b44-780f8228f4cf'} Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:52.405677 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb73700c-60d0-4fc2-a201-5160545a407a tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033079 Oct 27 11:09:52.410293 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3737/7276] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:09:52 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:55.762303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:55.762859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:55.770458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.770943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.771403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.772099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.772543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.772995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.787710 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf HTTP/1.1 Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e708e115-b1d2-45c9-8b44-780f8228f4cf'} Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:55.789318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3605965f-7ae8-4b81-a495-8a5d65f3afc9 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 404 len: 111 microversion: 2.1 time: 0.032611 Oct 27 11:09:55.793553 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3540/7277] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:09:55 2022] DELETE /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:55.800428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:55.801114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: e708e115-b1d2-45c9-8b44-780f8228f4cf] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:55.808228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.808718 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.809177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.809869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.810332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.811039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.825206 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf HTTP/1.1 Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'e708e115-b1d2-45c9-8b44-780f8228f4cf'} Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.826789 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance e708e115-b1d2-45c9-8b44-780f8228f4cf could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f5fbec5-1a24-46a2-b612-70d09b2c5224 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf" status: 404 len: 111 microversion: 2.1 time: 0.032305 Oct 27 11:09:55.832111 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3738/7278] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:55 2022] GET /compute/v2.1/servers/e708e115-b1d2-45c9-8b44-780f8228f4cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:55.838208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:55.838709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:55.845388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.845864 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.846292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.846982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.847455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.847872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.862329 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f HTTP/1.1 Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'db222a92-d08b-4020-b523-3b2041e7f55f'} Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:55.863952 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a842e0bc-940a-4fca-b541-9897361d4f5d tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 404 len: 111 microversion: 2.1 time: 0.031148 Oct 27 11:09:55.868261 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3541/7279] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:09:55 2022] DELETE /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:55.875205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:55.875945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: db222a92-d08b-4020-b523-3b2041e7f55f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:55.882606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.883106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.883550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.884262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.884757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.885186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.900515 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f HTTP/1.1 Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'db222a92-d08b-4020-b523-3b2041e7f55f'} Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.902145 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance db222a92-d08b-4020-b523-3b2041e7f55f could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f477ea00-aba1-4ad4-9a62-09e5dcaeac42 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f" status: 404 len: 111 microversion: 2.1 time: 0.032648 Oct 27 11:09:55.906679 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3739/7280] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:55 2022] GET /compute/v2.1/servers/db222a92-d08b-4020-b523-3b2041e7f55f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:55.912691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:55.913271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:55.919639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.920178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.920646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.921712 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.922194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.922571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.937446 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 HTTP/1.1 Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '769b7ba3-40c8-4499-b06d-1082b1192960'} Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:55.939048 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f6d665f9-5207-4f92-88d6-4439c2121ce5 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 404 len: 111 microversion: 2.1 time: 0.031844 Oct 27 11:09:55.943367 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3542/7281] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:09:55 2022] DELETE /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:55.949203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:55.949832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: 769b7ba3-40c8-4499-b06d-1082b1192960] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:55.956397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.957032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.957476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.958171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.958627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.959053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.973107 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 HTTP/1.1 Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '769b7ba3-40c8-4499-b06d-1082b1192960'} Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:55.974972 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance 769b7ba3-40c8-4499-b06d-1082b1192960 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d69f1be-72c9-40a8-b56b-e5159096a477 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960" status: 404 len: 111 microversion: 2.1 time: 0.031328 Oct 27 11:09:55.979757 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3740/7282] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:55 2022] GET /compute/v2.1/servers/769b7ba3-40c8-4499-b06d-1082b1192960 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:55.985539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:55.985971 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:55.992097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.992576 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.993057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:55.993737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:55.994184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:55.994600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:56.008460 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb HTTP/1.1 Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'afe8a304-7663-4c6e-b8cc-f761415b13eb'} Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:56.010067 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88618333-c13f-4da6-9841-0d5f33d886a0 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "DELETE /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 404 len: 111 microversion: 2.1 time: 0.030094 Oct 27 11:09:56.014848 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3543/7283] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:09:55 2022] DELETE /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:56.020253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:56.020924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [instance: afe8a304-7663-4c6e-b8cc-f761415b13eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:09:56.027090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:56.027592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:56.028048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:56.028863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:09:56.029332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:09:56.029827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:09:56.044307 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] HTTP exception thrown: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Request method failure captured: Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb HTTP/1.1 Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmWAJ9K0m-ZHdy5DLlvE6VA4IwSTJhSmL-EKiY0rB7jQChV9rYZp1kfi61iyemmSNmNz8F4GIluU_1tDVlXDCdlEyIspJb1tl_7XQPufZDp1T7ZIInJ1gtgjw5hQjZD_qFV2y5WaFEfDQ0GrS-W0XuJOrj4DhcAPiX7lRzlfcCq96Uw Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0791cc2d697b435eb6a3b066c16f809e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0791cc2d697b435eb6a3b066c16f809e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 0791cc2d697b435eb6a3b066c16f809e Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerActionsTestJSON-2058807460 Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 59897473b3f44b6394a0dc9f53d85be4 Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServerActionsTestJSON-2058807460-project Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'afe8a304-7663-4c6e-b8cc-f761415b13eb'} Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:09:56.046413 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.051208 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:09:56.051208 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:09:56.051208 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:09:56.051208 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:09:56.051208 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:09:56.051208 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. Oct 27 11:09:56.051208 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:09:56.051208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Returning 404 to user: Instance afe8a304-7663-4c6e-b8cc-f761415b13eb could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:09:56.051208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10d39053-87e0-4d31-8b65-d02a03122eb4 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb" status: 404 len: 111 microversion: 2.1 time: 0.031582 Oct 27 11:09:56.051785 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3741/7284] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:09:56 2022] GET /compute/v2.1/servers/afe8a304-7663-4c6e-b8cc-f761415b13eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:09:56.057112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4d9be559-645a-4cc9-b465-4c457df21770 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] Calling method '.version_select at 0x7f6d5a92cb80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:09:56.061660 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d9be559-645a-4cc9-b465-4c457df21770 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 11:09:57.073811 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d9be559-645a-4cc9-b465-4c457df21770 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] [1805e24c-bdc6-4c5a-94ef-cf0d2306fd81] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 49220. Oct 27 11:09:57.106618 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4d9be559-645a-4cc9-b465-4c457df21770 tempest-ServerActionsTestJSON-2058807460 tempest-ServerActionsTestJSON-2058807460-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99605006" status: 202 len: 0 microversion: 2.1 time: 1.053252 Oct 27 11:09:57.107250 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3544/7285] 10.222.0.76 () {58 vars in 1215 bytes} [Thu Oct 27 11:09:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99605006 => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:10:06.666460 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:10:06.666978 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:10:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Oct 27 11:10:06.667981 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:10:06.668095 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:10:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Oct 27 11:10:06.669060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=33 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:06.670413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=79 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:06.815522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1888502849", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "cad18436-72c9-4cee-b355-442339b5ee47"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:06.872785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] validate_networks() for [('cad18436-72c9-4cee-b355-442339b5ee47', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:10:07.361581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:10:07.362021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:10:07.362593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:10:07.362951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:10:07.363379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:10:07.373078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:07.373613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:07.374305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:07.375056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:07.375547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:07.375982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:07.395337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Getting quotas for project 2dd814f978f64968b78cc3b31c1a721a. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:10:07.401000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Getting quotas for user 6fd5d9d97375481790b6806e96e48600 and project 2dd814f978f64968b78cc3b31c1a721a. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:10:07.414679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:10:07.417080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:10:07.475127 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-135ac1db-756a-4fd4-9e9f-85abe79db094 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814622 Oct 27 11:10:07.476173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3742/7286] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:10:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:10:07.487808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-715c7e4c-caf3-4707-a191-7f052cfe543d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:07.488307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-715c7e4c-caf3-4707-a191-7f052cfe543d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:07.493505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:07.494115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:07.565182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-715c7e4c-caf3-4707-a191-7f052cfe543d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:07.573684 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-715c7e4c-caf3-4707-a191-7f052cfe543d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1217 microversion: 2.1 time: 0.090091 Oct 27 11:10:07.574606 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3545/7287] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:07 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:08.603935 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:08.604578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:08.611137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:08.611883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:08.612529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:08.613276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:08.613740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:08.614176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:08.683573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:08.693211 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58429b6f-14cb-4a4e-9204-46ea23c6b81e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1269 microversion: 2.1 time: 0.099728 Oct 27 11:10:08.693797 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3743/7288] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:08 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:09.717703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:09.720360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:09.729998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:09.730492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:09.730936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:09.736424 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:09.737422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:09.738008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:09.902985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:09.912289 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b8b94fe5-fd92-4195-8646-ed278f8ff892 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1317 microversion: 2.1 time: 0.198815 Oct 27 11:10:09.912872 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3546/7289] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:09 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:10.224382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-51b0d109-6134-4478-b1e2-2cd64d0b5eba req-3004e0c8-0fa6-4de0-acf9-9a54ffe61f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360c2690-c3bf-4026-99f5-715a52ebcaf4", "tag": "0e8d5793-9617-4652-b6b4-6989d88b1891"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:10.244914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-51b0d109-6134-4478-b1e2-2cd64d0b5eba req-3004e0c8-0fa6-4de0-acf9-9a54ffe61f15 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:10.245422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-51b0d109-6134-4478-b1e2-2cd64d0b5eba req-3004e0c8-0fa6-4de0-acf9-9a54ffe61f15 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:10.245855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-51b0d109-6134-4478-b1e2-2cd64d0b5eba req-3004e0c8-0fa6-4de0-acf9-9a54ffe61f15 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:10.264145 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-51b0d109-6134-4478-b1e2-2cd64d0b5eba req-3004e0c8-0fa6-4de0-acf9-9a54ffe61f15 service nova] Creating event network-changed:0e8d5793-9617-4652-b6b4-6989d88b1891 for instance 360c2690-c3bf-4026-99f5-715a52ebcaf4 on n-h1-854663-10 Oct 27 11:10:10.269547 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-51b0d109-6134-4478-b1e2-2cd64d0b5eba req-3004e0c8-0fa6-4de0-acf9-9a54ffe61f15 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049132 Oct 27 11:10:10.270421 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3744/7290] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:10:10.936559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:10.937153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:10.944838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:10.945323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:10.945754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:10.946464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:10.946892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:10.947313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:11.103225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:11.111402 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a9152d6-b4ad-4866-96a0-23b1be3147e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1317 microversion: 2.1 time: 0.179110 Oct 27 11:10:11.112019 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3547/7291] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:10 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:12.138492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:12.139186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:12.148150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:12.148910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:12.149373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:12.150345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:12.151000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:12.151519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:12.292488 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:12.301208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6dcdd25e-67e1-466b-9266-0349a0e8b265 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1317 microversion: 2.1 time: 0.170155 Oct 27 11:10:12.301789 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3745/7292] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:12 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:13.325407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:13.326267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:13.334292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:13.334774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:13.335206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:13.335900 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:13.336343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:13.336791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:13.475968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:13.484384 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16b079ba-f4a0-4cbb-aed7-ce9f22532fbb tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1317 microversion: 2.1 time: 0.164515 Oct 27 11:10:13.484998 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3548/7293] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:13 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:14.512270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:14.513156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:14.525297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:14.526151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:14.526946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:14.528185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:14.529035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:14.530031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:14.672851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:14.681035 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e916ab09-a68a-4934-aa65-28602daf1f8d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1317 microversion: 2.1 time: 0.175748 Oct 27 11:10:14.681632 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3746/7294] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:14 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:15.246401 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-df6b581a-8b7f-43ca-900b-a73df0bfa9d6 req-960ee7f0-0a77-4086-a2e1-991dfce734be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360c2690-c3bf-4026-99f5-715a52ebcaf4", "name": "network-vif-plugged", "status": "completed", "tag": "0e8d5793-9617-4652-b6b4-6989d88b1891"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:15.257727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-df6b581a-8b7f-43ca-900b-a73df0bfa9d6 req-960ee7f0-0a77-4086-a2e1-991dfce734be service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:15.258162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-df6b581a-8b7f-43ca-900b-a73df0bfa9d6 req-960ee7f0-0a77-4086-a2e1-991dfce734be service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:15.258681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-df6b581a-8b7f-43ca-900b-a73df0bfa9d6 req-960ee7f0-0a77-4086-a2e1-991dfce734be service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:15.270806 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-df6b581a-8b7f-43ca-900b-a73df0bfa9d6 req-960ee7f0-0a77-4086-a2e1-991dfce734be service nova] Creating event network-vif-plugged:0e8d5793-9617-4652-b6b4-6989d88b1891 for instance 360c2690-c3bf-4026-99f5-715a52ebcaf4 on n-h1-854663-10 Oct 27 11:10:15.276253 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-df6b581a-8b7f-43ca-900b-a73df0bfa9d6 req-960ee7f0-0a77-4086-a2e1-991dfce734be service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033709 Oct 27 11:10:15.277117 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3549/7295] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:10:15.707503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:15.708199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:15.719300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:15.719796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:15.720242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:15.720980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:15.721438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:15.721870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:15.855799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:15.864024 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33698d00-b8fe-4fa9-b408-dece7f304dcf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1317 microversion: 2.1 time: 0.163334 Oct 27 11:10:15.864635 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3747/7296] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:15 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:16.888909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:16.889603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:16.896591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:16.897140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:16.897567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:16.898255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:16.898703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:16.899152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:17.042043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:17.050792 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-02d8457b-ccd7-43c7-94b8-674effc9939f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1506 microversion: 2.1 time: 0.167455 Oct 27 11:10:17.051369 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3550/7297] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:16 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:17.125070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1465756621", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "cad18436-72c9-4cee-b355-442339b5ee47"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:17.180244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] validate_networks() for [('cad18436-72c9-4cee-b355-442339b5ee47', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:10:17.382285 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:17.408021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:17.587008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:10:17.587513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:10:17.588104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:10:17.588589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:10:17.589102 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:10:17.598619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:17.599191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:17.599711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:17.600525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:17.601087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:17.601586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:17.619131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Getting quotas for project 2dd814f978f64968b78cc3b31c1a721a. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:10:17.624701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Getting quotas for user 6fd5d9d97375481790b6806e96e48600 and project 2dd814f978f64968b78cc3b31c1a721a. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:10:17.638948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:10:17.641444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:10:17.690302 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6caae228-0bbe-4e6c-a6e4-382acaaddde9 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568987 Oct 27 11:10:17.691246 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3748/7298] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:10:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:10:17.702248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e5d2bd6-f488-4728-9f8a-20c7a62c7b9e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:17.702868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e5d2bd6-f488-4728-9f8a-20c7a62c7b9e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:17.705152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:17.762387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e5d2bd6-f488-4728-9f8a-20c7a62c7b9e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:17.770084 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e5d2bd6-f488-4728-9f8a-20c7a62c7b9e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1217 microversion: 2.1 time: 0.071731 Oct 27 11:10:17.770660 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3551/7299] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:17 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:18.793324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:18.797112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:18.806784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:18.808508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:18.809320 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:18.812081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:18.812769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:18.813298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:18.914021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:18.922435 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42c3b6d1-3b12-44ee-bc3d-f3f93b7a61ff tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1287 microversion: 2.1 time: 0.133469 Oct 27 11:10:18.923027 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3749/7300] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:18 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:19.945764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:19.946268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:19.954240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:19.955008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:19.955721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:19.956441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:19.956932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:19.957364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:20.160289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:20.168686 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-11117bba-16f7-4f9d-ac66-6ffafa13e484 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1317 microversion: 2.1 time: 0.227384 Oct 27 11:10:20.169269 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3552/7301] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:19 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:20.207398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-dfa86ca0-5785-4a06-b94e-72a78ce0692f req-03a87691-447d-43c1-ac61-c697e8533800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86efdea1-eb00-4850-83ba-a60058a75e39", "tag": "2fea6861-47f1-4552-b875-743caf335e9d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:20.219849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dfa86ca0-5785-4a06-b94e-72a78ce0692f req-03a87691-447d-43c1-ac61-c697e8533800 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:20.221147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dfa86ca0-5785-4a06-b94e-72a78ce0692f req-03a87691-447d-43c1-ac61-c697e8533800 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:20.221655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-dfa86ca0-5785-4a06-b94e-72a78ce0692f req-03a87691-447d-43c1-ac61-c697e8533800 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:20.233641 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-dfa86ca0-5785-4a06-b94e-72a78ce0692f req-03a87691-447d-43c1-ac61-c697e8533800 service nova] Creating event network-changed:2fea6861-47f1-4552-b875-743caf335e9d for instance 86efdea1-eb00-4850-83ba-a60058a75e39 on n-h2-854663-10 Oct 27 11:10:20.239019 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-dfa86ca0-5785-4a06-b94e-72a78ce0692f req-03a87691-447d-43c1-ac61-c697e8533800 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035435 Oct 27 11:10:20.239827 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3750/7302] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:10:21.193528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:21.194158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:21.201809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:21.202296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:21.202729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:21.203421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:21.203869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:21.204289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:21.342985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:21.351481 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a162c691-fcfd-4dd0-9efd-e1949fb0b39a tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1317 microversion: 2.1 time: 0.162288 Oct 27 11:10:21.352068 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3553/7303] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:21 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:22.378499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:22.379214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:22.385956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:22.386452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:22.386898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:22.387603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:22.388063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:22.388501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:22.533531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:22.541577 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5097be27-035d-4d0e-9c9a-4251c6658317 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1317 microversion: 2.1 time: 0.169844 Oct 27 11:10:22.542178 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3751/7304] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:22 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:23.569814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:23.570903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:23.581881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:23.582365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:23.582806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:23.583509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:23.583961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:23.584393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:23.719604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:23.727703 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c404282-791b-4fa4-b840-82c9cd3aee8b tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1317 microversion: 2.1 time: 0.165037 Oct 27 11:10:23.728306 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3554/7305] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:23 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:24.755432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:24.755992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:24.763519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:24.764057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:24.764499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:24.765239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:24.765702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:24.766134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:24.912179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:24.924994 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9fa939d-5c1f-4216-a781-843e42e17e80 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1317 microversion: 2.1 time: 0.173826 Oct 27 11:10:24.925958 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3752/7306] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:24 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:25.955169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:25.955875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:25.963433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:25.963911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:25.964346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:25.965069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:25.965519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:25.965940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:26.104304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:26.114061 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c9b4dff-122f-4ed7-a9dc-8f23a2a864c5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1317 microversion: 2.1 time: 0.163633 Oct 27 11:10:26.114695 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3555/7307] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:25 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:27.140485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:27.141153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:27.148769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:27.149426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:27.149795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:27.150587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:27.151037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:27.151515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:27.240423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-92228e32-26ca-444b-a617-4b51faf33dbc req-fe22ef1c-fbf5-4ab0-b4fe-d42d7fd1b7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86efdea1-eb00-4850-83ba-a60058a75e39", "name": "network-vif-plugged", "status": "completed", "tag": "2fea6861-47f1-4552-b875-743caf335e9d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:27.251831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-92228e32-26ca-444b-a617-4b51faf33dbc req-fe22ef1c-fbf5-4ab0-b4fe-d42d7fd1b7c8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:27.252593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-92228e32-26ca-444b-a617-4b51faf33dbc req-fe22ef1c-fbf5-4ab0-b4fe-d42d7fd1b7c8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:27.253290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-92228e32-26ca-444b-a617-4b51faf33dbc req-fe22ef1c-fbf5-4ab0-b4fe-d42d7fd1b7c8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:27.266133 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-92228e32-26ca-444b-a617-4b51faf33dbc req-fe22ef1c-fbf5-4ab0-b4fe-d42d7fd1b7c8 service nova] Creating event network-vif-plugged:2fea6861-47f1-4552-b875-743caf335e9d for instance 86efdea1-eb00-4850-83ba-a60058a75e39 on n-h2-854663-10 Oct 27 11:10:27.271681 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-92228e32-26ca-444b-a617-4b51faf33dbc req-fe22ef1c-fbf5-4ab0-b4fe-d42d7fd1b7c8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036787 Oct 27 11:10:27.272973 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3556/7308] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:10:27.295419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:27.304414 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a90ccdc5-eae6-4995-a668-0efc5f3a3b8e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1317 microversion: 2.1 time: 0.167915 Oct 27 11:10:27.305044 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3753/7309] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:27 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:28.328144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:28.334581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:28.335289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:28.342205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:28.342687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:28.343125 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:28.343810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:28.344263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:28.344696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:28.481380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:28.491917 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9258cb9-ea37-4221-90f6-9ea89bc38993 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1317 microversion: 2.1 time: 0.165606 Oct 27 11:10:28.492810 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3557/7310] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:28 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:29.517995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:29.518771 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:29.521078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:29.521750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:29.529258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:29.529775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:29.530212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:29.530917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:29.531382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:29.531815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:29.676633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:29.685114 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a798f967-6874-4219-a875-85911bf00045 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1506 microversion: 2.1 time: 0.171545 Oct 27 11:10:29.685692 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3754/7311] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:29 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:29.707600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:29.708180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:29.715094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:29.715590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:29.715996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:29.716696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:29.717145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:29.717580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:29.743360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:10:29.825447 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a706526-88d9-4f4d-9ea6-61cabc407eaf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "DELETE /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 204 len: 0 microversion: 2.1 time: 0.121644 Oct 27 11:10:29.826007 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3558/7312] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:10:29 2022] DELETE /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 11:10:29.835668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:29.836329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:29.842796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:29.843290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:29.843734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:29.844430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:29.844920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:29.845354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:29.990739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:30.002866 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a8b8653-b467-4d60-9c57-ee1ac81feabf tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1512 microversion: 2.1 time: 0.171527 Oct 27 11:10:30.003640 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3755/7313] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:29 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:31.031411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:31.032695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:31.044597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:31.045479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:31.046564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:31.047693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:31.048443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:31.049181 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:31.276208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:31.284726 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-70b1bfa2-9f19-4a01-bac6-8c842033f4ce tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 200 len: 1512 microversion: 2.1 time: 0.260429 Oct 27 11:10:31.285673 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3559/7314] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:31 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:31.639353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4b2f48e3-6127-400c-8f14-5b32f76dfd22 req-54073dcf-d34c-4c3a-902c-54acae7f5813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86efdea1-eb00-4850-83ba-a60058a75e39", "name": "network-vif-deleted", "tag": "2fea6861-47f1-4552-b875-743caf335e9d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:31.651896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4b2f48e3-6127-400c-8f14-5b32f76dfd22 req-54073dcf-d34c-4c3a-902c-54acae7f5813 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:31.652788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4b2f48e3-6127-400c-8f14-5b32f76dfd22 req-54073dcf-d34c-4c3a-902c-54acae7f5813 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:31.653240 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4b2f48e3-6127-400c-8f14-5b32f76dfd22 req-54073dcf-d34c-4c3a-902c-54acae7f5813 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:31.665957 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4b2f48e3-6127-400c-8f14-5b32f76dfd22 req-54073dcf-d34c-4c3a-902c-54acae7f5813 service nova] Creating event network-vif-deleted:2fea6861-47f1-4552-b875-743caf335e9d for instance 86efdea1-eb00-4850-83ba-a60058a75e39 on n-h2-854663-10 Oct 27 11:10:31.672946 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4b2f48e3-6127-400c-8f14-5b32f76dfd22 req-54073dcf-d34c-4c3a-902c-54acae7f5813 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043153 Oct 27 11:10:31.674415 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3756/7315] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:10:32.311577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:32.312393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:32.322160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.322816 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.323414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.324340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.324992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.325567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.345583 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] HTTP exception thrown: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Request method failure captured: Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 HTTP/1.1 Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmcOYkqJAk1Zm5m6TkfjfjTuda7vmZcnv4hkIg_m-OBwPu_56oFoPTdM0FxU-TPF4yyG1CmfTH6KJCFRQlOmD44QD7uHSNR_XaKgWOVN2tQvtbmjY3KQv2z4dPtW8E92wHD7tawF0Zn5456tR_wsr0oLJtW9woJqtQpjQsIDRI2xhJ8 Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2dd814f978f64968b78cc3b31c1a721a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6fd5d9d97375481790b6806e96e48600 Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '86efdea1-eb00-4850-83ba-a60058a75e39'} Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:32.347203 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Returning 404 to user: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b04d6977-9848-4b50-a2ae-3e227544e4b8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 404 len: 111 microversion: 2.1 time: 0.042570 Oct 27 11:10:32.352306 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3560/7316] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:32 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:10:32.362189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:32.363299 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:32.370287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.370844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.371292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.371869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.372339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.372808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.509732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:32.517820 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-137ce4e8-07c0-436e-b699-2c7390a0367c tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1506 microversion: 2.1 time: 0.162709 Oct 27 11:10:32.518405 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3757/7317] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:32 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:32.540555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a0543ec-ff82-4488-a05e-1daa54fba34d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:32.542983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5a0543ec-ff82-4488-a05e-1daa54fba34d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: f19f64ff-b348-4dae-9705-65d21e5a0033] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:32.549151 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5a0543ec-ff82-4488-a05e-1daa54fba34d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] HTTP exception thrown: Instance f19f64ff-b348-4dae-9705-65d21e5a0033 could not be found. Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a0543ec-ff82-4488-a05e-1daa54fba34d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Request method failure captured: Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/f19f64ff-b348-4dae-9705-65d21e5a0033/action HTTP/1.1 Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 32 Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmcOYkqJAk1Zm5m6TkfjfjTuda7vmZcnv4hkIg_m-OBwPu_56oFoPTdM0FxU-TPF4yyG1CmfTH6KJCFRQlOmD44QD7uHSNR_XaKgWOVN2tQvtbmjY3KQv2z4dPtW8E92wHD7tawF0Zn5456tR_wsr0oLJtW9woJqtQpjQsIDRI2xhJ8 Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2dd814f978f64968b78cc3b31c1a721a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6fd5d9d97375481790b6806e96e48600 Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: {"resize": {"flavorRef": "452"}} Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance f19f64ff-b348-4dae-9705-65d21e5a0033 could not be found. Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'f19f64ff-b348-4dae-9705-65d21e5a0033', 'body': {'resize': {'flavorRef': '452'}}} Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f19f64ff-b348-4dae-9705-65d21e5a0033 could not be found. Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:10:32.550732 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f19f64ff-b348-4dae-9705-65d21e5a0033 could not be found. Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f19f64ff-b348-4dae-9705-65d21e5a0033 could not be found. Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a0543ec-ff82-4488-a05e-1daa54fba34d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Returning 404 to user: Instance f19f64ff-b348-4dae-9705-65d21e5a0033 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5a0543ec-ff82-4488-a05e-1daa54fba34d tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "POST /compute/v2.1/servers/f19f64ff-b348-4dae-9705-65d21e5a0033/action" status: 404 len: 111 microversion: 2.1 time: 0.015754 Oct 27 11:10:32.556121 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3561/7318] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:10:32 2022] POST /compute/v2.1/servers/f19f64ff-b348-4dae-9705-65d21e5a0033/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 11:10:32.560778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:32.561428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:32.567917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.568426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.568904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.569574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.570031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.570458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.711727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:32.719909 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-04a40325-1497-4fdb-894d-f43fe6570187 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1506 microversion: 2.1 time: 0.163030 Oct 27 11:10:32.720695 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3758/7319] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:32 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:10:32.743187 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:32.743813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:32.751320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.751806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.752249 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.752981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.753440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.753869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.890871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:32.901237 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bb830be3-71c6-40f5-b8d6-1dc4cf9c7a5f tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1506 microversion: 2.1 time: 0.162085 Oct 27 11:10:32.901886 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3562/7320] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:32 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:32.925832 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "8a95aa90-ccef-4450-97a7-51f1a23d02b7"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:32.928230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:32.934837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.935321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.935759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.936448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:32.936941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:32.937373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:32.979841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:32.985732 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] HTTP exception thrown: Flavor 8a95aa90-ccef-4450-97a7-51f1a23d02b7 could not be found. Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Request method failure captured: Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4/action HTTP/1.1 Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 65 Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmcOYkqJAk1Zm5m6TkfjfjTuda7vmZcnv4hkIg_m-OBwPu_56oFoPTdM0FxU-TPF4yyG1CmfTH6KJCFRQlOmD44QD7uHSNR_XaKgWOVN2tQvtbmjY3KQv2z4dPtW8E92wHD7tawF0Zn5456tR_wsr0oLJtW9woJqtQpjQsIDRI2xhJ8 Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2dd814f978f64968b78cc3b31c1a721a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6fd5d9d97375481790b6806e96e48600 Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: {"resize": {"flavorRef": "8a95aa90-ccef-4450-97a7-51f1a23d02b7"}} Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: exception: Flavor 8a95aa90-ccef-4450-97a7-51f1a23d02b7 could not be found. Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '360c2690-c3bf-4026-99f5-715a52ebcaf4', 'body': {'resize': {'flavorRef': '8a95aa90-ccef-4450-97a7-51f1a23d02b7'}}} Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:10:32.997126 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8a95aa90-ccef-4450-97a7-51f1a23d02b7 could not be found. Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 8a95aa90-ccef-4450-97a7-51f1a23d02b7 could not be found. Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8a95aa90-ccef-4450-97a7-51f1a23d02b7 could not be found. Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Returning 400 to user: Flavor 8a95aa90-ccef-4450-97a7-51f1a23d02b7 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-199b18ba-9251-4bb1-855c-455d6c1bad4e tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "POST /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4/action" status: 400 len: 107 microversion: 2.1 time: 0.077260 Oct 27 11:10:33.001917 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3759/7321] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:10:32 2022] POST /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4/action => generated 107 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 11:10:33.007547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:33.008167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:33.014402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.014876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.015307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.015986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.016431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.016881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.159130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:33.171874 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9504f561-5ee5-44bc-9315-8383d90788a6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1506 microversion: 2.1 time: 0.167701 Oct 27 11:10:33.172696 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3563/7322] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:33 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:10:33.196986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:33.197610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:33.204308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.204802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.205249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.205955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.206421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.206861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.349135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:33.357376 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68a80f5f-37b1-4bc8-a552-4cfa0d79c0e7 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1506 microversion: 2.1 time: 0.164439 Oct 27 11:10:33.357951 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3760/7323] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:33 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:33.379910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4f2b0c81-ef39-4fd7-b160-32af639ac650 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4f2b0c81-ef39-4fd7-b160-32af639ac650 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Request method failure captured: Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4/action HTTP/1.1 Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 29 Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmcOYkqJAk1Zm5m6TkfjfjTuda7vmZcnv4hkIg_m-OBwPu_56oFoPTdM0FxU-TPF4yyG1CmfTH6KJCFRQlOmD44QD7uHSNR_XaKgWOVN2tQvtbmjY3KQv2z4dPtW8E92wHD7tawF0Zn5456tR_wsr0oLJtW9woJqtQpjQsIDRI2xhJ8 Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2dd814f978f64968b78cc3b31c1a721a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6fd5d9d97375481790b6806e96e48600 Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: {"resize": {"flavorRef": ""}} Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '360c2690-c3bf-4026-99f5-715a52ebcaf4', 'body': {'resize': {'flavorRef': ''}}} Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '' Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.383647 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4f2b0c81-ef39-4fd7-b160-32af639ac650 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4f2b0c81-ef39-4fd7-b160-32af639ac650 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "POST /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4/action" status: 400 len: 113 microversion: 2.1 time: 0.009200 Oct 27 11:10:33.388144 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3564/7324] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:10:33 2022] POST /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 11:10:33.395811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:33.396904 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:33.405018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.405797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.406312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.407396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.408027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.408645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.545305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:33.554342 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d94ecf29-8ac5-4867-955f-59940018d2de tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1506 microversion: 2.1 time: 0.164805 Oct 27 11:10:33.554924 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3761/7325] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:33 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:33.581149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:33.581639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:33.589248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.589726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.590161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.590848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.591299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.591723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.605372 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] HTTP exception thrown: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Request method failure captured: Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 HTTP/1.1 Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmcOYkqJAk1Zm5m6TkfjfjTuda7vmZcnv4hkIg_m-OBwPu_56oFoPTdM0FxU-TPF4yyG1CmfTH6KJCFRQlOmD44QD7uHSNR_XaKgWOVN2tQvtbmjY3KQv2z4dPtW8E92wHD7tawF0Zn5456tR_wsr0oLJtW9woJqtQpjQsIDRI2xhJ8 Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2dd814f978f64968b78cc3b31c1a721a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 6fd5d9d97375481790b6806e96e48600 Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '86efdea1-eb00-4850-83ba-a60058a75e39'} Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:10:33.606914 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Returning 404 to user: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-122df69b-640b-4df3-be0b-2f1e85cb14a0 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "DELETE /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 404 len: 111 microversion: 2.1 time: 0.032048 Oct 27 11:10:33.611535 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3565/7326] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:10:33 2022] DELETE /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 11:10:33.617179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:33.617804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 86efdea1-eb00-4850-83ba-a60058a75e39] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:33.624226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.624717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.625177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.625875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.626332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.626758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.631509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:33.641937 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] HTTP exception thrown: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Request method failure captured: Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 HTTP/1.1 Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmcOYkqJAk1Zm5m6TkfjfjTuda7vmZcnv4hkIg_m-OBwPu_56oFoPTdM0FxU-TPF4yyG1CmfTH6KJCFRQlOmD44QD7uHSNR_XaKgWOVN2tQvtbmjY3KQv2z4dPtW8E92wHD7tawF0Zn5456tR_wsr0oLJtW9woJqtQpjQsIDRI2xhJ8 Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2dd814f978f64968b78cc3b31c1a721a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6fd5d9d97375481790b6806e96e48600 Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '86efdea1-eb00-4850-83ba-a60058a75e39'} Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:33.643478 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Returning 404 to user: Instance 86efdea1-eb00-4850-83ba-a60058a75e39 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ecccb0b2-bbcc-4f10-ad69-2d4ba1143db4 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39" status: 404 len: 111 microversion: 2.1 time: 0.031827 Oct 27 11:10:33.648808 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3762/7327] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:33 2022] GET /compute/v2.1/servers/86efdea1-eb00-4850-83ba-a60058a75e39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:10:33.653825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:33.654345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:33.660736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.661164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.661612 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.662308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.662754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.663175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.681874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:33.690866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:10:33.771247 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21a66b6a-6c8a-4593-98bf-418daf1be9d8 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "DELETE /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 204 len: 0 microversion: 2.1 time: 0.121115 Oct 27 11:10:33.771853 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3566/7328] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:10:33 2022] DELETE /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 11:10:33.780063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:33.780716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:33.788198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.788698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.789155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.789858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:33.790312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:33.790721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:33.933658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:33.941958 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68cee088-27a7-44c2-95ff-45bd5c10c7c2 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1512 microversion: 2.1 time: 0.165847 Oct 27 11:10:33.942533 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3763/7329] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:33 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:34.970328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:34.971488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:34.980283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:34.980814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:34.981255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:34.981992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:34.982475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:34.982930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:35.128201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:35.140070 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-514ab38c-b8c4-4ab9-9b30-0e7c9810bfe6 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1512 microversion: 2.1 time: 0.177159 Oct 27 11:10:35.140833 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3567/7330] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:34 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:10:35.699923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-09c44ada-2286-475d-b601-50e20bbdfcae req-0c0b1710-c2e9-47fa-947d-05aa0910d1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360c2690-c3bf-4026-99f5-715a52ebcaf4", "name": "network-vif-deleted", "tag": "0e8d5793-9617-4652-b6b4-6989d88b1891"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:10:35.715208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-09c44ada-2286-475d-b601-50e20bbdfcae req-0c0b1710-c2e9-47fa-947d-05aa0910d1a4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:35.715719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-09c44ada-2286-475d-b601-50e20bbdfcae req-0c0b1710-c2e9-47fa-947d-05aa0910d1a4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:35.716539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-09c44ada-2286-475d-b601-50e20bbdfcae req-0c0b1710-c2e9-47fa-947d-05aa0910d1a4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:35.730535 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-09c44ada-2286-475d-b601-50e20bbdfcae req-0c0b1710-c2e9-47fa-947d-05aa0910d1a4 service nova] Creating event network-vif-deleted:0e8d5793-9617-4652-b6b4-6989d88b1891 for instance 360c2690-c3bf-4026-99f5-715a52ebcaf4 on n-h1-854663-10 Oct 27 11:10:35.737532 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-09c44ada-2286-475d-b601-50e20bbdfcae req-0c0b1710-c2e9-47fa-947d-05aa0910d1a4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042524 Oct 27 11:10:35.738384 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3764/7331] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:10:36.165476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:36.166160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:36.176430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:36.176950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:36.177384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:36.178126 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:36.178559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:36.178999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:36.218843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:36.219327 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:36.219760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:36.220280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lazy-loading 'fault' on Instance uuid 360c2690-c3bf-4026-99f5-715a52ebcaf4 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:10:36.270092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5d9d97375481790b6806e96e48600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd814f978f64968b78cc3b31c1a721a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:10:36.280179 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58325078-7a32-4faf-bb3a-1062b59217f5 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 200 len: 1307 microversion: 2.1 time: 0.118835 Oct 27 11:10:36.280998 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3568/7332] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:36 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:10:37.308754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:10:37.309468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] [instance: 360c2690-c3bf-4026-99f5-715a52ebcaf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:10:37.312513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:10:37.318465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:37.318964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:37.319409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:37.320143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:10:37.320608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:10:37.321069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:10:37.335942 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] HTTP exception thrown: Instance 360c2690-c3bf-4026-99f5-715a52ebcaf4 could not be found. Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Request method failure captured: Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 HTTP/1.1 Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmcOYkqJAk1Zm5m6TkfjfjTuda7vmZcnv4hkIg_m-OBwPu_56oFoPTdM0FxU-TPF4yyG1CmfTH6KJCFRQlOmD44QD7uHSNR_XaKgWOVN2tQvtbmjY3KQv2z4dPtW8E92wHD7tawF0Zn5456tR_wsr0oLJtW9woJqtQpjQsIDRI2xhJ8 Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2dd814f978f64968b78cc3b31c1a721a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2dd814f978f64968b78cc3b31c1a721a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 2dd814f978f64968b78cc3b31c1a721a Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServersNegativeTestJSON-44175837 Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 6fd5d9d97375481790b6806e96e48600 Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-ServersNegativeTestJSON-44175837-project Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 360c2690-c3bf-4026-99f5-715a52ebcaf4 could not be found. Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '360c2690-c3bf-4026-99f5-715a52ebcaf4'} Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360c2690-c3bf-4026-99f5-715a52ebcaf4 could not be found. Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360c2690-c3bf-4026-99f5-715a52ebcaf4 could not be found. Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:10:37.337657 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360c2690-c3bf-4026-99f5-715a52ebcaf4 could not be found. Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] Returning 404 to user: Instance 360c2690-c3bf-4026-99f5-715a52ebcaf4 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-174f300b-7b5c-4377-a1ec-fbc924beb358 tempest-ServersNegativeTestJSON-44175837 tempest-ServersNegativeTestJSON-44175837-project] 10.222.0.76 "GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4" status: 404 len: 111 microversion: 2.1 time: 0.034790 Oct 27 11:10:37.341923 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3765/7333] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:10:37 2022] GET /compute/v2.1/servers/360c2690-c3bf-4026-99f5-715a52ebcaf4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:11:10.455061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:10.455830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:10.639539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6c8f2ee-01ae-448b-b462-16337f053c00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Action: 'create', calling method: .version_select at 0x7f6d5a92f160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1171934258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcpxJcaRPv8VvHDH+SIdgAQEGw/ZoLXAS9GQDKVVB41BdC1dXcijYCxiATHv6YiPu7pytEG+hohYIIZWR7w2E7QTjSyxxz3mj0aMwIs3TsBpC1Jv/yk2dlZxFs7kQJaKw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:10.655503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c6c8f2ee-01ae-448b-b462-16337f053c00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:11:10.660875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-c6c8f2ee-01ae-448b-b462-16337f053c00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for user 9a0a2efcee38413ab51f9eb40fbab5a0 and project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:11:10.689317 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6c8f2ee-01ae-448b-b462-16337f053c00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.239731 Oct 27 11:11:10.689940 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3569/7334] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:11:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:10.742750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1996905922", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1171934258", "networks": [{"uuid": "3397e6c9-3330-441f-a644-09097176a8f1"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:10.752601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:10.753466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:10.984559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] validate_networks() for [('3397e6c9-3330-441f-a644-09097176a8f1', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:11:11.386534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:11:11.386971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:11:11.387459 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:11:11.388010 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:11:11.388426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:11:11.398408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:11.398887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:11.399529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:11.400272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:11.400798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:11.401275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:11.420091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:11:11.426105 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for user 9a0a2efcee38413ab51f9eb40fbab5a0 and project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:11:11.439908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:11:11.442362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:11:11.491287 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d4846ba-4ed7-4ae9-b9d1-05931c82ab75 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752741 Oct 27 11:11:11.492132 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3766/7335] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:11:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:11:11.503428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5130e3c5-d6fc-41da-a017-9c2fd3a73c2b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:11.504307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5130e3c5-d6fc-41da-a017-9c2fd3a73c2b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:11.675285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5130e3c5-d6fc-41da-a017-9c2fd3a73c2b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:11.683921 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5130e3c5-d6fc-41da-a017-9c2fd3a73c2b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1263 microversion: 2.1 time: 0.184501 Oct 27 11:11:11.684497 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3570/7336] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:11 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:12.708561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:12.710245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:12.728078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:12.728697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:12.729160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:12.729907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:12.730377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:12.730804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:12.796901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:12.806770 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48a9c673-129c-448a-b187-4cae811e2db7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1333 microversion: 2.1 time: 0.102934 Oct 27 11:11:12.820684 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3767/7337] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:12 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:11:13.833486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:13.834338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:13.843381 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:13.844283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:13.844843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:13.845786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:13.846318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:13.846750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:13.993646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:14.002814 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-49dd968c-3ab5-448e-a9eb-4d592e8e0a3c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1363 microversion: 2.1 time: 0.173821 Oct 27 11:11:14.003411 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3571/7338] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:13 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:14.244382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8a0903f6-6b90-4aa1-920c-cddbcbb24d31 req-3e0b9979-4e07-415f-a710-2d73655ac530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5737b80e-1c48-4fca-801e-472b2de73827", "tag": "9827ffdb-a6ac-40f3-a043-efe3d09b15cc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:14.254901 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8a0903f6-6b90-4aa1-920c-cddbcbb24d31 req-3e0b9979-4e07-415f-a710-2d73655ac530 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:14.255396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8a0903f6-6b90-4aa1-920c-cddbcbb24d31 req-3e0b9979-4e07-415f-a710-2d73655ac530 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:14.255843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8a0903f6-6b90-4aa1-920c-cddbcbb24d31 req-3e0b9979-4e07-415f-a710-2d73655ac530 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:14.267630 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8a0903f6-6b90-4aa1-920c-cddbcbb24d31 req-3e0b9979-4e07-415f-a710-2d73655ac530 service nova] Creating event network-changed:9827ffdb-a6ac-40f3-a043-efe3d09b15cc for instance 5737b80e-1c48-4fca-801e-472b2de73827 on n-h1-854663-10 Oct 27 11:11:14.272877 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8a0903f6-6b90-4aa1-920c-cddbcbb24d31 req-3e0b9979-4e07-415f-a710-2d73655ac530 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105213 Oct 27 11:11:14.273631 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3768/7339] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:11:15.029681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:15.030359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:15.038994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:15.039557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:15.040058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:15.040962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:15.041519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:15.041943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:15.176905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:15.185507 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2738b6ef-979d-41e1-acd0-774f4896eb29 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1363 microversion: 2.1 time: 0.161497 Oct 27 11:11:15.186068 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3572/7340] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:15 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:16.210749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:16.211463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:16.218559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:16.219049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:16.219500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:16.220203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:16.220692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:16.221133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:16.364032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:16.372325 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5e56b80-2c9a-4cb7-8812-762265d1af2d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1363 microversion: 2.1 time: 0.166902 Oct 27 11:11:16.372939 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3769/7341] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:16 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:17.396087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:17.396627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:17.403898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:17.404392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:17.404866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:17.405570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:17.406019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:17.406441 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:17.544239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:17.555055 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21b50da6-e4da-49a5-b562-9bb14c615393 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1363 microversion: 2.1 time: 0.163275 Oct 27 11:11:17.555967 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3573/7342] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:17 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:18.579207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:18.579813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:18.587312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:18.587830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:18.588278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:18.589035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:18.589563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:18.590337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:18.730702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:18.739307 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c559554-6bdd-412d-afd4-9e638fa5137d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1363 microversion: 2.1 time: 0.164067 Oct 27 11:11:18.739911 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3770/7343] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:18 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:19.522045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-933b99af-d273-45c0-9088-98a7ac278156 req-2587838a-e9a9-4a84-bbea-f7d54b268ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5737b80e-1c48-4fca-801e-472b2de73827", "name": "network-vif-plugged", "status": "completed", "tag": "9827ffdb-a6ac-40f3-a043-efe3d09b15cc"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:19.534733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-933b99af-d273-45c0-9088-98a7ac278156 req-2587838a-e9a9-4a84-bbea-f7d54b268ba4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:19.535215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-933b99af-d273-45c0-9088-98a7ac278156 req-2587838a-e9a9-4a84-bbea-f7d54b268ba4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:19.535651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-933b99af-d273-45c0-9088-98a7ac278156 req-2587838a-e9a9-4a84-bbea-f7d54b268ba4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:19.548136 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-933b99af-d273-45c0-9088-98a7ac278156 req-2587838a-e9a9-4a84-bbea-f7d54b268ba4 service nova] Creating event network-vif-plugged:9827ffdb-a6ac-40f3-a043-efe3d09b15cc for instance 5737b80e-1c48-4fca-801e-472b2de73827 on n-h1-854663-10 Oct 27 11:11:19.553709 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-933b99af-d273-45c0-9088-98a7ac278156 req-2587838a-e9a9-4a84-bbea-f7d54b268ba4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Oct 27 11:11:19.554289 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3574/7344] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:19.763542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:19.764114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:19.771448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:19.771941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:19.772379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:19.773113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:19.773576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:19.774004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:19.909272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:19.917798 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d156f07-da45-44b1-91ab-0f87999a3c67 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1363 microversion: 2.1 time: 0.158314 Oct 27 11:11:19.918388 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3771/7345] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:19 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:20.942898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:20.943478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:20.951664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:20.952147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:20.952575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:20.953310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:20.953740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:20.954185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:21.101796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:21.110259 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8528f174-bf4e-4b97-aa1f-13639d5a40fa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1363 microversion: 2.1 time: 0.172619 Oct 27 11:11:21.110853 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3575/7346] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:20 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:22.136955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:22.138073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:22.141895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:22.142892 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:22.151487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:22.152145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:22.152837 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:22.153525 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:22.153975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:22.154461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:22.305472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:22.313650 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61864ab2-1dcb-43a9-8d13-9e83018fa6e6 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1555 microversion: 2.1 time: 0.182247 Oct 27 11:11:22.314208 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3772/7347] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:22 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:22.336374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:22.337009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:22.338970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:22.345764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:22.346238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:22.346667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:22.347347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:22.347790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:22.348211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:22.483316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:22.491623 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-edd604f4-7aa8-47eb-bb2b-f0b9f6b46eab tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1555 microversion: 2.1 time: 0.159598 Oct 27 11:11:22.492227 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3576/7348] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:22 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:24.152021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b755cd95-d173-463e-926b-aedd97187b72 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f5c16af-9148-471e-865f-030bc47f58c9"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:24.154517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b755cd95-d173-463e-926b-aedd97187b72 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:24.161593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b755cd95-d173-463e-926b-aedd97187b72 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:24.162087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b755cd95-d173-463e-926b-aedd97187b72 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:24.162532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b755cd95-d173-463e-926b-aedd97187b72 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:24.163234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b755cd95-d173-463e-926b-aedd97187b72 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:24.163691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b755cd95-d173-463e-926b-aedd97187b72 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:24.164121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b755cd95-d173-463e-926b-aedd97187b72 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:24.452119 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b755cd95-d173-463e-926b-aedd97187b72 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "POST /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303941 Oct 27 11:11:24.452822 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3773/7349] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 11:11:24 2022] POST /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:35.248888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:35.249564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:35.252443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:35.253323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=32 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:35.262029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:35.262588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:35.263234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:35.264478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:35.265287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:35.265942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:35.360523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lazy-loading 'services' on Instance uuid 5737b80e-1c48-4fca-801e-472b2de73827 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:11:35.441535 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-66531dce-4cce-4120-a3b9-e2cdf68245c7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments/6f5c16af-9148-471e-865f-030bc47f58c9" status: 202 len: 0 microversion: 2.1 time: 0.196924 Oct 27 11:11:35.442152 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3577/7350] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:11:35 2022] DELETE /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments/6f5c16af-9148-471e-865f-030bc47f58c9 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:11:35.448699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:35.449609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:35.454219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24bc9949-dc35-416a-9369-0c7f451ae84f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:35.456765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24bc9949-dc35-416a-9369-0c7f451ae84f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:35.464429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24bc9949-dc35-416a-9369-0c7f451ae84f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:35.464946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24bc9949-dc35-416a-9369-0c7f451ae84f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:35.465393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24bc9949-dc35-416a-9369-0c7f451ae84f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:35.466097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24bc9949-dc35-416a-9369-0c7f451ae84f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:35.466549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24bc9949-dc35-416a-9369-0c7f451ae84f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:35.467114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24bc9949-dc35-416a-9369-0c7f451ae84f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:35.501144 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24bc9949-dc35-416a-9369-0c7f451ae84f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054083 Oct 27 11:11:35.501765 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3774/7351] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:11:35 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:36.519542 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-150a0e2d-fdcb-4ab4-8608-c1d91beb180b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:36.522060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-150a0e2d-fdcb-4ab4-8608-c1d91beb180b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:36.528916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-150a0e2d-fdcb-4ab4-8608-c1d91beb180b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:36.529472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-150a0e2d-fdcb-4ab4-8608-c1d91beb180b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:36.530062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-150a0e2d-fdcb-4ab4-8608-c1d91beb180b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:36.530785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-150a0e2d-fdcb-4ab4-8608-c1d91beb180b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:36.531318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-150a0e2d-fdcb-4ab4-8608-c1d91beb180b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:36.531819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-150a0e2d-fdcb-4ab4-8608-c1d91beb180b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:36.564282 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-150a0e2d-fdcb-4ab4-8608-c1d91beb180b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052052 Oct 27 11:11:36.564902 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3578/7352] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:11:36 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:37.578343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e96c650f-468c-4be8-8834-cfe5f449ce89 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:37.580990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e96c650f-468c-4be8-8834-cfe5f449ce89 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:37.589073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e96c650f-468c-4be8-8834-cfe5f449ce89 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:37.589573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e96c650f-468c-4be8-8834-cfe5f449ce89 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:37.590024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e96c650f-468c-4be8-8834-cfe5f449ce89 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:37.590745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e96c650f-468c-4be8-8834-cfe5f449ce89 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:37.591209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e96c650f-468c-4be8-8834-cfe5f449ce89 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:37.591672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e96c650f-468c-4be8-8834-cfe5f449ce89 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:37.626368 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e96c650f-468c-4be8-8834-cfe5f449ce89 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052387 Oct 27 11:11:37.626980 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3775/7353] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:11:37 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:38.638916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6efb2681-5c20-4f5e-b28b-51fc053b41ca tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:38.641225 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6efb2681-5c20-4f5e-b28b-51fc053b41ca tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:38.649001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6efb2681-5c20-4f5e-b28b-51fc053b41ca tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:38.649466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6efb2681-5c20-4f5e-b28b-51fc053b41ca tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:38.649956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6efb2681-5c20-4f5e-b28b-51fc053b41ca tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:38.650633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6efb2681-5c20-4f5e-b28b-51fc053b41ca tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:38.651081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6efb2681-5c20-4f5e-b28b-51fc053b41ca tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:38.651485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6efb2681-5c20-4f5e-b28b-51fc053b41ca tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:38.683875 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6efb2681-5c20-4f5e-b28b-51fc053b41ca tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048926 Oct 27 11:11:38.684340 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3579/7354] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:11:38 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:39.696873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40afec1a-8495-49f8-b78a-2101e4478950 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:39.699017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40afec1a-8495-49f8-b78a-2101e4478950 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:39.706405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40afec1a-8495-49f8-b78a-2101e4478950 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:39.706899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40afec1a-8495-49f8-b78a-2101e4478950 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:39.707342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40afec1a-8495-49f8-b78a-2101e4478950 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:39.708045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40afec1a-8495-49f8-b78a-2101e4478950 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:39.708535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40afec1a-8495-49f8-b78a-2101e4478950 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:39.708976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40afec1a-8495-49f8-b78a-2101e4478950 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:39.739980 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40afec1a-8495-49f8-b78a-2101e4478950 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047162 Oct 27 11:11:39.744620 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3776/7355] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:11:39 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:40.754586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7c60d83-64f8-439a-8810-b64d67942426 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:40.758861 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7c60d83-64f8-439a-8810-b64d67942426 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:40.768287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c60d83-64f8-439a-8810-b64d67942426 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:40.768800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c60d83-64f8-439a-8810-b64d67942426 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:40.769231 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c60d83-64f8-439a-8810-b64d67942426 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:40.769928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c60d83-64f8-439a-8810-b64d67942426 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:40.770375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c60d83-64f8-439a-8810-b64d67942426 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:40.770780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7c60d83-64f8-439a-8810-b64d67942426 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:40.800991 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7c60d83-64f8-439a-8810-b64d67942426 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051878 Oct 27 11:11:40.801559 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3580/7356] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:11:40 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 11:11:40.812964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:40.813587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:40.820887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:40.821379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:40.821823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:40.822521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:40.822979 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:40.823410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:40.900797 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] HTTP exception thrown: Instance 5737b80e-1c48-4fca-801e-472b2de73827 is not attached to volume 6f5c16af-9148-471e-865f-030bc47f58c9 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Request method failure captured: Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments/6f5c16af-9148-471e-865f-030bc47f58c9 HTTP/1.1 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmdIvXBRvZ5v3LHlKmnZ8KN-1xRBb-MBtaJN1L38ZyeMVsXvXWIUFft6oMsLEzPjB9hYZGjZCLdnZyo7uf4flSCa-Y2-edzqlm43RIW7S3lhV9FMgu_PM7OfTNOVse-0aC9sGpwAQ-imKKszoC9CH_tcSHoLBkbDcIQ2xKZetedYwCo Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8535a9e4e1ff48c28d403513a8d513e4", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9a0a2efcee38413ab51f9eb40fbab5a0 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 5737b80e-1c48-4fca-801e-472b2de73827 is not attached to volume 6f5c16af-9148-471e-865f-030bc47f58c9 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'server_id': '5737b80e-1c48-4fca-801e-472b2de73827', 'id': '6f5c16af-9148-471e-865f-030bc47f58c9'} Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6f5c16af-9148-471e-865f-030bc47f58c9. Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5737b80e-1c48-4fca-801e-472b2de73827 is not attached to volume 6f5c16af-9148-471e-865f-030bc47f58c9 Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:11:40.911485 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:11:40.915652 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:11:40.915652 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:11:40.915652 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5737b80e-1c48-4fca-801e-472b2de73827 is not attached to volume 6f5c16af-9148-471e-865f-030bc47f58c9 Oct 27 11:11:40.915652 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:40.915652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Returning 404 to user: Instance 5737b80e-1c48-4fca-801e-472b2de73827 is not attached to volume 6f5c16af-9148-471e-865f-030bc47f58c9 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:11:40.915652 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8b5d0d3-29af-41ed-9e04-a236ed94402c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments/6f5c16af-9148-471e-865f-030bc47f58c9" status: 404 len: 154 microversion: 2.1 time: 0.104457 Oct 27 11:11:40.915652 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3777/7357] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:11:40 2022] DELETE /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827/os-volume_attachments/6f5c16af-9148-471e-865f-030bc47f58c9 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:11:44.282916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:44.283492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:44.290681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:44.291261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:44.291705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:44.292468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:44.292960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:44.293390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:44.320063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:11:44.408900 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afc9054d-56d5-4eaf-8177-414359f91289 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 204 len: 0 microversion: 2.1 time: 0.129725 Oct 27 11:11:44.409721 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3581/7358] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:11:44 2022] DELETE /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:11:44.420973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:44.421920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:44.431098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:44.431613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:44.432062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:44.432831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:44.433305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:44.433749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:44.572643 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:44.581339 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95e58f68-7234-4a1b-85be-5ec5cfa0ef4c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1561 microversion: 2.1 time: 0.166852 Oct 27 11:11:44.581962 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3778/7359] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:44 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:45.610319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:45.611114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:45.618614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:45.619104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:45.619550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:45.620261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:45.620751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:45.621178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:45.775266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:45.783632 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e0c17b9-d6ab-4153-99f0-a7fdc47b77cf tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1561 microversion: 2.1 time: 0.180723 Oct 27 11:11:45.784221 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3582/7360] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:45 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:46.798746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b7b5cb06-4295-4437-82c2-2aa271b68a43 req-cc912089-33c4-4acf-ba74-54a3a0df7685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5737b80e-1c48-4fca-801e-472b2de73827", "name": "network-vif-deleted", "tag": "9827ffdb-a6ac-40f3-a043-efe3d09b15cc"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:46.807511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:46.808146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:46.810977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b7b5cb06-4295-4437-82c2-2aa271b68a43 req-cc912089-33c4-4acf-ba74-54a3a0df7685 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:46.811342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b7b5cb06-4295-4437-82c2-2aa271b68a43 req-cc912089-33c4-4acf-ba74-54a3a0df7685 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:46.811788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b7b5cb06-4295-4437-82c2-2aa271b68a43 req-cc912089-33c4-4acf-ba74-54a3a0df7685 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:46.816610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:46.817148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:46.817593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:46.818308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:46.818978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:46.819390 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:46.825289 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b7b5cb06-4295-4437-82c2-2aa271b68a43 req-cc912089-33c4-4acf-ba74-54a3a0df7685 service nova] Creating event network-vif-deleted:9827ffdb-a6ac-40f3-a043-efe3d09b15cc for instance 5737b80e-1c48-4fca-801e-472b2de73827 on n-h1-854663-10 Oct 27 11:11:46.832959 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b7b5cb06-4295-4437-82c2-2aa271b68a43 req-cc912089-33c4-4acf-ba74-54a3a0df7685 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037977 Oct 27 11:11:46.835691 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3779/7361] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:46.924284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:46.932772 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d5267c53-1c5a-4d4d-9f05-5ae3aeadb7b3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 200 len: 1519 microversion: 2.1 time: 0.129029 Oct 27 11:11:46.933442 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3583/7362] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:46 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 1519 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:47.959228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:47.959990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 5737b80e-1c48-4fca-801e-472b2de73827] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:47.966920 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:47.967421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:47.967862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:47.968573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:47.969066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:47.969506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:47.983702 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] HTTP exception thrown: Instance 5737b80e-1c48-4fca-801e-472b2de73827 could not be found. Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Request method failure captured: Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 HTTP/1.1 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmdIvXBRvZ5v3LHlKmnZ8KN-1xRBb-MBtaJN1L38ZyeMVsXvXWIUFft6oMsLEzPjB9hYZGjZCLdnZyo7uf4flSCa-Y2-edzqlm43RIW7S3lhV9FMgu_PM7OfTNOVse-0aC9sGpwAQ-imKKszoC9CH_tcSHoLBkbDcIQ2xKZetedYwCo Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8535a9e4e1ff48c28d403513a8d513e4", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 9a0a2efcee38413ab51f9eb40fbab5a0 Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 5737b80e-1c48-4fca-801e-472b2de73827 could not be found. Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '5737b80e-1c48-4fca-801e-472b2de73827'} Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5737b80e-1c48-4fca-801e-472b2de73827 could not be found. Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5737b80e-1c48-4fca-801e-472b2de73827 could not be found. Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:11:47.985385 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5737b80e-1c48-4fca-801e-472b2de73827 could not be found. Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Returning 404 to user: Instance 5737b80e-1c48-4fca-801e-472b2de73827 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3671ed28-21d1-4250-94c6-5764e15c97d3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827" status: 404 len: 111 microversion: 2.1 time: 0.032875 Oct 27 11:11:47.990323 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3780/7363] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:47 2022] GET /compute/v2.1/servers/5737b80e-1c48-4fca-801e-472b2de73827 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:11:47.995751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bad9c15c-a810-40e6-999c-7c2dad768ac3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '.version_select at 0x7f6d5a2ec4c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:48.000640 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:11:48.000829 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:11:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1171934258 (ip 10.222.0.76) !!! Oct 27 11:11:48.021513 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bad9c15c-a810-40e6-999c-7c2dad768ac3 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1171934258" status: 202 len: 0 microversion: 2.1 time: 0.029689 Oct 27 11:11:48.022110 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3584/7364] 10.222.0.76 () {58 vars in 1278 bytes} [Thu Oct 27 11:11:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1171934258 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:11:48.042961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc576862-18be-4e8d-8af2-d7899f2c75b9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Action: 'create', calling method: .version_select at 0x7f6d5854d160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2061687716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJozTghgZ1k67Mx5UaWo1QA94RpyATBJ4Ilzf7TW7hufiaNNksvOs5AUwg9Wo/9U12ZWhz9CwNuF61WlsAoGsIt2UjlOSXxXTp6YhLxZ2FlxGA9UiUKp2JRraaMHLVIEzA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:48.066749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-bc576862-18be-4e8d-8af2-d7899f2c75b9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:11:48.075528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-bc576862-18be-4e8d-8af2-d7899f2c75b9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for user 9a0a2efcee38413ab51f9eb40fbab5a0 and project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:11:48.105448 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc576862-18be-4e8d-8af2-d7899f2c75b9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.069142 Oct 27 11:11:48.106063 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3781/7365] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:11:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:48.160445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1208802159", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2061687716", "networks": [{"uuid": "3397e6c9-3330-441f-a644-09097176a8f1"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:48.215379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] validate_networks() for [('3397e6c9-3330-441f-a644-09097176a8f1', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:11:48.612754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:11:48.613177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:11:48.613682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:11:48.614094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:11:48.614511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:11:48.625240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:48.625893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:48.626484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:48.627502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:48.627977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:48.628405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:48.647068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:11:48.653025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for user 9a0a2efcee38413ab51f9eb40fbab5a0 and project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:11:48.667001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:11:48.669485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:11:48.720655 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c3ff2ec-4b0c-422c-aa3a-51f9660953aa tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564461 Oct 27 11:11:48.721361 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3585/7366] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:11:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:11:48.732692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a29cddb4-4004-4d7c-83be-14d37c1f3838 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:48.733355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a29cddb4-4004-4d7c-83be-14d37c1f3838 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:48.789679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a29cddb4-4004-4d7c-83be-14d37c1f3838 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:48.797165 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a29cddb4-4004-4d7c-83be-14d37c1f3838 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1263 microversion: 2.1 time: 0.068177 Oct 27 11:11:48.797943 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3782/7367] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:48 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:49.825002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:49.825774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:49.835189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:49.835672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:49.836104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:49.836827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:49.837274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:49.837698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:49.907847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:49.917499 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cdd13828-900d-429a-9266-ad16c397365c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1315 microversion: 2.1 time: 0.100724 Oct 27 11:11:49.918093 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3586/7368] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:49 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1315 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:50.942624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:50.943212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:50.950483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:50.950985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:50.951425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:50.952126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:50.952572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:50.953036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:51.085910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:51.094081 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68dffdb7-1bb1-4856-82fc-35b7fcdfeae2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1363 microversion: 2.1 time: 0.155892 Oct 27 11:11:51.094747 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3783/7369] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:50 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:51.386392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0da1a099-0a48-47d7-b15a-98b7afff8454 req-dc767c5f-a54c-40e2-a3ad-8ef8a1bad5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e920e02-308a-414d-ba32-4303bb369e54", "tag": "5756d340-77bd-4b4f-a813-a71dc31a4c06"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:51.399173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0da1a099-0a48-47d7-b15a-98b7afff8454 req-dc767c5f-a54c-40e2-a3ad-8ef8a1bad5d4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:51.399572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0da1a099-0a48-47d7-b15a-98b7afff8454 req-dc767c5f-a54c-40e2-a3ad-8ef8a1bad5d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:51.400113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0da1a099-0a48-47d7-b15a-98b7afff8454 req-dc767c5f-a54c-40e2-a3ad-8ef8a1bad5d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:51.423780 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0da1a099-0a48-47d7-b15a-98b7afff8454 req-dc767c5f-a54c-40e2-a3ad-8ef8a1bad5d4 service nova] Creating event network-changed:5756d340-77bd-4b4f-a813-a71dc31a4c06 for instance 1e920e02-308a-414d-ba32-4303bb369e54 on n-h1-854663-10 Oct 27 11:11:51.429189 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0da1a099-0a48-47d7-b15a-98b7afff8454 req-dc767c5f-a54c-40e2-a3ad-8ef8a1bad5d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046705 Oct 27 11:11:51.429809 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3587/7370] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:52.121713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:52.122324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:52.132921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:52.133612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:52.134254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:52.135113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:52.135767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:52.136352 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:52.278683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:52.290973 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3347cf3-247a-4ab4-88c0-a676774b74ce tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1363 microversion: 2.1 time: 0.175407 Oct 27 11:11:52.291791 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3784/7371] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:52 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:53.319762 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:53.320495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:53.327500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:53.328091 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:53.328613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:53.329344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:53.329788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:53.330207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:53.472494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:53.485370 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17205056-4766-4dab-ba00-fd699e2521fd tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1363 microversion: 2.1 time: 0.170775 Oct 27 11:11:53.485982 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3588/7372] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:53 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:54.513391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:54.514347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:54.523295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:54.523786 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:54.524226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:54.524964 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:54.525426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:54.525853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:54.669241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:54.681345 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e308c5e5-1e60-4139-8061-9d024a9a1159 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1363 microversion: 2.1 time: 0.174353 Oct 27 11:11:54.682124 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3785/7373] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:54 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:55.707227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:55.707831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:55.715295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:55.715755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:55.716184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:55.716906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:55.717370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:55.717787 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:55.855029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:55.863418 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f100245-f310-43c7-9062-e1c95e068033 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1363 microversion: 2.1 time: 0.162090 Oct 27 11:11:55.864059 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3589/7374] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:55 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:56.887621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:56.888247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:56.895992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:56.896492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:56.896981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:56.897654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:56.898160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:56.898596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:57.042233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:57.054224 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a1f7485-c373-4a9a-b165-850c4e3fbbc5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1363 microversion: 2.1 time: 0.170312 Oct 27 11:11:57.054995 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3786/7375] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:56 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:57.678973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-93b84ad9-ed43-44bc-b199-acf6ba5d160a req-99f1ea14-9760-4db7-8be7-d1f5bd6d5564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e920e02-308a-414d-ba32-4303bb369e54", "name": "network-vif-plugged", "status": "completed", "tag": "5756d340-77bd-4b4f-a813-a71dc31a4c06"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:11:57.692753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-93b84ad9-ed43-44bc-b199-acf6ba5d160a req-99f1ea14-9760-4db7-8be7-d1f5bd6d5564 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:57.693233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-93b84ad9-ed43-44bc-b199-acf6ba5d160a req-99f1ea14-9760-4db7-8be7-d1f5bd6d5564 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:57.693656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-93b84ad9-ed43-44bc-b199-acf6ba5d160a req-99f1ea14-9760-4db7-8be7-d1f5bd6d5564 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:57.709117 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-93b84ad9-ed43-44bc-b199-acf6ba5d160a req-99f1ea14-9760-4db7-8be7-d1f5bd6d5564 service nova] Creating event network-vif-plugged:5756d340-77bd-4b4f-a813-a71dc31a4c06 for instance 1e920e02-308a-414d-ba32-4303bb369e54 on n-h1-854663-10 Oct 27 11:11:57.714248 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-93b84ad9-ed43-44bc-b199-acf6ba5d160a req-99f1ea14-9760-4db7-8be7-d1f5bd6d5564 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039562 Oct 27 11:11:57.714867 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3590/7376] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:11:58.083775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:58.084350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:58.092387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:58.092957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:58.093431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:58.094189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:58.094680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:58.095148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:58.245658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:58.258609 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c31a452-873a-49d3-bf23-488dc32ee832 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1363 microversion: 2.1 time: 0.180020 Oct 27 11:11:58.259515 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3787/7377] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:58 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:59.283859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:59.284800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:59.289887 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:59.290594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:59.298208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:59.298689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:59.299129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:59.299819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:59.300270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:59.300708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:59.442631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:59.450958 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-587301ed-601a-4f42-a510-78d460a1b258 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1555 microversion: 2.1 time: 0.168738 Oct 27 11:11:59.451472 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3591/7378] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:59 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:11:59.473918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:11:59.474559 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:11:59.476528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:11:59.483028 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:59.483520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:59.483965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:59.484686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:11:59.485149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:11:59.485581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:11:59.631817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:11:59.640332 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a687915-ff06-453f-98dc-498bbd71d55d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1555 microversion: 2.1 time: 0.170388 Oct 27 11:11:59.640951 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3788/7379] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:11:59 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:01.214687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b50eeee7-01d8-41bf-a493-33b98f4dd181 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0ec8b12-3d05-4cff-919a-76d30e75b52b"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:12:01.218490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b50eeee7-01d8-41bf-a493-33b98f4dd181 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:01.229224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b50eeee7-01d8-41bf-a493-33b98f4dd181 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:01.230008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b50eeee7-01d8-41bf-a493-33b98f4dd181 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:01.230708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b50eeee7-01d8-41bf-a493-33b98f4dd181 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:01.231717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b50eeee7-01d8-41bf-a493-33b98f4dd181 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:01.232384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b50eeee7-01d8-41bf-a493-33b98f4dd181 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:01.233112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b50eeee7-01d8-41bf-a493-33b98f4dd181 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:01.498912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:01.514106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b50eeee7-01d8-41bf-a493-33b98f4dd181 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "POST /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306043 Oct 27 11:12:01.515114 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3592/7380] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 11:12:01 2022] POST /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:12.316854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:12.317438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:12.319419 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:12.320155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=70 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:12.326861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:12.327356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:12.327798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:12.328493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:12.328976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:12.329445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:12.416264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lazy-loading 'services' on Instance uuid 1e920e02-308a-414d-ba32-4303bb369e54 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:12:12.495751 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a9410d7-174a-4849-99a5-57df7598b236 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments/c0ec8b12-3d05-4cff-919a-76d30e75b52b" status: 202 len: 0 microversion: 2.1 time: 0.183049 Oct 27 11:12:12.496424 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3789/7381] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:12:12 2022] DELETE /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments/c0ec8b12-3d05-4cff-919a-76d30e75b52b => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:12:12.503710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:12.508267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0832de58-f7af-424f-ac9b-ee584e81a55b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:12.510886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0832de58-f7af-424f-ac9b-ee584e81a55b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:12.518694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0832de58-f7af-424f-ac9b-ee584e81a55b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:12.519192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0832de58-f7af-424f-ac9b-ee584e81a55b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:12.519615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0832de58-f7af-424f-ac9b-ee584e81a55b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:12.520557 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0832de58-f7af-424f-ac9b-ee584e81a55b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:12.521093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0832de58-f7af-424f-ac9b-ee584e81a55b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:12.521524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0832de58-f7af-424f-ac9b-ee584e81a55b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:12.555628 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0832de58-f7af-424f-ac9b-ee584e81a55b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054470 Oct 27 11:12:12.556164 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3593/7382] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:12 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:13.573182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-110cec9a-99fa-4407-b372-9fdfef2c0498 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:13.575675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-110cec9a-99fa-4407-b372-9fdfef2c0498 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:13.583049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-110cec9a-99fa-4407-b372-9fdfef2c0498 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:13.583856 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-110cec9a-99fa-4407-b372-9fdfef2c0498 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:13.584318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-110cec9a-99fa-4407-b372-9fdfef2c0498 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:13.585080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-110cec9a-99fa-4407-b372-9fdfef2c0498 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:13.585555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-110cec9a-99fa-4407-b372-9fdfef2c0498 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:13.586008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-110cec9a-99fa-4407-b372-9fdfef2c0498 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:13.619539 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-110cec9a-99fa-4407-b372-9fdfef2c0498 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052817 Oct 27 11:12:13.620120 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3790/7383] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:13 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:14.632629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0867cda-50b9-4f0c-835b-90e89b93dc7a tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:14.635067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0867cda-50b9-4f0c-835b-90e89b93dc7a tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:14.642530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0867cda-50b9-4f0c-835b-90e89b93dc7a tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:14.643017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0867cda-50b9-4f0c-835b-90e89b93dc7a tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:14.643461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0867cda-50b9-4f0c-835b-90e89b93dc7a tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:14.644169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0867cda-50b9-4f0c-835b-90e89b93dc7a tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:14.644640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0867cda-50b9-4f0c-835b-90e89b93dc7a tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:14.645093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0867cda-50b9-4f0c-835b-90e89b93dc7a tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:14.678686 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0867cda-50b9-4f0c-835b-90e89b93dc7a tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050200 Oct 27 11:12:14.679703 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3594/7384] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:14 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:15.691872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45469d0d-2241-4752-ac6b-58ce798f5bd9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:15.694289 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-45469d0d-2241-4752-ac6b-58ce798f5bd9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:15.701917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45469d0d-2241-4752-ac6b-58ce798f5bd9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:15.702412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45469d0d-2241-4752-ac6b-58ce798f5bd9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:15.702855 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45469d0d-2241-4752-ac6b-58ce798f5bd9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:15.703565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45469d0d-2241-4752-ac6b-58ce798f5bd9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:15.704027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45469d0d-2241-4752-ac6b-58ce798f5bd9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:15.704457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45469d0d-2241-4752-ac6b-58ce798f5bd9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:15.735683 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45469d0d-2241-4752-ac6b-58ce798f5bd9 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048043 Oct 27 11:12:15.736216 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3791/7385] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:15 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:16.752311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-63748f18-84b4-43a9-8723-99a4193f5aa7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:16.755753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-63748f18-84b4-43a9-8723-99a4193f5aa7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:16.768544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63748f18-84b4-43a9-8723-99a4193f5aa7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:16.769344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63748f18-84b4-43a9-8723-99a4193f5aa7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:16.770061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63748f18-84b4-43a9-8723-99a4193f5aa7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:16.771226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63748f18-84b4-43a9-8723-99a4193f5aa7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:16.771879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63748f18-84b4-43a9-8723-99a4193f5aa7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:16.772270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63748f18-84b4-43a9-8723-99a4193f5aa7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:16.805294 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-63748f18-84b4-43a9-8723-99a4193f5aa7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059753 Oct 27 11:12:16.805861 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3595/7386] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:16 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:17.818794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54a0524a-e59c-499e-9b90-94aa2042674b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:17.821481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54a0524a-e59c-499e-9b90-94aa2042674b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:17.829048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54a0524a-e59c-499e-9b90-94aa2042674b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:17.829557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54a0524a-e59c-499e-9b90-94aa2042674b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:17.830014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54a0524a-e59c-499e-9b90-94aa2042674b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:17.830733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54a0524a-e59c-499e-9b90-94aa2042674b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:17.831202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54a0524a-e59c-499e-9b90-94aa2042674b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:17.831617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54a0524a-e59c-499e-9b90-94aa2042674b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:17.863484 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54a0524a-e59c-499e-9b90-94aa2042674b tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049009 Oct 27 11:12:17.864079 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3792/7387] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:17 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 11:12:17.875840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:17.876378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:17.883918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:17.884394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:17.884875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:17.885581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:17.886036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:17.886464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:17.969292 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] HTTP exception thrown: Instance 1e920e02-308a-414d-ba32-4303bb369e54 is not attached to volume c0ec8b12-3d05-4cff-919a-76d30e75b52b Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Request method failure captured: Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments/c0ec8b12-3d05-4cff-919a-76d30e75b52b HTTP/1.1 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmdIvXBRvZ5v3LHlKmnZ8KN-1xRBb-MBtaJN1L38ZyeMVsXvXWIUFft6oMsLEzPjB9hYZGjZCLdnZyo7uf4flSCa-Y2-edzqlm43RIW7S3lhV9FMgu_PM7OfTNOVse-0aC9sGpwAQ-imKKszoC9CH_tcSHoLBkbDcIQ2xKZetedYwCo Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8535a9e4e1ff48c28d403513a8d513e4", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9a0a2efcee38413ab51f9eb40fbab5a0 Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 1e920e02-308a-414d-ba32-4303bb369e54 is not attached to volume c0ec8b12-3d05-4cff-919a-76d30e75b52b Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'server_id': '1e920e02-308a-414d-ba32-4303bb369e54', 'id': 'c0ec8b12-3d05-4cff-919a-76d30e75b52b'} Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c0ec8b12-3d05-4cff-919a-76d30e75b52b. Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e920e02-308a-414d-ba32-4303bb369e54 is not attached to volume c0ec8b12-3d05-4cff-919a-76d30e75b52b Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:12:17.971257 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:12:17.975319 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:12:17.975319 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:12:17.975319 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e920e02-308a-414d-ba32-4303bb369e54 is not attached to volume c0ec8b12-3d05-4cff-919a-76d30e75b52b Oct 27 11:12:17.975319 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:17.975319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Returning 404 to user: Instance 1e920e02-308a-414d-ba32-4303bb369e54 is not attached to volume c0ec8b12-3d05-4cff-919a-76d30e75b52b {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:12:17.975319 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-321b076c-26ce-424c-a300-17254be67474 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments/c0ec8b12-3d05-4cff-919a-76d30e75b52b" status: 404 len: 154 microversion: 2.1 time: 0.101123 Oct 27 11:12:17.975319 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3596/7388] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:12:17 2022] DELETE /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54/os-volume_attachments/c0ec8b12-3d05-4cff-919a-76d30e75b52b => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 11:12:21.345458 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:21.346041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:21.353585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:21.354081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:21.354536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:21.355277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:21.355852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:21.356302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:21.384034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:12:21.475849 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f88b4a0c-57af-431c-bf30-78418be54685 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 204 len: 0 microversion: 2.1 time: 0.133877 Oct 27 11:12:21.476605 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3793/7389] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:12:21 2022] DELETE /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:12:21.486501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:21.487111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:21.494406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:21.494897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:21.495320 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:21.496220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:21.496686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:21.497118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:21.641096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:21.650013 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95e5d5f4-6380-41ec-b79f-5b0ecc6843df tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1561 microversion: 2.1 time: 0.168712 Oct 27 11:12:21.650582 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3597/7390] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:21 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:22.679260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:22.679982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:22.689885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:22.690565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:22.691214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:22.692068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:22.692654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:22.693291 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:22.850911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:22.863632 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fefe828-f2b9-4827-9462-a332aaa97b22 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1561 microversion: 2.1 time: 0.191825 Oct 27 11:12:22.864562 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3794/7391] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:22 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:23.728267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2eb4a701-517d-4f25-8e27-d5988a2aa486 req-2ce3703c-2cc1-409f-a712-d19c48052d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e920e02-308a-414d-ba32-4303bb369e54", "name": "network-vif-deleted", "tag": "5756d340-77bd-4b4f-a813-a71dc31a4c06"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:12:23.750725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2eb4a701-517d-4f25-8e27-d5988a2aa486 req-2ce3703c-2cc1-409f-a712-d19c48052d74 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:23.751855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2eb4a701-517d-4f25-8e27-d5988a2aa486 req-2ce3703c-2cc1-409f-a712-d19c48052d74 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:23.752472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2eb4a701-517d-4f25-8e27-d5988a2aa486 req-2ce3703c-2cc1-409f-a712-d19c48052d74 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:23.765744 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2eb4a701-517d-4f25-8e27-d5988a2aa486 req-2ce3703c-2cc1-409f-a712-d19c48052d74 service nova] Creating event network-vif-deleted:5756d340-77bd-4b4f-a813-a71dc31a4c06 for instance 1e920e02-308a-414d-ba32-4303bb369e54 on n-h1-854663-10 Oct 27 11:12:23.771449 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2eb4a701-517d-4f25-8e27-d5988a2aa486 req-2ce3703c-2cc1-409f-a712-d19c48052d74 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047406 Oct 27 11:12:23.772628 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3598/7392] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:23.888893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:23.889521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:23.896461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:23.896981 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:23.897424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:23.898191 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:23.898646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:23.899160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:23.931250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:23.931767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:23.932211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:23.932692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lazy-loading 'fault' on Instance uuid 1e920e02-308a-414d-ba32-4303bb369e54 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:12:23.978719 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:23.987855 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-322bc422-17c8-4536-a7ce-b4afbf25ef31 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 200 len: 1353 microversion: 2.1 time: 0.103045 Oct 27 11:12:23.988472 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3795/7393] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:23 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 1353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:25.018347 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:25.019523 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 1e920e02-308a-414d-ba32-4303bb369e54] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:25.028078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:25.028586 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:25.029056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:25.029754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:25.030205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:25.030633 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:25.045169 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] HTTP exception thrown: Instance 1e920e02-308a-414d-ba32-4303bb369e54 could not be found. Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Request method failure captured: Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 HTTP/1.1 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmdIvXBRvZ5v3LHlKmnZ8KN-1xRBb-MBtaJN1L38ZyeMVsXvXWIUFft6oMsLEzPjB9hYZGjZCLdnZyo7uf4flSCa-Y2-edzqlm43RIW7S3lhV9FMgu_PM7OfTNOVse-0aC9sGpwAQ-imKKszoC9CH_tcSHoLBkbDcIQ2xKZetedYwCo Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8535a9e4e1ff48c28d403513a8d513e4", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9a0a2efcee38413ab51f9eb40fbab5a0 Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 1e920e02-308a-414d-ba32-4303bb369e54 could not be found. Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '1e920e02-308a-414d-ba32-4303bb369e54'} Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e920e02-308a-414d-ba32-4303bb369e54 could not be found. Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e920e02-308a-414d-ba32-4303bb369e54 could not be found. Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:12:25.047172 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e920e02-308a-414d-ba32-4303bb369e54 could not be found. Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Returning 404 to user: Instance 1e920e02-308a-414d-ba32-4303bb369e54 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21e2e7f2-cf6e-4d21-9f7b-2e46b39da2a0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54" status: 404 len: 111 microversion: 2.1 time: 0.039164 Oct 27 11:12:25.051572 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3599/7394] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:25 2022] GET /compute/v2.1/servers/1e920e02-308a-414d-ba32-4303bb369e54 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:12:25.058871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dcf0e2e2-3cb5-403b-a17b-b7aad8ff3736 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '.version_select at 0x7f6d585e28b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:25.082033 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dcf0e2e2-3cb5-403b-a17b-b7aad8ff3736 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2061687716" status: 202 len: 0 microversion: 2.1 time: 0.027848 Oct 27 11:12:25.082612 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3796/7395] 10.222.0.76 () {58 vars in 1278 bytes} [Thu Oct 27 11:12:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2061687716 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:12:25.100602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfb1bf4f-06dc-4d8c-8aab-357c122282d2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Action: 'create', calling method: .version_select at 0x7f6d5b310700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1230631820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALTmPe5ms9GfEpvvx6hVcgixy9uWcyl/zeGK75LBrT2ogWPW94W/EkYZ4HfGpgpYzH5I0sb4a9hkIdWgXOblAl5EJSZTxObyXrIl0JZvQw3pxzrsf7zKHBEJsMyVVoDiA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:12:25.116574 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-cfb1bf4f-06dc-4d8c-8aab-357c122282d2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:12:25.122116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-cfb1bf4f-06dc-4d8c-8aab-357c122282d2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for user 9a0a2efcee38413ab51f9eb40fbab5a0 and project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:12:25.150168 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cfb1bf4f-06dc-4d8c-8aab-357c122282d2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053637 Oct 27 11:12:25.150789 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3600/7396] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:12:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:25.206157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1698523400", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1230631820", "networks": [{"uuid": "3397e6c9-3330-441f-a644-09097176a8f1"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:12:25.276611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] validate_networks() for [('3397e6c9-3330-441f-a644-09097176a8f1', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:12:25.671679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:12:25.672713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:12:25.673550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:12:25.674210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:12:25.674787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:12:25.686941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:25.687441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:25.687897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:25.688649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:25.689150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:25.689589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:25.708532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:12:25.714450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Getting quotas for user 9a0a2efcee38413ab51f9eb40fbab5a0 and project 8535a9e4e1ff48c28d403513a8d513e4. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:12:25.727570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:12:25.730032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:12:25.781674 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-37922d7d-d51f-4524-94e2-0773c11b085c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581852 Oct 27 11:12:25.782402 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3797/7397] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:12:25.794868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ad557f61-5e5f-4391-b39a-fee09bc2737d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:25.795510 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ad557f61-5e5f-4391-b39a-fee09bc2737d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:25.852587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ad557f61-5e5f-4391-b39a-fee09bc2737d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:25.862542 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ad557f61-5e5f-4391-b39a-fee09bc2737d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1263 microversion: 2.1 time: 0.072146 Oct 27 11:12:25.862923 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3601/7398] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:25 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:26.886181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:26.886814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:26.893967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:26.894474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:26.894925 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:26.895644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:26.896110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:26.896551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:26.965804 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:26.974116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a557ea9-5833-486a-a7e2-03ba4274dcdb tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1315 microversion: 2.1 time: 0.093083 Oct 27 11:12:26.974729 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3798/7399] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:26 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1315 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:27.998504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:27.999059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:28.006223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:28.007236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:28.007715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:28.008431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:28.008944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:28.009505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:28.149298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:28.157921 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-53178292-54f7-44e4-b8f2-bf983cf52aa2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1363 microversion: 2.1 time: 0.163915 Oct 27 11:12:28.158482 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3602/7400] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:27 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:28.333181 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9302262d-821e-4a32-a84f-234824f9af16 req-69f7dbbc-1129-48f0-a5cd-77473d8d7b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "780c024a-70a9-4f60-9b81-ed251eae47b0", "tag": "f10d07f8-fa49-4df1-b3f3-3af4a6571e0b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:12:28.345173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9302262d-821e-4a32-a84f-234824f9af16 req-69f7dbbc-1129-48f0-a5cd-77473d8d7b50 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:28.345671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9302262d-821e-4a32-a84f-234824f9af16 req-69f7dbbc-1129-48f0-a5cd-77473d8d7b50 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:28.346132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9302262d-821e-4a32-a84f-234824f9af16 req-69f7dbbc-1129-48f0-a5cd-77473d8d7b50 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:28.359536 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9302262d-821e-4a32-a84f-234824f9af16 req-69f7dbbc-1129-48f0-a5cd-77473d8d7b50 service nova] Creating event network-changed:f10d07f8-fa49-4df1-b3f3-3af4a6571e0b for instance 780c024a-70a9-4f60-9b81-ed251eae47b0 on n-h1-854663-10 Oct 27 11:12:28.364532 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9302262d-821e-4a32-a84f-234824f9af16 req-69f7dbbc-1129-48f0-a5cd-77473d8d7b50 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035081 Oct 27 11:12:28.365377 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3799/7401] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:12:29.183043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:29.183650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:29.190724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:29.191207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:29.191648 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:29.192345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:29.192825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:29.193251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:29.336550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:29.345327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc8fb276-ae18-4c5e-ba7a-05bd2cda9799 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1363 microversion: 2.1 time: 0.166604 Oct 27 11:12:29.345916 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3603/7402] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:29 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:30.369864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:30.370581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:30.377516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:30.378017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:30.378473 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:30.379190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:30.379657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:30.380098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:30.515895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:30.524322 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e59b9ee-8f92-4c78-8f45-98096947bc6d tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1363 microversion: 2.1 time: 0.160259 Oct 27 11:12:30.525141 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3800/7403] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:30 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:31.552839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:31.553806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:31.562199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:31.562695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:31.563161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:31.563934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:31.564386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:31.564869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:31.712118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:31.720284 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a698d08e-61dd-4519-9cd3-4a3bd2b2c3b2 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1363 microversion: 2.1 time: 0.174404 Oct 27 11:12:31.720881 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3604/7404] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:31 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:32.747409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:32.748160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:32.758898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:32.759680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:32.760134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:32.760967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:32.761428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:32.761859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:32.909660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:32.918586 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce29de76-d19a-41df-b9ea-b43afce79f39 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1363 microversion: 2.1 time: 0.177428 Oct 27 11:12:32.919158 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3801/7405] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:32 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:33.941879 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:33.942492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:33.950001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:33.950478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:33.950911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:33.951585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:33.952039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:33.952458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:34.090771 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:34.099065 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-64874e2d-f3a6-44b8-8f9a-96bf65e2d31f tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1363 microversion: 2.1 time: 0.161142 Oct 27 11:12:34.099701 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3605/7406] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:33 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:35.127574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:35.128638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:35.138792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:35.139288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:35.139731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:35.140430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:35.140928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:35.141360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:35.275363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:35.284119 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f302d2f-f5fe-432d-a3c9-ee555ba0d6f8 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1363 microversion: 2.1 time: 0.163249 Oct 27 11:12:35.284690 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3802/7407] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:35 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:35.858133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:35.887426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b42fe040-ceb5-461d-8fee-a19ff7d2988e req-1eb65f36-c698-4f9e-ad64-b1a53fb8f22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780c024a-70a9-4f60-9b81-ed251eae47b0", "name": "network-vif-plugged", "status": "completed", "tag": "f10d07f8-fa49-4df1-b3f3-3af4a6571e0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:12:35.897145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b42fe040-ceb5-461d-8fee-a19ff7d2988e req-1eb65f36-c698-4f9e-ad64-b1a53fb8f22e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:35.898299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b42fe040-ceb5-461d-8fee-a19ff7d2988e req-1eb65f36-c698-4f9e-ad64-b1a53fb8f22e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:35.898299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b42fe040-ceb5-461d-8fee-a19ff7d2988e req-1eb65f36-c698-4f9e-ad64-b1a53fb8f22e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:35.909691 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b42fe040-ceb5-461d-8fee-a19ff7d2988e req-1eb65f36-c698-4f9e-ad64-b1a53fb8f22e service nova] Creating event network-vif-plugged:f10d07f8-fa49-4df1-b3f3-3af4a6571e0b for instance 780c024a-70a9-4f60-9b81-ed251eae47b0 on n-h1-854663-10 Oct 27 11:12:35.914682 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b42fe040-ceb5-461d-8fee-a19ff7d2988e req-1eb65f36-c698-4f9e-ad64-b1a53fb8f22e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091130 Oct 27 11:12:35.915269 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3606/7408] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:36.309377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:36.309990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:36.311987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:36.312803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:36.319641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:36.320248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:36.320800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:36.321847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:36.322491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:36.323177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:36.470276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:36.478196 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8d14da7-467f-48d3-a018-d1c90fe1b3ff tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1363 microversion: 2.1 time: 0.173659 Oct 27 11:12:36.478797 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3803/7409] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:36 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:37.503470 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:37.504050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:37.511398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:37.511880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:37.512318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:37.513053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:37.513513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:37.513943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:37.651142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:37.659421 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59ee9e81-db3b-4fdf-b352-563d8706f204 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1555 microversion: 2.1 time: 0.161277 Oct 27 11:12:37.660004 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3607/7410] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:37 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:37.692534 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:37.693202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:37.703441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:37.704119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:37.704640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:37.705685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:37.706239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:37.706689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:37.844356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:37.856846 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0075e00f-02b7-4b48-a544-a8d76b8aa906 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1555 microversion: 2.1 time: 0.170326 Oct 27 11:12:37.857656 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3804/7411] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:37 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:12:39.398432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d9274fd6-4dba-4b6c-a2db-1d8ccbebfd41 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2c67e8d-fcbb-48c7-95f0-706995eb6c88"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:12:39.401292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d9274fd6-4dba-4b6c-a2db-1d8ccbebfd41 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:39.409498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9274fd6-4dba-4b6c-a2db-1d8ccbebfd41 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:39.409990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9274fd6-4dba-4b6c-a2db-1d8ccbebfd41 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:39.410708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9274fd6-4dba-4b6c-a2db-1d8ccbebfd41 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:39.411936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9274fd6-4dba-4b6c-a2db-1d8ccbebfd41 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:39.412730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9274fd6-4dba-4b6c-a2db-1d8ccbebfd41 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:39.413502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d9274fd6-4dba-4b6c-a2db-1d8ccbebfd41 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:39.702642 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d9274fd6-4dba-4b6c-a2db-1d8ccbebfd41 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "POST /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307572 Oct 27 11:12:39.703714 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3608/7412] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 11:12:39 2022] POST /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:50.497069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:50.497689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:50.500041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:50.500754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:50.508154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:50.508677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:50.509137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:50.509980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:50.510437 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:50.510866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:50.596612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lazy-loading 'services' on Instance uuid 780c024a-70a9-4f60-9b81-ed251eae47b0 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:12:50.671092 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32534bd2-fd83-4d99-8fc0-c98d523830d5 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments/a2c67e8d-fcbb-48c7-95f0-706995eb6c88" status: 202 len: 0 microversion: 2.1 time: 0.178459 Oct 27 11:12:50.672197 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3805/7413] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:12:50 2022] DELETE /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments/a2c67e8d-fcbb-48c7-95f0-706995eb6c88 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:12:50.679364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:50.681158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:12:50.686286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1039dc0c-03c3-47f7-8e4c-00d1983a471c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:50.688741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1039dc0c-03c3-47f7-8e4c-00d1983a471c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:50.696474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1039dc0c-03c3-47f7-8e4c-00d1983a471c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:50.696997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1039dc0c-03c3-47f7-8e4c-00d1983a471c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:50.697467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1039dc0c-03c3-47f7-8e4c-00d1983a471c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:50.698177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1039dc0c-03c3-47f7-8e4c-00d1983a471c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:50.698631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1039dc0c-03c3-47f7-8e4c-00d1983a471c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:50.699057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1039dc0c-03c3-47f7-8e4c-00d1983a471c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:50.732916 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1039dc0c-03c3-47f7-8e4c-00d1983a471c tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055508 Oct 27 11:12:50.739425 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3609/7414] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:50 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:51.747902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3111f64-79a4-4161-8bbb-88ecf8bf14be tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:51.750224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3111f64-79a4-4161-8bbb-88ecf8bf14be tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:51.757768 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3111f64-79a4-4161-8bbb-88ecf8bf14be tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:51.758259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3111f64-79a4-4161-8bbb-88ecf8bf14be tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:51.758697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3111f64-79a4-4161-8bbb-88ecf8bf14be tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:51.759395 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3111f64-79a4-4161-8bbb-88ecf8bf14be tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:51.759854 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3111f64-79a4-4161-8bbb-88ecf8bf14be tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:51.760284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3111f64-79a4-4161-8bbb-88ecf8bf14be tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:51.791842 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3111f64-79a4-4161-8bbb-88ecf8bf14be tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048480 Oct 27 11:12:51.792774 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3806/7415] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:51 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:52.804888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8478d61d-0a77-4ffc-9543-6d09d0e4c910 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:52.807517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8478d61d-0a77-4ffc-9543-6d09d0e4c910 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:52.815305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8478d61d-0a77-4ffc-9543-6d09d0e4c910 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:52.815798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8478d61d-0a77-4ffc-9543-6d09d0e4c910 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:52.816222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8478d61d-0a77-4ffc-9543-6d09d0e4c910 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:52.816969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8478d61d-0a77-4ffc-9543-6d09d0e4c910 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:52.817455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8478d61d-0a77-4ffc-9543-6d09d0e4c910 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:52.817964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8478d61d-0a77-4ffc-9543-6d09d0e4c910 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:52.854031 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8478d61d-0a77-4ffc-9543-6d09d0e4c910 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053140 Oct 27 11:12:52.858709 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3610/7416] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:52 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:53.867244 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30125178-caf7-4e1a-b963-ad9502d26346 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:53.869936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30125178-caf7-4e1a-b963-ad9502d26346 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:53.877996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30125178-caf7-4e1a-b963-ad9502d26346 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:53.878429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30125178-caf7-4e1a-b963-ad9502d26346 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:53.878884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30125178-caf7-4e1a-b963-ad9502d26346 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:53.879633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30125178-caf7-4e1a-b963-ad9502d26346 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:53.880129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30125178-caf7-4e1a-b963-ad9502d26346 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:53.880542 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30125178-caf7-4e1a-b963-ad9502d26346 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:53.914280 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30125178-caf7-4e1a-b963-ad9502d26346 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051149 Oct 27 11:12:53.914850 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3807/7417] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:53 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:54.928081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59d6659a-2b7b-4bcf-931f-3bb499c93dd7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:54.930638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-59d6659a-2b7b-4bcf-931f-3bb499c93dd7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:54.938413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59d6659a-2b7b-4bcf-931f-3bb499c93dd7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:54.938911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59d6659a-2b7b-4bcf-931f-3bb499c93dd7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:54.939354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59d6659a-2b7b-4bcf-931f-3bb499c93dd7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:54.940061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59d6659a-2b7b-4bcf-931f-3bb499c93dd7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:54.940551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59d6659a-2b7b-4bcf-931f-3bb499c93dd7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:54.941003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59d6659a-2b7b-4bcf-931f-3bb499c93dd7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:54.973694 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59d6659a-2b7b-4bcf-931f-3bb499c93dd7 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049841 Oct 27 11:12:54.974271 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3611/7418] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:54 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:12:55.986736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3f1ebcc-05fb-4879-976b-ecdd1451db00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:55.989252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3f1ebcc-05fb-4879-976b-ecdd1451db00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:55.996946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f1ebcc-05fb-4879-976b-ecdd1451db00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:55.997446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f1ebcc-05fb-4879-976b-ecdd1451db00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:55.997903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f1ebcc-05fb-4879-976b-ecdd1451db00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:55.998608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f1ebcc-05fb-4879-976b-ecdd1451db00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:55.999070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f1ebcc-05fb-4879-976b-ecdd1451db00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:55.999506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f1ebcc-05fb-4879-976b-ecdd1451db00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:56.031210 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3f1ebcc-05fb-4879-976b-ecdd1451db00 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048584 Oct 27 11:12:56.031793 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3808/7419] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:12:55 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 11:12:56.046512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:56.047691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:56.057730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:56.058222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:56.058662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:56.059361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:56.059824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:56.060253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:56.148804 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] HTTP exception thrown: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 is not attached to volume a2c67e8d-fcbb-48c7-95f0-706995eb6c88 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Request method failure captured: Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments/a2c67e8d-fcbb-48c7-95f0-706995eb6c88 HTTP/1.1 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmdIvXBRvZ5v3LHlKmnZ8KN-1xRBb-MBtaJN1L38ZyeMVsXvXWIUFft6oMsLEzPjB9hYZGjZCLdnZyo7uf4flSCa-Y2-edzqlm43RIW7S3lhV9FMgu_PM7OfTNOVse-0aC9sGpwAQ-imKKszoC9CH_tcSHoLBkbDcIQ2xKZetedYwCo Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8535a9e4e1ff48c28d403513a8d513e4", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9a0a2efcee38413ab51f9eb40fbab5a0 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 is not attached to volume a2c67e8d-fcbb-48c7-95f0-706995eb6c88 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'server_id': '780c024a-70a9-4f60-9b81-ed251eae47b0', 'id': 'a2c67e8d-fcbb-48c7-95f0-706995eb6c88'} Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a2c67e8d-fcbb-48c7-95f0-706995eb6c88. Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 is not attached to volume a2c67e8d-fcbb-48c7-95f0-706995eb6c88 Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:12:56.151205 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:12:56.155697 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:12:56.155697 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:12:56.155697 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 is not attached to volume a2c67e8d-fcbb-48c7-95f0-706995eb6c88 Oct 27 11:12:56.155697 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:12:56.155697 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Returning 404 to user: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 is not attached to volume a2c67e8d-fcbb-48c7-95f0-706995eb6c88 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:12:56.155697 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a4e2eb6-7a1b-45a4-85f8-ee9d65276fb0 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments/a2c67e8d-fcbb-48c7-95f0-706995eb6c88" status: 404 len: 154 microversion: 2.1 time: 0.113456 Oct 27 11:12:56.155697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3612/7420] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:12:56 2022] DELETE /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0/os-volume_attachments/a2c67e8d-fcbb-48c7-95f0-706995eb6c88 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:12:59.515914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:59.516434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:59.523816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:59.524302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:59.524782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:59.525491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:59.525952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:59.526383 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:59.555115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:12:59.640054 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48ea0d48-367c-4dce-b32b-cb702a56f057 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 204 len: 0 microversion: 2.1 time: 0.127909 Oct 27 11:12:59.640947 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3809/7421] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:12:59 2022] DELETE /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:12:59.650899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:12:59.651537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:12:59.658918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:59.659473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:59.659976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:59.660750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:12:59.661368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:12:59.661792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:12:59.802468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:12:59.810831 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7ee95d9c-a519-4ddb-a5da-16b99e559563 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1561 microversion: 2.1 time: 0.164377 Oct 27 11:12:59.811410 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3613/7422] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:12:59 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:00.839549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:00.840626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:00.851797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:00.852558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:00.853514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:00.854557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:00.855046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:00.855484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:00.993224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:01.002320 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47010fd2-ebd6-4350-b194-93a47ce142af tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1561 microversion: 2.1 time: 0.169559 Oct 27 11:13:01.002872 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3810/7423] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:00 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:01.958681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-bd0e945b-ded1-4568-849d-eebe3e075dd3 req-f983a920-ac14-4062-8609-de36bdf2cf9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780c024a-70a9-4f60-9b81-ed251eae47b0", "name": "network-vif-deleted", "tag": "f10d07f8-fa49-4df1-b3f3-3af4a6571e0b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:13:01.970718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bd0e945b-ded1-4568-849d-eebe3e075dd3 req-f983a920-ac14-4062-8609-de36bdf2cf9e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:01.971463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bd0e945b-ded1-4568-849d-eebe3e075dd3 req-f983a920-ac14-4062-8609-de36bdf2cf9e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:01.971968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bd0e945b-ded1-4568-849d-eebe3e075dd3 req-f983a920-ac14-4062-8609-de36bdf2cf9e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:01.985141 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-bd0e945b-ded1-4568-849d-eebe3e075dd3 req-f983a920-ac14-4062-8609-de36bdf2cf9e service nova] Creating event network-vif-deleted:f10d07f8-fa49-4df1-b3f3-3af4a6571e0b for instance 780c024a-70a9-4f60-9b81-ed251eae47b0 on n-h1-854663-10 Oct 27 11:13:01.990751 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-bd0e945b-ded1-4568-849d-eebe3e075dd3 req-f983a920-ac14-4062-8609-de36bdf2cf9e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035956 Oct 27 11:13:01.991395 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3614/7424] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:13:02.025967 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:02.026775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:02.034465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:02.035276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:02.036080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:02.037063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:02.037529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:02.037970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:02.111064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0a2efcee38413ab51f9eb40fbab5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8535a9e4e1ff48c28d403513a8d513e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:02.119573 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3252fe7f-27cf-43e9-8b70-74bf3ae58610 tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 200 len: 1348 microversion: 2.1 time: 0.097688 Oct 27 11:13:02.120200 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3811/7425] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:02 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:03.147734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:03.148509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] [instance: 780c024a-70a9-4f60-9b81-ed251eae47b0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:03.157313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:03.157942 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:03.158500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:03.159333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:03.159934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:03.160475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:03.177230 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] HTTP exception thrown: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 could not be found. Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Request method failure captured: Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 HTTP/1.1 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmdIvXBRvZ5v3LHlKmnZ8KN-1xRBb-MBtaJN1L38ZyeMVsXvXWIUFft6oMsLEzPjB9hYZGjZCLdnZyo7uf4flSCa-Y2-edzqlm43RIW7S3lhV9FMgu_PM7OfTNOVse-0aC9sGpwAQ-imKKszoC9CH_tcSHoLBkbDcIQ2xKZetedYwCo Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8535a9e4e1ff48c28d403513a8d513e4", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8535a9e4e1ff48c28d403513a8d513e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 8535a9e4e1ff48c28d403513a8d513e4 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-948447137 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 9a0a2efcee38413ab51f9eb40fbab5a0 Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestEncryptedCinderVolumes-948447137-project Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 could not be found. Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '780c024a-70a9-4f60-9b81-ed251eae47b0'} Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 could not be found. Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 could not be found. Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:13:03.178872 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 could not be found. Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Returning 404 to user: Instance 780c024a-70a9-4f60-9b81-ed251eae47b0 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bcb5ab92-12b4-4e75-958f-dbe7d4cb063e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0" status: 404 len: 111 microversion: 2.1 time: 0.039883 Oct 27 11:13:03.183752 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3615/7426] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:03 2022] GET /compute/v2.1/servers/780c024a-70a9-4f60-9b81-ed251eae47b0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:13:03.189973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f442342-13b1-40cc-818f-adfdc9ce718e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] Calling method '.version_select at 0x7f6d606430d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:03.214761 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f442342-13b1-40cc-818f-adfdc9ce718e tempest-TestEncryptedCinderVolumes-948447137 tempest-TestEncryptedCinderVolumes-948447137-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1230631820" status: 202 len: 0 microversion: 2.1 time: 0.028725 Oct 27 11:13:03.215519 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3812/7427] 10.222.0.76 () {58 vars in 1278 bytes} [Thu Oct 27 11:13:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1230631820 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:13:30.214299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-352ce062-1fa6-438e-8dec-8a363e75e329 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'create', calling method: .version_select at 0x7f6d5a87f5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1974812204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnCAKzYjZQhS7EsRlclL9ZhFdwexJHVi07A1/pn/WbJDr7ky/hvrzc9D3FC1aUat/8ViFAc2puNh6wMWeGwUSTVl9ne3bMIJd9AqGCW9GfpohBHFz9ZXlld1tY40lFh/w=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:13:30.220102 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=14 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:13:30.220786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=34 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:13:30.234838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-352ce062-1fa6-438e-8dec-8a363e75e329 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Getting quotas for project 2bdc00887761460ea894c5ebeb254774. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:13:30.240200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-352ce062-1fa6-438e-8dec-8a363e75e329 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Getting quotas for user 71006f8916b141f9aabddc9c4870633d and project 2bdc00887761460ea894c5ebeb254774. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:13:30.266232 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-352ce062-1fa6-438e-8dec-8a363e75e329 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056140 Oct 27 11:13:30.266839 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3616/7428] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:13:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:13:30.323460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:13:30.324307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:13:30.329871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-693942251", "imageRef": "b409585e-869a-41a2-9460-f9ebfd6d475e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1974812204", "networks": [{"uuid": "6b53bc50-3717-42af-914e-ebe9d46966f2"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:13:30.383272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] validate_networks() for [('6b53bc50-3717-42af-914e-ebe9d46966f2', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:13:30.801013 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:13:30.801691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:13:30.802484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:13:30.803196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:13:30.803898 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:13:30.819199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:30.819852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:30.820476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:30.821675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:30.822388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:30.822990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:30.843781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Getting quotas for project 2bdc00887761460ea894c5ebeb254774. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:13:30.849720 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Getting quotas for user 71006f8916b141f9aabddc9c4870633d and project 2bdc00887761460ea894c5ebeb254774. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:13:30.863613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:13:30.865887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b409585e-869a-41a2-9460-f9ebfd6d475e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:13:30.927515 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f5bb3aa-f6f2-4dbc-a5db-76efab9355c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606070 Oct 27 11:13:30.928706 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3813/7429] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:13:30.940747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6da5fd24-d78e-4776-8357-5f76a5463f6a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:30.941486 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6da5fd24-d78e-4776-8357-5f76a5463f6a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:31.021419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6da5fd24-d78e-4776-8357-5f76a5463f6a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:31.028906 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6da5fd24-d78e-4776-8357-5f76a5463f6a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1258 microversion: 2.1 time: 0.093066 Oct 27 11:13:31.029493 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3617/7430] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:30 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1258 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:32.055482 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:32.056090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:32.064729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:32.065387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:32.065817 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:32.066531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:32.066992 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:32.067431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:32.136086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:32.146844 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-becaea00-0d1b-4cb1-99de-58d1fcf773f6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1318 microversion: 2.1 time: 0.098246 Oct 27 11:13:32.147744 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3814/7431] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:32 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:33.170431 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:33.171037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:33.179738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:33.180216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:33.180644 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:33.183460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:33.184162 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:33.184975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:33.327639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:33.341077 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2964d1eb-78bf-47e7-8d0c-ffbd33e88b16 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.174420 Oct 27 11:13:33.342301 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3618/7432] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:33 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:34.366945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:34.367504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:34.378995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:34.380276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:34.381047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:34.382086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:34.383106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:34.383820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:34.836292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:34.844473 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9b2a2146-4f39-4f98-95a6-ebff31ed95b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.482015 Oct 27 11:13:34.845426 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3815/7433] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:34 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:35.871469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:35.872129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:35.884418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:35.885061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:35.885715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:35.886600 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:35.887263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:35.887747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:36.049636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:36.057930 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd3b0332-13a4-4717-964b-30410e44a273 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.193027 Oct 27 11:13:36.058544 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3619/7434] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:35 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:37.081407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:37.082034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:37.089133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:37.089633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:37.090110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:37.090809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:37.091274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:37.091700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:37.242345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:37.266316 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ca8bf96-d0c9-4386-8549-330242ffa9a8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.187089 Oct 27 11:13:37.269575 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3816/7435] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:37 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:38.292689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:38.293371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:38.301247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:38.301747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:38.302186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:38.302898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:38.303352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:38.303781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:38.470717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:38.478985 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b9b1ab68-0396-437e-8336-a68654be29e4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.190373 Oct 27 11:13:38.480108 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3620/7436] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:38 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:39.505658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:39.507355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:39.515026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:39.515610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:39.516114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:39.517052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:39.517563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:39.518101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:39.662068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:39.670117 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2cb2e214-530e-4b79-b594-78cf7716109a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.170808 Oct 27 11:13:39.670688 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3817/7437] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:39 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:40.694788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:40.695416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:40.702312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:40.702826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:40.703242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:40.703943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:40.704511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:40.705106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:40.855947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:40.865463 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b13db1d-d27a-40e4-997f-f7a18e6e7e79 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.175462 Oct 27 11:13:40.866066 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3621/7438] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:40 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:41.895758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:41.896388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:41.899231 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:13:41.899939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:13:41.905568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:41.906089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:41.906554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:41.907258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:41.907886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:41.908327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:42.236152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-afaa009c-1915-4d94-bbf9-476d8a594764 req-79377b5e-4306-4a8c-ac5a-742c576e3722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4", "tag": "9fb7c5ce-5792-438a-b1c4-47e471f9839d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:13:42.242456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:13:42.255132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-afaa009c-1915-4d94-bbf9-476d8a594764 req-79377b5e-4306-4a8c-ac5a-742c576e3722 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:42.255623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-afaa009c-1915-4d94-bbf9-476d8a594764 req-79377b5e-4306-4a8c-ac5a-742c576e3722 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:42.256323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-afaa009c-1915-4d94-bbf9-476d8a594764 req-79377b5e-4306-4a8c-ac5a-742c576e3722 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:42.269194 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-afaa009c-1915-4d94-bbf9-476d8a594764 req-79377b5e-4306-4a8c-ac5a-742c576e3722 service nova] Creating event network-changed:9fb7c5ce-5792-438a-b1c4-47e471f9839d for instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 on n-h1-854663-10 Oct 27 11:13:42.274921 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-afaa009c-1915-4d94-bbf9-476d8a594764 req-79377b5e-4306-4a8c-ac5a-742c576e3722 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046934 Oct 27 11:13:42.275889 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3622/7439] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:13:42.411717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:42.419771 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9bdb47b0-e747-48a1-bd31-7d112f000590 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.528063 Oct 27 11:13:42.420359 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3818/7440] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:41 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:43.445024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:43.445726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:43.452603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:43.453118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:43.453556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:43.454323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:43.454782 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:43.455212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:43.602833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:43.611825 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c8d2f474-aa30-49cd-a5af-02e60d41755e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.172029 Oct 27 11:13:43.612387 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3623/7441] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:43 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:44.638993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:44.639985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:44.655789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:44.656550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:44.657509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:44.658282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:44.658745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:44.659175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:44.794225 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:44.807129 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96e8d8b6-ec7b-4f32-a601-3fa44422c8b6 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.174104 Oct 27 11:13:44.808043 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3819/7442] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:44 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:45.832052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:45.832709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:45.840085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:45.840570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:45.841049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:45.841739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:45.842188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:45.842605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:45.981739 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:45.989853 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea729455-c519-4c54-bfea-d2e9673055fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.162061 Oct 27 11:13:45.990436 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3624/7443] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:45 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:47.017954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:47.018959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:47.030672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:47.031533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:47.032302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:47.033754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:47.034612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:47.035463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:47.178332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:47.191632 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-51ac91e6-511e-41b4-bf7a-9f62d7f49fa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.180447 Oct 27 11:13:47.192526 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3820/7444] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:47 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:48.131109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3419bb3e-8864-472a-a3fd-4d1b765a49f0 req-626b8723-f2a5-4555-be51-2037a77a2052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4", "name": "network-vif-plugged", "status": "completed", "tag": "9fb7c5ce-5792-438a-b1c4-47e471f9839d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:13:48.140890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3419bb3e-8864-472a-a3fd-4d1b765a49f0 req-626b8723-f2a5-4555-be51-2037a77a2052 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:48.141368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3419bb3e-8864-472a-a3fd-4d1b765a49f0 req-626b8723-f2a5-4555-be51-2037a77a2052 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:48.142155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3419bb3e-8864-472a-a3fd-4d1b765a49f0 req-626b8723-f2a5-4555-be51-2037a77a2052 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:48.153839 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3419bb3e-8864-472a-a3fd-4d1b765a49f0 req-626b8723-f2a5-4555-be51-2037a77a2052 service nova] Creating event network-vif-plugged:9fb7c5ce-5792-438a-b1c4-47e471f9839d for instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 on n-h1-854663-10 Oct 27 11:13:48.159094 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3419bb3e-8864-472a-a3fd-4d1b765a49f0 req-626b8723-f2a5-4555-be51-2037a77a2052 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033824 Oct 27 11:13:48.159744 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3625/7445] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:13:48.220317 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:48.220922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:48.228612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:48.229159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:48.229601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:48.230300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:48.230760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:48.231183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:48.364204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:48.372256 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3c710c3-7e60-4478-b3b8-4315b3c9ab30 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.156551 Oct 27 11:13:48.372863 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3821/7446] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:48 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:49.399067 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:49.400477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:49.407596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:49.408107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:49.408571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:49.409349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:49.409832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:49.410247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:49.550799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:49.559709 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80adfbf6-fb4d-464e-a5be-bf73f254a622 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1358 microversion: 2.1 time: 0.166120 Oct 27 11:13:49.560343 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3626/7447] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:49 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:50.586577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:50.587543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:50.597664 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:50.598164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:50.598605 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:50.599309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:50.599769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:50.600198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:50.745230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:50.754099 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87556efa-504e-48c4-bee9-51a3633678ab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1547 microversion: 2.1 time: 0.173670 Oct 27 11:13:50.754686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3822/7448] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:50 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:50.776575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:50.777222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:50.784686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:50.785207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:50.785641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:50.786344 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:50.786830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:50.787252 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:50.930502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:50.938890 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-667a9bfc-939a-44ce-adeb-d5b9dc85cd26 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1547 microversion: 2.1 time: 0.166262 Oct 27 11:13:50.945029 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3627/7449] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:50 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:50.964353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:50.969180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:50.969960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Searching by: {'deleted': False, 'project_id': '2bdc00887761460ea894c5ebeb254774'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 11:13:50.975922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:50.976407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:50.976887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:50.977594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:50.978054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:50.978481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:51.003846 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 11:13:51.031192 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8a47e1b-0146-42be-a21e-279832e8ee74 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070595 Oct 27 11:13:51.031793 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3823/7450] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 11:13:50 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:13:51.043916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:13:51.044537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:51.051639 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:51.052123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:51.052592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:51.053353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:51.053774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:51.054192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:51.212261 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:13:51.221714 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd59a8e0-c169-408e-a9b2-a79df6c052b3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1547 microversion: 2.1 time: 0.181440 Oct 27 11:13:51.222351 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3628/7451] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:13:51 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1547 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:13:52.830514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74a36ea4-042e-4a34-bf0d-3881b41f3266 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f67ad2d8-502a-4095-9dcb-3ecd6b750939"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:13:52.833293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74a36ea4-042e-4a34-bf0d-3881b41f3266 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:13:52.840544 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74a36ea4-042e-4a34-bf0d-3881b41f3266 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:52.841075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74a36ea4-042e-4a34-bf0d-3881b41f3266 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:52.841527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74a36ea4-042e-4a34-bf0d-3881b41f3266 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:52.842230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74a36ea4-042e-4a34-bf0d-3881b41f3266 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:13:52.842688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74a36ea4-042e-4a34-bf0d-3881b41f3266 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:13:52.843128 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74a36ea4-042e-4a34-bf0d-3881b41f3266 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:13:53.120320 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74a36ea4-042e-4a34-bf0d-3881b41f3266 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293715 Oct 27 11:13:53.120972 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3824/7452] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 11:13:52 2022] POST /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:14:06.301476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:14:06.302384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:14:06.306959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:14:06.307757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=58 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:14:06.314273 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:14:06.314948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:14:06.315570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:14:06.316796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:14:06.317550 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:14:06.318081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:14:06.455755 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:14:06.464388 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0824ac44-4892-4c94-ae6c-1db401f988b1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1593 microversion: 2.1 time: 0.169492 Oct 27 11:14:06.465018 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3629/7453] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:14:06 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1593 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:14:08.243546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:14:08.244335 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:14:08.245043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:14:08.249666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e5e9ff20-25ae-4e7b-8177-4d62e4335518 req-c292922e-b6f2-42ef-8e51-b00ef5d53786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4", "tag": "9fb7c5ce-5792-438a-b1c4-47e471f9839d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:14:08.261921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e5e9ff20-25ae-4e7b-8177-4d62e4335518 req-c292922e-b6f2-42ef-8e51-b00ef5d53786 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:14:08.262467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e5e9ff20-25ae-4e7b-8177-4d62e4335518 req-c292922e-b6f2-42ef-8e51-b00ef5d53786 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:14:08.262885 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e5e9ff20-25ae-4e7b-8177-4d62e4335518 req-c292922e-b6f2-42ef-8e51-b00ef5d53786 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:14:08.276242 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e5e9ff20-25ae-4e7b-8177-4d62e4335518 req-c292922e-b6f2-42ef-8e51-b00ef5d53786 service nova] Creating event network-changed:9fb7c5ce-5792-438a-b1c4-47e471f9839d for instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 on n-h1-854663-10 Oct 27 11:14:08.282354 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e5e9ff20-25ae-4e7b-8177-4d62e4335518 req-c292922e-b6f2-42ef-8e51-b00ef5d53786 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040656 Oct 27 11:14:08.283187 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3825/7454] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:14:09.278835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-765705795"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:14:09.279427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:14:09.286773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:14:09.287268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:14:09.287730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:14:09.288497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:14:09.288987 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:14:09.289416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:14:09.423994 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.network.security_group_api [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Adding security group d0d22408-6298-4044-8607-aa01dc27e6f2 to port 9fb7c5ce-5792-438a-b1c4-47e471f9839d Oct 27 11:14:09.760906 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d59865bd-eee1-435f-9bad-b9cccd1b7eaa tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/action" status: 202 len: 0 microversion: 2.1 time: 0.486086 Oct 27 11:14:09.761626 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3630/7455] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:14:09 2022] POST /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 11:14:09.771732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:14:09.778405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:14:09.788472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:14:09.789642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:14:09.790259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:14:09.791155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:14:09.791784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:14:09.792608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:14:09.923462 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a62778e5-9ca1-4366-89d6-ba8434e8df9e req-54869339-dacb-4076-9e6e-3e5b84d72778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4", "tag": "9fb7c5ce-5792-438a-b1c4-47e471f9839d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:14:09.935177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a62778e5-9ca1-4366-89d6-ba8434e8df9e req-54869339-dacb-4076-9e6e-3e5b84d72778 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:14:09.936142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a62778e5-9ca1-4366-89d6-ba8434e8df9e req-54869339-dacb-4076-9e6e-3e5b84d72778 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:14:09.936779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a62778e5-9ca1-4366-89d6-ba8434e8df9e req-54869339-dacb-4076-9e6e-3e5b84d72778 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:14:09.951757 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a62778e5-9ca1-4366-89d6-ba8434e8df9e req-54869339-dacb-4076-9e6e-3e5b84d72778 service nova] Creating event network-changed:9fb7c5ce-5792-438a-b1c4-47e471f9839d for instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 on n-h1-854663-10 Oct 27 11:14:09.961042 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a62778e5-9ca1-4366-89d6-ba8434e8df9e req-54869339-dacb-4076-9e6e-3e5b84d72778 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187259 Oct 27 11:14:09.962244 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3631/7456] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:14:09.969971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:14:09.979564 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a29f2c36-8faf-4564-b669-6876c654f9c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1758 microversion: 2.1 time: 0.213424 Oct 27 11:14:09.980168 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3826/7457] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:14:09 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1758 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:15:52.366296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:15:52.367104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:15:52.368474 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:15:52.368692 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:15:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/action (ip 10.222.0.76) !!! Oct 27 11:15:52.374629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d13e43b6-d380-4c9d-a091-b5734f6d6946 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:15:52.377149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d13e43b6-d380-4c9d-a091-b5734f6d6946 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:15:52.385926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d13e43b6-d380-4c9d-a091-b5734f6d6946 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:15:52.386411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d13e43b6-d380-4c9d-a091-b5734f6d6946 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:15:52.386851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d13e43b6-d380-4c9d-a091-b5734f6d6946 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:15:52.387601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d13e43b6-d380-4c9d-a091-b5734f6d6946 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:15:52.388157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d13e43b6-d380-4c9d-a091-b5734f6d6946 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:15:52.388584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d13e43b6-d380-4c9d-a091-b5734f6d6946 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:15:52.469531 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d13e43b6-d380-4c9d-a091-b5734f6d6946 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/action" status: 202 len: 0 microversion: 2.1 time: 0.105743 Oct 27 11:15:52.470320 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3632/7458] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:15:52 2022] POST /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:15:52.476811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:15:52.477612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:15:52.479112 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:15:52.479280 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:15:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 (ip 10.222.0.76) !!! Oct 27 11:15:52.484971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:15:52.485602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:15:52.496275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:15:52.496924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:15:52.497659 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:15:52.498393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:15:52.498866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:15:52.499321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:15:52.655018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:15:52.664004 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-beabd045-1cb8-42f4-9d93-2e8ef13ca4fd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1760 microversion: 2.1 time: 0.189226 Oct 27 11:15:52.664598 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3827/7459] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:15:52 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1760 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:15:53.689565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:15:53.690276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:15:53.697101 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:15:53.697583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:15:53.698016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:15:53.698710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:15:53.699160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:15:53.699579 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:15:53.856086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:15:53.864965 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-70d2ff5c-80ea-411b-a1ce-dda17f4c1999 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1758 microversion: 2.1 time: 0.180628 Oct 27 11:15:53.865550 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3633/7460] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:15:53 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:10.681413 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96cdc9e5-e02f-4d91-99be-23d737d0e4ff] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 11:17:10.682568 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0fef263e-49f6-40e0-92a9-76f7527873a5] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 11:17:10.683305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:10.684421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:10.691267 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-765705795"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:17:10.692216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:10.699249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:10.699739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:10.700183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:10.700914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:10.701452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:10.701887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:10.946829 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Removing security group d0d22408-6298-4044-8607-aa01dc27e6f2 from port 9fb7c5ce-5792-438a-b1c4-47e471f9839d Oct 27 11:17:11.287824 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1412bc4-87f0-4f22-afe2-c29511d90219 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/action" status: 202 len: 0 microversion: 2.1 time: 0.609638 Oct 27 11:17:11.291553 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3828/7461] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:17:10 2022] POST /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:17:11.293452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:11.294229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:11.298767 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e970cdc4-5b1c-460c-8bcc-3ff0b3fccd2b req-252c13c6-762c-493a-9ab0-5f01cb1ab2df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4", "tag": "9fb7c5ce-5792-438a-b1c4-47e471f9839d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:17:11.310945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e970cdc4-5b1c-460c-8bcc-3ff0b3fccd2b req-252c13c6-762c-493a-9ab0-5f01cb1ab2df service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:11.311473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e970cdc4-5b1c-460c-8bcc-3ff0b3fccd2b req-252c13c6-762c-493a-9ab0-5f01cb1ab2df service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:11.311894 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e970cdc4-5b1c-460c-8bcc-3ff0b3fccd2b req-252c13c6-762c-493a-9ab0-5f01cb1ab2df service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:11.325735 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e970cdc4-5b1c-460c-8bcc-3ff0b3fccd2b req-252c13c6-762c-493a-9ab0-5f01cb1ab2df service nova] Creating event network-changed:9fb7c5ce-5792-438a-b1c4-47e471f9839d for instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 on n-h1-854663-10 Oct 27 11:17:11.333107 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e970cdc4-5b1c-460c-8bcc-3ff0b3fccd2b req-252c13c6-762c-493a-9ab0-5f01cb1ab2df service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041120 Oct 27 11:17:11.334247 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3634/7462] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:12.515452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:12.516572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:12.530342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:12.530841 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:12.531288 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:12.532192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:12.532677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:12.533134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:12.533782 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [96cdc9e5-e02f-4d91-99be-23d737d0e4ff] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 50586. Oct 27 11:17:12.539677 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [0fef263e-49f6-40e0-92a9-76f7527873a5] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 50588. Oct 27 11:17:12.622186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lazy-loading 'services' on Instance uuid c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:17:12.704494 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [7a24d499-0313-40e8-9e0a-3b27bb72710e] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 11:17:13.351097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-15089553-cab2-4af7-bebb-a4ac17aea7b2 req-bec487d6-f65c-498b-87dd-c5f011a721d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4", "tag": "9fb7c5ce-5792-438a-b1c4-47e471f9839d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:17:13.364749 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-15089553-cab2-4af7-bebb-a4ac17aea7b2 req-bec487d6-f65c-498b-87dd-c5f011a721d4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:13.365152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-15089553-cab2-4af7-bebb-a4ac17aea7b2 req-bec487d6-f65c-498b-87dd-c5f011a721d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:13.365581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-15089553-cab2-4af7-bebb-a4ac17aea7b2 req-bec487d6-f65c-498b-87dd-c5f011a721d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:13.381518 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-15089553-cab2-4af7-bebb-a4ac17aea7b2 req-bec487d6-f65c-498b-87dd-c5f011a721d4 service nova] Creating event network-changed:9fb7c5ce-5792-438a-b1c4-47e471f9839d for instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 on n-h1-854663-10 Oct 27 11:17:13.387278 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-15089553-cab2-4af7-bebb-a4ac17aea7b2 req-bec487d6-f65c-498b-87dd-c5f011a721d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041371 Oct 27 11:17:13.387879 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3635/7463] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:13.712493 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [7a24d499-0313-40e8-9e0a-3b27bb72710e] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 50596. Oct 27 11:17:13.716894 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-507e512f-d4b1-459b-91e5-f3b92a6515b2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments/f67ad2d8-502a-4095-9dcb-3ecd6b750939" status: 202 len: 0 microversion: 2.1 time: 1.208645 Oct 27 11:17:13.717512 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3829/7464] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:17:12 2022] DELETE /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments/f67ad2d8-502a-4095-9dcb-3ecd6b750939 => generated 0 bytes in 1210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:17:13.726707 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e7dc7570-8194-42d9-a11b-39d5765cf7fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:13.729035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e7dc7570-8194-42d9-a11b-39d5765cf7fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:13.736404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7dc7570-8194-42d9-a11b-39d5765cf7fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:13.736921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7dc7570-8194-42d9-a11b-39d5765cf7fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:13.737357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7dc7570-8194-42d9-a11b-39d5765cf7fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:13.738082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7dc7570-8194-42d9-a11b-39d5765cf7fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:13.738565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7dc7570-8194-42d9-a11b-39d5765cf7fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:13.739020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7dc7570-8194-42d9-a11b-39d5765cf7fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:13.771778 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e7dc7570-8194-42d9-a11b-39d5765cf7fe tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048984 Oct 27 11:17:13.772901 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3636/7465] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:17:13 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:14.787109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0042c1d7-8752-4b0a-83e9-da7db5066621 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:14.790899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0042c1d7-8752-4b0a-83e9-da7db5066621 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:14.802132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0042c1d7-8752-4b0a-83e9-da7db5066621 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:14.802656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0042c1d7-8752-4b0a-83e9-da7db5066621 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:14.803104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0042c1d7-8752-4b0a-83e9-da7db5066621 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:14.803840 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0042c1d7-8752-4b0a-83e9-da7db5066621 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:14.804319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0042c1d7-8752-4b0a-83e9-da7db5066621 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:14.804770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0042c1d7-8752-4b0a-83e9-da7db5066621 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:14.835015 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0042c1d7-8752-4b0a-83e9-da7db5066621 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053200 Oct 27 11:17:14.835592 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3830/7466] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:17:14 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:15.848545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c25dbb9-3e38-4609-affa-60f42cf008c5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:15.850929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c25dbb9-3e38-4609-affa-60f42cf008c5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:15.858405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c25dbb9-3e38-4609-affa-60f42cf008c5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:15.858892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c25dbb9-3e38-4609-affa-60f42cf008c5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:15.859331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c25dbb9-3e38-4609-affa-60f42cf008c5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:15.860056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c25dbb9-3e38-4609-affa-60f42cf008c5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:15.860616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c25dbb9-3e38-4609-affa-60f42cf008c5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:15.861070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c25dbb9-3e38-4609-affa-60f42cf008c5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:15.894287 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c25dbb9-3e38-4609-affa-60f42cf008c5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050196 Oct 27 11:17:15.894930 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3637/7467] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:17:15 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:16.907736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66f12aab-fcd5-49b7-828b-f6d93a42d231 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:16.910119 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66f12aab-fcd5-49b7-828b-f6d93a42d231 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:16.918292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f12aab-fcd5-49b7-828b-f6d93a42d231 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:16.918723 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f12aab-fcd5-49b7-828b-f6d93a42d231 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:16.919197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f12aab-fcd5-49b7-828b-f6d93a42d231 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:16.919913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f12aab-fcd5-49b7-828b-f6d93a42d231 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:16.920378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f12aab-fcd5-49b7-828b-f6d93a42d231 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:16.920933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66f12aab-fcd5-49b7-828b-f6d93a42d231 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:16.952288 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66f12aab-fcd5-49b7-828b-f6d93a42d231 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048728 Oct 27 11:17:16.952893 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3831/7468] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:17:16 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:17.965385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c43bca57-6b52-41fb-8969-be9584ab80f4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:17.967607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c43bca57-6b52-41fb-8969-be9584ab80f4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:17.974885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c43bca57-6b52-41fb-8969-be9584ab80f4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:17.975369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c43bca57-6b52-41fb-8969-be9584ab80f4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:17.975800 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c43bca57-6b52-41fb-8969-be9584ab80f4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:17.976499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c43bca57-6b52-41fb-8969-be9584ab80f4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:17.976962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c43bca57-6b52-41fb-8969-be9584ab80f4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:17.977384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c43bca57-6b52-41fb-8969-be9584ab80f4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:18.008375 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c43bca57-6b52-41fb-8969-be9584ab80f4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047041 Oct 27 11:17:18.008971 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3638/7469] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:17:17 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:19.025495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62aec5d5-1127-4f20-be9b-df46d296abf7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:19.028941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62aec5d5-1127-4f20-be9b-df46d296abf7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:19.039633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62aec5d5-1127-4f20-be9b-df46d296abf7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:19.040129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62aec5d5-1127-4f20-be9b-df46d296abf7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:19.040567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62aec5d5-1127-4f20-be9b-df46d296abf7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:19.041308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62aec5d5-1127-4f20-be9b-df46d296abf7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:19.041764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62aec5d5-1127-4f20-be9b-df46d296abf7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:19.042198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62aec5d5-1127-4f20-be9b-df46d296abf7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:19.073605 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62aec5d5-1127-4f20-be9b-df46d296abf7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055259 Oct 27 11:17:19.074175 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3832/7470] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:17:19 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 11:17:19.085671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:19.086201 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:19.093786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:19.094275 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:19.094714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:19.095415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:19.095871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:19.096302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:19.289717 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] HTTP exception thrown: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 is not attached to volume f67ad2d8-502a-4095-9dcb-3ecd6b750939 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Request method failure captured: Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments/f67ad2d8-502a-4095-9dcb-3ecd6b750939 HTTP/1.1 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmfLL3GWD8X8OPxJq8yXntRZQs0heR_EHDFF3jN4GL3PHvfNyf2XLJ0UWiSzBZWCp64SwWrsSw3vqj3ITSUut_E2yCoaT6TBeEXUfyOuBpdfQjuRVNDJtBEg5e7V440CLk4XS2n_ti8qZOQj9TEYEebsjWDae8_YQs7qnZmT4P4Sz4w Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2bdc00887761460ea894c5ebeb254774 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2bdc00887761460ea894c5ebeb254774", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2bdc00887761460ea894c5ebeb254774 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestMinimumBasicScenario-1695158375-project Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 71006f8916b141f9aabddc9c4870633d Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestMinimumBasicScenario-1695158375-project Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 is not attached to volume f67ad2d8-502a-4095-9dcb-3ecd6b750939 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'server_id': 'c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4', 'id': 'f67ad2d8-502a-4095-9dcb-3ecd6b750939'} Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f67ad2d8-502a-4095-9dcb-3ecd6b750939. Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 is not attached to volume f67ad2d8-502a-4095-9dcb-3ecd6b750939 Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:17:19.291364 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:17:19.296143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:17:19.296143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:17:19.296143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 is not attached to volume f67ad2d8-502a-4095-9dcb-3ecd6b750939 Oct 27 11:17:19.296143 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:19.296143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Returning 404 to user: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 is not attached to volume f67ad2d8-502a-4095-9dcb-3ecd6b750939 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:17:19.296143 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7135ced9-e18a-4951-a470-dccfd79c43c1 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments/f67ad2d8-502a-4095-9dcb-3ecd6b750939" status: 404 len: 154 microversion: 2.1 time: 0.211594 Oct 27 11:17:19.296143 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3639/7471] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:17:19 2022] DELETE /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4/os-volume_attachments/f67ad2d8-502a-4095-9dcb-3ecd6b750939 => generated 154 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:17:22.554055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:22.554618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:22.562139 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:22.562711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:22.563217 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:22.564031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:22.564573 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:22.565059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:22.591990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:17:22.683384 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a523b5f3-0824-4cee-a284-3464dcaba59b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 204 len: 0 microversion: 2.1 time: 0.133154 Oct 27 11:17:22.683895 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3833/7472] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:17:22 2022] DELETE /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:17:22.694786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:22.695419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:22.703367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:22.703858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:22.704300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:22.705308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:22.705777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:22.706232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:22.846960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:22.855277 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ab0dee83-d82e-47c3-9718-06ceb80e8897 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1553 microversion: 2.1 time: 0.166666 Oct 27 11:17:22.855859 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3640/7473] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:22 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:23.885520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:23.886700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:23.898357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:23.898869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:23.899311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:23.900012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:23.900478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:23.901062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:24.039742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:24.048694 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a7239897-a947-48ee-af68-0f3a696ec01a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1553 microversion: 2.1 time: 0.171610 Oct 27 11:17:24.049316 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3834/7474] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:23 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:25.074204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:25.074855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:25.082443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:25.082932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:25.083367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:25.084098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:25.084809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:25.085472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:25.157103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-327dfebe-d11e-413b-b2e1-d1d76dbc0dd8 req-9b87dead-aa0e-4171-96a1-106d9e66fed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4", "name": "network-vif-deleted", "tag": "9fb7c5ce-5792-438a-b1c4-47e471f9839d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:17:25.165296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:25.169490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-327dfebe-d11e-413b-b2e1-d1d76dbc0dd8 req-9b87dead-aa0e-4171-96a1-106d9e66fed9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:25.170198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-327dfebe-d11e-413b-b2e1-d1d76dbc0dd8 req-9b87dead-aa0e-4171-96a1-106d9e66fed9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:25.170760 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-327dfebe-d11e-413b-b2e1-d1d76dbc0dd8 req-9b87dead-aa0e-4171-96a1-106d9e66fed9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:25.174418 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-385b31ef-90eb-4511-9034-f70e8b2027d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 200 len: 1511 microversion: 2.1 time: 0.104223 Oct 27 11:17:25.175200 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3641/7475] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:25 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 1511 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:25.184148 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-327dfebe-d11e-413b-b2e1-d1d76dbc0dd8 req-9b87dead-aa0e-4171-96a1-106d9e66fed9 service nova] Creating event network-vif-deleted:9fb7c5ce-5792-438a-b1c4-47e471f9839d for instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 on n-h1-854663-10 Oct 27 11:17:25.194267 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-327dfebe-d11e-413b-b2e1-d1d76dbc0dd8 req-9b87dead-aa0e-4171-96a1-106d9e66fed9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113364 Oct 27 11:17:25.194902 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3835/7476] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:26.200630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:26.201270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:26.208944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:26.209437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:26.209882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:26.210923 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:26.211505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:26.211941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:26.226834 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] HTTP exception thrown: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 could not be found. Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Request method failure captured: Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 HTTP/1.1 Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmfLL3GWD8X8OPxJq8yXntRZQs0heR_EHDFF3jN4GL3PHvfNyf2XLJ0UWiSzBZWCp64SwWrsSw3vqj3ITSUut_E2yCoaT6TBeEXUfyOuBpdfQjuRVNDJtBEg5e7V440CLk4XS2n_ti8qZOQj9TEYEebsjWDae8_YQs7qnZmT4P4Sz4w Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2bdc00887761460ea894c5ebeb254774 Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2bdc00887761460ea894c5ebeb254774", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2bdc00887761460ea894c5ebeb254774 Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestMinimumBasicScenario-1695158375-project Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 71006f8916b141f9aabddc9c4870633d Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestMinimumBasicScenario-1695158375-project Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 could not be found. Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4'} Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 could not be found. Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 could not be found. Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:17:26.228361 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 could not be found. Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Returning 404 to user: Instance c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc33bf18-90f3-472d-95b6-dac787cefbbc tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4" status: 404 len: 111 microversion: 2.1 time: 0.033320 Oct 27 11:17:26.233120 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3642/7477] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:26 2022] GET /compute/v2.1/servers/c4304a9e-95b6-4fa4-801d-3da5ebf8fdd4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 11:17:26.240519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69408d7e-8f00-4552-a4ec-d1d5629640c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '.version_select at 0x7f6d58515d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:26.267982 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69408d7e-8f00-4552-a4ec-d1d5629640c7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1974812204" status: 202 len: 0 microversion: 2.1 time: 0.032854 Oct 27 11:17:26.268566 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3836/7478] 10.222.0.76 () {58 vars in 1272 bytes} [Thu Oct 27 11:17:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1974812204 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:17:35.487677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b852ebf-321d-4e41-918b-379f9677b95c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'create', calling method: .version_select at 0x7f6d5abbd0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-417973066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWkmr2owEYdvByEo51J67wEX8l4wlMEj3reEqgZAF/cA3bFM0u5n3gOsHbAZbHHJAIW//f3cMxDKmd0Xjdw1YeBxSdYWRp4nzu72D4YuzXHDEY0tPFz7OnGWqmLDRBcUw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:17:35.495244 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:17:35.495394 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:17:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.76) !!! Oct 27 11:17:35.509581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-8b852ebf-321d-4e41-918b-379f9677b95c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Getting quotas for project 2bdc00887761460ea894c5ebeb254774. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:17:35.514851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-8b852ebf-321d-4e41-918b-379f9677b95c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Getting quotas for user 71006f8916b141f9aabddc9c4870633d and project 2bdc00887761460ea894c5ebeb254774. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:17:35.546211 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b852ebf-321d-4e41-918b-379f9677b95c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062653 Oct 27 11:17:35.546816 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3643/7479] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:17:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:35.604930 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:17:35.605469 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:17:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Oct 27 11:17:35.606748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:35.612685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1453070113", "imageRef": "1d785146-5414-4a8e-9b38-542dc862dffa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-417973066", "networks": [{"uuid": "6b53bc50-3717-42af-914e-ebe9d46966f2"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:17:35.672071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] validate_networks() for [('6b53bc50-3717-42af-914e-ebe9d46966f2', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:17:36.122021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:17:36.122689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:17:36.123428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:17:36.124098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:17:36.124813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:17:36.139337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:36.140060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:36.140745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:36.141950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:36.142635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:36.143275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:36.163733 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Getting quotas for project 2bdc00887761460ea894c5ebeb254774. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:17:36.169068 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Getting quotas for user 71006f8916b141f9aabddc9c4870633d and project 2bdc00887761460ea894c5ebeb254774. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:17:36.181987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:17:36.184397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d785146-5414-4a8e-9b38-542dc862dffa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:17:36.233375 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-208f47a0-75d6-4660-8cb2-ac6b494b154b tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630018 Oct 27 11:17:36.234261 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3837/7480] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:17:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:17:36.246056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=42 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:36.250384 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e13c5a52-f727-4840-b31f-9b08b494a8df tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:36.251098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e13c5a52-f727-4840-b31f-9b08b494a8df tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:36.310387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e13c5a52-f727-4840-b31f-9b08b494a8df tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:36.317488 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e13c5a52-f727-4840-b31f-9b08b494a8df tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1258 microversion: 2.1 time: 0.072144 Oct 27 11:17:36.318062 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3644/7481] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:36 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:37.342797 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:37.343405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:37.350849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:37.351342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:37.351795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:37.352695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:37.353141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:37.353584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:37.420389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:37.429101 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4e4d53a-1f28-408c-8943-d81ffa3ed204 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1310 microversion: 2.1 time: 0.091161 Oct 27 11:17:37.429902 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3838/7482] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:37 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:38.454692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:38.456632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:38.491843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:38.492350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:38.493035 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:38.493807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:38.494420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:38.494844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:38.753270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:38.762553 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0be2e05d-0d8a-4d63-a992-332c21631ff3 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.312365 Oct 27 11:17:38.768243 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3645/7483] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:38 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:39.470247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ad383160-8db7-4592-8244-76f34524038c req-b784fc1e-61e4-47f1-abaa-9d646972f23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddacb15-0009-4211-bb29-a085b55e3cce", "tag": "1967cecf-1063-453d-9cdc-5aec81666986"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:17:39.500250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ad383160-8db7-4592-8244-76f34524038c req-b784fc1e-61e4-47f1-abaa-9d646972f23d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:39.501086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ad383160-8db7-4592-8244-76f34524038c req-b784fc1e-61e4-47f1-abaa-9d646972f23d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:39.501681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ad383160-8db7-4592-8244-76f34524038c req-b784fc1e-61e4-47f1-abaa-9d646972f23d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:39.542205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ad383160-8db7-4592-8244-76f34524038c req-b784fc1e-61e4-47f1-abaa-9d646972f23d service nova] Creating event network-changed:1967cecf-1063-453d-9cdc-5aec81666986 for instance 2ddacb15-0009-4211-bb29-a085b55e3cce on n-h1-854663-10 Oct 27 11:17:39.550925 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ad383160-8db7-4592-8244-76f34524038c req-b784fc1e-61e4-47f1-abaa-9d646972f23d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084397 Oct 27 11:17:39.553173 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3839/7484] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:39.794723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:39.795376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:39.802933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:39.803433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:39.803828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:39.804530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:39.805426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:39.806007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:39.958901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:39.968502 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-adc7207f-4777-459b-8994-d5281395656d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.177492 Oct 27 11:17:39.970028 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3646/7485] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:39 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:40.993169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:40.993851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:40.995861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:41.003061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:41.003732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:41.004415 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:41.005165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:41.005639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:41.006077 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:41.152414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:41.160385 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b07f6513-ff53-446b-b139-4ee846138654 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.172489 Oct 27 11:17:41.161625 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3840/7486] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:40 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:42.186662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:42.187505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:42.190321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:42.199151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:42.199727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:42.200224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:42.201215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:42.201668 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:42.202092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:42.348544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:42.357556 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3711d0a0-6142-4590-8512-cec443569aa7 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.174860 Oct 27 11:17:42.358154 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3647/7487] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:42 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:43.382650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:43.383390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:43.401639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:43.402161 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:43.402623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:43.403372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:43.403844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:43.404363 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:43.581636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:43.591176 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-93ba10b1-09ea-4e94-a445-5e081b76519c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.212916 Oct 27 11:17:43.600284 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3841/7488] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:43 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:44.619622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:44.620253 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:44.628747 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:44.629847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:44.630634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:44.631850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:44.632778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:44.633933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:44.788063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:44.796951 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1eb3be4-5d4b-4d10-b80b-ca2f1cd6b61c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.181961 Oct 27 11:17:44.797895 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3648/7489] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:44 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:45.820748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:45.821397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:45.832274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:45.833030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:45.833676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:45.834705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:45.835373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:45.835955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:45.971303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:45.979573 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee1fcdfa-187f-4d7c-bbd8-bc1fbd9314ca tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.162876 Oct 27 11:17:45.980263 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3842/7490] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:45 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:17:47.006838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:47.007901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:47.011625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:47.017428 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:47.017914 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:47.018349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:47.019050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:47.019503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:47.019941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:47.170721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:47.182041 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-74ec7ea0-0a95-490b-9941-da81cf1a0d71 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.181460 Oct 27 11:17:47.182639 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3649/7491] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:46 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:48.209682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:48.210727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:48.214014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:48.215150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:17:48.226094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:48.226954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:48.227682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:48.228919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:48.229474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:48.229927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:48.370060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:48.378181 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ebaa54cd-2532-4796-9d22-078dc72d7e11 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.175225 Oct 27 11:17:48.378775 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3843/7492] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:48 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:49.403666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:49.404255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:49.411840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:49.412328 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:49.412799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:49.413532 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:49.414010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:49.414432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:49.554968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:49.563399 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7fc46c8e-bc09-4165-b082-6f9ad65a4c23 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.163790 Oct 27 11:17:49.563969 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3650/7493] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:49 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:50.589776 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:50.590658 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:50.600543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:50.601259 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:50.601897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:50.602845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:50.603463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:50.604286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:50.741468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:50.753794 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4d715c6-2a80-4687-852c-d1b015d31130 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.169438 Oct 27 11:17:50.754692 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3844/7494] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:50 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:51.261245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1b481742-cf90-4238-b1e5-4b1b60bcd645 req-bc605d53-b27f-49ce-95cf-f623e49a7a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddacb15-0009-4211-bb29-a085b55e3cce", "name": "network-vif-plugged", "status": "completed", "tag": "1967cecf-1063-453d-9cdc-5aec81666986"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:17:51.270933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1b481742-cf90-4238-b1e5-4b1b60bcd645 req-bc605d53-b27f-49ce-95cf-f623e49a7a0d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:51.271421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1b481742-cf90-4238-b1e5-4b1b60bcd645 req-bc605d53-b27f-49ce-95cf-f623e49a7a0d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:51.271849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1b481742-cf90-4238-b1e5-4b1b60bcd645 req-bc605d53-b27f-49ce-95cf-f623e49a7a0d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:51.286809 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1b481742-cf90-4238-b1e5-4b1b60bcd645 req-bc605d53-b27f-49ce-95cf-f623e49a7a0d service nova] Creating event network-vif-plugged:1967cecf-1063-453d-9cdc-5aec81666986 for instance 2ddacb15-0009-4211-bb29-a085b55e3cce on n-h1-854663-10 Oct 27 11:17:51.292706 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1b481742-cf90-4238-b1e5-4b1b60bcd645 req-bc605d53-b27f-49ce-95cf-f623e49a7a0d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092266 Oct 27 11:17:51.293548 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3651/7495] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:51.780321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:51.780959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:51.788788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:51.789295 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:51.789742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:51.790454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:51.790922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:51.791391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:51.930004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:51.942633 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f08e10ce-7c60-4d69-b258-b3623dc5c44a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1358 microversion: 2.1 time: 0.166581 Oct 27 11:17:51.943473 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3845/7496] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:51 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:52.970004 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:52.970736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:52.977565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:52.978069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:52.978499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:52.979222 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:52.979698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:52.980106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:53.120978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:53.129043 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d2fcd418-cedf-43c9-8065-831228f24667 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1548 microversion: 2.1 time: 0.164180 Oct 27 11:17:53.129604 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3652/7497] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:52 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:53.152278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:53.152954 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:53.160361 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:53.160905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:53.161362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:53.162088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:53.162581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:53.163030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:53.305474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:53.314048 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ea8bacf-b587-455b-a387-acda4803d5d2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1548 microversion: 2.1 time: 0.165996 Oct 27 11:17:53.314647 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3846/7498] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:53 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:53.336859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:53.341863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:53.342632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Searching by: {'deleted': False, 'project_id': '2bdc00887761460ea894c5ebeb254774'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 11:17:53.348748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:53.349271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:53.349688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:53.350438 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:53.350928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:53.351314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:53.378998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 11:17:53.408683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9396e635-71c6-43c1-a06b-6c576eac652a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.075811 Oct 27 11:17:53.409705 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3653/7499] 10.222.0.76 () {58 vars in 1125 bytes} [Thu Oct 27 11:17:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:17:53.424386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:17:53.425269 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:53.434427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:53.435045 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:53.435639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:53.436716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:53.437318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:53.437886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:53.581391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:17:53.589514 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-292511da-3578-4ae8-ae75-7945b8d546f2 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1548 microversion: 2.1 time: 0.171585 Oct 27 11:17:53.590124 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3847/7500] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:17:53 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:17:55.133285 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8eeb8f4b-b147-447c-9f58-482d604cdfb8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a8d286d-4083-427c-b470-210cf80c68b0"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:17:55.135776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8eeb8f4b-b147-447c-9f58-482d604cdfb8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:17:55.143092 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eeb8f4b-b147-447c-9f58-482d604cdfb8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:55.143571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eeb8f4b-b147-447c-9f58-482d604cdfb8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:55.144034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eeb8f4b-b147-447c-9f58-482d604cdfb8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:55.144718 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eeb8f4b-b147-447c-9f58-482d604cdfb8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:17:55.145190 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eeb8f4b-b147-447c-9f58-482d604cdfb8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:17:55.145615 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eeb8f4b-b147-447c-9f58-482d604cdfb8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:17:55.407508 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8eeb8f4b-b147-447c-9f58-482d604cdfb8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278152 Oct 27 11:17:55.408156 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3654/7501] 10.222.0.76 () {60 vars in 1323 bytes} [Thu Oct 27 11:17:55 2022] POST /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:18:06.243961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:06.244615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:06.247576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=15 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:18:06.248270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=58 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:18:06.257203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:06.257924 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:06.258598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:06.259713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:06.260428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:06.260917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:06.396592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:06.405641 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-580855cb-8c52-4d68-b783-f4948d7af891 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1594 microversion: 2.1 time: 0.165554 Oct 27 11:18:06.406292 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3848/7502] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:06 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:08.438702 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:18:08.439490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=15 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:18:08.440450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:18:08.445911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4bbded3b-0473-4a80-998c-ced0aae344be req-1c2abf2a-d9e2-482e-a359-45ffe4a63fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddacb15-0009-4211-bb29-a085b55e3cce", "tag": "1967cecf-1063-453d-9cdc-5aec81666986"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:18:08.457862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4bbded3b-0473-4a80-998c-ced0aae344be req-1c2abf2a-d9e2-482e-a359-45ffe4a63fa7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:08.458385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4bbded3b-0473-4a80-998c-ced0aae344be req-1c2abf2a-d9e2-482e-a359-45ffe4a63fa7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:08.458813 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4bbded3b-0473-4a80-998c-ced0aae344be req-1c2abf2a-d9e2-482e-a359-45ffe4a63fa7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:08.472862 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4bbded3b-0473-4a80-998c-ced0aae344be req-1c2abf2a-d9e2-482e-a359-45ffe4a63fa7 service nova] Creating event network-changed:1967cecf-1063-453d-9cdc-5aec81666986 for instance 2ddacb15-0009-4211-bb29-a085b55e3cce on n-h1-854663-10 Oct 27 11:18:08.478599 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4bbded3b-0473-4a80-998c-ced0aae344be req-1c2abf2a-d9e2-482e-a359-45ffe4a63fa7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041971 Oct 27 11:18:08.479540 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3655/7503] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:18:09.607043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1355661635"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:18:09.607816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:09.615342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:09.615950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:09.616434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:09.617347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:09.617919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:09.618449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:09.751922 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Adding security group ff9ffe74-766d-440a-be71-7db146683727 to port 1967cecf-1063-453d-9cdc-5aec81666986 Oct 27 11:18:10.094185 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28bab0f9-c884-40eb-80cc-b7bb2eaa935c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/action" status: 202 len: 0 microversion: 2.1 time: 0.491126 Oct 27 11:18:10.095473 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3849/7504] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:18:09 2022] POST /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:18:10.104921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:10.105632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:10.113131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:10.113626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:10.114066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:10.115687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:10.116151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:10.116606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:10.266738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:10.275366 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a0ae3fe-7145-49a6-a1bf-abf593953933 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1760 microversion: 2.1 time: 0.175374 Oct 27 11:18:10.276134 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3656/7505] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:10 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:10.495576 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-650665b5-932e-4a16-8a3a-ea307ed6ad29 req-89b4e14b-31f6-4a6e-aec6-e03e8ea07c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddacb15-0009-4211-bb29-a085b55e3cce", "tag": "1967cecf-1063-453d-9cdc-5aec81666986"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:18:10.506389 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-650665b5-932e-4a16-8a3a-ea307ed6ad29 req-89b4e14b-31f6-4a6e-aec6-e03e8ea07c28 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:10.507018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-650665b5-932e-4a16-8a3a-ea307ed6ad29 req-89b4e14b-31f6-4a6e-aec6-e03e8ea07c28 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:10.507574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-650665b5-932e-4a16-8a3a-ea307ed6ad29 req-89b4e14b-31f6-4a6e-aec6-e03e8ea07c28 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:10.523522 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-650665b5-932e-4a16-8a3a-ea307ed6ad29 req-89b4e14b-31f6-4a6e-aec6-e03e8ea07c28 service nova] Creating event network-changed:1967cecf-1063-453d-9cdc-5aec81666986 for instance 2ddacb15-0009-4211-bb29-a085b55e3cce on n-h1-854663-10 Oct 27 11:18:10.530130 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-650665b5-932e-4a16-8a3a-ea307ed6ad29 req-89b4e14b-31f6-4a6e-aec6-e03e8ea07c28 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038755 Oct 27 11:18:10.530846 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3850/7506] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:18:32.961890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:18:32.962613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:18:33.011803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-130205c3-4d7e-4392-bcdf-eb00fcd9ab18 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:18:33.014202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-130205c3-4d7e-4392-bcdf-eb00fcd9ab18 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:33.020731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130205c3-4d7e-4392-bcdf-eb00fcd9ab18 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:33.021421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130205c3-4d7e-4392-bcdf-eb00fcd9ab18 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:33.021866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130205c3-4d7e-4392-bcdf-eb00fcd9ab18 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:33.022531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130205c3-4d7e-4392-bcdf-eb00fcd9ab18 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:33.022983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130205c3-4d7e-4392-bcdf-eb00fcd9ab18 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:33.023418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130205c3-4d7e-4392-bcdf-eb00fcd9ab18 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:33.107537 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-130205c3-4d7e-4392-bcdf-eb00fcd9ab18 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/action" status: 202 len: 0 microversion: 2.1 time: 0.153028 Oct 27 11:18:33.108193 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3657/7507] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:18:32 2022] POST /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:18:33.115145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:18:33.115922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:18:33.120090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:33.120844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:33.128121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:33.128908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:33.129444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:33.130502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:33.130695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:33.131138 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:33.293735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:33.303570 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c496e1f-3959-4a79-b86e-422cd5d60a0c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1752 microversion: 2.1 time: 0.190781 Oct 27 11:18:33.304169 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3851/7508] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:33 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1752 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:34.330323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:34.330908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:34.338801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:34.339336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:34.339830 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:34.340608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:34.341177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:34.341675 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:34.501829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:34.515896 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5db78c4b-c29d-4ed1-a964-feb34ba930fb tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.191291 Oct 27 11:18:34.516711 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3658/7509] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:34 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:35.546537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:35.547940 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:35.560449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:35.561342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:35.562093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:35.563258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:35.564024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:35.564751 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:35.718132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:35.729196 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e22ea6f3-9bba-4954-a773-8ced91bac70f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.189348 Oct 27 11:18:35.729781 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3852/7510] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:35 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:36.755278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:36.756147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:36.766177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:36.766847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:36.767451 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:36.768409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:36.769066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:36.769592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:36.931925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:36.940971 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5aace73d-7701-44a3-a5a9-1000a010e00c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.191118 Oct 27 11:18:36.941551 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3659/7511] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:36 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:37.975807 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:37.976690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:37.984169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:37.984697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:37.985144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:37.985858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:37.986321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:37.986762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:38.150637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:38.159633 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2089457d-cdcb-40db-861f-3a8fca76b567 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.190736 Oct 27 11:18:38.160222 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3853/7512] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:37 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:39.186955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:39.187925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:39.197349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:39.197829 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:39.198264 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:39.198958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:39.199399 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:39.199821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:39.348078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:39.357189 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5912e116-fa69-4b34-a20b-dfb95104c58f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.176488 Oct 27 11:18:39.357779 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3660/7513] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:39 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:40.381036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:40.381711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:40.389294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:40.389790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:40.390238 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:40.390946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:40.391411 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:40.391848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:40.540116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:40.549258 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-755d5c85-ecdf-49fb-8a7f-70215051d8d5 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.172393 Oct 27 11:18:40.549855 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3854/7514] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:40 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:41.578303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:41.579148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:41.588808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:41.589514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:41.590134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:41.591103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:41.591743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:41.592368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:41.746842 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:41.755665 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73e63de5-5132-43a9-8bb0-b290eefd2612 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.183305 Oct 27 11:18:41.756248 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3661/7515] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:41 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:42.788766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:42.789731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:42.796829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:42.797690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:42.798148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:42.798918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:42.799397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:42.799842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:42.958587 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:42.968484 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ab3cc27-be0a-472a-950e-748800820298 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.185684 Oct 27 11:18:42.969111 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3855/7516] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:42 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:43.995132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:43.995740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:44.006422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:44.007012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:44.007572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:44.008403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:44.008892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:44.009298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:44.170359 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:44.182905 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d35ea65d-c147-4a0f-94e1-8cedfe50fd3f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.194399 Oct 27 11:18:44.183499 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3662/7517] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:43 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:45.207765 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:45.208506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:45.216207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:45.216695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:45.217183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:45.217905 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:45.218372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:45.218808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:45.387262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:45.399066 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72df194b-52ce-42bf-bb3f-383733135a1f tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.195259 Oct 27 11:18:45.399662 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3856/7518] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:45 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:46.428304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:46.428979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:46.436460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:46.436966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:46.437403 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:46.438100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:46.438563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:46.438985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:46.591944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:46.605198 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87ff9748-96aa-43c0-a7f9-f1a5edb37cab tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.180627 Oct 27 11:18:46.606018 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3663/7519] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:46 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:47.630362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:47.630984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:47.638343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:47.639101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:47.639577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:47.640281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:47.640784 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:47.641219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:47.794574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:47.805422 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b6a5276-d638-49e3-b548-44ab6e13634a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.179363 Oct 27 11:18:47.806018 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3857/7520] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:47 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:48.830877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:48.831578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:48.838895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:48.839411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:48.839845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:48.840554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:48.841047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:48.841504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:48.996597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:49.005627 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a9df1bf-a2ec-4db4-9ebf-5a3ff813ec24 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1757 microversion: 2.1 time: 0.178869 Oct 27 11:18:49.006210 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3664/7521] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:48 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:18:50.032047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:18:50.033175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:18:50.040625 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:50.041156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:50.041602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:50.042308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:18:50.042772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:18:50.043223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:18:50.199313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:18:50.209819 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f231ee1-9fdc-4e4a-8199-64011c65cb39 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1760 microversion: 2.1 time: 0.183273 Oct 27 11:18:50.210402 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3858/7522] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:18:50 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1760 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:19:22.772976 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1355661635"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:19:22.773711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:22.776029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=16 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:19:22.776686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:19:22.777669 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:19:22.777857 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:19:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/action (ip 10.222.0.76) !!! Oct 27 11:19:22.787517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:22.787998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:22.788427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:22.789148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:22.789590 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:22.790009 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:22.925824 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.network.security_group_api [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Removing security group ff9ffe74-766d-440a-be71-7db146683727 from port 1967cecf-1063-453d-9cdc-5aec81666986 Oct 27 11:19:23.269567 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bdc07b60-21be-4d42-bb6c-f41030ba7be8 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "POST /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/action" status: 202 len: 0 microversion: 2.1 time: 0.500802 Oct 27 11:19:23.273241 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3665/7523] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:19:22 2022] POST /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:19:23.284863 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:19:23.285993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=48 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:19:23.364067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b652a957-3cd7-4f2d-ae65-4a040eef7314 req-d70dc7d0-303c-43b6-90c4-b79749b279a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddacb15-0009-4211-bb29-a085b55e3cce", "tag": "1967cecf-1063-453d-9cdc-5aec81666986"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:19:23.377546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b652a957-3cd7-4f2d-ae65-4a040eef7314 req-d70dc7d0-303c-43b6-90c4-b79749b279a5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:23.378059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b652a957-3cd7-4f2d-ae65-4a040eef7314 req-d70dc7d0-303c-43b6-90c4-b79749b279a5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:23.378514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b652a957-3cd7-4f2d-ae65-4a040eef7314 req-d70dc7d0-303c-43b6-90c4-b79749b279a5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:23.392121 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b652a957-3cd7-4f2d-ae65-4a040eef7314 req-d70dc7d0-303c-43b6-90c4-b79749b279a5 service nova] Creating event network-changed:1967cecf-1063-453d-9cdc-5aec81666986 for instance 2ddacb15-0009-4211-bb29-a085b55e3cce on n-h1-854663-10 Oct 27 11:19:23.398553 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b652a957-3cd7-4f2d-ae65-4a040eef7314 req-d70dc7d0-303c-43b6-90c4-b79749b279a5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119196 Oct 27 11:19:23.399370 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3859/7524] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:24.351182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:24.351740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:24.357910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:24.358388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:24.358819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:24.359507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:24.359985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:24.360411 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:24.446129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lazy-loading 'services' on Instance uuid 2ddacb15-0009-4211-bb29-a085b55e3cce {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:19:24.519709 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-634f7822-767b-4bb7-8acd-fdde0c4c6cda tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments/8a8d286d-4083-427c-b470-210cf80c68b0" status: 202 len: 0 microversion: 2.1 time: 0.173526 Oct 27 11:19:24.520337 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3666/7525] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:19:24 2022] DELETE /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments/8a8d286d-4083-427c-b470-210cf80c68b0 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:19:24.529899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f84cfb5-ad71-46ec-be81-ee1f9e77eeba tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:24.532452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f84cfb5-ad71-46ec-be81-ee1f9e77eeba tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:24.540881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f84cfb5-ad71-46ec-be81-ee1f9e77eeba tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:24.541717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f84cfb5-ad71-46ec-be81-ee1f9e77eeba tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:24.542387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f84cfb5-ad71-46ec-be81-ee1f9e77eeba tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:24.543183 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f84cfb5-ad71-46ec-be81-ee1f9e77eeba tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:24.543729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f84cfb5-ad71-46ec-be81-ee1f9e77eeba tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:24.544278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f84cfb5-ad71-46ec-be81-ee1f9e77eeba tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:24.577599 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f84cfb5-ad71-46ec-be81-ee1f9e77eeba tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052023 Oct 27 11:19:24.578278 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3860/7526] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:19:24 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:25.416453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9041b620-e575-494c-9026-59e32e0e68c5 req-4a14f13a-6cb4-4107-8867-f806c752be45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddacb15-0009-4211-bb29-a085b55e3cce", "tag": "1967cecf-1063-453d-9cdc-5aec81666986"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:19:25.427701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9041b620-e575-494c-9026-59e32e0e68c5 req-4a14f13a-6cb4-4107-8867-f806c752be45 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:25.428183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9041b620-e575-494c-9026-59e32e0e68c5 req-4a14f13a-6cb4-4107-8867-f806c752be45 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:25.428613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9041b620-e575-494c-9026-59e32e0e68c5 req-4a14f13a-6cb4-4107-8867-f806c752be45 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:25.440528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9041b620-e575-494c-9026-59e32e0e68c5 req-4a14f13a-6cb4-4107-8867-f806c752be45 service nova] Creating event network-changed:1967cecf-1063-453d-9cdc-5aec81666986 for instance 2ddacb15-0009-4211-bb29-a085b55e3cce on n-h1-854663-10 Oct 27 11:19:25.445757 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9041b620-e575-494c-9026-59e32e0e68c5 req-4a14f13a-6cb4-4107-8867-f806c752be45 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034493 Oct 27 11:19:25.446548 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3667/7527] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:25.591400 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0952e04a-6b87-4f92-95a1-9ed6a9c70d29 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:25.593908 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0952e04a-6b87-4f92-95a1-9ed6a9c70d29 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:25.602276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0952e04a-6b87-4f92-95a1-9ed6a9c70d29 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:25.602914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0952e04a-6b87-4f92-95a1-9ed6a9c70d29 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:25.603443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0952e04a-6b87-4f92-95a1-9ed6a9c70d29 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:25.604581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0952e04a-6b87-4f92-95a1-9ed6a9c70d29 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:25.605185 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0952e04a-6b87-4f92-95a1-9ed6a9c70d29 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:25.605716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0952e04a-6b87-4f92-95a1-9ed6a9c70d29 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:25.638942 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0952e04a-6b87-4f92-95a1-9ed6a9c70d29 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052493 Oct 27 11:19:25.639859 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3861/7528] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:19:25 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:26.653278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e9b473e5-4dba-4a92-b22b-09524f998a3d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:26.656303 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e9b473e5-4dba-4a92-b22b-09524f998a3d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:26.663563 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9b473e5-4dba-4a92-b22b-09524f998a3d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:26.664077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9b473e5-4dba-4a92-b22b-09524f998a3d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:26.664493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9b473e5-4dba-4a92-b22b-09524f998a3d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:26.665373 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9b473e5-4dba-4a92-b22b-09524f998a3d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:26.665932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9b473e5-4dba-4a92-b22b-09524f998a3d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:26.666310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9b473e5-4dba-4a92-b22b-09524f998a3d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:26.699952 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e9b473e5-4dba-4a92-b22b-09524f998a3d tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051921 Oct 27 11:19:26.700533 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3668/7529] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:19:26 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:27.713725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7945adb-6fc7-4770-b9be-10a3dc4bb853 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:27.715849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7945adb-6fc7-4770-b9be-10a3dc4bb853 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:27.723390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7945adb-6fc7-4770-b9be-10a3dc4bb853 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:27.723917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7945adb-6fc7-4770-b9be-10a3dc4bb853 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:27.724357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7945adb-6fc7-4770-b9be-10a3dc4bb853 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:27.725134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7945adb-6fc7-4770-b9be-10a3dc4bb853 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:27.725606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7945adb-6fc7-4770-b9be-10a3dc4bb853 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:27.726049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7945adb-6fc7-4770-b9be-10a3dc4bb853 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:27.760171 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7945adb-6fc7-4770-b9be-10a3dc4bb853 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050708 Oct 27 11:19:27.760788 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3862/7530] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:19:27 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:28.774050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6279ec1-abc3-4f4b-89f2-1e960c97309a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:28.777143 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6279ec1-abc3-4f4b-89f2-1e960c97309a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:28.786534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6279ec1-abc3-4f4b-89f2-1e960c97309a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:28.787077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6279ec1-abc3-4f4b-89f2-1e960c97309a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:28.787903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6279ec1-abc3-4f4b-89f2-1e960c97309a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:28.789012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6279ec1-abc3-4f4b-89f2-1e960c97309a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:28.789519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6279ec1-abc3-4f4b-89f2-1e960c97309a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:28.789973 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6279ec1-abc3-4f4b-89f2-1e960c97309a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:28.823914 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6279ec1-abc3-4f4b-89f2-1e960c97309a tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054134 Oct 27 11:19:28.825418 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3669/7531] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:19:28 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:29.841686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-426783d5-20ba-4c82-bfc1-4d5d3cd96976 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:29.845694 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-426783d5-20ba-4c82-bfc1-4d5d3cd96976 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:29.857914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-426783d5-20ba-4c82-bfc1-4d5d3cd96976 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:29.858748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-426783d5-20ba-4c82-bfc1-4d5d3cd96976 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:29.859497 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-426783d5-20ba-4c82-bfc1-4d5d3cd96976 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:29.860690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-426783d5-20ba-4c82-bfc1-4d5d3cd96976 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:29.861274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-426783d5-20ba-4c82-bfc1-4d5d3cd96976 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:29.861717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-426783d5-20ba-4c82-bfc1-4d5d3cd96976 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:29.893200 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-426783d5-20ba-4c82-bfc1-4d5d3cd96976 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058357 Oct 27 11:19:29.893780 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3863/7532] 10.222.0.76 () {58 vars in 1302 bytes} [Thu Oct 27 11:19:29 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 11:19:29.909933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:29.910723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:29.921232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:29.922272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:29.922856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:29.923584 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:29.924032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:29.924453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:30.007731 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] HTTP exception thrown: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce is not attached to volume 8a8d286d-4083-427c-b470-210cf80c68b0 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Request method failure captured: Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments/8a8d286d-4083-427c-b470-210cf80c68b0 HTTP/1.1 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmfLL3GWD8X8OPxJq8yXntRZQs0heR_EHDFF3jN4GL3PHvfNyf2XLJ0UWiSzBZWCp64SwWrsSw3vqj3ITSUut_E2yCoaT6TBeEXUfyOuBpdfQjuRVNDJtBEg5e7V440CLk4XS2n_ti8qZOQj9TEYEebsjWDae8_YQs7qnZmT4P4Sz4w Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2bdc00887761460ea894c5ebeb254774 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2bdc00887761460ea894c5ebeb254774", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2bdc00887761460ea894c5ebeb254774 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestMinimumBasicScenario-1695158375-project Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 71006f8916b141f9aabddc9c4870633d Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestMinimumBasicScenario-1695158375-project Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce is not attached to volume 8a8d286d-4083-427c-b470-210cf80c68b0 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'server_id': '2ddacb15-0009-4211-bb29-a085b55e3cce', 'id': '8a8d286d-4083-427c-b470-210cf80c68b0'} Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8a8d286d-4083-427c-b470-210cf80c68b0. Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce is not attached to volume 8a8d286d-4083-427c-b470-210cf80c68b0 Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:19:30.009427 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:19:30.014105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:19:30.014105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:19:30.014105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce is not attached to volume 8a8d286d-4083-427c-b470-210cf80c68b0 Oct 27 11:19:30.014105 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:30.014105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Returning 404 to user: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce is not attached to volume 8a8d286d-4083-427c-b470-210cf80c68b0 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:19:30.014105 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-158cf2eb-012e-43d5-82f0-c8b1bb3a2fcd tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments/8a8d286d-4083-427c-b470-210cf80c68b0" status: 404 len: 154 microversion: 2.1 time: 0.107614 Oct 27 11:19:30.014105 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3670/7533] 10.222.0.76 () {58 vars in 1416 bytes} [Thu Oct 27 11:19:29 2022] DELETE /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce/os-volume_attachments/8a8d286d-4083-427c-b470-210cf80c68b0 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:19:33.284416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:33.284980 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:33.292421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:33.293336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:33.293887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:33.294682 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:33.295180 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:33.295884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:33.324344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:19:33.416972 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b96201b4-f06b-422f-af33-d70d95ea3b3c tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 204 len: 0 microversion: 2.1 time: 0.137339 Oct 27 11:19:33.418047 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3864/7534] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:19:33 2022] DELETE /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:19:33.427423 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:33.428058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:33.438788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:33.439482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:33.439752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:33.440467 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:33.440962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:33.441387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:33.578604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:19:33.587061 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4247d974-7284-4a61-a931-4d72b08e8da0 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1554 microversion: 2.1 time: 0.164145 Oct 27 11:19:33.587634 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3671/7535] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:33 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:19:34.616318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:34.617617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:34.628282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:34.628821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:34.629272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:34.629960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:34.630424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:34.630893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:34.777219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:19:34.787157 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94d60ae5-0c96-4476-9eb5-d79815146e2e tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1554 microversion: 2.1 time: 0.178236 Oct 27 11:19:34.787772 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3865/7536] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:34 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:19:35.795098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-474acd0d-4ad1-4f31-9a06-1f2bc59924d6 req-1ce117cd-d620-4404-86d4-876c32e22f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddacb15-0009-4211-bb29-a085b55e3cce", "name": "network-vif-deleted", "tag": "1967cecf-1063-453d-9cdc-5aec81666986"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:19:35.807669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-474acd0d-4ad1-4f31-9a06-1f2bc59924d6 req-1ce117cd-d620-4404-86d4-876c32e22f88 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:35.808155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-474acd0d-4ad1-4f31-9a06-1f2bc59924d6 req-1ce117cd-d620-4404-86d4-876c32e22f88 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:35.808625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-474acd0d-4ad1-4f31-9a06-1f2bc59924d6 req-1ce117cd-d620-4404-86d4-876c32e22f88 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:35.811493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:35.812151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:35.820003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:35.820491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:35.821060 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:35.821587 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-474acd0d-4ad1-4f31-9a06-1f2bc59924d6 req-1ce117cd-d620-4404-86d4-876c32e22f88 service nova] Creating event network-vif-deleted:1967cecf-1063-453d-9cdc-5aec81666986 for instance 2ddacb15-0009-4211-bb29-a085b55e3cce on n-h1-854663-10 Oct 27 11:19:35.821757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:35.822245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:35.822687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:35.827024 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-474acd0d-4ad1-4f31-9a06-1f2bc59924d6 req-1ce117cd-d620-4404-86d4-876c32e22f88 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035428 Oct 27 11:19:35.827714 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3672/7537] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:35.892365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71006f8916b141f9aabddc9c4870633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdc00887761460ea894c5ebeb254774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:19:35.901146 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42142f71-a0b6-4eb6-a451-c0f4d9dc6884 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 200 len: 1512 microversion: 2.1 time: 0.093704 Oct 27 11:19:35.901732 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3866/7538] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:35 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:19:36.933772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:36.934743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] [instance: 2ddacb15-0009-4211-bb29-a085b55e3cce] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:36.944377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:36.944903 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:36.945343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:36.946047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:36.946500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:36.946936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:36.961201 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] HTTP exception thrown: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce could not be found. Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Request method failure captured: Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce HTTP/1.1 Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmfLL3GWD8X8OPxJq8yXntRZQs0heR_EHDFF3jN4GL3PHvfNyf2XLJ0UWiSzBZWCp64SwWrsSw3vqj3ITSUut_E2yCoaT6TBeEXUfyOuBpdfQjuRVNDJtBEg5e7V440CLk4XS2n_ti8qZOQj9TEYEebsjWDae8_YQs7qnZmT4P4Sz4w Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 2bdc00887761460ea894c5ebeb254774 Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2bdc00887761460ea894c5ebeb254774", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2bdc00887761460ea894c5ebeb254774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 2bdc00887761460ea894c5ebeb254774 Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1695158375 Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestMinimumBasicScenario-1695158375-project Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 71006f8916b141f9aabddc9c4870633d Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestMinimumBasicScenario-1695158375-project Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce could not be found. Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '2ddacb15-0009-4211-bb29-a085b55e3cce'} Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce could not be found. Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce could not be found. Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:19:36.962847 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce could not be found. Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Returning 404 to user: Instance 2ddacb15-0009-4211-bb29-a085b55e3cce could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d691b86-158e-4186-9d5e-9de601c396c4 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce" status: 404 len: 111 microversion: 2.1 time: 0.040185 Oct 27 11:19:36.968290 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3673/7539] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:36 2022] GET /compute/v2.1/servers/2ddacb15-0009-4211-bb29-a085b55e3cce => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:19:36.973644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5cadd3d4-9027-4597-9615-4ab38868f704 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] Calling method '.version_select at 0x7f6d638b1310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:37.000323 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5cadd3d4-9027-4597-9615-4ab38868f704 tempest-TestMinimumBasicScenario-1695158375 tempest-TestMinimumBasicScenario-1695158375-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-417973066" status: 202 len: 0 microversion: 2.1 time: 0.030727 Oct 27 11:19:37.001037 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3867/7540] 10.222.0.76 () {58 vars in 1269 bytes} [Thu Oct 27 11:19:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-417973066 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:19:46.940447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=18 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:19:46.952022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:19:47.111533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb17ccae-b90a-43d5-9fc0-38bc6b4a16d6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: .version_select at 0x7f6d6386b670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-572765635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYanG15GPZkqiGACoBDpHUc7Glnd+aec0QQh4eAWrweFsEJ7wlkm68xbPj5smYs87Jxy5kQHYjtkrXgBQoSvPHYpL9gkZ/l7Gsl5NFei01TZfczjr/87xa1lP/7Fx4yw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:19:47.129521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-eb17ccae-b90a-43d5-9fc0-38bc6b4a16d6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:19:47.135340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-eb17ccae-b90a-43d5-9fc0-38bc6b4a16d6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:19:47.164189 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb17ccae-b90a-43d5-9fc0-38bc6b4a16d6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.244013 Oct 27 11:19:47.164897 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3674/7541] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:19:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:52.784145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1966414692", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "1982620b-7608-4ce4-843a-e6a6d04817c8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-572765635", "security_groups": [{"name": "tempest-secgroup-smoke-387329845"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:19:52.827092 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:19:52.828342 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:19:52.947002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] validate_networks() for [('1982620b-7608-4ce4-843a-e6a6d04817c8', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:19:53.736000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:19:53.736376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:19:53.736949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:19:53.737379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:19:53.737960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:19:53.748059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:53.748567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:53.749074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:53.749829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:53.750302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:53.750745 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:53.770460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:19:53.776799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:19:53.791261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:19:53.793691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:19:53.844319 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05287714-b527-4f71-ae33-c5d33a00bf02 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.064388 Oct 27 11:19:53.845345 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3868/7542] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:19:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:19:53.857036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-489faa5e-216b-481e-befe-33c81feb186f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:53.857669 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-489faa5e-216b-481e-befe-33c81feb186f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:53.928618 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-489faa5e-216b-481e-befe-33c81feb186f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:19:53.937240 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-489faa5e-216b-481e-befe-33c81feb186f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1266 microversion: 2.1 time: 0.084360 Oct 27 11:19:53.937964 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3675/7543] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:53 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:19:54.961200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:54.961938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:54.971889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:54.972387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:54.973018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:54.973818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:54.974376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:54.974888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:55.054722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:19:55.064434 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-250118d5-1c0a-41d8-a8af-65d0ecbd7ae4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1318 microversion: 2.1 time: 0.107455 Oct 27 11:19:55.070713 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3869/7544] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:54 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1318 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:19:56.088358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:56.089090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:56.097430 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:56.098152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:56.098826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:56.099701 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:56.100167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:56.100599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:56.245913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:19:56.254379 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5143751-c808-48e2-8336-104b495893a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1391 microversion: 2.1 time: 0.170182 Oct 27 11:19:56.254948 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3676/7545] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:56 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:19:56.593654 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-311b8def-d68e-453a-a2da-a517f99b4d0e req-fde06397-8909-4c14-8577-444c2981a5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c545cd1-34d3-4f6e-9a27-dbc36af38832", "tag": "fbefe73d-d21a-4f20-926d-b1e846cacf42"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:19:56.606799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-311b8def-d68e-453a-a2da-a517f99b4d0e req-fde06397-8909-4c14-8577-444c2981a5ea service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:56.607294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-311b8def-d68e-453a-a2da-a517f99b4d0e req-fde06397-8909-4c14-8577-444c2981a5ea service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:56.607835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-311b8def-d68e-453a-a2da-a517f99b4d0e req-fde06397-8909-4c14-8577-444c2981a5ea service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:56.622693 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-311b8def-d68e-453a-a2da-a517f99b4d0e req-fde06397-8909-4c14-8577-444c2981a5ea service nova] Creating event network-changed:fbefe73d-d21a-4f20-926d-b1e846cacf42 for instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 on n-h1-854663-10 Oct 27 11:19:56.627876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-311b8def-d68e-453a-a2da-a517f99b4d0e req-fde06397-8909-4c14-8577-444c2981a5ea service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038265 Oct 27 11:19:56.628539 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3870/7546] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:19:57.278473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:57.279074 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:57.286706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:57.287186 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:57.287625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:57.288310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:57.288798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:57.289204 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:57.437086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:19:57.449675 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52aa6ecf-b4fc-4534-971b-3f0024b2e11f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1391 microversion: 2.1 time: 0.174897 Oct 27 11:19:57.450450 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3677/7547] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:57 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:19:58.477377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:58.478252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:58.485310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:58.485875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:58.486426 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:58.487243 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:58.487810 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:58.488461 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:58.632037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:19:58.644572 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fad55c61-e49d-44f3-866b-01c3ee4e4b4e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1391 microversion: 2.1 time: 0.172280 Oct 27 11:19:58.645509 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3871/7548] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:58 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:19:59.673896 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:19:59.674498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:19:59.682055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:59.682545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:59.682978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:59.683687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:19:59.684133 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:19:59.684555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:19:59.832234 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:19:59.840394 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e7b6b80e-c8c7-415d-9250-5de92fee05a9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1391 microversion: 2.1 time: 0.171022 Oct 27 11:19:59.841015 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3678/7549] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:19:59 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:00.863879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:00.864512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:00.871627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:00.872135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:00.872590 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:00.873345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:00.873818 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:00.874261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:01.010989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:01.019497 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f70d170-8f40-4ac1-8cbd-5427302cdd95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1391 microversion: 2.1 time: 0.159673 Oct 27 11:20:01.020140 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3872/7550] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:00 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:01.763136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-873451b0-76e0-44a8-94a7-ad98bd833d84 req-01abec2f-14e8-447c-9948-ac6a3effaa55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c545cd1-34d3-4f6e-9a27-dbc36af38832", "name": "network-vif-plugged", "status": "completed", "tag": "fbefe73d-d21a-4f20-926d-b1e846cacf42"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:01.776215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-873451b0-76e0-44a8-94a7-ad98bd833d84 req-01abec2f-14e8-447c-9948-ac6a3effaa55 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:01.777151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-873451b0-76e0-44a8-94a7-ad98bd833d84 req-01abec2f-14e8-447c-9948-ac6a3effaa55 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:01.777589 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-873451b0-76e0-44a8-94a7-ad98bd833d84 req-01abec2f-14e8-447c-9948-ac6a3effaa55 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:01.793474 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-873451b0-76e0-44a8-94a7-ad98bd833d84 req-01abec2f-14e8-447c-9948-ac6a3effaa55 service nova] Creating event network-vif-plugged:fbefe73d-d21a-4f20-926d-b1e846cacf42 for instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 on n-h1-854663-10 Oct 27 11:20:01.799106 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-873451b0-76e0-44a8-94a7-ad98bd833d84 req-01abec2f-14e8-447c-9948-ac6a3effaa55 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039714 Oct 27 11:20:01.799862 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3679/7551] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:20:02.047609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:02.048583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:02.056951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:02.057455 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:02.057915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:02.058630 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:02.059106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:02.059549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:02.202791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:02.211397 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-631af5a9-0f56-486b-8c9b-9f50158b338b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1391 microversion: 2.1 time: 0.171087 Oct 27 11:20:02.211962 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3873/7552] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:02 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:03.235881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:03.236634 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:03.244215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:03.244692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:03.245159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:03.245846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:03.246297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:03.246715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:03.389518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:03.399217 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f780ce7f-bebd-4ea1-b76f-800f3ea938b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1563 microversion: 2.1 time: 0.167670 Oct 27 11:20:03.399811 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3680/7553] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:03 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:03.421621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:03.422615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:03.429978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:03.430445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:03.430895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:03.431606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:03.432070 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:03.432507 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:03.571997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:03.580164 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d74e40d0-eb4b-41e0-b083-9fe80a81b7c9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1563 microversion: 2.1 time: 0.162504 Oct 27 11:20:03.580810 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3874/7554] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:03 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:05.492997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2c322eed-c622-4285-9918-6fa4a57c940e req-78bd611e-badd-4d06-91e5-92f29848d58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c545cd1-34d3-4f6e-9a27-dbc36af38832", "tag": "fbefe73d-d21a-4f20-926d-b1e846cacf42"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:05.498025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:20:05.498731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:20:05.500821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:05.501543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:05.503977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:20:05.514306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2c322eed-c622-4285-9918-6fa4a57c940e req-78bd611e-badd-4d06-91e5-92f29848d58e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:05.514806 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2c322eed-c622-4285-9918-6fa4a57c940e req-78bd611e-badd-4d06-91e5-92f29848d58e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:05.515254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2c322eed-c622-4285-9918-6fa4a57c940e req-78bd611e-badd-4d06-91e5-92f29848d58e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:05.520796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:05.521288 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:05.521731 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:05.522459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:05.522913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:05.523338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:05.538067 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2c322eed-c622-4285-9918-6fa4a57c940e req-78bd611e-badd-4d06-91e5-92f29848d58e service nova] Creating event network-changed:fbefe73d-d21a-4f20-926d-b1e846cacf42 for instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 on n-h1-854663-10 Oct 27 11:20:05.543535 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2c322eed-c622-4285-9918-6fa4a57c940e req-78bd611e-badd-4d06-91e5-92f29848d58e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054262 Oct 27 11:20:05.544825 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3875/7555] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:20:05.664221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:05.673621 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-303502ec-ffc9-4003-9261-b834f2ca4d8a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1563 microversion: 2.1 time: 0.189537 Oct 27 11:20:05.674490 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3681/7556] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:05 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:31.089145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:20:31.090160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=36 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:20:31.095445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ceea68c-11fd-4b55-8ad0-4291f54f872d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:31.099029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ceea68c-11fd-4b55-8ad0-4291f54f872d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:31.109632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ceea68c-11fd-4b55-8ad0-4291f54f872d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:31.110385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ceea68c-11fd-4b55-8ad0-4291f54f872d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:31.111058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ceea68c-11fd-4b55-8ad0-4291f54f872d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:31.112166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ceea68c-11fd-4b55-8ad0-4291f54f872d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:31.112937 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ceea68c-11fd-4b55-8ad0-4291f54f872d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:31.113788 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ceea68c-11fd-4b55-8ad0-4291f54f872d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:31.172023 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ceea68c-11fd-4b55-8ad0-4291f54f872d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action" status: 200 len: 24564 microversion: 2.1 time: 0.085582 Oct 27 11:20:31.172690 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3876/7557] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:20:31 2022] POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action => generated 24564 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:20:42.189687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a580377-e1f7-413e-913e-612594e3fd09 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:42.190479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a580377-e1f7-413e-913e-612594e3fd09 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:42.192843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:20:42.193728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=32 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:20:42.202184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a580377-e1f7-413e-913e-612594e3fd09 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:42.202783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a580377-e1f7-413e-913e-612594e3fd09 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:42.203351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a580377-e1f7-413e-913e-612594e3fd09 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:42.204195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a580377-e1f7-413e-913e-612594e3fd09 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:42.204785 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a580377-e1f7-413e-913e-612594e3fd09 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:42.205311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a580377-e1f7-413e-913e-612594e3fd09 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:42.283554 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a580377-e1f7-413e-913e-612594e3fd09 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action" status: 202 len: 0 microversion: 2.1 time: 0.099211 Oct 27 11:20:42.284253 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3682/7558] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:20:42 2022] POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:20:42.295014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:42.295742 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:42.299275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:20:42.300222 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:20:42.306346 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:42.306853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:42.307327 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:42.308064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:42.308549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:42.309020 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:42.448583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:42.457197 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82e7f997-7c4d-4f8b-9cb8-3b522cccf264 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1687 microversion: 2.1 time: 0.166518 Oct 27 11:20:42.457789 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3877/7559] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:42 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:43.488920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:43.490082 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:43.497806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:43.498293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:43.498734 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:43.499434 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:43.499886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:43.500314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:43.647137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:43.656006 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc67ae85-a873-437a-8384-58740a77e899 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1667 microversion: 2.1 time: 0.176268 Oct 27 11:20:43.656614 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3683/7560] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:43 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1667 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:44.781416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-954e1da0-3c5c-4b59-ad84-4d7c4fa5d7e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:44.784601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-954e1da0-3c5c-4b59-ad84-4d7c4fa5d7e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:44.793298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-954e1da0-3c5c-4b59-ad84-4d7c4fa5d7e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:44.793799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-954e1da0-3c5c-4b59-ad84-4d7c4fa5d7e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:44.794253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-954e1da0-3c5c-4b59-ad84-4d7c4fa5d7e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:44.795003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-954e1da0-3c5c-4b59-ad84-4d7c4fa5d7e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:44.795460 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-954e1da0-3c5c-4b59-ad84-4d7c4fa5d7e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:44.795918 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-954e1da0-3c5c-4b59-ad84-4d7c4fa5d7e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:44.866753 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-954e1da0-3c5c-4b59-ad84-4d7c4fa5d7e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action" status: 200 len: 32631 microversion: 2.1 time: 0.090968 Oct 27 11:20:44.867496 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3878/7561] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:20:44 2022] POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action => generated 32631 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:20:44.879720 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0bb95f9-f634-4ae2-bf1d-e6b0cb5fbb05 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:44.880316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b0bb95f9-f634-4ae2-bf1d-e6b0cb5fbb05 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:44.887808 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0bb95f9-f634-4ae2-bf1d-e6b0cb5fbb05 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:44.888299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0bb95f9-f634-4ae2-bf1d-e6b0cb5fbb05 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:44.888774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0bb95f9-f634-4ae2-bf1d-e6b0cb5fbb05 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:44.889499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0bb95f9-f634-4ae2-bf1d-e6b0cb5fbb05 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:44.889925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0bb95f9-f634-4ae2-bf1d-e6b0cb5fbb05 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:44.890354 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0bb95f9-f634-4ae2-bf1d-e6b0cb5fbb05 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:44.964388 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0bb95f9-f634-4ae2-bf1d-e6b0cb5fbb05 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action" status: 202 len: 0 microversion: 2.1 time: 0.088502 Oct 27 11:20:44.965067 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3684/7562] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:20:44 2022] POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:20:44.974416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:44.975214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:44.982951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:44.983454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:44.984056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:44.984848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:44.985422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:44.985870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:45.133408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:45.141876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6154d86-8620-49d3-8b15-e54020146810 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1674 microversion: 2.1 time: 0.172160 Oct 27 11:20:45.142469 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3879/7563] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:44 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:46.170109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:46.170806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:46.179002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:46.179435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:46.179875 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:46.180572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:46.181042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:46.181455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:46.337776 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:46.346261 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-372c0f84-b7d3-4f87-bfe8-d663e70b306e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1682 microversion: 2.1 time: 0.181813 Oct 27 11:20:46.346843 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3685/7564] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:46 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:46.468398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8d9a630-edf4-4995-948d-e3a755a4bb39 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:46.471212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8d9a630-edf4-4995-948d-e3a755a4bb39 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:46.482829 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d9a630-edf4-4995-948d-e3a755a4bb39 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:46.483532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d9a630-edf4-4995-948d-e3a755a4bb39 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:46.484157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d9a630-edf4-4995-948d-e3a755a4bb39 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:46.485190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d9a630-edf4-4995-948d-e3a755a4bb39 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:46.485825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d9a630-edf4-4995-948d-e3a755a4bb39 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:46.486387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8d9a630-edf4-4995-948d-e3a755a4bb39 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:46.546240 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8d9a630-edf4-4995-948d-e3a755a4bb39 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action" status: 200 len: 38456 microversion: 2.1 time: 0.083891 Oct 27 11:20:46.547682 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3880/7565] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:20:46 2022] POST /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832/action => generated 38456 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:20:47.908096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:47.908628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:47.910859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f59dff11-2174-41d1-a9e0-893f745ccf48 req-6af7c699-2412-4012-8c61-dff45d801405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c545cd1-34d3-4f6e-9a27-dbc36af38832", "tag": "fbefe73d-d21a-4f20-926d-b1e846cacf42"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:47.916306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:47.916913 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:47.917419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:47.918235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:47.918742 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:47.919233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:47.923232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f59dff11-2174-41d1-a9e0-893f745ccf48 req-6af7c699-2412-4012-8c61-dff45d801405 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:47.923725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f59dff11-2174-41d1-a9e0-893f745ccf48 req-6af7c699-2412-4012-8c61-dff45d801405 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:47.924201 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f59dff11-2174-41d1-a9e0-893f745ccf48 req-6af7c699-2412-4012-8c61-dff45d801405 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:47.941483 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f59dff11-2174-41d1-a9e0-893f745ccf48 req-6af7c699-2412-4012-8c61-dff45d801405 service nova] Creating event network-changed:fbefe73d-d21a-4f20-926d-b1e846cacf42 for instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 on n-h1-854663-10 Oct 27 11:20:47.948205 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f59dff11-2174-41d1-a9e0-893f745ccf48 req-6af7c699-2412-4012-8c61-dff45d801405 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040873 Oct 27 11:20:47.949120 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3881/7566] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:20:47.949892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:20:48.042569 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c1013f0-5e4c-45d9-814e-c6e98994bd1f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 204 len: 0 microversion: 2.1 time: 0.138033 Oct 27 11:20:48.047010 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3686/7567] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:20:47 2022] DELETE /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:20:48.055277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:48.056278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:48.066520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:48.067274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:48.067903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:48.068888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:48.069514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:48.070164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:48.215672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:48.223955 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4929bf2-5e75-42a7-94f6-431713432b3d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1688 microversion: 2.1 time: 0.174250 Oct 27 11:20:48.224834 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3882/7568] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:48 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:49.254804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:49.255862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:49.264321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:49.264838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:49.265286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:49.265980 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:49.266456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:49.266881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:49.410192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:49.419083 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3fde94ca-b0e2-47f3-99a0-bb399c74f6d5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1688 microversion: 2.1 time: 0.171603 Oct 27 11:20:49.419646 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3687/7569] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:49 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:50.348467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f4ce6b40-b382-46e7-9086-34bd307ab58e req-00084a84-17c0-455e-907f-f71e450e9c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c545cd1-34d3-4f6e-9a27-dbc36af38832", "name": "network-vif-deleted", "tag": "fbefe73d-d21a-4f20-926d-b1e846cacf42"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:50.359970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f4ce6b40-b382-46e7-9086-34bd307ab58e req-00084a84-17c0-455e-907f-f71e450e9c1d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:50.360468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f4ce6b40-b382-46e7-9086-34bd307ab58e req-00084a84-17c0-455e-907f-f71e450e9c1d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:50.360952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f4ce6b40-b382-46e7-9086-34bd307ab58e req-00084a84-17c0-455e-907f-f71e450e9c1d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:50.375638 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f4ce6b40-b382-46e7-9086-34bd307ab58e req-00084a84-17c0-455e-907f-f71e450e9c1d service nova] Creating event network-vif-deleted:fbefe73d-d21a-4f20-926d-b1e846cacf42 for instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 on n-h1-854663-10 Oct 27 11:20:50.381259 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f4ce6b40-b382-46e7-9086-34bd307ab58e req-00084a84-17c0-455e-907f-f71e450e9c1d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036720 Oct 27 11:20:50.381872 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3883/7570] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:20:50.443738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:50.445104 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:50.453743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:50.454236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:50.454674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:50.455443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:50.455915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:50.456343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:50.489240 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:50.489726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:50.490163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:50.490616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lazy-loading 'fault' on Instance uuid 6c545cd1-34d3-4f6e-9a27-dbc36af38832 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:20:50.534474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:20:50.543310 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b8bc9b33-1caa-40f4-8347-5202fe9a3bf1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 200 len: 1356 microversion: 2.1 time: 0.104311 Oct 27 11:20:50.543834 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3688/7571] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:50 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:20:51.573126 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:51.573922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 6c545cd1-34d3-4f6e-9a27-dbc36af38832] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:20:51.583634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:51.584357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:51.584965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:51.586254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:20:51.586746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:20:51.587197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:20:51.601379 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] HTTP exception thrown: Instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 could not be found. Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Request method failure captured: Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 HTTP/1.1 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmlStebiKTLBxTveHIk3m95tQoizDDGjkJ2N7T4TxY3DX1zl8AdjG7RqZ9AOOLA6Z_3SbGNDGHHJDiJxChFG1ducEQlyTap_QDjR3GAkSLzk5gzJm8PrdZhRLoiPwoC_VLHM3VeXHm49loX_N75CMOA5q-yLG64LXa8MsPLAETjoRM8 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_36d616f24c374d71ac77d9eadf706d90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: eb71fbee272b430f889f71bb9351a794 Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 could not be found. Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '6c545cd1-34d3-4f6e-9a27-dbc36af38832'} Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 could not be found. Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 could not be found. Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:20:51.603085 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 could not be found. Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Returning 404 to user: Instance 6c545cd1-34d3-4f6e-9a27-dbc36af38832 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26eb034f-4e98-49ad-ae9c-fcdb0928d9bd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832" status: 404 len: 111 microversion: 2.1 time: 0.038987 Oct 27 11:20:51.608106 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3884/7572] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:20:51 2022] GET /compute/v2.1/servers/6c545cd1-34d3-4f6e-9a27-dbc36af38832 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:20:55.046960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b73e311d-bfb6-433e-a82a-6caa8a4e8d62 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '.version_select at 0x7f6d5b6dd0d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:20:55.068406 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b73e311d-bfb6-433e-a82a-6caa8a4e8d62 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-572765635" status: 202 len: 0 microversion: 2.1 time: 0.025777 Oct 27 11:20:55.069062 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3689/7573] 10.222.0.76 () {58 vars in 1281 bytes} [Thu Oct 27 11:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-572765635 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:20:55.096310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-105c600e-4e4e-4aa6-a61f-751a682d0ea3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: .version_select at 0x7f6d59ea1790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1057166664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0r+n7XNmAA7cjHY/u+2EuzA8S3/ra8Tq4Rg2B2eBG0mm0aV+/TFXhuN1FPCSkpOrEbOdhdsAKNp0uWhv8QQQPrh3X3JklV+wQHsszfG9U9FZLDmQ+O6ttaIJxHnyv1ZQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:20:55.114453 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-105c600e-4e4e-4aa6-a61f-751a682d0ea3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:20:55.120586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-105c600e-4e4e-4aa6-a61f-751a682d0ea3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:20:55.150687 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-105c600e-4e4e-4aa6-a61f-751a682d0ea3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058348 Oct 27 11:20:55.151750 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3885/7574] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:20:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:21:00.790759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:00.802876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1301944005", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "f76c4616-acc9-4e07-9958-de2129d5419e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1057166664", "security_groups": [{"name": "tempest-secgroup-smoke-643368747"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:21:00.948647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] validate_networks() for [('f76c4616-acc9-4e07-9958-de2129d5419e', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:21:01.511161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:21:01.511588 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:21:01.512193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:21:01.512616 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:21:01.513061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:21:01.522995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:01.523478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:01.523957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:01.524991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:01.525460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:01.525888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:01.545121 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:21:01.553676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:21:01.570433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:21:01.574188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:21:01.624811 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7553ed7a-91fa-4099-be10-ea80e856b947 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.835701 Oct 27 11:21:01.626201 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3690/7575] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:21:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:21:01.635260 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=32 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:01.640615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53631daf-cc6d-4317-97be-dd9c9537b0a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:01.641515 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53631daf-cc6d-4317-97be-dd9c9537b0a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:01.701547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-53631daf-cc6d-4317-97be-dd9c9537b0a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:01.709799 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53631daf-cc6d-4317-97be-dd9c9537b0a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1267 microversion: 2.1 time: 0.076231 Oct 27 11:21:01.710636 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3886/7576] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:01 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:02.737349 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:02.738118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:02.749266 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:02.750032 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:02.750722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:02.752503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:02.753216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:02.753926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:02.851182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:02.863148 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4209b62-a838-4a90-955f-4094bd60bdd5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1319 microversion: 2.1 time: 0.132044 Oct 27 11:21:02.863753 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3691/7577] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:02 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1319 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:03.886412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:03.887129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:03.898080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:03.899221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:03.900069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:03.901624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:03.902372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:03.902921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:04.133501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:04.142235 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-003140cf-4a72-4400-a5c8-982671d91aae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1392 microversion: 2.1 time: 0.260084 Oct 27 11:21:04.142835 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3887/7578] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:03 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:04.475528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5f3d08ef-e0d3-450b-862f-bdaaea826c0b req-9bcb292c-613d-4f64-912b-80a09b286016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7", "tag": "cdbfc722-f3f8-46cf-935b-8b2a0a1ec028"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:21:04.488929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5f3d08ef-e0d3-450b-862f-bdaaea826c0b req-9bcb292c-613d-4f64-912b-80a09b286016 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:04.489419 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5f3d08ef-e0d3-450b-862f-bdaaea826c0b req-9bcb292c-613d-4f64-912b-80a09b286016 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:04.489955 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5f3d08ef-e0d3-450b-862f-bdaaea826c0b req-9bcb292c-613d-4f64-912b-80a09b286016 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:04.503500 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5f3d08ef-e0d3-450b-862f-bdaaea826c0b req-9bcb292c-613d-4f64-912b-80a09b286016 service nova] Creating event network-changed:cdbfc722-f3f8-46cf-935b-8b2a0a1ec028 for instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 on n-h1-854663-10 Oct 27 11:21:04.508585 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5f3d08ef-e0d3-450b-862f-bdaaea826c0b req-9bcb292c-613d-4f64-912b-80a09b286016 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039864 Oct 27 11:21:04.509371 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3692/7579] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:21:05.172356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:05.173293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:05.183700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:05.184199 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:05.184651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:05.185396 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:05.185879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:05.186310 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:05.332923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:05.341457 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-770f4749-b3f7-4b68-97d0-37d45f4b6696 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1392 microversion: 2.1 time: 0.177063 Oct 27 11:21:05.342051 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3888/7580] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:05 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:06.365846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:06.367157 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:06.375274 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:06.375784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:06.376216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:06.376941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:06.377387 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:06.377809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:06.890219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:06.898195 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c0dc5874-7d05-4377-9efe-ffd528138933 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1392 microversion: 2.1 time: 0.536816 Oct 27 11:21:06.898773 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3693/7581] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:06 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:07.928272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:07.928947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:07.936449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:07.936990 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:07.937444 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:07.938171 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:07.938641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:07.939086 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:08.079412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:08.087801 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f913e921-d748-4987-9029-e4626a1c254b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1392 microversion: 2.1 time: 0.163584 Oct 27 11:21:08.088383 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3889/7582] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:07 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:09.114918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:09.115911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:09.124482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:09.125006 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:09.125447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:09.126149 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:09.126614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:09.127043 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:09.269918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:09.282528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-703f7212-8d37-412f-96ed-e240858af430 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1392 microversion: 2.1 time: 0.173953 Oct 27 11:21:09.283401 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3694/7583] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:09 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:09.965761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-39e92eac-4a41-4acd-85c5-64bf6830a20e req-48de8c30-579e-48ac-a89b-815b15b408d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7", "name": "network-vif-plugged", "status": "completed", "tag": "cdbfc722-f3f8-46cf-935b-8b2a0a1ec028"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:21:09.977281 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-39e92eac-4a41-4acd-85c5-64bf6830a20e req-48de8c30-579e-48ac-a89b-815b15b408d8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:09.978129 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-39e92eac-4a41-4acd-85c5-64bf6830a20e req-48de8c30-579e-48ac-a89b-815b15b408d8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:09.978676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-39e92eac-4a41-4acd-85c5-64bf6830a20e req-48de8c30-579e-48ac-a89b-815b15b408d8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:09.991116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-39e92eac-4a41-4acd-85c5-64bf6830a20e req-48de8c30-579e-48ac-a89b-815b15b408d8 service nova] Creating event network-vif-plugged:cdbfc722-f3f8-46cf-935b-8b2a0a1ec028 for instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 on n-h1-854663-10 Oct 27 11:21:09.996259 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-39e92eac-4a41-4acd-85c5-64bf6830a20e req-48de8c30-579e-48ac-a89b-815b15b408d8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034603 Oct 27 11:21:09.996905 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3890/7584] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:21:10.312071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:10.312719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:10.320028 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:10.320566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:10.321096 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:10.321866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:10.322375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:10.322850 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:10.478042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:10.486466 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54800ad2-9d2a-49b5-acb3-886d006e67b1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1392 microversion: 2.1 time: 0.179398 Oct 27 11:21:10.487047 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3695/7585] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:10 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:11.514002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:11.514668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:11.521706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:11.522200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:11.522645 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:11.523353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:11.523820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:11.524255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:11.676439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:11.685231 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d92dd6f-92ba-43d3-bcf6-23ab035ba66e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1564 microversion: 2.1 time: 0.178221 Oct 27 11:21:11.685823 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3891/7586] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:11 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:11.708215 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:11.708831 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:11.711698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:11.712385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:11.719046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:11.719524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:11.719958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:11.720651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:11.721116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:11.721530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:11.861848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:11.872269 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-abde577a-9489-45b8-84c7-bb88a6d1a454 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1564 microversion: 2.1 time: 0.168034 Oct 27 11:21:11.872883 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3696/7587] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:11 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:13.815491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:13.816272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:13.817884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-80f3f2a3-c9d4-4131-9408-f4ae2fddc2b7 req-5a4f5eb0-61d6-4993-bc33-82afafc81c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7", "tag": "cdbfc722-f3f8-46cf-935b-8b2a0a1ec028"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:21:13.819681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:13.820921 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:13.824909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:13.826148 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:13.826702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:13.827099 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:13.828052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:13.829145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:13.829803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:13.830367 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-80f3f2a3-c9d4-4131-9408-f4ae2fddc2b7 req-5a4f5eb0-61d6-4993-bc33-82afafc81c78 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:13.830843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-80f3f2a3-c9d4-4131-9408-f4ae2fddc2b7 req-5a4f5eb0-61d6-4993-bc33-82afafc81c78 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:13.831270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-80f3f2a3-c9d4-4131-9408-f4ae2fddc2b7 req-5a4f5eb0-61d6-4993-bc33-82afafc81c78 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:13.844615 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-80f3f2a3-c9d4-4131-9408-f4ae2fddc2b7 req-5a4f5eb0-61d6-4993-bc33-82afafc81c78 service nova] Creating event network-changed:cdbfc722-f3f8-46cf-935b-8b2a0a1ec028 for instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 on n-h1-854663-10 Oct 27 11:21:13.850416 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-80f3f2a3-c9d4-4131-9408-f4ae2fddc2b7 req-5a4f5eb0-61d6-4993-bc33-82afafc81c78 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036810 Oct 27 11:21:13.851331 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3697/7588] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:21:14.059463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:14.068426 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-262f0459-4061-483a-a25e-13c51eedcd2b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1564 microversion: 2.1 time: 0.257379 Oct 27 11:21:14.069075 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3892/7589] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:13 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1564 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:39.376649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=36 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:39.381282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b09b492d-89fd-4638-87db-fc3fca0a7a9c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:21:39.383570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b09b492d-89fd-4638-87db-fc3fca0a7a9c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:39.391052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09b492d-89fd-4638-87db-fc3fca0a7a9c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:39.391497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09b492d-89fd-4638-87db-fc3fca0a7a9c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:39.391964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09b492d-89fd-4638-87db-fc3fca0a7a9c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:39.392686 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09b492d-89fd-4638-87db-fc3fca0a7a9c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:39.393302 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09b492d-89fd-4638-87db-fc3fca0a7a9c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:39.393730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b09b492d-89fd-4638-87db-fc3fca0a7a9c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:39.448691 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b09b492d-89fd-4638-87db-fc3fca0a7a9c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7/action" status: 200 len: 24570 microversion: 2.1 time: 0.073643 Oct 27 11:21:39.449332 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3698/7590] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:21:39 2022] POST /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7/action => generated 24570 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:21:50.533801 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-380b8d20-5dc7-4407-a530-d6d88c71046c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:21:50.536122 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-380b8d20-5dc7-4407-a530-d6d88c71046c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:50.538627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:50.539292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=32 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:50.546182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380b8d20-5dc7-4407-a530-d6d88c71046c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:50.547083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380b8d20-5dc7-4407-a530-d6d88c71046c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:50.547500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380b8d20-5dc7-4407-a530-d6d88c71046c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:50.548198 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380b8d20-5dc7-4407-a530-d6d88c71046c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:50.548680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380b8d20-5dc7-4407-a530-d6d88c71046c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:50.549135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-380b8d20-5dc7-4407-a530-d6d88c71046c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:50.630076 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-380b8d20-5dc7-4407-a530-d6d88c71046c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7/action" status: 202 len: 0 microversion: 2.1 time: 0.100705 Oct 27 11:21:50.630748 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3893/7591] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:21:50 2022] POST /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:21:50.640920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:50.641713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:50.644298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:50.644910 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:21:50.651237 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:50.651837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:50.652365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:50.653098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:50.653547 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:50.653963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:50.881545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:50.890369 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54470b60-5b3f-451e-b880-cbc30b04b014 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1675 microversion: 2.1 time: 0.254227 Oct 27 11:21:50.891021 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3699/7592] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:50 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:51.920735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:51.922375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:51.934850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:51.935679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:51.936466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:51.937782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:51.938253 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:51.938692 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:52.086297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:52.094590 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9d60a14-72b3-4d80-be2e-0227f3a67693 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.181435 Oct 27 11:21:52.095184 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3894/7593] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:51 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:53.122688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:53.123768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:53.136164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:53.137088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:53.137853 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:53.139059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:53.139912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:53.140694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:53.301728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:53.313845 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a51be037-197b-472d-bc56-7be15d93d0d0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.197867 Oct 27 11:21:53.314433 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3700/7594] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:53 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:54.338671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:54.339311 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:54.346871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:54.347371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:54.347821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:54.348531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:54.349035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:54.349464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:54.493027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:54.501490 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60d4888e-d0cf-45e1-8213-557ede997b0b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.167010 Oct 27 11:21:54.502197 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3895/7595] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:54 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:55.530593 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:55.531408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:55.538774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:55.539260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:55.539708 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:55.540404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:55.540905 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:55.541334 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:55.692591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:55.700929 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fba242c2-9318-4511-ae6d-e15f4c26561c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.177390 Oct 27 11:21:55.701652 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3701/7596] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:55 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:56.725711 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:56.726282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:56.733703 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:56.734205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:56.734663 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:56.735376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:56.735933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:56.736381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:56.878746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:56.886802 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92c1f15c-e882-4f42-a160-a855dc3ee089 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.165261 Oct 27 11:21:56.887384 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3896/7597] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:56 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:57.911746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:57.912407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:57.920106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:57.920621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:57.921137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:57.922250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:57.922727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:57.923178 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:58.061883 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:58.070404 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58766477-a3b7-4a0f-8f15-3f7bf8ee6272 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.163348 Oct 27 11:21:58.070984 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3702/7598] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:57 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:21:59.099502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:21:59.100522 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:21:59.112150 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:59.112647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:59.113132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:59.113842 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:21:59.114315 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:21:59.114753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:21:59.261731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:21:59.270298 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16631657-6d23-46d2-bf70-b809ea5fb770 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.177897 Oct 27 11:21:59.270848 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3897/7599] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:21:59 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:00.299156 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:00.300459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:00.312153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:00.313013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:00.313736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:00.314876 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:00.315507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:00.315966 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:00.475895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:00.484377 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce32493f-f4ef-4d6f-9d82-ccc458efae2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.192251 Oct 27 11:22:00.485021 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3703/7600] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:00 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:01.510250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:01.511053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:01.520424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:01.521104 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:01.521673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:01.522567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:01.523154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:01.523710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:01.667405 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:01.676110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe441737-4c3e-4c75-8add-69a0e9d76de1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.170942 Oct 27 11:22:01.676632 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3898/7601] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:01 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:02.708317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:02.708906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:02.716357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:02.716880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:02.717329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:02.718033 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:02.718489 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:02.718916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:02.878372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:02.891453 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7fb61554-68cf-4461-a49a-d490fdc789c2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.188378 Oct 27 11:22:02.892310 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3704/7602] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:02 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:03.919674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:03.920693 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:03.933791 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:03.934613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:03.935374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:03.936540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:03.937362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:03.938112 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:04.088963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:04.100595 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-028c0a15-f6e2-4d7b-9052-f71e96ae3055 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.187464 Oct 27 11:22:04.101220 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3899/7603] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:03 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:05.130341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:05.131129 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:05.141055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:05.141715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:05.142290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:05.143254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:05.143934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:05.144382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:05.292561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:05.305626 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1df6240-5c99-49cb-b13d-fa80401a9981 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.180968 Oct 27 11:22:05.306502 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3705/7604] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:05 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:06.335371 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:06.336004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:06.343492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:06.343993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:06.344448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:06.345196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:06.345668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:06.346113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:06.493993 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:06.502737 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5384022-cda0-4cda-a2c3-5f4f54efe004 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1680 microversion: 2.1 time: 0.172512 Oct 27 11:22:06.503436 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3900/7605] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:06 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:07.530147 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:07.530769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:07.540131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:07.540617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:07.541085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:07.541798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:07.542248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:07.542700 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:07.680554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:07.688943 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f88dc1e8-2853-414b-9976-9a129d5ae1c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1683 microversion: 2.1 time: 0.164920 Oct 27 11:22:07.689530 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3706/7606] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:07 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:33.976899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f32bfc5-0c34-4b1f-ae3f-321864afa051 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:22:33.980799 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f32bfc5-0c34-4b1f-ae3f-321864afa051 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:33.983334 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:22:33.984012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:22:33.991245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f32bfc5-0c34-4b1f-ae3f-321864afa051 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:33.991686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f32bfc5-0c34-4b1f-ae3f-321864afa051 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:33.992144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f32bfc5-0c34-4b1f-ae3f-321864afa051 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:33.993247 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f32bfc5-0c34-4b1f-ae3f-321864afa051 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:33.993781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f32bfc5-0c34-4b1f-ae3f-321864afa051 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:33.994249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f32bfc5-0c34-4b1f-ae3f-321864afa051 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:34.056348 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f32bfc5-0c34-4b1f-ae3f-321864afa051 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7/action" status: 200 len: 68975 microversion: 2.1 time: 0.086066 Oct 27 11:22:34.057087 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3901/7607] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:22:33 2022] POST /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7/action => generated 68975 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:22:41.267174 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:41.267740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:41.271071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=16 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:22:41.272134 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=48 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:22:41.275768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:41.277405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:41.277929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:41.278745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:41.279501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:41.280081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:41.315008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:22:41.364436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e6bb07af-a45b-46d4-933f-ec86acc3fbfc req-d888bb6c-cdb3-4ac7-b606-cc3cff1f0fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7", "tag": "cdbfc722-f3f8-46cf-935b-8b2a0a1ec028"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:22:41.376880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e6bb07af-a45b-46d4-933f-ec86acc3fbfc req-d888bb6c-cdb3-4ac7-b606-cc3cff1f0fd9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:41.377370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e6bb07af-a45b-46d4-933f-ec86acc3fbfc req-d888bb6c-cdb3-4ac7-b606-cc3cff1f0fd9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:41.377813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e6bb07af-a45b-46d4-933f-ec86acc3fbfc req-d888bb6c-cdb3-4ac7-b606-cc3cff1f0fd9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:41.389605 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e6bb07af-a45b-46d4-933f-ec86acc3fbfc req-d888bb6c-cdb3-4ac7-b606-cc3cff1f0fd9 service nova] Creating event network-changed:cdbfc722-f3f8-46cf-935b-8b2a0a1ec028 for instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 on n-h1-854663-10 Oct 27 11:22:41.395584 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e6bb07af-a45b-46d4-933f-ec86acc3fbfc req-d888bb6c-cdb3-4ac7-b606-cc3cff1f0fd9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130049 Oct 27 11:22:41.396507 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3902/7608] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:22:41.402457 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f566734-86fa-4c51-813e-49224fed1d10 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 204 len: 0 microversion: 2.1 time: 0.139931 Oct 27 11:22:41.403348 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3707/7609] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:22:41 2022] DELETE /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:22:41.413015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:41.416417 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:41.423636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:41.424154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:41.424593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:41.425355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:41.425825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:41.426273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:41.620708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:41.629428 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3e57625-ec82-4709-b847-09a98840426c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1689 microversion: 2.1 time: 0.221041 Oct 27 11:22:41.629991 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3903/7610] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:41 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1689 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:42.656575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:42.657348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:42.665368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:42.665885 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:42.666343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:42.667079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:42.667561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:42.668010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:42.863472 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:42.871859 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-56c7d4a4-a3c9-4419-99c1-ad05ec878d5b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1689 microversion: 2.1 time: 0.220909 Oct 27 11:22:42.872443 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3708/7611] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:42 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:43.663377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-61ffa5ca-99f9-43de-bae6-bd2de1bafa5d req-8ce208f8-3287-4b06-a7ed-1c8e274cbce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7", "name": "network-vif-deleted", "tag": "cdbfc722-f3f8-46cf-935b-8b2a0a1ec028"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:22:43.674121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-61ffa5ca-99f9-43de-bae6-bd2de1bafa5d req-8ce208f8-3287-4b06-a7ed-1c8e274cbce2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:43.674636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-61ffa5ca-99f9-43de-bae6-bd2de1bafa5d req-8ce208f8-3287-4b06-a7ed-1c8e274cbce2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:43.675083 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-61ffa5ca-99f9-43de-bae6-bd2de1bafa5d req-8ce208f8-3287-4b06-a7ed-1c8e274cbce2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:43.687058 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-61ffa5ca-99f9-43de-bae6-bd2de1bafa5d req-8ce208f8-3287-4b06-a7ed-1c8e274cbce2 service nova] Creating event network-vif-deleted:cdbfc722-f3f8-46cf-935b-8b2a0a1ec028 for instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 on n-h1-854663-10 Oct 27 11:22:43.692456 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-61ffa5ca-99f9-43de-bae6-bd2de1bafa5d req-8ce208f8-3287-4b06-a7ed-1c8e274cbce2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033063 Oct 27 11:22:43.693116 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3904/7612] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:22:43.895794 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:43.896405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:43.904150 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:43.904797 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:43.905233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:43.905920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:43.906369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:43.906788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:43.940536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:43.941062 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:43.941495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:43.941946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lazy-loading 'fault' on Instance uuid 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:22:43.987592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:43.995989 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0579e872-540d-4a1a-a454-b35bda9518b2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 200 len: 1357 microversion: 2.1 time: 0.104245 Oct 27 11:22:43.996574 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3709/7613] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:43 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:45.018112 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:22:45.018732 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:22:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 (ip 10.222.0.76) !!! Oct 27 11:22:45.024465 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:45.025266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:45.033843 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:45.034364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:45.034835 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:45.035574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:45.036056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:45.036519 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:45.051704 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] HTTP exception thrown: Instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 could not be found. Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Request method failure captured: Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 HTTP/1.1 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmlStebiKTLBxTveHIk3m95tQoizDDGjkJ2N7T4TxY3DX1zl8AdjG7RqZ9AOOLA6Z_3SbGNDGHHJDiJxChFG1ducEQlyTap_QDjR3GAkSLzk5gzJm8PrdZhRLoiPwoC_VLHM3VeXHm49loX_N75CMOA5q-yLG64LXa8MsPLAETjoRM8 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_36d616f24c374d71ac77d9eadf706d90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: eb71fbee272b430f889f71bb9351a794 Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 could not be found. Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7'} Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 could not be found. Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 could not be found. Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:22:45.053325 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 could not be found. Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Returning 404 to user: Instance 0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d583d2b-d6ed-4f16-b477-9a15570aeeaa tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7" status: 404 len: 111 microversion: 2.1 time: 0.038376 Oct 27 11:22:45.058592 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3905/7614] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:45 2022] GET /compute/v2.1/servers/0c38a2a1-2b4d-4bbd-a2a9-7ded9953e6c7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:22:48.447015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ad637fc8-c474-453e-a044-13557a8b46b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '.version_select at 0x7f6d637a1940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:48.472924 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ad637fc8-c474-453e-a044-13557a8b46b3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1057166664" status: 202 len: 0 microversion: 2.1 time: 0.035288 Oct 27 11:22:48.474098 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3710/7615] 10.222.0.76 () {58 vars in 1284 bytes} [Thu Oct 27 11:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1057166664 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:22:48.503394 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89586ca6-6090-4191-8889-cf95bdcdfde8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: .version_select at 0x7f6d5a0b1430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-167181982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIeXQNCg4ex/hbnRydWm+xLtADHrFy/4jWnYtrFgLo6FbXC5mGIxb5hcG1jBKCxwTJmsp2vFLOdZMkFEpzrXaM1OJ+MD5OiJMDkt4+gSXr5xu08S3eo1HuYH+NB1atPkg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:22:48.522339 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-89586ca6-6090-4191-8889-cf95bdcdfde8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:22:48.527581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-89586ca6-6090-4191-8889-cf95bdcdfde8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:22:48.553315 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-89586ca6-6090-4191-8889-cf95bdcdfde8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055677 Oct 27 11:22:48.554066 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3906/7616] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:22:48 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:22:54.282772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1395005505", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "4baad48c-9d62-49bd-bc44-ad3aff933ac3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-167181982", "security_groups": [{"name": "tempest-secgroup-smoke-1707532322"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:22:54.293279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:22:54.407709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] validate_networks() for [('4baad48c-9d62-49bd-bc44-ad3aff933ac3', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:22:54.819440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:22:54.819881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:22:54.820391 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:22:54.821017 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:22:54.821439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:22:54.840454 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:54.840884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:54.841369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:54.842059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:54.842723 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:54.843433 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:54.862961 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:22:54.868674 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:22:54.882217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:22:54.884649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:22:54.935021 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ccf1768e-935b-457e-9536-b8f1dea749be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.656473 Oct 27 11:22:54.936186 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3711/7617] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:22:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:22:54.948697 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4d118cb-3cc7-44fd-8812-f50465c9614e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:54.949343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4d118cb-3cc7-44fd-8812-f50465c9614e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:55.010090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a4d118cb-3cc7-44fd-8812-f50465c9614e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:55.017600 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4d118cb-3cc7-44fd-8812-f50465c9614e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1266 microversion: 2.1 time: 0.073910 Oct 27 11:22:55.018200 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3907/7618] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:54 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:56.041175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5910f1d4-5bc0-4a26-8b65-91ecdb8dc423 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:56.041792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5910f1d4-5bc0-4a26-8b65-91ecdb8dc423 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:56.107516 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5910f1d4-5bc0-4a26-8b65-91ecdb8dc423 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:56.114807 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5910f1d4-5bc0-4a26-8b65-91ecdb8dc423 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1266 microversion: 2.1 time: 0.078605 Oct 27 11:22:56.115397 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3712/7619] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:56 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:57.138928 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92c6f100-e5e8-4843-ac4e-834c589b8c95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:57.139965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92c6f100-e5e8-4843-ac4e-834c589b8c95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:57.145779 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:22:57.209376 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-92c6f100-e5e8-4843-ac4e-834c589b8c95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:57.221098 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92c6f100-e5e8-4843-ac4e-834c589b8c95 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1266 microversion: 2.1 time: 0.086665 Oct 27 11:22:57.230897 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3908/7620] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:57 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:58.248591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-662cb56e-0645-446b-8a8d-ac47c45ec517 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:58.249624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-662cb56e-0645-446b-8a8d-ac47c45ec517 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:58.314890 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-662cb56e-0645-446b-8a8d-ac47c45ec517 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:58.322456 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-662cb56e-0645-446b-8a8d-ac47c45ec517 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1266 microversion: 2.1 time: 0.080562 Oct 27 11:22:58.323045 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3713/7621] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:58 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:22:59.347143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:22:59.347767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:22:59.355284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:59.355793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:59.356261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:59.357143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:22:59.357618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:22:59.358085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:22:59.424093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:22:59.432311 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4358667f-e6ea-4692-85d7-deaaa428d339 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1270 microversion: 2.1 time: 0.090020 Oct 27 11:22:59.432929 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3909/7622] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:22:59 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:00.456789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:00.457397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:00.465313 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:00.465805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:00.466238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:00.466938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:00.467386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:00.467809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:00.532161 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:00.540337 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-14c30588-f726-46fb-a240-f7549819c594 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1324 microversion: 2.1 time: 0.088346 Oct 27 11:23:00.541026 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3714/7623] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:00 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1324 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:01.564103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:01.565343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:01.572712 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:01.573328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:01.573872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:01.574662 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:01.575224 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:01.575665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:01.617245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-43c65458-31bd-4fd4-9593-538568b24115 req-2fe025d9-6fa2-4a52-9d32-6ead3adcbd90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce93ae9d-e793-4b0a-9aaf-8d10a94886a0", "tag": "58c55386-7507-4167-b0ff-59ae17cb5074"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:23:01.635643 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-43c65458-31bd-4fd4-9593-538568b24115 req-2fe025d9-6fa2-4a52-9d32-6ead3adcbd90 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:01.636107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-43c65458-31bd-4fd4-9593-538568b24115 req-2fe025d9-6fa2-4a52-9d32-6ead3adcbd90 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:01.636895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-43c65458-31bd-4fd4-9593-538568b24115 req-2fe025d9-6fa2-4a52-9d32-6ead3adcbd90 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:01.651814 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-43c65458-31bd-4fd4-9593-538568b24115 req-2fe025d9-6fa2-4a52-9d32-6ead3adcbd90 service nova] Creating event network-changed:58c55386-7507-4167-b0ff-59ae17cb5074 for instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 on n-h1-854663-10 Oct 27 11:23:01.657273 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-43c65458-31bd-4fd4-9593-538568b24115 req-2fe025d9-6fa2-4a52-9d32-6ead3adcbd90 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047435 Oct 27 11:23:01.658323 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3715/7624] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:23:01.721220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:01.729927 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4bfbbf2-4fe6-4ae0-8526-e9335ca2b172 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1392 microversion: 2.1 time: 0.169856 Oct 27 11:23:01.730514 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3910/7625] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:01 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:02.755224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:02.756087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:02.763291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:02.763779 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:02.764216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:02.764945 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:02.765398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:02.765856 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:02.910002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:02.923973 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3348bbd2-822a-4605-8394-d7ed9e95e9db tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1392 microversion: 2.1 time: 0.173648 Oct 27 11:23:02.924948 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3716/7626] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:02 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:03.951498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:03.952321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:03.962763 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:03.963356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:03.963963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:03.964956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:03.965724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:03.966353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:04.118675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:04.126998 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cbaa7268-a351-4f1e-9519-6f2ca003fd34 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1392 microversion: 2.1 time: 0.180925 Oct 27 11:23:04.127609 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3911/7627] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:03 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:05.151660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:05.152311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:05.155218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:05.161046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:05.161527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:05.161960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:05.162689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:05.163310 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:05.163772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:05.310772 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:05.318784 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f815dad0-89d2-4c0d-a913-17c28c47c020 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1392 microversion: 2.1 time: 0.171804 Oct 27 11:23:05.319443 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3717/7628] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:05 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:06.342819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:06.343469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:06.346314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:06.352961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:06.353640 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:06.354091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:06.354811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:06.355262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:06.355695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:06.494997 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:06.503735 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15463dde-dc0b-4c28-8019-2ea8d479f7bc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1392 microversion: 2.1 time: 0.165474 Oct 27 11:23:06.504381 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3912/7629] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:06 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:07.530664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:07.531432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:07.542109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:07.542784 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:07.543404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:07.544393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:07.545068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:07.545672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:07.683298 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:07.693501 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d881c328-b26b-4c4d-86c6-f897ed18021e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1392 microversion: 2.1 time: 0.168736 Oct 27 11:23:07.694091 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3718/7630] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:07 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:08.493143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:08.550805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3c94f764-9e2f-4011-83fa-35e96f9e95ef req-009319f3-7e05-4a50-817f-c0808cb5aa6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce93ae9d-e793-4b0a-9aaf-8d10a94886a0", "name": "network-vif-plugged", "status": "completed", "tag": "58c55386-7507-4167-b0ff-59ae17cb5074"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:23:08.561782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3c94f764-9e2f-4011-83fa-35e96f9e95ef req-009319f3-7e05-4a50-817f-c0808cb5aa6e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:08.562280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3c94f764-9e2f-4011-83fa-35e96f9e95ef req-009319f3-7e05-4a50-817f-c0808cb5aa6e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:08.563227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3c94f764-9e2f-4011-83fa-35e96f9e95ef req-009319f3-7e05-4a50-817f-c0808cb5aa6e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:08.574154 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3c94f764-9e2f-4011-83fa-35e96f9e95ef req-009319f3-7e05-4a50-817f-c0808cb5aa6e service nova] Creating event network-vif-plugged:58c55386-7507-4167-b0ff-59ae17cb5074 for instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 on n-h1-854663-10 Oct 27 11:23:08.579603 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3c94f764-9e2f-4011-83fa-35e96f9e95ef req-009319f3-7e05-4a50-817f-c0808cb5aa6e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091119 Oct 27 11:23:08.580201 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3913/7631] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:23:08.722898 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:08.723604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:08.725519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:08.732015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:08.732498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:08.732958 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:08.733658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:08.734103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:08.734521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:08.885052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:08.897204 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb1af095-42a7-42f4-8560-b6c56afa31ae tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1392 microversion: 2.1 time: 0.177882 Oct 27 11:23:08.898283 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3719/7632] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:08 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:09.922237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:09.922965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:09.931258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:09.931789 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:09.932304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:09.933147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:09.933651 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:09.934130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:10.086265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:10.098729 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ccf962a6-d155-4872-959a-3e7f9412a8fb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1392 microversion: 2.1 time: 0.180842 Oct 27 11:23:10.099493 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3914/7633] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:09 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:11.128455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:11.129408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:11.140314 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:11.141185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:11.141917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:11.143077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:11.143841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:11.144567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:11.292316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:11.308628 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-24de7111-8b93-447d-8943-33f76d0f7d73 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1564 microversion: 2.1 time: 0.187575 Oct 27 11:23:11.309283 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3720/7634] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:11 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1564 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:11.331671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:11.332684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:11.341212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:11.341732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:11.342210 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:11.342951 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:11.343418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:11.343858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:11.482055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:11.490192 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca9c28b5-ea20-4ff1-ad41-2279727b78d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1564 microversion: 2.1 time: 0.162625 Oct 27 11:23:11.490774 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3915/7635] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:11 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:13.423974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:13.424716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:13.425301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4442864c-0230-4a20-8f1a-8d5ddb38da06 req-c7ab0019-5723-455e-8397-8e56deb7a0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce93ae9d-e793-4b0a-9aaf-8d10a94886a0", "tag": "58c55386-7507-4167-b0ff-59ae17cb5074"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:23:13.427610 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:13.435338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:13.436146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:13.436636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:13.437445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:13.437904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:13.438230 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4442864c-0230-4a20-8f1a-8d5ddb38da06 req-c7ab0019-5723-455e-8397-8e56deb7a0b7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:13.438368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:13.438815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4442864c-0230-4a20-8f1a-8d5ddb38da06 req-c7ab0019-5723-455e-8397-8e56deb7a0b7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:13.439503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4442864c-0230-4a20-8f1a-8d5ddb38da06 req-c7ab0019-5723-455e-8397-8e56deb7a0b7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:13.453763 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4442864c-0230-4a20-8f1a-8d5ddb38da06 req-c7ab0019-5723-455e-8397-8e56deb7a0b7 service nova] Creating event network-changed:58c55386-7507-4167-b0ff-59ae17cb5074 for instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 on n-h1-854663-10 Oct 27 11:23:13.459316 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4442864c-0230-4a20-8f1a-8d5ddb38da06 req-c7ab0019-5723-455e-8397-8e56deb7a0b7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038898 Oct 27 11:23:13.460368 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3916/7636] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:23:13.590655 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:13.600515 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8072118c-48a1-4ac5-ad08-00fed4f4a7c3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1564 microversion: 2.1 time: 0.182465 Oct 27 11:23:13.604697 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3721/7637] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:13 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:36.873009 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:36.873868 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=40 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:36.878359 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63563ea3-a128-4166-a128-3da8fcc984af tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:23:36.880681 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63563ea3-a128-4166-a128-3da8fcc984af tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:36.887774 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63563ea3-a128-4166-a128-3da8fcc984af tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:36.888351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63563ea3-a128-4166-a128-3da8fcc984af tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:36.888950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63563ea3-a128-4166-a128-3da8fcc984af tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:36.889543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63563ea3-a128-4166-a128-3da8fcc984af tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:36.890007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63563ea3-a128-4166-a128-3da8fcc984af tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:36.890446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63563ea3-a128-4166-a128-3da8fcc984af tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:36.943074 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63563ea3-a128-4166-a128-3da8fcc984af tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0/action" status: 200 len: 24569 microversion: 2.1 time: 0.072111 Oct 27 11:23:36.943686 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3917/7638] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:23:36 2022] POST /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0/action => generated 24569 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:23:47.912012 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:23:47.914408 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:47.916492 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:47.917164 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=46 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:47.924070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:47.924998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:47.925444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:47.926131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:47.926587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:47.927011 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:47.972046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:47.981704 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Old instance type m1.heat2, new instance type m1.heat {{(pid=120719) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 11:23:47.991066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:23:47.991495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:23:47.991970 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:23:47.992386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:23:47.992846 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:23:48.068896 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc862cd0-fd97-4cd6-97b0-5d6b98c195e1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0/action" status: 202 len: 0 microversion: 2.1 time: 0.161334 Oct 27 11:23:48.069518 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3722/7639] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:23:47 2022] POST /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:23:48.081477 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:48.082427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:48.085152 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:48.085871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:23:48.092348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:48.092963 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:48.093328 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:48.094085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:48.094581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:48.095011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:48.235539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:48.244240 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-64a6d720-346a-4b5c-9299-e3c7412b14eb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1692 microversion: 2.1 time: 0.169542 Oct 27 11:23:48.244867 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3918/7640] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:48 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:49.269242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:49.269859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:49.277891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:49.278425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:49.278889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:49.279597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:49.280068 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:49.280678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:49.422519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:49.430670 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c639cb40-b45f-494c-a581-220d56e5dfcd tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1692 microversion: 2.1 time: 0.166509 Oct 27 11:23:49.431271 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3723/7641] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:49 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:50.455012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:50.455644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:50.463689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:50.464196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:50.464636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:50.465393 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:50.466100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:50.466899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:50.640957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:50.655894 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70c31b04-cfcf-4865-a1b6-320abfed7bed tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.204651 Oct 27 11:23:50.657063 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3919/7642] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:50 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:51.694652 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:51.695535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:51.707173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:51.708056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:51.708500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:51.709585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:51.710137 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:51.710559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:51.851145 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:51.859552 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6804dde-1791-49f9-8399-42c0e8e56120 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.172244 Oct 27 11:23:51.860142 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3724/7643] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:51 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:52.883262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:52.883881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:52.891347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:52.891845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:52.892293 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:52.893035 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:52.893505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:52.893947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:53.028443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:53.036719 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36991852-43af-4e55-bc2a-9b31409e8cb0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.157799 Oct 27 11:23:53.037290 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3920/7644] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:52 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:54.064986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:54.065960 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:54.077819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:54.078631 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:54.079371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:54.080524 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:54.081333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:54.082084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:54.232694 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:54.241343 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4690f216-aa37-40bc-96a3-8ba94dc9ed0d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.183085 Oct 27 11:23:54.241965 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3725/7645] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:54 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:55.274775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:55.275698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:55.287275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:55.287769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:55.288220 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:55.288962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:55.289430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:55.289870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:55.441909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:55.450511 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8fedb610-bc16-4494-aeee-57cd2b5c9d81 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.182869 Oct 27 11:23:55.451093 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3921/7646] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:55 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:56.478329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:56.479397 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:56.491018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:56.491781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:56.492195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:56.492927 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:56.493378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:56.493799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:56.639622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:56.652390 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6b2b170c-baa1-4d38-86eb-37638f1b670f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.180479 Oct 27 11:23:56.653254 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3726/7647] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:56 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:57.679961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:57.680584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:57.688208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:57.688754 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:57.689211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:57.689914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:57.690422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:57.690869 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:57.835205 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:57.844041 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6899414e-d0e7-4bd0-9606-dc39eb0abd4b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.168161 Oct 27 11:23:57.844608 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3922/7648] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:57 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:23:58.876330 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:23:58.877072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:23:58.884926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:58.885413 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:58.885852 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:58.886551 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:23:58.887002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:23:58.887427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:23:59.033414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:23:59.042858 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-faae8c2e-9811-42ca-8967-9649da96c54a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.170671 Oct 27 11:23:59.043386 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3727/7649] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:23:58 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:00.070844 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:00.072096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:00.084214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:00.085106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:00.085867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:00.087052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:00.087968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:00.088432 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:00.240262 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:00.251784 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c9b2bff-fb71-4467-b4f1-a15718c8499a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.187345 Oct 27 11:24:00.252577 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3923/7650] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:00 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:01.277862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:01.278435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:01.285765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:01.286255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:01.286696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:01.287396 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:01.287851 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:01.288278 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:01.426025 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:01.434561 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7003053-8f35-4904-a456-d2f5f8594d11 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.162190 Oct 27 11:24:01.435143 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3728/7651] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:01 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:02.460715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:02.461521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:02.471624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:02.472282 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:02.472962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:02.473903 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:02.474520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:02.475107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:02.618446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:02.631219 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c823776-0901-4fa0-88d1-0e17624e8b16 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.175531 Oct 27 11:24:02.632007 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3924/7652] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:02 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:03.660308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:03.661306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:03.673491 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:03.674188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:03.674907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:03.676050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:03.676860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:03.677560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:03.815254 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:03.823750 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e9d78bf-90e6-424f-9e95-4c8d33a8d852 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.170092 Oct 27 11:24:03.824335 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3729/7653] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:03 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:04.851857 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:04.853058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:04.860637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:04.861179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:04.861638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:04.862356 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:04.862826 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:04.863275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:05.009808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:05.018139 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8fb1e7d0-aaf9-48c2-9642-0e9034a3d89b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.173019 Oct 27 11:24:05.018722 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3925/7654] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:04 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:06.042683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:06.043345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:06.051226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:06.051730 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:06.052183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:06.052935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:06.053405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:06.053845 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:06.204193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:06.216902 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f541d2d-a453-46e7-8863-e979d7c4d557 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.178386 Oct 27 11:24:06.217566 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3730/7655] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:06 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:07.247075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:07.248464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:07.257106 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:07.257639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:07.258089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:07.258813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:07.259279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:07.259787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:07.461159 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:07.469728 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1248511f-55f6-4bd0-beb4-2a5e3c4c7668 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1697 microversion: 2.1 time: 0.226913 Oct 27 11:24:07.470326 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3926/7656] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:07 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1697 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:08.112629 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-cb1dadcd-0a08-450a-a9df-c7bf6ca0def6 req-d99e080b-e887-45dd-b142-48ef0ea5356c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce93ae9d-e793-4b0a-9aaf-8d10a94886a0", "name": "network-vif-unplugged", "status": "completed", "tag": "58c55386-7507-4167-b0ff-59ae17cb5074"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:08.122799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cb1dadcd-0a08-450a-a9df-c7bf6ca0def6 req-d99e080b-e887-45dd-b142-48ef0ea5356c service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:08.123286 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cb1dadcd-0a08-450a-a9df-c7bf6ca0def6 req-d99e080b-e887-45dd-b142-48ef0ea5356c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:08.123729 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cb1dadcd-0a08-450a-a9df-c7bf6ca0def6 req-d99e080b-e887-45dd-b142-48ef0ea5356c service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:08.136646 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-cb1dadcd-0a08-450a-a9df-c7bf6ca0def6 req-d99e080b-e887-45dd-b142-48ef0ea5356c service nova] Creating event network-vif-unplugged:58c55386-7507-4167-b0ff-59ae17cb5074 for instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 on n-h2-854663-10 Oct 27 11:24:08.142331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [req-cb1dadcd-0a08-450a-a9df-c7bf6ca0def6 req-d99e080b-e887-45dd-b142-48ef0ea5356c service nova] Instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120719) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:24:08.154193 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-cb1dadcd-0a08-450a-a9df-c7bf6ca0def6 req-d99e080b-e887-45dd-b142-48ef0ea5356c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046584 Oct 27 11:24:08.155025 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3731/7657] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:24:08.494059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:08.494683 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:08.502237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:08.502749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:08.503212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:08.503933 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:08.504434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:08.504911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:08.733535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:08.741941 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bba3ae9-f853-460f-b1b2-2bb63c129ca8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1696 microversion: 2.1 time: 0.251997 Oct 27 11:24:08.742539 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3927/7658] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:08 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1696 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:09.768474 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:09.769083 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:09.776024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:09.776506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:09.776981 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:09.777667 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:09.778113 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:09.778534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:09.923488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:09.931980 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e05daa39-4461-46fa-90fe-e3cf35dd587d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1694 microversion: 2.1 time: 0.168948 Oct 27 11:24:09.932689 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3732/7659] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:09 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:10.174999 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3139e867-f4d4-4251-bead-b6d717c4f0db req-9702b375-7885-482f-8cdd-e91cc318aac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce93ae9d-e793-4b0a-9aaf-8d10a94886a0", "tag": "58c55386-7507-4167-b0ff-59ae17cb5074"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:10.187551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3139e867-f4d4-4251-bead-b6d717c4f0db req-9702b375-7885-482f-8cdd-e91cc318aac7 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:10.188125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3139e867-f4d4-4251-bead-b6d717c4f0db req-9702b375-7885-482f-8cdd-e91cc318aac7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:10.188644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3139e867-f4d4-4251-bead-b6d717c4f0db req-9702b375-7885-482f-8cdd-e91cc318aac7 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:10.202488 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3139e867-f4d4-4251-bead-b6d717c4f0db req-9702b375-7885-482f-8cdd-e91cc318aac7 service nova] Creating event network-changed:58c55386-7507-4167-b0ff-59ae17cb5074 for instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 on n-h2-854663-10 Oct 27 11:24:10.208349 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-3139e867-f4d4-4251-bead-b6d717c4f0db req-9702b375-7885-482f-8cdd-e91cc318aac7 service nova] Instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:24:10.220270 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3139e867-f4d4-4251-bead-b6d717c4f0db req-9702b375-7885-482f-8cdd-e91cc318aac7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050177 Oct 27 11:24:10.220905 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3928/7660] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:24:10.955899 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:10.956394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:10.963882 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:10.964398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:10.964928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:10.965628 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:10.966080 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:10.966504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:11.185678 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:11.193950 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aafd4d34-134d-4fdb-87e0-70152d281690 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1694 microversion: 2.1 time: 0.242158 Oct 27 11:24:11.194553 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3733/7661] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:10 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:12.225767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:12.226947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:12.234946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:12.235441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:12.235891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:12.236596 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:12.237093 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:12.237537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:12.384580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:12.393742 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c91c3491-a64d-4bc8-8050-c2b3644d4d03 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1691 microversion: 2.1 time: 0.177204 Oct 27 11:24:12.394344 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3929/7662] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:12 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:12.420242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16dd20d8-23e1-4c9c-a6d2-5271c199dd26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:12.421132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16dd20d8-23e1-4c9c-a6d2-5271c199dd26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:12.428358 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16dd20d8-23e1-4c9c-a6d2-5271c199dd26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:12.428877 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16dd20d8-23e1-4c9c-a6d2-5271c199dd26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:12.429333 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16dd20d8-23e1-4c9c-a6d2-5271c199dd26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:12.430014 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16dd20d8-23e1-4c9c-a6d2-5271c199dd26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:12.430466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16dd20d8-23e1-4c9c-a6d2-5271c199dd26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:12.430886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16dd20d8-23e1-4c9c-a6d2-5271c199dd26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:12.501854 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16dd20d8-23e1-4c9c-a6d2-5271c199dd26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0/action" status: 204 len: 0 microversion: 2.1 time: 0.085125 Oct 27 11:24:12.502592 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3734/7663] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:24:12 2022] POST /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 11:24:12.513566 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:12.514208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:12.520514 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:12.521081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:12.521578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:12.522347 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:12.522858 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:12.523298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:12.662002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:12.670322 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f231a2f-92eb-410a-afce-7bea245a62c0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1691 microversion: 2.1 time: 0.162206 Oct 27 11:24:12.671249 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3930/7664] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:12 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:12.694097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:12.694805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:12.701242 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:12.701728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:12.702163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:12.702865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:12.703317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:12.703744 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:12.855555 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:12.863802 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f54afd5a-baa0-409e-80c2-7cb08328dd60 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1691 microversion: 2.1 time: 0.174058 Oct 27 11:24:12.864384 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3735/7665] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:12 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:13.599553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5ecf1bca-82e6-40af-a14d-fe2d0232e4ec req-bd014859-6a4a-418e-8d33-e3a9065efa2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce93ae9d-e793-4b0a-9aaf-8d10a94886a0", "name": "network-vif-plugged", "status": "completed", "tag": "58c55386-7507-4167-b0ff-59ae17cb5074"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:13.610622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5ecf1bca-82e6-40af-a14d-fe2d0232e4ec req-bd014859-6a4a-418e-8d33-e3a9065efa2d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:13.611248 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5ecf1bca-82e6-40af-a14d-fe2d0232e4ec req-bd014859-6a4a-418e-8d33-e3a9065efa2d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:13.611721 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5ecf1bca-82e6-40af-a14d-fe2d0232e4ec req-bd014859-6a4a-418e-8d33-e3a9065efa2d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:13.624326 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5ecf1bca-82e6-40af-a14d-fe2d0232e4ec req-bd014859-6a4a-418e-8d33-e3a9065efa2d service nova] Creating event network-vif-plugged:58c55386-7507-4167-b0ff-59ae17cb5074 for instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 on n-h2-854663-10 Oct 27 11:24:13.629944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [req-5ecf1bca-82e6-40af-a14d-fe2d0232e4ec req-bd014859-6a4a-418e-8d33-e3a9065efa2d service nova] Instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854663-10', 'n-h2-854663-10'} {{(pid=120720) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 11:24:13.641105 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5ecf1bca-82e6-40af-a14d-fe2d0232e4ec req-bd014859-6a4a-418e-8d33-e3a9065efa2d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045939 Oct 27 11:24:13.641726 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3931/7666] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:24:13.887560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:13.888287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:13.895372 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:13.895936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:13.896370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:13.897089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:13.897529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:13.897984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:13.914990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:24:14.044951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:14.053400 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ba020d9-1bbe-461f-ba29-cde482d95225 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1683 microversion: 2.1 time: 0.170044 Oct 27 11:24:14.053978 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3736/7667] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:13 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:36.270439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=28 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:24:36.271130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=80 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:24:36.276626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2461f67-4012-4856-844b-a71455cd3320 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:36.278983 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f2461f67-4012-4856-844b-a71455cd3320 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:36.286580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2461f67-4012-4856-844b-a71455cd3320 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:36.287076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2461f67-4012-4856-844b-a71455cd3320 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:36.287537 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2461f67-4012-4856-844b-a71455cd3320 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:36.288245 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2461f67-4012-4856-844b-a71455cd3320 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:36.288730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2461f67-4012-4856-844b-a71455cd3320 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:36.289169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2461f67-4012-4856-844b-a71455cd3320 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:36.348102 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2461f67-4012-4856-844b-a71455cd3320 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0/action" status: 200 len: 24581 microversion: 2.1 time: 0.079137 Oct 27 11:24:36.348919 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3932/7668] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:24:36 2022] POST /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0/action => generated 24581 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:24:43.678886 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:43.679476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:43.682916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=34 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:24:43.683646 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:24:43.684005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b1ce0548-8156-4319-b32e-9ac33c094db9 req-4f82af27-89f7-4cd7-9985-3332f7e24966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce93ae9d-e793-4b0a-9aaf-8d10a94886a0", "tag": "58c55386-7507-4167-b0ff-59ae17cb5074"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:43.689605 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:43.690155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:43.690872 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:43.691627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:43.692277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:43.693001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:43.696216 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b1ce0548-8156-4319-b32e-9ac33c094db9 req-4f82af27-89f7-4cd7-9985-3332f7e24966 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:43.696686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b1ce0548-8156-4319-b32e-9ac33c094db9 req-4f82af27-89f7-4cd7-9985-3332f7e24966 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:43.697204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b1ce0548-8156-4319-b32e-9ac33c094db9 req-4f82af27-89f7-4cd7-9985-3332f7e24966 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:43.709032 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b1ce0548-8156-4319-b32e-9ac33c094db9 req-4f82af27-89f7-4cd7-9985-3332f7e24966 service nova] Creating event network-changed:58c55386-7507-4167-b0ff-59ae17cb5074 for instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 on n-h2-854663-10 Oct 27 11:24:43.715147 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b1ce0548-8156-4319-b32e-9ac33c094db9 req-4f82af27-89f7-4cd7-9985-3332f7e24966 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036205 Oct 27 11:24:43.716185 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3933/7669] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:24:43.722292 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:24:43.807603 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-02523e44-fcdd-43b1-9a4f-edc81bf22813 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 204 len: 0 microversion: 2.1 time: 0.132493 Oct 27 11:24:43.808353 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3737/7670] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:24:43 2022] DELETE /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:24:43.818644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:43.819372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:43.826989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:43.827494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:43.828080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:43.828849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:43.829325 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:43.829769 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:43.993134 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:44.001728 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-534c28b4-5b24-4db7-8ca0-dca580be3ae9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1689 microversion: 2.1 time: 0.187905 Oct 27 11:24:44.002438 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3934/7671] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:43 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:24:45.027199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:45.027946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:45.035425 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:45.035915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:45.036437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:45.037180 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:45.037722 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:45.038138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:45.272975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:45.281631 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5bbf7be3-d1ce-44c2-b85b-9374dcdaacb9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 200 len: 1689 microversion: 2.1 time: 0.258703 Oct 27 11:24:45.285263 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3738/7672] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:45 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 1689 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:45.730790 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c7bc7b10-a8c7-4303-a7ef-8742b3d51760 req-eb8300ca-269e-4a23-bd6d-f2d8f99e5ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce93ae9d-e793-4b0a-9aaf-8d10a94886a0", "name": "network-vif-deleted", "tag": "58c55386-7507-4167-b0ff-59ae17cb5074"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:45.741621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c7bc7b10-a8c7-4303-a7ef-8742b3d51760 req-eb8300ca-269e-4a23-bd6d-f2d8f99e5ce2 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:45.742107 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c7bc7b10-a8c7-4303-a7ef-8742b3d51760 req-eb8300ca-269e-4a23-bd6d-f2d8f99e5ce2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:45.742551 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c7bc7b10-a8c7-4303-a7ef-8742b3d51760 req-eb8300ca-269e-4a23-bd6d-f2d8f99e5ce2 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:45.754325 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c7bc7b10-a8c7-4303-a7ef-8742b3d51760 req-eb8300ca-269e-4a23-bd6d-f2d8f99e5ce2 service nova] Creating event network-vif-deleted:58c55386-7507-4167-b0ff-59ae17cb5074 for instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 on n-h2-854663-10 Oct 27 11:24:45.759095 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c7bc7b10-a8c7-4303-a7ef-8742b3d51760 req-eb8300ca-269e-4a23-bd6d-f2d8f99e5ce2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032370 Oct 27 11:24:45.759687 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3935/7673] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:24:46.306258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:46.306859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: ce93ae9d-e793-4b0a-9aaf-8d10a94886a0] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:46.314599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:46.315089 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:46.315530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:46.316246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:46.316698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:46.317132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:46.331318 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] HTTP exception thrown: Instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 could not be found. Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Request method failure captured: Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 HTTP/1.1 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmlStebiKTLBxTveHIk3m95tQoizDDGjkJ2N7T4TxY3DX1zl8AdjG7RqZ9AOOLA6Z_3SbGNDGHHJDiJxChFG1ducEQlyTap_QDjR3GAkSLzk5gzJm8PrdZhRLoiPwoC_VLHM3VeXHm49loX_N75CMOA5q-yLG64LXa8MsPLAETjoRM8 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_36d616f24c374d71ac77d9eadf706d90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: eb71fbee272b430f889f71bb9351a794 Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 could not be found. Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'ce93ae9d-e793-4b0a-9aaf-8d10a94886a0'} Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 could not be found. Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 could not be found. Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:24:46.333189 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 could not be found. Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Returning 404 to user: Instance ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bfccf885-d3dd-4b1f-93b0-8e24c74536be tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0" status: 404 len: 111 microversion: 2.1 time: 0.032570 Oct 27 11:24:46.338544 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3739/7674] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:46 2022] GET /compute/v2.1/servers/ce93ae9d-e793-4b0a-9aaf-8d10a94886a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:24:49.812987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68124c3a-88e0-4d7c-94f5-dc7b991481ab tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '.version_select at 0x7f6d5a042940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:49.835873 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68124c3a-88e0-4d7c-94f5-dc7b991481ab tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-167181982" status: 202 len: 0 microversion: 2.1 time: 0.028120 Oct 27 11:24:49.836498 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3936/7675] 10.222.0.76 () {58 vars in 1281 bytes} [Thu Oct 27 11:24:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-167181982 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:24:49.860202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07a5b7db-083d-41fb-b68e-8b0ec3612087 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: .version_select at 0x7f6d5b3d9550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1433977752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6UNrZRa0AdikvKqEKdvue1YMWIIECMMnCue53AMU0A0CAVRUnVMeFK3ILFIjBKoAo/JBnjEwUMFyxzRzfgig0aaYKxbqiSbeaNILSgImovVsKBY31ecSzBpWD/ILcYg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:49.877336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-07a5b7db-083d-41fb-b68e-8b0ec3612087 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:24:49.883446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-07a5b7db-083d-41fb-b68e-8b0ec3612087 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:24:49.913540 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07a5b7db-083d-41fb-b68e-8b0ec3612087 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059938 Oct 27 11:24:49.914096 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3740/7676] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:24:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:24:55.922724 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1439108497", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "a04f8e9f-f44b-4722-95e6-7b93f54514bb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1433977752", "security_groups": [{"name": "tempest-secgroup-smoke-227811596"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:55.935946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:24:56.054598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] validate_networks() for [('a04f8e9f-f44b-4722-95e6-7b93f54514bb', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:24:56.558239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:24:56.558673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:24:56.559189 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:24:56.559604 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:24:56.560021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:24:56.570469 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:56.570958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:56.571406 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:56.572272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:56.572766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:56.573203 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:56.591513 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:24:56.597611 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:24:56.613125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:24:56.615794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:24:56.666946 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-525c021a-17c8-4596-8265-396ed2e6771f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.748577 Oct 27 11:24:56.673300 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3937/7677] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:24:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:24:56.678597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:24:56.683822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9602a7b-c44d-4954-b053-7284fde70fdf tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:56.684443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9602a7b-c44d-4954-b053-7284fde70fdf tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:56.753036 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9602a7b-c44d-4954-b053-7284fde70fdf tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:56.760576 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9602a7b-c44d-4954-b053-7284fde70fdf tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1267 microversion: 2.1 time: 0.084210 Oct 27 11:24:56.761187 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3741/7678] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:56 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:57.785154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:57.785798 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:57.793110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:57.793815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:57.794354 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:57.795184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:57.796064 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:57.796601 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:57.872972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:57.882592 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aacebd2e-81c9-4837-b906-841c15e411e5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1319 microversion: 2.1 time: 0.102543 Oct 27 11:24:57.883588 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3938/7679] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:57 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1319 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:58.910682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:24:58.911280 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:24:58.923546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:58.924071 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:58.924518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:58.926594 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:58.927085 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:58.927522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:59.090884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:24:59.102354 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b719ba4-f671-4536-ac18-ec5a6c137041 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1392 microversion: 2.1 time: 0.198087 Oct 27 11:24:59.103482 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3742/7680] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:24:58 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:24:59.590549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-82d0d446-8644-4e4e-8369-6191337544f0 req-ce4db176-aad3-4a9a-83ae-5efbe931c727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802d088a-7d37-4139-bc21-987953492851", "tag": "3afbce96-03b2-40e1-aeda-29623f04d1d3"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:24:59.602331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-82d0d446-8644-4e4e-8369-6191337544f0 req-ce4db176-aad3-4a9a-83ae-5efbe931c727 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:24:59.602866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-82d0d446-8644-4e4e-8369-6191337544f0 req-ce4db176-aad3-4a9a-83ae-5efbe931c727 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:24:59.603413 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-82d0d446-8644-4e4e-8369-6191337544f0 req-ce4db176-aad3-4a9a-83ae-5efbe931c727 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:24:59.615835 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-82d0d446-8644-4e4e-8369-6191337544f0 req-ce4db176-aad3-4a9a-83ae-5efbe931c727 service nova] Creating event network-changed:3afbce96-03b2-40e1-aeda-29623f04d1d3 for instance 802d088a-7d37-4139-bc21-987953492851 on n-h2-854663-10 Oct 27 11:24:59.620994 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-82d0d446-8644-4e4e-8369-6191337544f0 req-ce4db176-aad3-4a9a-83ae-5efbe931c727 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034244 Oct 27 11:24:59.621619 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3939/7681] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:25:00.129059 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:00.130020 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:00.139640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:00.140317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:00.140939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:00.141943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:00.142395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:00.142832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:00.282658 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:00.290869 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e213c9e6-eac5-4fe8-8dba-b94f549a9b6d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1392 microversion: 2.1 time: 0.167357 Oct 27 11:25:00.291449 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3743/7682] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:00 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:01.317689 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:01.318410 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:01.325004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:01.325508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:01.325960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:01.326671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:01.327144 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:01.327585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:01.478270 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:01.487556 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b46826fd-6286-409d-9f69-d8761dfd2848 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1392 microversion: 2.1 time: 0.176545 Oct 27 11:25:01.488168 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3940/7683] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:01 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:02.514270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:02.515158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:02.523956 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:02.524443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:02.524917 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:02.525617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:02.526105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:02.526529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:02.672839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:02.685892 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-649eb69e-1cd3-4617-a98d-39d27bd60ecc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1392 microversion: 2.1 time: 0.177092 Oct 27 11:25:02.686735 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3744/7684] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:02 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:03.710973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:03.711750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:03.719132 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:03.719639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:03.720085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:03.720838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:03.721304 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:03.721762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:03.802815 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9e9e9d9e-d4b1-4f42-a601-f27590c04006 req-9d65ce63-a332-4655-a8ee-0531a9db6c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802d088a-7d37-4139-bc21-987953492851", "name": "network-vif-plugged", "status": "completed", "tag": "3afbce96-03b2-40e1-aeda-29623f04d1d3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:25:03.814045 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e9e9d9e-d4b1-4f42-a601-f27590c04006 req-9d65ce63-a332-4655-a8ee-0531a9db6c43 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:03.814583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e9e9d9e-d4b1-4f42-a601-f27590c04006 req-9d65ce63-a332-4655-a8ee-0531a9db6c43 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:03.815077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9e9e9d9e-d4b1-4f42-a601-f27590c04006 req-9d65ce63-a332-4655-a8ee-0531a9db6c43 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:03.828361 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9e9e9d9e-d4b1-4f42-a601-f27590c04006 req-9d65ce63-a332-4655-a8ee-0531a9db6c43 service nova] Creating event network-vif-plugged:3afbce96-03b2-40e1-aeda-29623f04d1d3 for instance 802d088a-7d37-4139-bc21-987953492851 on n-h2-854663-10 Oct 27 11:25:03.833711 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9e9e9d9e-d4b1-4f42-a601-f27590c04006 req-9d65ce63-a332-4655-a8ee-0531a9db6c43 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035106 Oct 27 11:25:03.834617 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3745/7685] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:25:03.863034 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:03.873564 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6514e151-4f34-4f66-9479-e0b78a067eec tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1392 microversion: 2.1 time: 0.166646 Oct 27 11:25:03.874210 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3941/7686] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:03 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:04.898865 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:04.899552 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:04.906400 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:04.906889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:04.907325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:04.907997 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:04.908464 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:04.908950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:05.051796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:05.061387 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ae806de-fdde-488e-ad6c-548a6161afc6 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1392 microversion: 2.1 time: 0.167728 Oct 27 11:25:05.061993 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3746/7687] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:04 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:06.085589 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:06.086236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:06.093736 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:06.094249 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:06.094705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:06.095424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:06.095899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:06.096348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:06.236859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:06.245785 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff00b7a9-b274-459d-8637-740d207a8bc1 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1565 microversion: 2.1 time: 0.164634 Oct 27 11:25:06.246379 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3942/7688] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:06 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:06.271924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:06.272507 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:06.280297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:06.280809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:06.281245 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:06.281941 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:06.282386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:06.282809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:06.433791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:06.441860 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6540d4b-1993-4c48-aa53-40c06fe49c6a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1565 microversion: 2.1 time: 0.174234 Oct 27 11:25:06.442519 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3747/7689] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:06 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:08.121553 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:08.122165 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:08.124458 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9f82e6d3-7b2b-46b7-8c3d-8fdcf782f428 req-ffcc4a9e-3422-4ed8-82a7-8d01b676fc81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802d088a-7d37-4139-bc21-987953492851", "tag": "3afbce96-03b2-40e1-aeda-29623f04d1d3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:25:08.124958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:25:08.125280 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:25:08.127078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:25:08.134127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:25:08.134770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:08.135547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:08.136226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:08.137801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9f82e6d3-7b2b-46b7-8c3d-8fdcf782f428 req-ffcc4a9e-3422-4ed8-82a7-8d01b676fc81 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:08.138088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:08.138312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9f82e6d3-7b2b-46b7-8c3d-8fdcf782f428 req-ffcc4a9e-3422-4ed8-82a7-8d01b676fc81 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:08.138796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9f82e6d3-7b2b-46b7-8c3d-8fdcf782f428 req-ffcc4a9e-3422-4ed8-82a7-8d01b676fc81 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:08.139065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:08.139753 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:08.152151 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9f82e6d3-7b2b-46b7-8c3d-8fdcf782f428 req-ffcc4a9e-3422-4ed8-82a7-8d01b676fc81 service nova] Creating event network-changed:3afbce96-03b2-40e1-aeda-29623f04d1d3 for instance 802d088a-7d37-4139-bc21-987953492851 on n-h2-854663-10 Oct 27 11:25:08.158430 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9f82e6d3-7b2b-46b7-8c3d-8fdcf782f428 req-ffcc4a9e-3422-4ed8-82a7-8d01b676fc81 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037913 Oct 27 11:25:08.159258 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3748/7690] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:25:08.288292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:08.297244 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4623e8ec-3b60-4df0-9655-0016c5aaa2d3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1565 microversion: 2.1 time: 0.179945 Oct 27 11:25:08.297997 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3943/7691] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:08 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:29.594281 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a807ec67-a67c-4a70-8852-19a7d4ad6ebc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:25:29.596603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a807ec67-a67c-4a70-8852-19a7d4ad6ebc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:29.599058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:25:29.599681 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=34 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:25:29.606901 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a807ec67-a67c-4a70-8852-19a7d4ad6ebc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:29.607402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a807ec67-a67c-4a70-8852-19a7d4ad6ebc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:29.608084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a807ec67-a67c-4a70-8852-19a7d4ad6ebc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:29.608820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a807ec67-a67c-4a70-8852-19a7d4ad6ebc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:29.609270 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a807ec67-a67c-4a70-8852-19a7d4ad6ebc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:29.609670 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a807ec67-a67c-4a70-8852-19a7d4ad6ebc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:29.666599 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a807ec67-a67c-4a70-8852-19a7d4ad6ebc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action" status: 200 len: 24572 microversion: 2.1 time: 0.077790 Oct 27 11:25:29.667345 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3749/7692] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:25:29 2022] POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:25:35.994613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa9368cb-2fa3-4192-a1e4-01357573a94f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:25:35.998528 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:25:35.999960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=34 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:25:36.007018 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9368cb-2fa3-4192-a1e4-01357573a94f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:36.007518 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9368cb-2fa3-4192-a1e4-01357573a94f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:36.007966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9368cb-2fa3-4192-a1e4-01357573a94f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:36.032043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa9368cb-2fa3-4192-a1e4-01357573a94f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 11:25:36.079926 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa9368cb-2fa3-4192-a1e4-01357573a94f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action" status: 202 len: 0 microversion: 2.1 time: 0.092142 Oct 27 11:25:36.081097 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3944/7693] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:25:35 2022] POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:25:36.091418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:36.092217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:36.100461 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:36.101277 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:36.101710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:36.102500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:36.102959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:36.103385 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:36.258583 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:36.266842 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-149344cf-df3b-4584-96d4-250228040112 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1692 microversion: 2.1 time: 0.179777 Oct 27 11:25:36.267674 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3750/7694] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:36 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:37.294412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:37.295864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:37.304675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:37.305190 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:37.305639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:37.306386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:37.306852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:37.307486 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:37.453207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:37.465566 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9dfa58a7-b684-40da-8b14-995b614c1d2c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1692 microversion: 2.1 time: 0.177238 Oct 27 11:25:37.466343 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3945/7695] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:37 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:38.492229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:38.492916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:38.500226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:38.500709 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:38.501167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:38.501855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:38.502300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:38.502721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:38.646621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:38.657903 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-029f6e4f-95b7-41f4-9bf4-5f6fc4bcfa68 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1692 microversion: 2.1 time: 0.170421 Oct 27 11:25:38.658602 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3751/7696] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:38 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:39.687552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:39.688149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:39.697502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:39.698133 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:39.698612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:39.699321 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:39.699792 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:39.700257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:39.851969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:39.860695 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15f62578-0770-489e-ae60-4adae99455d7 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1692 microversion: 2.1 time: 0.180823 Oct 27 11:25:39.861404 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3946/7697] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:39 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:40.888001 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:40.888963 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:40.898238 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:40.898880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:40.899801 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:40.900319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:40.900985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:40.901515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:41.048377 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:41.060533 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e578eb94-3130-4635-a6d3-812e77c016f4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1692 microversion: 2.1 time: 0.177590 Oct 27 11:25:41.061368 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3752/7698] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:40 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:42.091268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:42.092308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:42.104272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:42.105182 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:42.105939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:42.107192 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:42.107946 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:42.108747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:42.259881 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:42.273075 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7c693c1-7587-4041-a35a-37cdf59dea4d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1692 microversion: 2.1 time: 0.188211 Oct 27 11:25:42.274119 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3947/7699] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:42 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:43.306962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:43.308016 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:43.319230 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:43.319715 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:43.320155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:43.320893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:43.321348 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:43.321866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:43.458097 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:43.466404 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e55369a-f5cd-4940-ae9d-e02d085ef762 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1692 microversion: 2.1 time: 0.166142 Oct 27 11:25:43.466987 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3753/7700] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:43 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:44.490632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:44.491297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:44.498353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:44.498860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:44.499316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:44.500030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:44.500495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:44.500984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:44.646959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:44.655053 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e25f0c2d-c58d-4513-b16b-c4ba6713e4a4 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1692 microversion: 2.1 time: 0.168966 Oct 27 11:25:44.655620 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3948/7701] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:44 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:45.682809 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:45.683549 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:45.692724 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:45.693374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:45.693962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:45.694833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:45.695405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:45.695932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:45.837580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:45.845927 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-072385d9-ad6c-4108-84cf-06d268a371e2 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1692 microversion: 2.1 time: 0.168725 Oct 27 11:25:45.846513 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3754/7702] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:45 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:46.870017 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:46.870638 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:46.878463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:46.878968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:46.879440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:46.880214 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:46.880767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:46.881357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:47.033236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:47.041816 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8573f43c-fe5a-44aa-88fa-e629e7023451 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1669 microversion: 2.1 time: 0.175936 Oct 27 11:25:47.042398 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3949/7703] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:46 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:25:48.149544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-851e038a-b7af-4ff3-bd48-2f34b0d1a24e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:25:48.151775 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-851e038a-b7af-4ff3-bd48-2f34b0d1a24e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:48.159136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-851e038a-b7af-4ff3-bd48-2f34b0d1a24e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:48.159614 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-851e038a-b7af-4ff3-bd48-2f34b0d1a24e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:48.160050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-851e038a-b7af-4ff3-bd48-2f34b0d1a24e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:48.161010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-851e038a-b7af-4ff3-bd48-2f34b0d1a24e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:48.161585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-851e038a-b7af-4ff3-bd48-2f34b0d1a24e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:48.162008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-851e038a-b7af-4ff3-bd48-2f34b0d1a24e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:48.216514 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-851e038a-b7af-4ff3-bd48-2f34b0d1a24e tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action" status: 200 len: 35162 microversion: 2.1 time: 0.073580 Oct 27 11:25:48.217349 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3755/7704] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:25:48 2022] POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action => generated 35162 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:25:48.232548 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-039bd773-b356-43c0-9cbd-2337a23aa69c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:25:48.239985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-039bd773-b356-43c0-9cbd-2337a23aa69c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:48.240485 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-039bd773-b356-43c0-9cbd-2337a23aa69c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:48.241000 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-039bd773-b356-43c0-9cbd-2337a23aa69c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:48.263633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-039bd773-b356-43c0-9cbd-2337a23aa69c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Going to try to start instance {{(pid=120720) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 11:25:48.311446 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-039bd773-b356-43c0-9cbd-2337a23aa69c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action" status: 202 len: 0 microversion: 2.1 time: 0.082712 Oct 27 11:25:48.312083 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3950/7705] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:25:48 2022] POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:25:48.321506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:48.322211 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:48.329663 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:48.330290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:48.330757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:48.331466 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:48.331919 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:48.332340 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:48.475796 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:48.484047 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ecce467c-91af-4d12-8bd7-cd878ed741f9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1678 microversion: 2.1 time: 0.167035 Oct 27 11:25:48.484890 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3756/7706] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:48 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:25:49.514557 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:25:49.515679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:25:49.525670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:49.526170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:49.526609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:49.527316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:25:49.527781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:25:49.528219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:25:49.682538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:25:49.690824 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9f81b0e-a4c9-4acf-84c6-58c90e543e5f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1682 microversion: 2.1 time: 0.184869 Oct 27 11:25:49.691417 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3951/7707] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:25:49 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:13.911418 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-18813321-32a6-4091-aebe-dfd0c0a6c815 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:26:13.913689 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-18813321-32a6-4091-aebe-dfd0c0a6c815 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:13.916505 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=16 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:13.917192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=44 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:13.924414 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18813321-32a6-4091-aebe-dfd0c0a6c815 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:13.924951 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18813321-32a6-4091-aebe-dfd0c0a6c815 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:13.925406 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18813321-32a6-4091-aebe-dfd0c0a6c815 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:13.926108 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18813321-32a6-4091-aebe-dfd0c0a6c815 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:13.926559 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18813321-32a6-4091-aebe-dfd0c0a6c815 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:13.926984 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18813321-32a6-4091-aebe-dfd0c0a6c815 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:13.983598 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-18813321-32a6-4091-aebe-dfd0c0a6c815 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action" status: 200 len: 59716 microversion: 2.1 time: 0.076767 Oct 27 11:26:13.984501 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3757/7708] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:26:13 2022] POST /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851/action => generated 59716 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:26:21.050467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:21.051023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:21.054125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:21.054851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:21.063738 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:21.064532 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:21.065065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:21.066614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:21.067147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:21.067759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:21.096957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:26:21.112733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-91b0c8b7-b404-4729-910b-df04b6cd6b6c req-85a702a8-65ff-49e4-816a-579952675b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802d088a-7d37-4139-bc21-987953492851", "tag": "3afbce96-03b2-40e1-aeda-29623f04d1d3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:26:21.124777 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-91b0c8b7-b404-4729-910b-df04b6cd6b6c req-85a702a8-65ff-49e4-816a-579952675b8d service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:21.125582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-91b0c8b7-b404-4729-910b-df04b6cd6b6c req-85a702a8-65ff-49e4-816a-579952675b8d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:21.126283 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-91b0c8b7-b404-4729-910b-df04b6cd6b6c req-85a702a8-65ff-49e4-816a-579952675b8d service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:21.138570 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-91b0c8b7-b404-4729-910b-df04b6cd6b6c req-85a702a8-65ff-49e4-816a-579952675b8d service nova] Creating event network-changed:3afbce96-03b2-40e1-aeda-29623f04d1d3 for instance 802d088a-7d37-4139-bc21-987953492851 on n-h2-854663-10 Oct 27 11:26:21.145348 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-91b0c8b7-b404-4729-910b-df04b6cd6b6c req-85a702a8-65ff-49e4-816a-579952675b8d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095919 Oct 27 11:26:21.146571 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3758/7709] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:26:21.192936 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a336924c-6fc2-43c7-ae27-372516cbbafc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 204 len: 0 microversion: 2.1 time: 0.145879 Oct 27 11:26:21.193456 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3952/7710] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:26:21 2022] DELETE /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:26:21.203282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:21.203986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:21.211223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:21.211713 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:21.212256 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:21.213056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:21.213504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:21.213924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:21.357926 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:21.366213 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12c7d8cc-45df-419d-b02a-d6baebe8fda5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1688 microversion: 2.1 time: 0.167763 Oct 27 11:26:21.366783 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3759/7711] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:21 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:26:22.392164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:22.392796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:22.401051 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:22.401699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:22.402155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:22.402887 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:22.403355 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:22.403794 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:22.539816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:22.550437 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c84a989-7672-49eb-89b1-694264ac85a8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1688 microversion: 2.1 time: 0.162353 Oct 27 11:26:22.551038 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3953/7712] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:22 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:23.161692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-68ef1142-7bb9-436e-9afd-31bf1adcbb73 req-65a86761-d643-48ce-b558-312202ee63ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802d088a-7d37-4139-bc21-987953492851", "name": "network-vif-deleted", "tag": "3afbce96-03b2-40e1-aeda-29623f04d1d3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:26:23.172953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-68ef1142-7bb9-436e-9afd-31bf1adcbb73 req-65a86761-d643-48ce-b558-312202ee63ac service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:23.173564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-68ef1142-7bb9-436e-9afd-31bf1adcbb73 req-65a86761-d643-48ce-b558-312202ee63ac service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:23.174039 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-68ef1142-7bb9-436e-9afd-31bf1adcbb73 req-65a86761-d643-48ce-b558-312202ee63ac service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:23.186292 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-68ef1142-7bb9-436e-9afd-31bf1adcbb73 req-65a86761-d643-48ce-b558-312202ee63ac service nova] Creating event network-vif-deleted:3afbce96-03b2-40e1-aeda-29623f04d1d3 for instance 802d088a-7d37-4139-bc21-987953492851 on n-h2-854663-10 Oct 27 11:26:23.191051 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-68ef1142-7bb9-436e-9afd-31bf1adcbb73 req-65a86761-d643-48ce-b558-312202ee63ac service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033359 Oct 27 11:26:23.191659 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3760/7713] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:26:23.576127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:23.576802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:23.585490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:23.586003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:23.587235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:23.588570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:23.589278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:23.589707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:23.622675 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:23.623319 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:23.623620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:23.624094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lazy-loading 'fault' on Instance uuid 802d088a-7d37-4139-bc21-987953492851 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:26:23.666787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:23.675204 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52b3f2ac-8c8e-40eb-87a5-74d52164c58c tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 200 len: 1357 microversion: 2.1 time: 0.105183 Oct 27 11:26:23.675960 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3954/7714] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:23 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:24.700305 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:26:24.701004 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 (ip 10.222.0.76) !!! Oct 27 11:26:24.707677 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:24.708504 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: 802d088a-7d37-4139-bc21-987953492851] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:24.719975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:24.720548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:24.721093 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:24.721912 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:24.722442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:24.722943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:24.740565 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] HTTP exception thrown: Instance 802d088a-7d37-4139-bc21-987953492851 could not be found. Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Request method failure captured: Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 HTTP/1.1 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmlStebiKTLBxTveHIk3m95tQoizDDGjkJ2N7T4TxY3DX1zl8AdjG7RqZ9AOOLA6Z_3SbGNDGHHJDiJxChFG1ducEQlyTap_QDjR3GAkSLzk5gzJm8PrdZhRLoiPwoC_VLHM3VeXHm49loX_N75CMOA5q-yLG64LXa8MsPLAETjoRM8 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_36d616f24c374d71ac77d9eadf706d90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: eb71fbee272b430f889f71bb9351a794 Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 802d088a-7d37-4139-bc21-987953492851 could not be found. Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '802d088a-7d37-4139-bc21-987953492851'} Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802d088a-7d37-4139-bc21-987953492851 could not be found. Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802d088a-7d37-4139-bc21-987953492851 could not be found. Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:26:24.742269 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802d088a-7d37-4139-bc21-987953492851 could not be found. Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Returning 404 to user: Instance 802d088a-7d37-4139-bc21-987953492851 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4066516d-f3ff-4d09-89ea-a7a407b38bb5 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851" status: 404 len: 111 microversion: 2.1 time: 0.046151 Oct 27 11:26:24.748260 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3761/7715] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:24 2022] GET /compute/v2.1/servers/802d088a-7d37-4139-bc21-987953492851 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:26:27.876053 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7aaadf24-d05a-4f4d-bf35-5774552b5286 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '.version_select at 0x7f6d5aa74e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:27.899441 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7aaadf24-d05a-4f4d-bf35-5774552b5286 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1433977752" status: 202 len: 0 microversion: 2.1 time: 0.028206 Oct 27 11:26:27.900247 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3955/7716] 10.222.0.76 () {58 vars in 1284 bytes} [Thu Oct 27 11:26:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1433977752 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:26:27.929343 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f57beb16-87c8-4a03-ba09-78d487dcd09d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: .version_select at 0x7f6d6386bca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2045201347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIky0u1D9FKU4S0m7KKEmOXiz9wsVtMJyoEUdJwArjNP5M513mBrfJgUHcBb0xjzy9D6uiYdBPuuc3FOsObosX/nkfj25sdPbVMwyeqTS857M6wioJFR7ZksxDCKOdbARA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:26:27.947122 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f57beb16-87c8-4a03-ba09-78d487dcd09d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:26:27.954005 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-f57beb16-87c8-4a03-ba09-78d487dcd09d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:26:27.981190 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f57beb16-87c8-4a03-ba09-78d487dcd09d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055840 Oct 27 11:26:27.981812 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3762/7717] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:26:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:26:33.976439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1059892937", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "networks": [{"uuid": "a9c0c6db-e627-415b-812f-6d4f6d273026"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2045201347", "security_groups": [{"name": "tempest-secgroup-smoke-1264073179"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:26:33.989560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:34.113580 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] validate_networks() for [('a9c0c6db-e627-415b-812f-6d4f6d273026', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:26:34.525503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:26:34.526149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:26:34.526707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:26:34.527357 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:26:34.527899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:26:34.537451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:34.537959 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:34.538422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:34.539147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:34.539607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:34.540039 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:34.562717 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:26:34.568197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Getting quotas for user eb71fbee272b430f889f71bb9351a794 and project 36d616f24c374d71ac77d9eadf706d90. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:26:34.581560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:26:34.583910 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:26:34.634771 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83fb4a18-7258-417f-b9da-4f5535a67e74 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.662257 Oct 27 11:26:34.635683 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3956/7718] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:26:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:26:34.646881 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3cf3815d-1661-42d6-bdbe-b70df8931ea8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:34.647539 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3cf3815d-1661-42d6-bdbe-b70df8931ea8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:34.707754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cf3815d-1661-42d6-bdbe-b70df8931ea8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:34.716202 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3cf3815d-1661-42d6-bdbe-b70df8931ea8 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1267 microversion: 2.1 time: 0.073188 Oct 27 11:26:34.717231 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3763/7719] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:34 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:35.743704 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:35.744777 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:35.761439 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:35.763306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:35.763306 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:35.763539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:35.763861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:35.764475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:35.844219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:35.855421 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8111655d-4502-4941-88c2-2b9952390dfb tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1327 microversion: 2.1 time: 0.118594 Oct 27 11:26:35.856109 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3957/7720] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:35 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:36.879964 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:36.880582 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:36.882884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=16 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:36.890544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:36.891038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:36.891479 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:36.892220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:36.892757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:36.893168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:37.061623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:37.072053 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3a2234b9-5b00-4890-9a4c-dd73aa34842a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1393 microversion: 2.1 time: 0.196177 Oct 27 11:26:37.076711 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3764/7721] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:36 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1393 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:37.326268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-11c09590-afa6-4411-9d41-5c5495f7f9ae req-8b9d191f-93ee-4354-9b15-b570454f2398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e48a33-69c4-4918-af7d-bab72260cc17", "tag": "272f5124-c38f-4f8a-9dbc-aafb3fcd5574"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:26:37.337479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-11c09590-afa6-4411-9d41-5c5495f7f9ae req-8b9d191f-93ee-4354-9b15-b570454f2398 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:37.338511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-11c09590-afa6-4411-9d41-5c5495f7f9ae req-8b9d191f-93ee-4354-9b15-b570454f2398 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:37.339046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-11c09590-afa6-4411-9d41-5c5495f7f9ae req-8b9d191f-93ee-4354-9b15-b570454f2398 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:37.351489 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-11c09590-afa6-4411-9d41-5c5495f7f9ae req-8b9d191f-93ee-4354-9b15-b570454f2398 service nova] Creating event network-changed:272f5124-c38f-4f8a-9dbc-aafb3fcd5574 for instance f6e48a33-69c4-4918-af7d-bab72260cc17 on n-h1-854663-10 Oct 27 11:26:37.356752 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-11c09590-afa6-4411-9d41-5c5495f7f9ae req-8b9d191f-93ee-4354-9b15-b570454f2398 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034562 Oct 27 11:26:37.357604 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3958/7722] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:26:38.100420 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:38.101405 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:38.110502 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:38.110967 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:38.111638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:38.112352 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:38.112869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:38.113304 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:38.258868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:38.267165 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e88a3ba1-68c5-4ade-88c4-41541b28b63d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1393 microversion: 2.1 time: 0.174114 Oct 27 11:26:38.267794 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3765/7723] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:38 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:39.300889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:39.301615 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:39.308254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:39.308778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:39.315987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:39.317071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:39.317554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:39.317971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:39.460476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:39.469519 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-271565df-976a-408a-b797-9fefd9c79fce tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1393 microversion: 2.1 time: 0.175148 Oct 27 11:26:39.470151 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3959/7724] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:39 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:26:40.495309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:40.496306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:40.507165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:40.507938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:40.508613 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:40.509759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:40.510417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:40.511072 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:41.021841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:41.030395 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46a3e335-e4b0-4aae-955c-91da66623d86 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1393 microversion: 2.1 time: 0.541112 Oct 27 11:26:41.031238 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3766/7725] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:40 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1393 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:41.445036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-88be1324-c98a-4ba8-8829-4d669c57d706 req-469e53d8-3485-4bd2-b949-500580563668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e48a33-69c4-4918-af7d-bab72260cc17", "name": "network-vif-plugged", "status": "completed", "tag": "272f5124-c38f-4f8a-9dbc-aafb3fcd5574"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:26:41.456560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-88be1324-c98a-4ba8-8829-4d669c57d706 req-469e53d8-3485-4bd2-b949-500580563668 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:41.457286 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-88be1324-c98a-4ba8-8829-4d669c57d706 req-469e53d8-3485-4bd2-b949-500580563668 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:41.457735 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-88be1324-c98a-4ba8-8829-4d669c57d706 req-469e53d8-3485-4bd2-b949-500580563668 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:41.469759 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-88be1324-c98a-4ba8-8829-4d669c57d706 req-469e53d8-3485-4bd2-b949-500580563668 service nova] Creating event network-vif-plugged:272f5124-c38f-4f8a-9dbc-aafb3fcd5574 for instance f6e48a33-69c4-4918-af7d-bab72260cc17 on n-h1-854663-10 Oct 27 11:26:41.475159 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-88be1324-c98a-4ba8-8829-4d669c57d706 req-469e53d8-3485-4bd2-b949-500580563668 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033764 Oct 27 11:26:41.475835 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3960/7726] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:26:42.055496 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:42.056118 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:42.063638 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:42.064117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:42.064556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:42.065297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:42.065757 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:42.066188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:42.210635 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:42.219568 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d5f5809-1f8c-4c99-83a7-9a135605395d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1393 microversion: 2.1 time: 0.168160 Oct 27 11:26:42.220159 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3767/7727] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:42 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:43.258538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:43.259684 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:43.267464 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:43.267962 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:43.268409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:43.269153 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:43.269618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:43.270055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:43.419606 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:43.428385 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98577725-5224-406a-9b0b-4f44e80cc07d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1565 microversion: 2.1 time: 0.178734 Oct 27 11:26:43.428997 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3961/7728] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:43 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:43.451307 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:43.451869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:43.458991 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:43.459798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:43.460243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:43.460968 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:43.461416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:43.461835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:43.601207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:43.609532 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34dccbe8-66d0-40e4-8c39-2633fcf3f424 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1565 microversion: 2.1 time: 0.162321 Oct 27 11:26:43.610112 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3768/7729] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:43 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:26:45.288332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:26:45.289006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:26:45.290221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-bb45a04d-53ec-4de9-bdb7-b0abdda9a48a req-27372940-05c7-4d64-b23d-e5000af07a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e48a33-69c4-4918-af7d-bab72260cc17", "tag": "272f5124-c38f-4f8a-9dbc-aafb3fcd5574"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:26:45.291886 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:45.292758 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:45.299229 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:45.300239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:26:45.300680 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:45.301501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:45.302096 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:45.303237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:45.303746 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:45.304188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:45.309221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bb45a04d-53ec-4de9-bdb7-b0abdda9a48a req-27372940-05c7-4d64-b23d-e5000af07a7e service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:26:45.310389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bb45a04d-53ec-4de9-bdb7-b0abdda9a48a req-27372940-05c7-4d64-b23d-e5000af07a7e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:26:45.311659 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bb45a04d-53ec-4de9-bdb7-b0abdda9a48a req-27372940-05c7-4d64-b23d-e5000af07a7e service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:26:45.324492 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-bb45a04d-53ec-4de9-bdb7-b0abdda9a48a req-27372940-05c7-4d64-b23d-e5000af07a7e service nova] Creating event network-changed:272f5124-c38f-4f8a-9dbc-aafb3fcd5574 for instance f6e48a33-69c4-4918-af7d-bab72260cc17 on n-h1-854663-10 Oct 27 11:26:45.331039 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-bb45a04d-53ec-4de9-bdb7-b0abdda9a48a req-27372940-05c7-4d64-b23d-e5000af07a7e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044710 Oct 27 11:26:45.333171 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3769/7730] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:26:45.463360 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:26:45.472675 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5febe5c0-a692-476a-ab4a-d57ec99eed80 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1565 microversion: 2.1 time: 0.188591 Oct 27 11:26:45.473361 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3962/7731] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:26:45 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:10.774386 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=32 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:10.775103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:10.779781 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43779ba0-bb15-482f-a334-ba372e898f26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:10.782116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43779ba0-bb15-482f-a334-ba372e898f26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:10.789444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43779ba0-bb15-482f-a334-ba372e898f26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:10.789924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43779ba0-bb15-482f-a334-ba372e898f26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:10.790360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43779ba0-bb15-482f-a334-ba372e898f26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:10.791053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43779ba0-bb15-482f-a334-ba372e898f26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:10.791501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43779ba0-bb15-482f-a334-ba372e898f26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:10.791931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43779ba0-bb15-482f-a334-ba372e898f26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:10.844102 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43779ba0-bb15-482f-a334-ba372e898f26 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action" status: 200 len: 24577 microversion: 2.1 time: 0.071625 Oct 27 11:27:10.844775 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3770/7732] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:27:10 2022] POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action => generated 24577 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:27:21.789665 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:21.790656 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:21.793936 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:21.795602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=30 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:21.804747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:21.805254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:21.805714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:21.806441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:21.806911 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:21.807353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:21.832194 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lazy-loading 'flavor' on Instance uuid f6e48a33-69c4-4918-af7d-bab72260cc17 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:27:21.908681 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7842daa3-1cd1-4bb0-acc0-c7e5ad85cd2f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action" status: 202 len: 0 microversion: 2.1 time: 0.126242 Oct 27 11:27:21.909389 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3963/7733] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:27:21 2022] POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:27:21.918490 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:21.919197 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:21.922473 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:21.923152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:21.930021 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:21.930572 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:21.930952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:21.931834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:21.932305 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:21.932751 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:22.083019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:22.091197 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-390ff02d-8b8c-41cc-884e-04be2dc8a4b9 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1691 microversion: 2.1 time: 0.177145 Oct 27 11:27:22.091744 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3771/7734] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:21 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:23.121612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:23.122508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:23.130827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:23.131440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:23.131978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:23.132906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:23.133491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:23.134036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:23.280142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:23.288474 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a479836-fc31-4e5f-b7bb-605c6b096f48 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1674 microversion: 2.1 time: 0.173710 Oct 27 11:27:23.289056 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3964/7735] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:23 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:24.396554 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65a91e97-33a6-4b05-ac56-a786d882438b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:24.400200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-65a91e97-33a6-4b05-ac56-a786d882438b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:24.413426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65a91e97-33a6-4b05-ac56-a786d882438b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:24.413915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65a91e97-33a6-4b05-ac56-a786d882438b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:24.414351 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65a91e97-33a6-4b05-ac56-a786d882438b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:24.415060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65a91e97-33a6-4b05-ac56-a786d882438b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:24.415498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65a91e97-33a6-4b05-ac56-a786d882438b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:24.415909 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65a91e97-33a6-4b05-ac56-a786d882438b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:24.474486 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65a91e97-33a6-4b05-ac56-a786d882438b tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action" status: 200 len: 38373 microversion: 2.1 time: 0.084336 Oct 27 11:27:24.475325 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3772/7736] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:27:24 2022] POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action => generated 38373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:27:24.488130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87250531-ef13-4c27-a0d8-fc2a01bb97a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:24.488707 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-87250531-ef13-4c27-a0d8-fc2a01bb97a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:24.496633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87250531-ef13-4c27-a0d8-fc2a01bb97a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:24.497193 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87250531-ef13-4c27-a0d8-fc2a01bb97a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:24.497635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87250531-ef13-4c27-a0d8-fc2a01bb97a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:24.498343 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87250531-ef13-4c27-a0d8-fc2a01bb97a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:24.498805 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87250531-ef13-4c27-a0d8-fc2a01bb97a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:24.499242 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87250531-ef13-4c27-a0d8-fc2a01bb97a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:24.572563 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87250531-ef13-4c27-a0d8-fc2a01bb97a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action" status: 202 len: 0 microversion: 2.1 time: 0.088469 Oct 27 11:27:24.573302 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3965/7737] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:27:24 2022] POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:27:24.582943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:24.583778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:24.594370 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:24.594889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:24.595294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:24.595995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:24.596450 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:24.596934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:24.739543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:24.748496 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-db201245-9a0f-42db-9669-b0b059016edc tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1680 microversion: 2.1 time: 0.169780 Oct 27 11:27:24.749392 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3773/7738] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:24 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:25.776833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:25.777757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:25.788830 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:25.789344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:25.789800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:25.790567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:25.791055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:25.791501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:25.939938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:25.948346 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-04609c31-1d58-43c3-b956-ec6fe4bfef27 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1680 microversion: 2.1 time: 0.177945 Oct 27 11:27:25.949045 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3966/7739] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:25 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:26.975671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:26.977664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:26.991361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:26.991848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:26.992284 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:26.993008 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:26.994598 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:26.995768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:27.140891 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:27.149128 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a629bc07-b2ab-4177-b51f-0476d7bdeb19 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1683 microversion: 2.1 time: 0.180224 Oct 27 11:27:27.149714 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3774/7740] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:26 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:27.256451 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c94fb79c-9a63-4bbd-a0d1-842334a91cc3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:27.258741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c94fb79c-9a63-4bbd-a0d1-842334a91cc3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:27.266374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94fb79c-9a63-4bbd-a0d1-842334a91cc3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:27.266872 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94fb79c-9a63-4bbd-a0d1-842334a91cc3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:27.267322 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94fb79c-9a63-4bbd-a0d1-842334a91cc3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:27.268026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94fb79c-9a63-4bbd-a0d1-842334a91cc3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:27.268489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94fb79c-9a63-4bbd-a0d1-842334a91cc3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:27.268969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94fb79c-9a63-4bbd-a0d1-842334a91cc3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:27.317856 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c94fb79c-9a63-4bbd-a0d1-842334a91cc3 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action" status: 200 len: 38373 microversion: 2.1 time: 0.067740 Oct 27 11:27:27.319303 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3967/7741] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:27:27 2022] POST /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17/action => generated 38373 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 11:27:28.341279 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:28.341828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:28.343781 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0fea07d8-610e-4e9a-84e6-b7dbe21c8f5b req-0cc58dba-e505-4e90-9e85-87d554fc6aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e48a33-69c4-4918-af7d-bab72260cc17", "tag": "272f5124-c38f-4f8a-9dbc-aafb3fcd5574"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:28.349094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:28.349656 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:28.350206 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:28.351151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:28.351676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:28.352169 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:28.355184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0fea07d8-610e-4e9a-84e6-b7dbe21c8f5b req-0cc58dba-e505-4e90-9e85-87d554fc6aa4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:28.355947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0fea07d8-610e-4e9a-84e6-b7dbe21c8f5b req-0cc58dba-e505-4e90-9e85-87d554fc6aa4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:28.356679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0fea07d8-610e-4e9a-84e6-b7dbe21c8f5b req-0cc58dba-e505-4e90-9e85-87d554fc6aa4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:28.368620 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0fea07d8-610e-4e9a-84e6-b7dbe21c8f5b req-0cc58dba-e505-4e90-9e85-87d554fc6aa4 service nova] Creating event network-changed:272f5124-c38f-4f8a-9dbc-aafb3fcd5574 for instance f6e48a33-69c4-4918-af7d-bab72260cc17 on n-h1-854663-10 Oct 27 11:27:28.373588 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0fea07d8-610e-4e9a-84e6-b7dbe21c8f5b req-0cc58dba-e505-4e90-9e85-87d554fc6aa4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033884 Oct 27 11:27:28.374197 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3968/7742] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:27:28.380046 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:27:28.473475 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-701a4dff-d1c6-4d2b-bd83-ec95b331b87f tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 204 len: 0 microversion: 2.1 time: 0.135820 Oct 27 11:27:28.477720 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3775/7743] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:27:28 2022] DELETE /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:27:28.483505 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:28.484235 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:28.491436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:28.491948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:28.492626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:28.493388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:28.493861 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:28.494308 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:28.637578 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:28.645578 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47c12810-b5d8-4577-bc65-f8e339e7710d tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1689 microversion: 2.1 time: 0.166366 Oct 27 11:27:28.646200 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3969/7744] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:28 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:29.676268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:29.677309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:29.690928 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:29.691764 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:29.692498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:29.693819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:29.694378 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:29.694810 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:29.838483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:29.847023 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6066e91-cb2c-4f42-b6b0-f70e210753a0 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1689 microversion: 2.1 time: 0.178613 Oct 27 11:27:29.847622 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3776/7745] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:29 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:30.728834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b17d8c47-7717-4fdb-ba06-6fe5d26b79d3 req-9363071a-1ab3-4517-b9de-81973b43ff73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e48a33-69c4-4918-af7d-bab72260cc17", "name": "network-vif-deleted", "tag": "272f5124-c38f-4f8a-9dbc-aafb3fcd5574"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:30.746324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b17d8c47-7717-4fdb-ba06-6fe5d26b79d3 req-9363071a-1ab3-4517-b9de-81973b43ff73 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:30.746820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b17d8c47-7717-4fdb-ba06-6fe5d26b79d3 req-9363071a-1ab3-4517-b9de-81973b43ff73 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:30.747265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b17d8c47-7717-4fdb-ba06-6fe5d26b79d3 req-9363071a-1ab3-4517-b9de-81973b43ff73 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:30.759118 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b17d8c47-7717-4fdb-ba06-6fe5d26b79d3 req-9363071a-1ab3-4517-b9de-81973b43ff73 service nova] Creating event network-vif-deleted:272f5124-c38f-4f8a-9dbc-aafb3fcd5574 for instance f6e48a33-69c4-4918-af7d-bab72260cc17 on n-h1-854663-10 Oct 27 11:27:30.764057 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b17d8c47-7717-4fdb-ba06-6fe5d26b79d3 req-9363071a-1ab3-4517-b9de-81973b43ff73 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039145 Oct 27 11:27:30.764720 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3970/7746] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:27:30.871276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:30.871866 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:30.878978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:30.879519 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:30.879979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:30.880688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:30.881151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:30.881577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:30.915837 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:30.916325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:30.916792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:30.917244 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lazy-loading 'fault' on Instance uuid f6e48a33-69c4-4918-af7d-bab72260cc17 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:27:30.961226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb71fbee272b430f889f71bb9351a794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d616f24c374d71ac77d9eadf706d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:30.970528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0eb380f2-4d6e-4a35-ba30-6377a963d155 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 200 len: 1357 microversion: 2.1 time: 0.103646 Oct 27 11:27:30.971273 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3777/7747] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:30 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:31.999567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:32.000536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] [instance: f6e48a33-69c4-4918-af7d-bab72260cc17] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:32.009095 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:32.009595 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:32.010074 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:32.010785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:32.011255 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:32.011750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:32.025844 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] HTTP exception thrown: Instance f6e48a33-69c4-4918-af7d-bab72260cc17 could not be found. Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Request method failure captured: Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 HTTP/1.1 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWmlStebiKTLBxTveHIk3m95tQoizDDGjkJ2N7T4TxY3DX1zl8AdjG7RqZ9AOOLA6Z_3SbGNDGHHJDiJxChFG1ducEQlyTap_QDjR3GAkSLzk5gzJm8PrdZhRLoiPwoC_VLHM3VeXHm49loX_N75CMOA5q-yLG64LXa8MsPLAETjoRM8 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_36d616f24c374d71ac77d9eadf706d90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/36d616f24c374d71ac77d9eadf706d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 36d616f24c374d71ac77d9eadf706d90 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-631900075 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: eb71fbee272b430f889f71bb9351a794 Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestNetworkAdvancedServerOps-631900075-project Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance f6e48a33-69c4-4918-af7d-bab72260cc17 could not be found. Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': 'f6e48a33-69c4-4918-af7d-bab72260cc17'} Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e48a33-69c4-4918-af7d-bab72260cc17 could not be found. Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e48a33-69c4-4918-af7d-bab72260cc17 could not be found. Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:27:32.027479 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e48a33-69c4-4918-af7d-bab72260cc17 could not be found. Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Returning 404 to user: Instance f6e48a33-69c4-4918-af7d-bab72260cc17 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12c77561-d65f-43e7-baff-181f233d786a tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17" status: 404 len: 111 microversion: 2.1 time: 0.036546 Oct 27 11:27:32.032848 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3971/7748] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:31 2022] GET /compute/v2.1/servers/f6e48a33-69c4-4918-af7d-bab72260cc17 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:27:35.310346 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-631c2b5a-60f9-4321-abb2-6f2d16587c90 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] Calling method '.version_select at 0x7f6d5b2fe9d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:35.336908 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-631c2b5a-60f9-4321-abb2-6f2d16587c90 tempest-TestNetworkAdvancedServerOps-631900075 tempest-TestNetworkAdvancedServerOps-631900075-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045201347" status: 202 len: 0 microversion: 2.1 time: 0.030287 Oct 27 11:27:35.337526 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3778/7749] 10.222.0.76 () {58 vars in 1284 bytes} [Thu Oct 27 11:27:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045201347 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:27:46.755207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=18 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:46.756103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:46.951909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0adb0fbb-b0e1-4d29-b589-facacd8e15e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Action: 'create', calling method: .version_select at 0x7f6d5a9e6c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1314094125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRSn5L0JFReFwMtx/97yGvTKDk4CUX/IJYJif/Xtr5pFmkRukhsYbV6CRgf6l6QPYG/39agmMFfGP1PT6646t38T8Fa12RObXDpeCVfNrk13hcO5V64GeTXmjSF8iKZ1A=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:46.969365 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0adb0fbb-b0e1-4d29-b589-facacd8e15e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Getting quotas for project e5fc8304329048ef8585c037e8313eab. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:27:46.974554 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-0adb0fbb-b0e1-4d29-b589-facacd8e15e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Getting quotas for user 761a65e9beb94b95b5abaa45f19cb9ce and project e5fc8304329048ef8585c037e8313eab. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:27:47.018047 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0adb0fbb-b0e1-4d29-b589-facacd8e15e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.268801 Oct 27 11:27:47.019044 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3972/7750] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:27:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:27:48.166662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:48.167544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:27:48.172199 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1481039613", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1314094125", "security_groups": [{"name": "tempest-secgroup-smoke-1100187772"}], "networks": [{"uuid": "45185fcc-f69f-43a7-a4bd-5c902ae394f8"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:48.415624 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] validate_networks() for [('45185fcc-f69f-43a7-a4bd-5c902ae394f8', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:27:48.903741 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:27:48.904459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:27:48.905308 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:27:48.906070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:27:48.906748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:27:48.918506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:48.919002 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:48.919443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:48.920556 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:48.921055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:48.921483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:48.940743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Getting quotas for project e5fc8304329048ef8585c037e8313eab. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:27:48.946710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Getting quotas for user 761a65e9beb94b95b5abaa45f19cb9ce and project e5fc8304329048ef8585c037e8313eab. Resources: {'instances', 'cores', 'ram'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:27:48.960057 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:27:48.962513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:27:49.020863 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3c0b7c1b-0311-49fb-af0a-b088cea8e91c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.855897 Oct 27 11:27:49.021531 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3779/7751] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:27:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:27:49.034272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b18d04b0-ee50-490e-97a2-e028ec031b0a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:49.035036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b18d04b0-ee50-490e-97a2-e028ec031b0a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:49.184456 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b18d04b0-ee50-490e-97a2-e028ec031b0a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:49.192067 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b18d04b0-ee50-490e-97a2-e028ec031b0a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1247 microversion: 2.1 time: 0.161949 Oct 27 11:27:49.192812 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3973/7752] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:49 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1247 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:50.215443 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d69d4fc3-ab19-4b79-aac1-b040bbdce95e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:50.216042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d69d4fc3-ab19-4b79-aac1-b040bbdce95e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:50.280084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d69d4fc3-ab19-4b79-aac1-b040bbdce95e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:50.289612 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d69d4fc3-ab19-4b79-aac1-b040bbdce95e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1247 microversion: 2.1 time: 0.077936 Oct 27 11:27:50.291378 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3780/7753] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:50 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1247 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:51.315177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5985451-003a-48a3-99d7-b723afc2694c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:51.315813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5985451-003a-48a3-99d7-b723afc2694c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:51.384535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5985451-003a-48a3-99d7-b723afc2694c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:51.392007 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5985451-003a-48a3-99d7-b723afc2694c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1247 microversion: 2.1 time: 0.080931 Oct 27 11:27:51.392607 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3974/7754] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:51 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:52.417954 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:52.418543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:52.426637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:52.427128 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:52.427568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:52.428265 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:52.428750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:52.429177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:52.492226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:52.500992 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6cf47e37-21ca-4fe9-8b7b-d1f5d91e39c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1251 microversion: 2.1 time: 0.089242 Oct 27 11:27:52.501584 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3781/7755] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:52 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1251 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:53.524698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:53.525350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:53.533290 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:53.534025 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:53.534490 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:53.535207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:53.535670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:53.536109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:53.610572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:53.618736 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c1db5bb-32f7-4816-b8af-5bdae5999f07 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1305 microversion: 2.1 time: 0.098463 Oct 27 11:27:53.619676 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3975/7756] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:53 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:54.642203 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:54.642871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:54.650531 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:54.651098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:54.651619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:54.652393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:54.652993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:54.653487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:54.907811 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:54.916322 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf51f9a1-128a-4eee-8e95-657101bb94dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1373 microversion: 2.1 time: 0.278023 Oct 27 11:27:54.916972 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3782/7757] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:54 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1373 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:55.059100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-fe455389-3abd-4e58-8ae4-83075f6531a3 req-4cc87c42-d4a5-473f-9013-d52aa053a2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e881cb58-3635-49b5-9260-97dae79d22c6", "tag": "11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:27:55.070207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fe455389-3abd-4e58-8ae4-83075f6531a3 req-4cc87c42-d4a5-473f-9013-d52aa053a2b8 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:55.070708 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fe455389-3abd-4e58-8ae4-83075f6531a3 req-4cc87c42-d4a5-473f-9013-d52aa053a2b8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:55.071197 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fe455389-3abd-4e58-8ae4-83075f6531a3 req-4cc87c42-d4a5-473f-9013-d52aa053a2b8 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:55.083272 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-fe455389-3abd-4e58-8ae4-83075f6531a3 req-4cc87c42-d4a5-473f-9013-d52aa053a2b8 service nova] Creating event network-changed:11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8 for instance e881cb58-3635-49b5-9260-97dae79d22c6 on n-h2-854663-10 Oct 27 11:27:55.089013 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-fe455389-3abd-4e58-8ae4-83075f6531a3 req-4cc87c42-d4a5-473f-9013-d52aa053a2b8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033773 Oct 27 11:27:55.089645 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3976/7758] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:27:55.940258 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:55.940953 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:55.948561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:55.949076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:55.949513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:55.950218 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:55.950661 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:55.951167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:56.097825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:56.109707 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b91c796-c242-41e1-bc89-076f6120668a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1373 microversion: 2.1 time: 0.173120 Oct 27 11:27:56.110495 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3783/7759] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:55 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:57.135142 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:57.135870 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:57.142666 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:57.143160 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:57.143618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:57.144300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:57.144815 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:57.145246 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:57.286174 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:57.294477 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-581c42bd-9ba0-46ab-83ff-34b3a516b8aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1373 microversion: 2.1 time: 0.164827 Oct 27 11:27:57.295403 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3977/7760] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:57 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:58.323481 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:58.324527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:58.336177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:58.337295 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:58.338165 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:58.338918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:58.339788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:58.339788 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:58.490052 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:58.498640 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2cdfeffb-563c-4072-b770-7f2e6317a626 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1373 microversion: 2.1 time: 0.182018 Oct 27 11:27:58.499235 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3784/7761] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:58 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:27:59.524864 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:27:59.525893 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:27:59.536533 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:59.537303 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:59.537947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:59.539011 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:27:59.539732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:27:59.540336 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:27:59.679449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:27:59.691750 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4f42b2a-21cd-4aa5-b3e9-9fdce95d7923 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1373 microversion: 2.1 time: 0.172477 Oct 27 11:27:59.692515 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3978/7762] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:27:59 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:28:00.637207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0548b04b-8368-4dba-9352-fb8378de3709 req-24edcdaa-daa2-4714-8a8f-5584d4d1e9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e881cb58-3635-49b5-9260-97dae79d22c6", "name": "network-vif-plugged", "status": "completed", "tag": "11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:28:00.642915 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:28:00.644595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:28:00.651357 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0548b04b-8368-4dba-9352-fb8378de3709 req-24edcdaa-daa2-4714-8a8f-5584d4d1e9b3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:28:00.651840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0548b04b-8368-4dba-9352-fb8378de3709 req-24edcdaa-daa2-4714-8a8f-5584d4d1e9b3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:28:00.652271 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0548b04b-8368-4dba-9352-fb8378de3709 req-24edcdaa-daa2-4714-8a8f-5584d4d1e9b3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:28:00.664051 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0548b04b-8368-4dba-9352-fb8378de3709 req-24edcdaa-daa2-4714-8a8f-5584d4d1e9b3 service nova] Creating event network-vif-plugged:11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8 for instance e881cb58-3635-49b5-9260-97dae79d22c6 on n-h2-854663-10 Oct 27 11:28:00.669446 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0548b04b-8368-4dba-9352-fb8378de3709 req-24edcdaa-daa2-4714-8a8f-5584d4d1e9b3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036524 Oct 27 11:28:00.670404 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3785/7763] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:28:00.718032 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:28:00.718679 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:28:00.726307 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:28:00.726816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:28:00.727272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:28:00.728003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:28:00.728476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:28:00.728947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:28:00.904237 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:28:00.916530 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2542bec1-cd48-441a-b858-098361ad295a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1373 microversion: 2.1 time: 0.203308 Oct 27 11:28:00.917343 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3979/7764] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:28:00 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:28:01.941972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:28:01.942693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:28:01.949131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:28:01.949611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:28:01.950114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:28:01.950803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:28:01.951293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:28:01.951680 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:28:02.102688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:28:02.114044 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0bd074b7-0561-45fe-91f1-d3b2ea8e0616 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1558 microversion: 2.1 time: 0.177236 Oct 27 11:28:02.114666 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3786/7765] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:28:01 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:28:02.139274 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:28:02.140054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:28:02.142747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:28:02.153375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:28:02.154047 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:28:02.154508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:28:02.155258 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:28:02.155737 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:28:02.156176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:28:02.294900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:28:02.303027 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-937b61ea-9f78-4177-b6ca-ec361462d3a7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1558 microversion: 2.1 time: 0.167906 Oct 27 11:28:02.303634 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3980/7766] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:28:02 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:28:04.024897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f6948094-8df0-428c-b597-ea17d6c5da2f req-2950c859-13e6-4f58-bc48-be0283bff7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e881cb58-3635-49b5-9260-97dae79d22c6", "tag": "11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:28:04.036705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f6948094-8df0-428c-b597-ea17d6c5da2f req-2950c859-13e6-4f58-bc48-be0283bff7ef service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:28:04.037183 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f6948094-8df0-428c-b597-ea17d6c5da2f req-2950c859-13e6-4f58-bc48-be0283bff7ef service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:28:04.037604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f6948094-8df0-428c-b597-ea17d6c5da2f req-2950c859-13e6-4f58-bc48-be0283bff7ef service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:28:04.050459 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f6948094-8df0-428c-b597-ea17d6c5da2f req-2950c859-13e6-4f58-bc48-be0283bff7ef service nova] Creating event network-changed:11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8 for instance e881cb58-3635-49b5-9260-97dae79d22c6 on n-h2-854663-10 Oct 27 11:28:04.056023 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f6948094-8df0-428c-b597-ea17d6c5da2f req-2950c859-13e6-4f58-bc48-be0283bff7ef service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035094 Oct 27 11:28:04.056679 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3787/7767] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:29:59.140268 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:29:59.141628 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=32 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:29:59.143590 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:29:59.143898 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6/action (ip 10.222.0.76) !!! Oct 27 11:29:59.146694 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:29:59.147025 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6/action (ip 10.222.0.76) !!! Oct 27 11:29:59.155014 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:29:59.155968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:29:59.167466 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:29:59.167968 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:29:59.168414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:29:59.169499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:29:59.169966 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:29:59.170385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:29:59.196305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lazy-loading 'flavor' on Instance uuid e881cb58-3635-49b5-9260-97dae79d22c6 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:29:59.412116 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2fb3ffe5-c4fe-40d5-97f4-5921389293f1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "POST /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6/action" status: 202 len: 0 microversion: 2.1 time: 0.275122 Oct 27 11:29:59.412745 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3981/7768] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:29:59 2022] POST /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:29:59.420469 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 11:29:59.420990 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 (ip 10.222.0.76) !!! Oct 27 11:29:59.422674 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3317bcd0-7139-4b6a-a168-7c5e11e5c085] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 11:29:59.423633 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecd0d1de-c8ef-468a-a3de-2649f8270da1] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 11:29:59.424263 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:29:59.425013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=36 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:29:59.430948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:29:59.431660 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:29:59.443456 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:29:59.443947 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:29:59.444388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:29:59.445148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:29:59.445609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:29:59.446034 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:29:59.582763 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:29:59.591583 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5bead85f-900d-45cb-aa4c-47a73fc38fdc tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.173838 Oct 27 11:29:59.592203 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3788/7769] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:29:59 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:00.621424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:00.622137 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:00.630475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:00.630956 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:00.631397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:00.632110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:00.632572 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:00.633036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:00.811252 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:00.820139 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1699db6d-5fa5-414e-991b-38ff0b27d67e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.204492 Oct 27 11:30:00.820755 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3982/7770] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:00 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:01.851119 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:01.851773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:01.865868 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:01.866525 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:01.867160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:01.868233 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:01.868893 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:01.869518 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:01.878899 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [3317bcd0-7139-4b6a-a168-7c5e11e5c085] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 52338. Oct 27 11:30:01.879753 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecd0d1de-c8ef-468a-a3de-2649f8270da1] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 52340. Oct 27 11:30:02.019018 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:02.030934 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0449757-e8ff-4be8-b8a4-077ef66ca9f3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.185768 Oct 27 11:30:02.031745 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3789/7771] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:01 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:03.057994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:03.058647 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:03.066109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:03.066622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:03.067073 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:03.067796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:03.068404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:03.069114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:03.221668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:03.232548 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-133ff11c-3f26-4b75-a543-2a1dd32d2bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.178385 Oct 27 11:30:03.233357 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3983/7772] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:03 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:04.264859 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:04.265471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:04.273131 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:04.273619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:04.274166 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:04.274871 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:04.275318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:04.275769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:04.421463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:04.430093 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e2a2f4d-da9a-4833-b9cc-2884294ec103 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.169261 Oct 27 11:30:04.430685 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3790/7773] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:04 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:05.458113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:05.459236 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:05.470923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:05.471757 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:05.472510 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:05.473731 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:05.474517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:05.475184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:05.611476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:05.620244 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9f304e0-2c7a-43f9-80df-e54ff87025e1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.168801 Oct 27 11:30:05.620826 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3984/7774] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:05 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:06.644439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:06.645049 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:06.652272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:06.652790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:06.653221 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:06.653907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:06.654350 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:06.654770 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:06.793528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:06.802212 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb88553e-8e3d-4c3f-923e-f448f5e7db74 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.161792 Oct 27 11:30:06.802797 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3791/7775] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:06 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:07.826362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:07.826994 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:07.834568 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:07.835062 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:07.835545 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:07.836250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:07.836749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:07.837175 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:07.979907 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:07.992071 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67c573b6-d398-4843-86e9-d9dac7aca8dd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.169451 Oct 27 11:30:07.993159 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3985/7776] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:07 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:09.022617 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:09.023435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:09.030988 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:09.031587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:09.032047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:09.032793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:09.033250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:09.033682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:09.241929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:09.250199 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10e7a344-46fe-4220-be09-a8535f02aa64 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.231560 Oct 27 11:30:09.250778 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3792/7777] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:09 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:10.276770 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:10.277362 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:10.284982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:10.285480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:10.285938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:10.286636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:10.287098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:10.287531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:10.437026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:10.449366 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7eaa3d9-8b72-4e5a-a978-4cafef3e4b14 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1704 microversion: 2.1 time: 0.177281 Oct 27 11:30:10.450160 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3986/7778] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:10 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1704 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:11.477761 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:11.478580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:11.485895 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:11.486388 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:11.486828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:11.487528 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:11.487985 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:11.488407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:11.632858 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:11.640753 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0168c200-3423-4459-912a-dcc1db25dc29 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1704 microversion: 2.1 time: 0.167133 Oct 27 11:30:11.641318 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3793/7779] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:11 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1704 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:12.667424 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:12.669275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:12.676633 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:12.677162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:12.677609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:12.678741 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:12.679386 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:12.680397 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:12.838219 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:12.847014 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a09f7bd-dbc1-4ca1-9b37-eb91390f00fa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1699 microversion: 2.1 time: 0.185937 Oct 27 11:30:12.847603 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3987/7780] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:12 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1699 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:13.521070 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-55dbac4b-fd0c-424e-84b4-32ce19f41ab6 req-554d6ff0-0fbc-4f5d-9584-0960ed38d513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e881cb58-3635-49b5-9260-97dae79d22c6", "name": "network-vif-plugged", "status": "completed", "tag": "11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:30:13.533376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-55dbac4b-fd0c-424e-84b4-32ce19f41ab6 req-554d6ff0-0fbc-4f5d-9584-0960ed38d513 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:13.534219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-55dbac4b-fd0c-424e-84b4-32ce19f41ab6 req-554d6ff0-0fbc-4f5d-9584-0960ed38d513 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:13.535440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-55dbac4b-fd0c-424e-84b4-32ce19f41ab6 req-554d6ff0-0fbc-4f5d-9584-0960ed38d513 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:13.549058 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-55dbac4b-fd0c-424e-84b4-32ce19f41ab6 req-554d6ff0-0fbc-4f5d-9584-0960ed38d513 service nova] Creating event network-vif-plugged:11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8 for instance e881cb58-3635-49b5-9260-97dae79d22c6 on n-h2-854663-10 Oct 27 11:30:13.552904 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [req-55dbac4b-fd0c-424e-84b4-32ce19f41ab6 req-554d6ff0-0fbc-4f5d-9584-0960ed38d513 service nova] [07e3d4d2-5da2-4771-aa02-33f27614451e] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 11:30:13.874292 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:13.875809 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:13.883109 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:13.883960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:13.884483 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:13.885496 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:13.886036 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:13.886570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:14.035021 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:14.043388 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8e9ed55e-139a-4df1-bd56-04f56660a5aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1699 microversion: 2.1 time: 0.173274 Oct 27 11:30:14.044291 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3988/7781] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:13 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1699 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:14.562615 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [req-55dbac4b-fd0c-424e-84b4-32ce19f41ab6 req-554d6ff0-0fbc-4f5d-9584-0960ed38d513 service nova] [07e3d4d2-5da2-4771-aa02-33f27614451e] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 52396. Oct 27 11:30:14.567253 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-55dbac4b-fd0c-424e-84b4-32ce19f41ab6 req-554d6ff0-0fbc-4f5d-9584-0960ed38d513 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.123086 Oct 27 11:30:14.567908 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3794/7782] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:30:15.068527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:15.070167 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:15.088902 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:15.089699 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:15.090353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:15.091350 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:15.091848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:15.092287 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:15.251759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:15.260851 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fbe7853-801e-468d-9466-41ade5664cef tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1699 microversion: 2.1 time: 0.197036 Oct 27 11:30:15.261450 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3989/7783] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:15 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1699 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:16.286151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:16.287636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:16.297578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:16.298098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:16.298512 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:16.299226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:16.299691 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:16.300109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:16.463682 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:16.472564 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b067341a-206f-4531-8a45-7eb87fc982b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1699 microversion: 2.1 time: 0.191091 Oct 27 11:30:16.485264 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3795/7784] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:16 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1699 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:17.498540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:17.499202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:17.507434 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:17.507944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:17.508652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:17.509438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:17.509906 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:17.510326 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:17.682549 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:17.692357 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1f5d93ee-0fbe-4dff-b8c2-5a588ceaf708 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1699 microversion: 2.1 time: 0.197864 Oct 27 11:30:17.693243 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3990/7785] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:17 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1699 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:18.716929 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:18.717575 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:18.726445 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:18.727442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:18.728103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:18.729079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:18.729740 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:18.730439 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:18.902696 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:18.913503 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1fe9e6a-bb89-4376-8d8a-55c509c18a8f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1699 microversion: 2.1 time: 0.200411 Oct 27 11:30:18.914136 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3796/7786] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:18 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1699 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:19.937612 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:19.938351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:19.946622 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:19.947108 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:19.947803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:19.948793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:19.949261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:19.949700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:20.105677 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:20.114193 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-06384a09-3d4f-4fa4-9bdd-89bebe96adff tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1699 microversion: 2.1 time: 0.180825 Oct 27 11:30:20.114882 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3991/7787] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:19 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1699 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:21.138609 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:21.139227 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:21.146239 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:21.146692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:21.147153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:21.148015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:21.148374 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:21.148759 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:21.286599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:21.295528 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91a2f5db-49cf-4f80-87dd-543f71ba0d59 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1699 microversion: 2.1 time: 0.160922 Oct 27 11:30:21.296225 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3797/7788] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:21 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:22.323614 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:22.324734 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:22.336375 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:22.336915 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:22.337531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:22.338069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:22.338541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:22.338984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:22.477932 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:22.486198 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed4aae13-e435-40cd-8ac5-4716a927c4c3 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1681 microversion: 2.1 time: 0.169263 Oct 27 11:30:22.486777 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3992/7789] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:22 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:23.511514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:23.512130 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:23.519611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:23.520099 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:23.520498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:23.521268 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:23.521717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:23.522138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:23.664940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:23.673668 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b0d7d02-15d1-4328-b5ff-520759d36dd8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1681 microversion: 2.1 time: 0.166461 Oct 27 11:30:23.674175 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3798/7790] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:23 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:24.702876 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:24.703787 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:24.713919 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:24.714427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:24.714871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:24.715586 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:24.716056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:24.716501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:24.859859 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:24.868551 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92466af2-1b8f-4821-9a74-6b6e7131e6c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1624 microversion: 2.1 time: 0.172389 Oct 27 11:30:24.869028 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3993/7791] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:24 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1624 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:24.894220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:30:24.894803 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:24.904753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:24.905440 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:24.906030 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:24.906874 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:24.907336 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:24.907844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:24.952055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120719) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 11:30:25.030915 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [dd897b98-c2cd-416d-a47a-9e5fdab299ae] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 11:30:25.465512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e2ab0ae5-ecc8-4cef-bc33-2a00c8a39c25 req-3cb3912b-1dc7-479f-8304-9f0d5e078a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e881cb58-3635-49b5-9260-97dae79d22c6", "name": "network-vif-unplugged", "status": "completed", "tag": "11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:30:25.475922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e2ab0ae5-ecc8-4cef-bc33-2a00c8a39c25 req-3cb3912b-1dc7-479f-8304-9f0d5e078a44 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:25.476644 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e2ab0ae5-ecc8-4cef-bc33-2a00c8a39c25 req-3cb3912b-1dc7-479f-8304-9f0d5e078a44 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:25.477136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e2ab0ae5-ecc8-4cef-bc33-2a00c8a39c25 req-3cb3912b-1dc7-479f-8304-9f0d5e078a44 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:25.490440 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_external_events [req-e2ab0ae5-ecc8-4cef-bc33-2a00c8a39c25 req-3cb3912b-1dc7-479f-8304-9f0d5e078a44 service nova] Unable to find a host for instance e881cb58-3635-49b5-9260-97dae79d22c6. Dropping event network-vif-unplugged {{(pid=120720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 11:30:25.491341 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e2ab0ae5-ecc8-4cef-bc33-2a00c8a39c25 req-3cb3912b-1dc7-479f-8304-9f0d5e078a44 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029960 Oct 27 11:30:25.491931 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3994/7792] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 11:30:26.043480 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [dd897b98-c2cd-416d-a47a-9e5fdab299ae] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 52442. Oct 27 11:30:26.051156 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6e15ea8-19b6-4498-b6ad-47d942368bb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "POST /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6/action" status: 202 len: 0 microversion: 2.1 time: 1.162966 Oct 27 11:30:26.052147 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3799/7793] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:30:24 2022] POST /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6/action => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:30:26.061927 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:26.062567 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:26.069698 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:26.070188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:26.070706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:26.071441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:26.072200 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:26.072561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:26.217228 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:26.225800 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0170e1f4-457e-4412-aa55-658ad9ca1b42 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1632 microversion: 2.1 time: 0.167635 Oct 27 11:30:26.226396 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3995/7794] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:26 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1632 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:27.254543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:27.255188 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:27.263650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:27.264135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:27.264566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:27.265316 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:27.265765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:27.266185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:27.403226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:27.414037 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd89976c-0d46-41ec-9750-a4306b4db382 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.165375 Oct 27 11:30:27.415105 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3800/7795] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:27 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:28.333162 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7c6deefe-5463-49ed-b0a4-c64661750ac2 req-1c1ed8d4-0d6b-4df6-b855-db0c3ff99681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e881cb58-3635-49b5-9260-97dae79d22c6", "tag": "11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:30:28.347949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7c6deefe-5463-49ed-b0a4-c64661750ac2 req-1c1ed8d4-0d6b-4df6-b855-db0c3ff99681 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:28.348448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7c6deefe-5463-49ed-b0a4-c64661750ac2 req-1c1ed8d4-0d6b-4df6-b855-db0c3ff99681 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:28.348950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7c6deefe-5463-49ed-b0a4-c64661750ac2 req-1c1ed8d4-0d6b-4df6-b855-db0c3ff99681 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:28.353089 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:30:28.361318 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7c6deefe-5463-49ed-b0a4-c64661750ac2 req-1c1ed8d4-0d6b-4df6-b855-db0c3ff99681 service nova] Creating event network-changed:11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8 for instance e881cb58-3635-49b5-9260-97dae79d22c6 on n-h1-854663-10 Oct 27 11:30:28.366525 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7c6deefe-5463-49ed-b0a4-c64661750ac2 req-1c1ed8d4-0d6b-4df6-b855-db0c3ff99681 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044535 Oct 27 11:30:28.367496 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3996/7796] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:30:28.441455 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:28.442073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:28.449435 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:28.449924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:28.450362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:28.451031 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:28.451515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:28.451938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:28.661366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:28.669964 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b99022d4-0a58-4c84-83eb-34b97e75ff81 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.232594 Oct 27 11:30:28.670539 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3801/7797] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:28 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:29.696767 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:29.698618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:29.703508 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=33 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:30:29.709066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:29.709668 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:29.710218 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:29.711004 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:29.711538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:29.712277 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:29.873637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:29.886067 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48d5eea1-e9ec-4a8b-9c6a-54a72ac3a0f9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.195393 Oct 27 11:30:29.886887 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3997/7798] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:29 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:30.918141 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:30.919153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:30.921932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:30:30.927930 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:30.928404 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:30.928862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:30.929533 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:30.929993 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:30.930409 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:30.933537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:30:31.088753 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:31.097420 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-68342a3f-5d59-45e4-8626-395da575fbb6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.185062 Oct 27 11:30:31.099733 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3802/7799] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:30 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:32.122143 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:32.122982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:32.130527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:32.131113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:32.131635 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:32.132431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:32.132995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:32.133500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:32.288421 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:32.297258 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4044a8c3-7d7b-4681-9453-c4f8a5205dc6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.179255 Oct 27 11:30:32.297841 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3998/7800] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:32 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:33.320906 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:33.321534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:33.328807 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:33.329299 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:33.329789 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:33.330407 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:33.330843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:33.331255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:33.501063 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:33.508905 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dcee8208-14d7-4c6a-9064-a9d3e3fed96c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.191953 Oct 27 11:30:33.509482 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3803/7801] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:33 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:34.536492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:34.537381 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:34.547409 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:34.547987 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:34.548436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:34.549177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:34.549639 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:34.550076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:34.701674 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:34.709837 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1861c4b4-bff4-4c28-84ca-62ada0391265 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.179755 Oct 27 11:30:34.710751 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3999/7802] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:34 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:35.738159 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:35.739107 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:35.750106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:35.750591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:35.751029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:35.751844 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:35.752294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:35.752737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:35.907110 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:35.917863 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9bf5e508-e134-46ff-9cb1-d6ce1cb40e3a tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.186639 Oct 27 11:30:35.926166 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3804/7803] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:35 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:36.942495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:36.943441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:36.950033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:36.950536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:36.950989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:36.951713 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:36.952184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:36.952631 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:37.125853 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:37.137753 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62deb96b-165d-4052-905a-a34dacd9d2d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.199386 Oct 27 11:30:37.138590 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4000/7804] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:36 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:30:38.163362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:38.164024 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:38.171447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:38.171934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:38.172587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:38.173380 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:38.173821 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:38.174247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:38.337069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:38.345675 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f792446a-c24e-43e0-9cf4-820728e7b2e7 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.186569 Oct 27 11:30:38.346778 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3805/7805] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:38 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:39.374603 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:39.375730 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:39.383040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:39.383530 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:39.384005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:39.384710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:39.385212 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:39.385637 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:39.583520 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:39.595182 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-04b87913-71b5-4c1c-b128-69c246cc0454 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.227180 Oct 27 11:30:39.595775 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4001/7806] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:39 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:40.622029 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:40.622935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:40.633826 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:40.634578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:40.635212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:40.636042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:40.636754 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:40.637355 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:40.773426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:40.782071 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55e4df80-fc4f-4592-a59c-91560e19e349 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.166183 Oct 27 11:30:40.782663 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3806/7807] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:40 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:41.809984 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:41.811007 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:41.819234 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:41.819725 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:41.820178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:41.820917 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:41.821377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:41.821811 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:41.965427 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:41.973484 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31bc9163-1762-4a69-8f77-b438ad54c6f6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.170174 Oct 27 11:30:41.974224 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4002/7808] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:41 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:42.997564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:42.998196 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:43.005626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:43.006109 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:43.006544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:43.007217 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:43.007664 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:43.008079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:43.145619 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:43.153615 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0884f1e8-2557-4c25-8a96-13319f6f6ab9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.160047 Oct 27 11:30:43.154227 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3807/7809] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:42 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:44.180883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:44.181710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:44.190610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:44.191273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:44.191862 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:44.192828 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:44.193449 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:44.194024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:44.334560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:44.342712 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63453605-9394-4e41-8790-90c30cab5b17 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.167246 Oct 27 11:30:44.343287 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4003/7810] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:44 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:44.498998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8bae7185-26ec-470b-8f71-ff3e25b2216a req-bb50ef2b-5228-4568-b4fc-533657fccb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e881cb58-3635-49b5-9260-97dae79d22c6", "name": "network-vif-plugged", "status": "completed", "tag": "11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:30:44.510216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8bae7185-26ec-470b-8f71-ff3e25b2216a req-bb50ef2b-5228-4568-b4fc-533657fccb82 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:44.510944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8bae7185-26ec-470b-8f71-ff3e25b2216a req-bb50ef2b-5228-4568-b4fc-533657fccb82 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:44.511375 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8bae7185-26ec-470b-8f71-ff3e25b2216a req-bb50ef2b-5228-4568-b4fc-533657fccb82 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:44.522999 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8bae7185-26ec-470b-8f71-ff3e25b2216a req-bb50ef2b-5228-4568-b4fc-533657fccb82 service nova] Creating event network-vif-plugged:11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8 for instance e881cb58-3635-49b5-9260-97dae79d22c6 on n-h1-854663-10 Oct 27 11:30:44.528239 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8bae7185-26ec-470b-8f71-ff3e25b2216a req-bb50ef2b-5228-4568-b4fc-533657fccb82 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033115 Oct 27 11:30:44.529049 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3808/7811] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:30:45.370958 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:45.371847 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:45.381177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:45.381672 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:45.382116 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:45.382820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:45.383284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:45.383722 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:45.520257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:45.528466 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e8d32a1-0c82-4bca-ae42-7df4db675c78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1690 microversion: 2.1 time: 0.164365 Oct 27 11:30:45.529079 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4004/7812] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:45 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:30:46.555732 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:30:46.556421 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:30:46.564908 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:46.565483 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:46.566088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:46.567135 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:30:46.567805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:30:46.568422 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:30:46.725493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:30:46.733796 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-42111990-0995-4ca7-872f-3012c5431432 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1677 microversion: 2.1 time: 0.184592 Oct 27 11:30:46.734414 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3809/7813] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:30:46 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:03.419521 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:03.419988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:03.424312 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=15 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:03.424959 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=43 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:03.432256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=15 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:03.432982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=48 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:03.452691 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:03.457370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:03.458428 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:03.460006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:03.460808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:03.461748 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:03.492607 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:32:03.499289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-65ad9c3d-ca0a-4c29-aedb-2730f6f9b018 req-be3e68e3-c96f-4877-ab2c-09389515f278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e881cb58-3635-49b5-9260-97dae79d22c6", "tag": "11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:32:03.509152 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65ad9c3d-ca0a-4c29-aedb-2730f6f9b018 req-be3e68e3-c96f-4877-ab2c-09389515f278 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:03.509944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65ad9c3d-ca0a-4c29-aedb-2730f6f9b018 req-be3e68e3-c96f-4877-ab2c-09389515f278 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:03.510376 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-65ad9c3d-ca0a-4c29-aedb-2730f6f9b018 req-be3e68e3-c96f-4877-ab2c-09389515f278 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:03.523948 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-65ad9c3d-ca0a-4c29-aedb-2730f6f9b018 req-be3e68e3-c96f-4877-ab2c-09389515f278 service nova] Creating event network-changed:11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8 for instance e881cb58-3635-49b5-9260-97dae79d22c6 on n-h1-854663-10 Oct 27 11:32:03.529194 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-65ad9c3d-ca0a-4c29-aedb-2730f6f9b018 req-be3e68e3-c96f-4877-ab2c-09389515f278 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107173 Oct 27 11:32:03.530163 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3810/7814] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:32:03.577876 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9f20276-58eb-42e5-b8dd-dd16e32eb0c6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 204 len: 0 microversion: 2.1 time: 0.163508 Oct 27 11:32:03.578818 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4005/7815] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:32:03 2022] DELETE /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 11:32:03.587743 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:03.588446 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:03.594940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:03.595410 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:03.595843 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:03.596530 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:03.597010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:03.597432 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:03.744061 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:03.762483 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec871941-017b-4778-922e-57723c461f8b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.179116 Oct 27 11:32:03.763798 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3811/7816] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:03 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:04.790563 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:04.791646 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:04.801098 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:04.801923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:04.802593 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:04.803814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:04.804890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:04.804890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:05.018149 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:05.026989 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3ccfca3-196b-48ca-a0e5-c95b5c2fedd2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1683 microversion: 2.1 time: 0.241818 Oct 27 11:32:05.027560 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4006/7817] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:04 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1683 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:05.829805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1c34bd63-f2d6-41c5-a404-61feb35f527b req-f71c61e7-9bac-4fb5-9d6f-63a445bcf5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e881cb58-3635-49b5-9260-97dae79d22c6", "name": "network-vif-deleted", "tag": "11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:32:05.840978 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1c34bd63-f2d6-41c5-a404-61feb35f527b req-f71c61e7-9bac-4fb5-9d6f-63a445bcf5bf service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:05.841459 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1c34bd63-f2d6-41c5-a404-61feb35f527b req-f71c61e7-9bac-4fb5-9d6f-63a445bcf5bf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:05.841889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1c34bd63-f2d6-41c5-a404-61feb35f527b req-f71c61e7-9bac-4fb5-9d6f-63a445bcf5bf service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:05.853569 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1c34bd63-f2d6-41c5-a404-61feb35f527b req-f71c61e7-9bac-4fb5-9d6f-63a445bcf5bf service nova] Creating event network-vif-deleted:11dd95d0-4585-4dc1-9f75-0d1c13b5ddc8 for instance e881cb58-3635-49b5-9260-97dae79d22c6 on n-h1-854663-10 Oct 27 11:32:05.858763 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1c34bd63-f2d6-41c5-a404-61feb35f527b req-f71c61e7-9bac-4fb5-9d6f-63a445bcf5bf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090496 Oct 27 11:32:05.859375 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3812/7818] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:32:06.051839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:06.052467 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:06.061474 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:06.062141 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:06.062594 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:06.063330 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:06.063796 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:06.064239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:06.099294 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:06.099800 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:06.100431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:06.100989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lazy-loading 'fault' on Instance uuid e881cb58-3635-49b5-9260-97dae79d22c6 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:32:06.144938 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:06.153516 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-64080d40-19ae-425f-b84d-5e2102503f8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 200 len: 1337 microversion: 2.1 time: 0.105660 Oct 27 11:32:06.154112 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4007/7819] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:06 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 1337 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:07.178587 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:07.179289 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: e881cb58-3635-49b5-9260-97dae79d22c6] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:07.186606 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:07.187090 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:07.187527 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:07.188212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:07.188687 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:07.189111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:07.203670 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] HTTP exception thrown: Instance e881cb58-3635-49b5-9260-97dae79d22c6 could not be found. Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Request method failure captured: Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 HTTP/1.1 Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmstDMjHSF1C4QPQ1tFdFnvCAArEzCIUPOuoQP2bPsKp_Sth3l9FQjNtlEZRk2EG0qKLP3QCGw2th3iPrus7bw5S2ZZFCd5r5QNcrVNkjGZmXH8JQjQW_6xt7nU6exU4oXu2j2R1jgZMd0ryFJitUhL8UNC_YJuCbQsS_8ocz3ts60Y Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: e5fc8304329048ef8585c037e8313eab Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestShelveInstance-70329324 Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e5fc8304329048ef8585c037e8313eab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e5fc8304329048ef8585c037e8313eab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e5fc8304329048ef8585c037e8313eab", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e5fc8304329048ef8585c037e8313eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestShelveInstance-70329324 Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: e5fc8304329048ef8585c037e8313eab Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestShelveInstance-70329324 Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestShelveInstance-70329324-project Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 761a65e9beb94b95b5abaa45f19cb9ce Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestShelveInstance-70329324-project Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance e881cb58-3635-49b5-9260-97dae79d22c6 could not be found. Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': 'e881cb58-3635-49b5-9260-97dae79d22c6'} Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e881cb58-3635-49b5-9260-97dae79d22c6 could not be found. Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e881cb58-3635-49b5-9260-97dae79d22c6 could not be found. Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:32:07.205341 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e881cb58-3635-49b5-9260-97dae79d22c6 could not be found. Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Returning 404 to user: Instance e881cb58-3635-49b5-9260-97dae79d22c6 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a603c36-78ae-4e58-8e28-9011eb9882cd tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6" status: 404 len: 111 microversion: 2.1 time: 0.032682 Oct 27 11:32:07.211325 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3813/7820] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:07 2022] GET /compute/v2.1/servers/e881cb58-3635-49b5-9260-97dae79d22c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:32:07.377960 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58a40008-3825-4b11-a711-a3c9cdf93325 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '.version_select at 0x7f6d60ed00d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:07.410540 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58a40008-3825-4b11-a711-a3c9cdf93325 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1314094125" status: 202 len: 0 microversion: 2.1 time: 0.036547 Oct 27 11:32:07.411141 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4008/7821] 10.222.0.76 () {58 vars in 1254 bytes} [Thu Oct 27 11:32:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1314094125 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:32:07.430216 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42eff205-2b49-4156-907f-09cd7168ec8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Action: 'create', calling method: .version_select at 0x7f6d5b571820>, body: {"keypair": {"name": "tempest-TestShelveInstance-754559658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/cIkAIkPZFecbxDtuYEwgKgPBrid3fIrTy+ssx7wZ9+oHuEMRpP8ybw0rrcAnhnD0Mvf8fGX05ithUobrqYkKBdMrIWxNLh11xsk3AAhOTfGfBf8ehRyHAkvw2rhvI7Q=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:32:07.447267 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-42eff205-2b49-4156-907f-09cd7168ec8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Getting quotas for project e5fc8304329048ef8585c037e8313eab. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:32:07.455521 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-42eff205-2b49-4156-907f-09cd7168ec8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Getting quotas for user 761a65e9beb94b95b5abaa45f19cb9ce and project e5fc8304329048ef8585c037e8313eab. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:32:07.493777 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-42eff205-2b49-4156-907f-09cd7168ec8d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.067658 Oct 27 11:32:07.494689 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3814/7822] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:32:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:32:24.886266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-62874429", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-754559658", "security_groups": [{"name": "tempest-secgroup-smoke-2053254187"}], "networks": [{"uuid": "45185fcc-f69f-43a7-a4bd-5c902ae394f8"}], "block_device_mapping_v2": [{"uuid": "2ead79d5-9c34-4d4b-8abd-d445de3089e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:32:24.897491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:24.898151 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:25.018913 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] validate_networks() for [('45185fcc-f69f-43a7-a4bd-5c902ae394f8', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:32:25.475676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:32:25.476110 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:32:25.476592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:32:25.477233 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:32:25.477655 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:32:25.487265 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:25.487752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:25.488196 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:25.488965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:25.489422 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:25.489850 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:25.507574 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Getting quotas for project e5fc8304329048ef8585c037e8313eab. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:32:25.513481 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Getting quotas for user 761a65e9beb94b95b5abaa45f19cb9ce and project e5fc8304329048ef8585c037e8313eab. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:32:25.576324 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:32:25.579648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ead79d5-9c34-4d4b-8abd-d445de3089e4',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:32:25.726369 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d460b05f-465b-4f7b-bc0c-a5717290b92f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844451 Oct 27 11:32:25.727274 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4009/7823] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:32:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:32:25.736040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:25.736977 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:25.737447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:25.742194 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-803148bd-c722-4097-b3ff-1f19f1656311 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:25.742849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-803148bd-c722-4097-b3ff-1f19f1656311 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:25.809241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-803148bd-c722-4097-b3ff-1f19f1656311 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:25.816405 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-803148bd-c722-4097-b3ff-1f19f1656311 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1086 microversion: 2.1 time: 0.082163 Oct 27 11:32:25.817002 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3815/7824] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:25 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1086 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:26.840487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e43eadb9-98b1-4b52-a839-ce8fd8e4a124 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:26.841125 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e43eadb9-98b1-4b52-a839-ce8fd8e4a124 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:26.896610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e43eadb9-98b1-4b52-a839-ce8fd8e4a124 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:26.904440 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e43eadb9-98b1-4b52-a839-ce8fd8e4a124 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1086 microversion: 2.1 time: 0.068891 Oct 27 11:32:26.905023 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4010/7825] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:26 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1086 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:27.931994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc6814ee-4537-4ed6-9daa-3810f29c2515 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:27.933309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc6814ee-4537-4ed6-9daa-3810f29c2515 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:27.988511 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cc6814ee-4537-4ed6-9daa-3810f29c2515 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:27.996255 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc6814ee-4537-4ed6-9daa-3810f29c2515 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1086 microversion: 2.1 time: 0.071011 Oct 27 11:32:27.997186 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3816/7826] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:27 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1086 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:29.019812 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2647fdf5-078f-4259-8838-5f7de44cc263 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:29.020445 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2647fdf5-078f-4259-8838-5f7de44cc263 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:29.088678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2647fdf5-078f-4259-8838-5f7de44cc263 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:29.095683 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2647fdf5-078f-4259-8838-5f7de44cc263 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1086 microversion: 2.1 time: 0.079854 Oct 27 11:32:29.106402 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4011/7827] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:29 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1086 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:30.120925 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:30.121602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:30.129567 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:30.130050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:30.130484 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:30.131173 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:30.131626 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:30.132047 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:30.197127 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:30.204924 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1027cb4f-b94e-4323-8b14-1668110fcaa6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1136 microversion: 2.1 time: 0.089071 Oct 27 11:32:30.205491 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3817/7828] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:30 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1136 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:31.230831 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:31.232176 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:31.239100 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:31.239883 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:31.240598 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:31.241582 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:31.242254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:31.242900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:31.315075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:31.324843 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d4d69d4-44d9-4a04-927c-135b7a3d8d51 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1202 microversion: 2.1 time: 0.098079 Oct 27 11:32:31.326265 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4012/7829] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:31 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1202 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:32.334317 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-db94e291-1131-4ef5-8fd6-370c9f72510d req-7407a57c-0edc-4192-82a9-61a1035cd063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2997b711-9e96-40c4-8585-9cd9184165eb", "tag": "4465be42-85ea-4fc9-8e52-e2b2ef567cc6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:32:32.347602 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-db94e291-1131-4ef5-8fd6-370c9f72510d req-7407a57c-0edc-4192-82a9-61a1035cd063 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:32.348389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-db94e291-1131-4ef5-8fd6-370c9f72510d req-7407a57c-0edc-4192-82a9-61a1035cd063 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:32.349728 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-db94e291-1131-4ef5-8fd6-370c9f72510d req-7407a57c-0edc-4192-82a9-61a1035cd063 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:32.351584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:32.352463 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:32.362118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:32.362825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:32.363555 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:32.364527 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:32.365379 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:32.366229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:32.369187 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-db94e291-1131-4ef5-8fd6-370c9f72510d req-7407a57c-0edc-4192-82a9-61a1035cd063 service nova] Creating event network-changed:4465be42-85ea-4fc9-8e52-e2b2ef567cc6 for instance 2997b711-9e96-40c4-8585-9cd9184165eb on n-h2-854663-10 Oct 27 11:32:32.378671 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-db94e291-1131-4ef5-8fd6-370c9f72510d req-7407a57c-0edc-4192-82a9-61a1035cd063 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049125 Oct 27 11:32:32.379605 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3818/7830] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:32:32.615154 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:32.623892 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de68bc15-6533-4c67-a933-d4833efc4695 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1270 microversion: 2.1 time: 0.277717 Oct 27 11:32:32.624724 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4013/7831] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:32 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:33.649151 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:33.650040 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:33.657048 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:33.657529 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:33.657965 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:33.658662 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:33.659114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:33.659535 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:33.795907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:33.803996 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-feb37f72-ff65-4c23-a71f-25be27754a2b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1270 microversion: 2.1 time: 0.160081 Oct 27 11:32:33.804579 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3819/7832] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:33 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:34.827834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:34.828420 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:34.837871 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:34.838623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:34.839227 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:34.839977 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:34.840492 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:34.840955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:34.981221 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:34.991654 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e29e597-69e8-4f6f-9d15-0c9e0fe84f89 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1270 microversion: 2.1 time: 0.168017 Oct 27 11:32:34.992256 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4014/7833] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:34 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:36.018329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:36.019124 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:36.028560 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:36.029081 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:36.029517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:36.030214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:36.030672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:36.031095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:36.180982 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:36.189082 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-059da4b9-504e-4edd-9016-a8ab88c8e164 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.176692 Oct 27 11:32:36.189681 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3820/7834] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:36 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:37.217384 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:37.218377 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:37.221487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:37.232111 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:37.232641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:37.233157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:37.233851 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:37.234369 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:37.234834 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:37.379008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:37.387419 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e0f26df-d7c5-4dea-bb5f-dd1fbd58066c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.177113 Oct 27 11:32:37.388027 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4015/7835] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:37 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:38.413604 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:38.414369 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:38.419084 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:38.428321 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:38.429103 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:38.429752 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:38.430802 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:38.431471 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:38.432132 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:38.581389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:38.590073 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f4ae984-c42f-4ff3-85a6-069bb5b1a297 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.181708 Oct 27 11:32:38.590666 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3821/7836] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:38 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:39.613839 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:39.614516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:39.617358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:32:39.623341 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:39.623849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:39.624298 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:39.625049 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:39.625523 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:39.625972 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:39.768170 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:39.776879 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6f98190-1a94-4177-bedf-2ca00efda1af tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.167011 Oct 27 11:32:39.777469 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4016/7837] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:39 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:40.802191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:40.802944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:40.811076 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:40.811548 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:40.811996 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:40.812698 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:40.813167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:40.813585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:40.951625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:40.959654 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1309720b-a7e5-4913-a45a-358578d700b2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.162206 Oct 27 11:32:40.960235 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3822/7838] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:40 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:41.994408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:41.995600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:42.003226 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:42.003766 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:42.004208 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:42.004947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:42.005414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:42.005848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:42.145688 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:42.154135 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35532797-e1b4-4a6d-a250-eeb8a88593c2 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.166393 Oct 27 11:32:42.154718 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4017/7839] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:41 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:43.178041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:43.178688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:43.186627 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:43.187114 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:43.187537 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:43.188223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:43.188693 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:43.189115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:43.336224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:43.349443 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88fd965e-423b-4c9e-b65e-f28495112163 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.175260 Oct 27 11:32:43.350335 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3823/7840] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:43 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:44.374941 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:44.375627 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:44.381950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:44.382441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:44.382879 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:44.383571 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:44.384029 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:44.384457 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:44.518783 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:44.526952 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4cd529cd-aae3-4763-8e8a-402f854a55cf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.156362 Oct 27 11:32:44.527532 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4018/7841] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:44 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:45.554827 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:45.555812 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:45.566719 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:45.567371 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:45.567962 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:45.568935 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:45.569546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:45.570117 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:45.709671 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:45.720444 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38042cdb-0959-4f35-8223-87063a6bb9d6 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.170854 Oct 27 11:32:45.721079 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3824/7842] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:45 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:46.230302 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-833195e7-bac7-4760-b7a1-05576e5fcb33 req-13c6a222-696e-43ff-a658-2f5ed5b95bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2997b711-9e96-40c4-8585-9cd9184165eb", "name": "network-vif-plugged", "status": "completed", "tag": "4465be42-85ea-4fc9-8e52-e2b2ef567cc6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:32:46.241729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-833195e7-bac7-4760-b7a1-05576e5fcb33 req-13c6a222-696e-43ff-a658-2f5ed5b95bf9 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:46.242541 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-833195e7-bac7-4760-b7a1-05576e5fcb33 req-13c6a222-696e-43ff-a658-2f5ed5b95bf9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:46.242823 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-833195e7-bac7-4760-b7a1-05576e5fcb33 req-13c6a222-696e-43ff-a658-2f5ed5b95bf9 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:46.254889 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-833195e7-bac7-4760-b7a1-05576e5fcb33 req-13c6a222-696e-43ff-a658-2f5ed5b95bf9 service nova] Creating event network-vif-plugged:4465be42-85ea-4fc9-8e52-e2b2ef567cc6 for instance 2997b711-9e96-40c4-8585-9cd9184165eb on n-h2-854663-10 Oct 27 11:32:46.260195 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-833195e7-bac7-4760-b7a1-05576e5fcb33 req-13c6a222-696e-43ff-a658-2f5ed5b95bf9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Oct 27 11:32:46.260848 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4019/7843] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:32:46.808622 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:46.809276 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:46.818597 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:46.819296 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:46.819834 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:46.820979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:46.821621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:46.822053 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:46.966207 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:46.974327 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9832b380-32e0-4369-98ea-3acd27f00ae8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1258 microversion: 2.1 time: 0.233192 Oct 27 11:32:46.974905 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3825/7844] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:46 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:48.000296 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:48.001057 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:48.008597 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:48.009187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:48.009714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:48.010499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:48.011015 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:48.011503 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:48.162450 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:48.171389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3fcf9437-b94d-4e8e-87fb-52a0fcbaef52 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1442 microversion: 2.1 time: 0.177092 Oct 27 11:32:48.172013 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4020/7845] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:47 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1442 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:48.198711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:32:48.199272 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:32:48.206515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:48.206994 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:48.207427 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:48.208115 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:48.208564 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:48.209010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:48.350106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:32:48.358711 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6699b9ae-8fc8-42a6-b3ee-e8ad97526a03 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1442 microversion: 2.1 time: 0.163923 Oct 27 11:32:48.359275 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3826/7846] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:32:48 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1442 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:32:50.305309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8636baa3-e92f-44e2-80d9-92dc04e5a59d req-db42338c-aea0-4755-b5c6-5eee45a88cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2997b711-9e96-40c4-8585-9cd9184165eb", "tag": "4465be42-85ea-4fc9-8e52-e2b2ef567cc6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:32:50.316040 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8636baa3-e92f-44e2-80d9-92dc04e5a59d req-db42338c-aea0-4755-b5c6-5eee45a88cd1 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:32:50.316706 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8636baa3-e92f-44e2-80d9-92dc04e5a59d req-db42338c-aea0-4755-b5c6-5eee45a88cd1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:32:50.317026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8636baa3-e92f-44e2-80d9-92dc04e5a59d req-db42338c-aea0-4755-b5c6-5eee45a88cd1 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:32:50.329077 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8636baa3-e92f-44e2-80d9-92dc04e5a59d req-db42338c-aea0-4755-b5c6-5eee45a88cd1 service nova] Creating event network-changed:4465be42-85ea-4fc9-8e52-e2b2ef567cc6 for instance 2997b711-9e96-40c4-8585-9cd9184165eb on n-h2-854663-10 Oct 27 11:32:50.334618 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8636baa3-e92f-44e2-80d9-92dc04e5a59d req-db42338c-aea0-4755-b5c6-5eee45a88cd1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032961 Oct 27 11:32:50.335546 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4021/7847] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:34:47.701804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=28 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:34:47.702649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=56 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:34:47.703774 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:34:47.703941 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:34:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb/action (ip 10.222.0.76) !!! Oct 27 11:34:47.714692 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:34:47.715223 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:47.722544 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:47.723366 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:47.723513 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:47.724168 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:47.724608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:47.725192 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:47.749463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lazy-loading 'flavor' on Instance uuid 2997b711-9e96-40c4-8585-9cd9184165eb {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:34:47.827282 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43545557-e7f1-441e-a5e8-d85afbde65aa tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "POST /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb/action" status: 202 len: 0 microversion: 2.1 time: 0.127330 Oct 27 11:34:47.827933 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3827/7848] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:34:47 2022] POST /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:34:47.834818 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96cdc9e5-e02f-4d91-99be-23d737d0e4ff] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 11:34:47.835740 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0fef263e-49f6-40e0-92a9-76f7527873a5] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 11:34:47.836617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:34:47.837504 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=54 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:34:47.842592 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:47.843301 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:47.851378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:47.851888 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:47.852358 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:47.853118 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:47.853577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:47.854019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:48.053931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:48.062325 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7edd837b-89c6-4cdc-8da2-3d04109117f8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.229784 Oct 27 11:34:48.062894 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4022/7849] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:47 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:49.092437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:49.093642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:49.103735 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:49.104226 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:49.104632 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:49.105402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:49.105867 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:49.106297 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:49.299726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:49.313501 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f6562daa-1d41-4bf3-a5ed-bc5f8986eecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.228077 Oct 27 11:34:49.314385 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3828/7850] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:49 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:50.340836 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:50.341529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:50.350570 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:50.351130 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:50.351636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:50.352443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:50.352996 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:50.353479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:50.361735 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [96cdc9e5-e02f-4d91-99be-23d737d0e4ff] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 52890. Oct 27 11:34:50.376299 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [0fef263e-49f6-40e0-92a9-76f7527873a5] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 52892. Oct 27 11:34:50.495067 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:50.506696 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8db7da8e-578e-4e8a-bbd1-5aecfe456929 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.169924 Oct 27 11:34:50.507396 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4023/7851] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:50 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:51.532651 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:51.533417 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:51.542904 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:51.543499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:51.544038 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:51.544940 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:51.545493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:51.546010 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:51.689041 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:51.701119 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b314203c-05e0-49c0-bf4c-4bfc5630cbad tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.173131 Oct 27 11:34:51.701985 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3829/7852] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:51 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:52.730026 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:52.730632 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:52.738435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:52.738931 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:52.739372 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:52.740101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:52.740565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:52.741043 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:52.897652 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:52.907047 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-289931ce-e8aa-4845-8304-449b2fe03256 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.182215 Oct 27 11:34:52.907636 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4024/7853] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:52 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:53.933553 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:53.934219 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:53.941695 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:53.942185 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:53.942625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:53.943322 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:53.943778 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:53.944200 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:54.091578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:54.099574 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-222277ed-c5b8-48d3-afee-11f70935cc7e tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.172035 Oct 27 11:34:54.100135 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3830/7854] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:53 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:55.124080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:55.124729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:55.132076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:55.132583 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:55.133075 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:55.133808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:55.134305 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:55.134740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:55.283493 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:55.295843 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6442e26-20ff-4fad-939c-58bfd1d7d081 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.175506 Oct 27 11:34:55.296623 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4025/7855] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:55 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:56.323022 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:56.323636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:56.331153 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:56.331653 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:56.332069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:56.332793 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:56.333246 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:56.333672 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:56.478447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:56.486814 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f38f34ff-4a89-480d-bf24-49571c52dcab tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.170325 Oct 27 11:34:56.487396 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3831/7856] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:56 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:57.515254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:57.516188 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:57.527491 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:57.527986 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:57.528429 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:57.529173 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:57.529636 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:57.530066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:57.671065 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:57.679155 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1866b8f1-94fe-4ef4-91b2-b970ae2291a4 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.171134 Oct 27 11:34:57.679709 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4026/7857] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:57 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:58.706738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:58.707585 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:58.717998 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:58.718705 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:58.719331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:58.720326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:58.721027 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:58.721642 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:58.883936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:34:58.892582 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-294a2481-c96d-4d3b-be8d-8ef94fffd1d1 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.191526 Oct 27 11:34:58.893214 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3832/7858] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:58 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:34:59.920115 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:34:59.921114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:34:59.932978 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:59.933487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:59.933944 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:34:59.934660 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:34:59.935121 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:34:59.935562 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:00.071229 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:00.079865 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ecba974-a274-4a03-aa4e-cee255a01b98 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.166844 Oct 27 11:35:00.080538 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4027/7859] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:34:59 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:01.103799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:01.104506 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:01.111992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:01.112476 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:01.112938 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:01.113630 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:01.114079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:01.114495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:01.254416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:01.263407 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-64f9fe93-ec23-4fa1-ab80-05e0d35d0ecb tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.163422 Oct 27 11:35:01.264102 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3833/7860] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:01 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:02.291331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:02.292516 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:02.300634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:02.301164 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:02.301608 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:02.302312 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:02.302772 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:02.303207 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:02.452759 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:02.461347 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e1c30d1-3b67-44df-a384-b21e02ef5002 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1507 microversion: 2.1 time: 0.176728 Oct 27 11:35:02.461932 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4028/7861] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:02 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:02.494738 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:35:02.495342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:02.504415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:02.505098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:02.505650 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:02.506640 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:02.507138 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:02.507647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:02.539768 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120719) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 11:35:02.612185 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d20f7499-c2b3-4c43-9d5f-ffbe0d265227 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "POST /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb/action" status: 202 len: 0 microversion: 2.1 time: 0.124113 Oct 27 11:35:02.612992 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3834/7862] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:35:02 2022] POST /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:35:02.621178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:02.621802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:02.627923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:02.628425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:02.628909 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:02.629613 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:02.630072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:02.630501 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:02.814202 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:02.822500 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2ce0a3d-ab96-4875-86b4-67ab34edc73f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1515 microversion: 2.1 time: 0.205279 Oct 27 11:35:02.823258 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4029/7863] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:02 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:03.851943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:03.853175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:03.862098 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:03.862665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:03.863146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:03.863854 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:03.864448 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:03.864783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:04.005442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:04.014199 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-23d09235-7db1-494d-a1b8-638e67a0fe78 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1517 microversion: 2.1 time: 0.168683 Oct 27 11:35:04.014806 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3835/7864] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:03 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:04.818008 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-be2c843c-fec5-4f84-a081-b3baa9a67a2f req-21bc850a-f50e-4732-a504-039e6fabd01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2997b711-9e96-40c4-8585-9cd9184165eb", "name": "network-vif-unplugged", "status": "completed", "tag": "4465be42-85ea-4fc9-8e52-e2b2ef567cc6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:35:04.832950 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be2c843c-fec5-4f84-a081-b3baa9a67a2f req-21bc850a-f50e-4732-a504-039e6fabd01f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:04.833561 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be2c843c-fec5-4f84-a081-b3baa9a67a2f req-21bc850a-f50e-4732-a504-039e6fabd01f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:04.834156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be2c843c-fec5-4f84-a081-b3baa9a67a2f req-21bc850a-f50e-4732-a504-039e6fabd01f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:04.847069 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_external_events [req-be2c843c-fec5-4f84-a081-b3baa9a67a2f req-21bc850a-f50e-4732-a504-039e6fabd01f service nova] Unable to find a host for instance 2997b711-9e96-40c4-8585-9cd9184165eb. Dropping event network-vif-unplugged {{(pid=120720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 11:35:04.848130 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-be2c843c-fec5-4f84-a081-b3baa9a67a2f req-21bc850a-f50e-4732-a504-039e6fabd01f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034141 Oct 27 11:35:04.849085 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4030/7865] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 11:35:05.038294 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:05.038873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:05.046750 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:05.047241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:05.047679 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:05.048393 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:05.048888 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:05.049341 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:05.201748 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:05.210446 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e065e50-30b0-4255-ba3e-cc063f6eec12 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1517 microversion: 2.1 time: 0.176246 Oct 27 11:35:05.211122 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3836/7866] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:05 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:06.235849 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:06.236531 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:06.244147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:06.244649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:06.245284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:06.247560 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:06.248157 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:06.248848 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:06.391374 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:06.399639 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12d56ddb-34ba-4f4f-a095-27338b6acd0f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1517 microversion: 2.1 time: 0.167967 Oct 27 11:35:06.400235 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4031/7867] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:06 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:07.424066 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:07.424649 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:07.432243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:07.432760 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:07.433195 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:07.433889 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:07.434311 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:07.434862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:07.576060 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:07.584801 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1908d12a-b8a6-4015-a7bc-1165df979309 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1517 microversion: 2.1 time: 0.164650 Oct 27 11:35:07.585301 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3837/7868] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:07 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:08.612454 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:08.613300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:08.624414 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:08.624961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:08.625418 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:08.626145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:08.626617 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:08.627059 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:08.798390 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:08.807778 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-060ec833-3660-47b4-b375-1e7d1b383d9b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.202252 Oct 27 11:35:08.808580 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4032/7869] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:08 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:09.728248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9af44da6-d593-4de9-a99a-844b71c840f1 req-9a682a0b-4954-4127-bf3a-66d486886c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2997b711-9e96-40c4-8585-9cd9184165eb", "tag": "4465be42-85ea-4fc9-8e52-e2b2ef567cc6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:35:09.740595 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9af44da6-d593-4de9-a99a-844b71c840f1 req-9a682a0b-4954-4127-bf3a-66d486886c81 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:09.741208 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9af44da6-d593-4de9-a99a-844b71c840f1 req-9a682a0b-4954-4127-bf3a-66d486886c81 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:09.741828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9af44da6-d593-4de9-a99a-844b71c840f1 req-9a682a0b-4954-4127-bf3a-66d486886c81 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:09.754550 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9af44da6-d593-4de9-a99a-844b71c840f1 req-9a682a0b-4954-4127-bf3a-66d486886c81 service nova] Creating event network-changed:4465be42-85ea-4fc9-8e52-e2b2ef567cc6 for instance 2997b711-9e96-40c4-8585-9cd9184165eb on n-h1-854663-10 Oct 27 11:35:09.759785 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9af44da6-d593-4de9-a99a-844b71c840f1 req-9a682a0b-4954-4127-bf3a-66d486886c81 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035631 Oct 27 11:35:09.760400 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3838/7870] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:35:09.831953 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:09.832700 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:09.840923 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:09.841540 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:09.842097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:09.842890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:09.843388 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:09.843821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:09.982005 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:09.990347 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-85bfcd9a-addd-448a-b1fa-490e073b2a9f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.162501 Oct 27 11:35:09.990984 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4033/7871] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:09 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:11.016485 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:11.017235 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:11.024146 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:11.024636 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:11.025112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:11.025819 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:11.026269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:11.026699 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:11.165703 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:11.174495 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3b58b4f3-cbac-4978-b252-638f3c0c8926 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.163551 Oct 27 11:35:11.175089 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3839/7872] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:11 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:12.202500 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:12.203416 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:12.211536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:12.212063 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:12.212538 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:12.213313 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:12.213803 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:12.214261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:12.353006 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:12.364992 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41e62f8b-bda8-43b8-992d-32a67cc8ff19 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.168752 Oct 27 11:35:12.365783 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4034/7873] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:12 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:13.393578 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:13.394501 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:13.406457 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:13.406944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:13.407379 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:13.408077 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:13.408517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:13.408979 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:13.547999 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:13.561092 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b5276429-7180-42ff-92f2-ad89075d440b tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.173988 Oct 27 11:35:13.562115 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3840/7874] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:13 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:14.593782 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:14.595117 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:14.602866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:14.603391 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:14.603816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:14.604529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:14.605056 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:14.605498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:14.747101 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:14.757172 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-319730a0-068b-41ac-b367-34f784adf5c8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.170063 Oct 27 11:35:14.757802 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4035/7875] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:14 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:15.785475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:15.786514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:15.798495 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:15.799323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:15.800079 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:15.801073 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:15.801526 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:15.802055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:15.806986 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:35:15.946773 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:15.955304 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aff3ab24-8f99-4b5b-b7a7-118c9aac28bf tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.176645 Oct 27 11:35:15.955871 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3841/7876] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:15 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:16.981623 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:16.982398 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:16.991860 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:16.992480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:16.993080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:16.993971 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:16.994552 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:16.995078 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:17.144076 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:17.152978 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e118789-528c-4a0c-bdd0-cafcbec7cf41 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.176388 Oct 27 11:35:17.153572 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4036/7877] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:16 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:18.177920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:18.178814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:18.181832 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:35:18.187880 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:18.188591 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:18.189158 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:18.189957 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:18.190478 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:18.190969 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:18.334319 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:18.342692 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bbd85faf-fa41-4667-a338-786727ee595f tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.169416 Oct 27 11:35:18.343247 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3842/7878] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:18 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:19.367279 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:19.367900 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:19.370715 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=31 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:35:19.376506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:19.377031 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:19.377487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:19.378186 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:19.378649 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:19.379094 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:19.381778 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=87 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:35:19.523314 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:19.531461 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7cb3734-c2bf-49e4-b24e-f58fa7c313a8 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.168358 Oct 27 11:35:19.532042 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4037/7879] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:19 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:19.775603 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ff902341-0722-4a37-b86e-30718e571a98 req-e21c9370-0572-4449-a945-15b1e2f79480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2997b711-9e96-40c4-8585-9cd9184165eb", "name": "network-vif-plugged", "status": "completed", "tag": "4465be42-85ea-4fc9-8e52-e2b2ef567cc6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:35:19.785214 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ff902341-0722-4a37-b86e-30718e571a98 req-e21c9370-0572-4449-a945-15b1e2f79480 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:19.785897 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ff902341-0722-4a37-b86e-30718e571a98 req-e21c9370-0572-4449-a945-15b1e2f79480 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:19.786368 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ff902341-0722-4a37-b86e-30718e571a98 req-e21c9370-0572-4449-a945-15b1e2f79480 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:19.798143 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ff902341-0722-4a37-b86e-30718e571a98 req-e21c9370-0572-4449-a945-15b1e2f79480 service nova] Creating event network-vif-plugged:4465be42-85ea-4fc9-8e52-e2b2ef567cc6 for instance 2997b711-9e96-40c4-8585-9cd9184165eb on n-h1-854663-10 Oct 27 11:35:19.803131 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ff902341-0722-4a37-b86e-30718e571a98 req-e21c9370-0572-4449-a945-15b1e2f79480 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084027 Oct 27 11:35:19.803730 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3843/7880] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:35:20.559564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:20.560740 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:20.569685 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:20.570318 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:20.570775 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:20.571489 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:20.571947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:20.572408 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:20.722676 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:20.731499 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00f5bc30-9314-4a82-a24c-fc4c70894861 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1573 microversion: 2.1 time: 0.178592 Oct 27 11:35:20.732078 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4038/7881] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:20 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:35:21.759673 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:35:21.760487 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:35:21.770921 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:21.771392 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:21.771824 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:21.772514 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:35:21.772995 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:35:21.773437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:35:21.926828 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:35:21.935096 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe3b488a-a3e6-401c-8a85-b3c418625b22 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1560 microversion: 2.1 time: 0.182337 Oct 27 11:35:21.935681 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3844/7882] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:35:21 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:36:39.391477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:36:39.392140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:39.392140 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:36:39.392637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=18 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:36:39.394234 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:36:39.394490 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.76) !!! Oct 27 11:36:39.394695 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:36:39.395275 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=11 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:36:39.399721 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a586f0d0-7647-4bfc-b3fa-4d42d4d72e82 req-fb6201d7-326b-4364-adf3-ed5b7e678d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2997b711-9e96-40c4-8585-9cd9184165eb", "tag": "4465be42-85ea-4fc9-8e52-e2b2ef567cc6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:36:39.402856 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:36:39.403202 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb (ip 10.222.0.76) !!! Oct 27 11:36:39.405218 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:36:39.405508 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb (ip 10.222.0.76) !!! Oct 27 11:36:39.408345 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:36:39.408489 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb (ip 10.222.0.76) !!! Oct 27 11:36:39.422774 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a586f0d0-7647-4bfc-b3fa-4d42d4d72e82 req-fb6201d7-326b-4364-adf3-ed5b7e678d5b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:39.423262 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a586f0d0-7647-4bfc-b3fa-4d42d4d72e82 req-fb6201d7-326b-4364-adf3-ed5b7e678d5b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:39.425250 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a586f0d0-7647-4bfc-b3fa-4d42d4d72e82 req-fb6201d7-326b-4364-adf3-ed5b7e678d5b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:39.434982 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:39.435957 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:39.436402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:39.437155 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:39.437618 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:39.439163 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:39.440399 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a586f0d0-7647-4bfc-b3fa-4d42d4d72e82 req-fb6201d7-326b-4364-adf3-ed5b7e678d5b service nova] Creating event network-changed:4465be42-85ea-4fc9-8e52-e2b2ef567cc6 for instance 2997b711-9e96-40c4-8585-9cd9184165eb on n-h1-854663-10 Oct 27 11:36:39.445569 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a586f0d0-7647-4bfc-b3fa-4d42d4d72e82 req-fb6201d7-326b-4364-adf3-ed5b7e678d5b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056335 Oct 27 11:36:39.446701 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3845/7883] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:36:39.470478 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:36:39.560194 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e481bf5-b24f-4280-88fd-5249c49ca499 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 204 len: 0 microversion: 2.1 time: 0.171862 Oct 27 11:36:39.561066 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4039/7884] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:36:39 2022] DELETE /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:36:39.570825 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:39.571820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:36:39.578647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:39.579116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:39.579546 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:39.580248 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:39.580717 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:39.581142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:39.721482 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:36:39.730383 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa5c5446-dede-4822-a2e8-58c5b9c09958 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.164766 Oct 27 11:36:39.730999 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3846/7885] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:36:39 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:36:40.759480 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:40.760558 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:36:40.772448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:40.773254 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:40.773814 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:40.774529 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:40.774998 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:40.775435 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:40.917081 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:36:40.930268 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a50f1035-e26d-47ba-b33c-0cb0547be3de tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1566 microversion: 2.1 time: 0.177838 Oct 27 11:36:40.930840 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4040/7886] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:36:40 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:36:41.849857 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b3ede5db-5159-413a-939d-0b1c33016c19 req-ca4ac3e9-b900-4ed7-94e0-24746fce750f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2997b711-9e96-40c4-8585-9cd9184165eb", "name": "network-vif-deleted", "tag": "4465be42-85ea-4fc9-8e52-e2b2ef567cc6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:36:41.864210 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b3ede5db-5159-413a-939d-0b1c33016c19 req-ca4ac3e9-b900-4ed7-94e0-24746fce750f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:41.864711 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b3ede5db-5159-413a-939d-0b1c33016c19 req-ca4ac3e9-b900-4ed7-94e0-24746fce750f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:41.865140 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b3ede5db-5159-413a-939d-0b1c33016c19 req-ca4ac3e9-b900-4ed7-94e0-24746fce750f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:41.878761 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b3ede5db-5159-413a-939d-0b1c33016c19 req-ca4ac3e9-b900-4ed7-94e0-24746fce750f service nova] Creating event network-vif-deleted:4465be42-85ea-4fc9-8e52-e2b2ef567cc6 for instance 2997b711-9e96-40c4-8585-9cd9184165eb on n-h1-854663-10 Oct 27 11:36:41.884117 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b3ede5db-5159-413a-939d-0b1c33016c19 req-ca4ac3e9-b900-4ed7-94e0-24746fce750f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038055 Oct 27 11:36:41.884754 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3847/7887] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:36:41.955232 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:41.955995 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:36:41.963701 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:41.964204 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:41.964650 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:41.965404 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:41.965884 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:41.966370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:42.037506 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:36:42.046635 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8dd621cb-a148-4198-859c-459635ca478d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1217 microversion: 2.1 time: 0.095404 Oct 27 11:36:42.047249 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4041/7888] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:36:41 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:36:43.072329 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:43.073182 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:36:43.080094 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:43.080569 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:43.081037 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:43.081733 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:43.082306 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:43.082736 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:43.148232 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:36:43.156966 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87429149-1612-4ef0-be92-e5004dbadde5 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1217 microversion: 2.1 time: 0.090092 Oct 27 11:36:43.157555 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3848/7889] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:36:43 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:36:44.181131 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:44.181747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:36:44.189585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:44.190090 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:44.190539 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:44.191263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:44.191729 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:44.192169 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:44.259084 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:36:44.267538 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9bc6b67d-3dd8-4b17-bcac-b105b9f0a2ce tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1217 microversion: 2.1 time: 0.090870 Oct 27 11:36:44.268123 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4042/7890] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:36:44 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:36:45.291541 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:45.292814 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:36:45.300301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:45.300822 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:45.301251 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:45.301943 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:45.302517 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:45.303056 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:45.367922 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:36:45.376337 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a110d7c8-7746-4fb8-aa59-06967482648c tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1217 microversion: 2.1 time: 0.089093 Oct 27 11:36:45.376966 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3849/7891] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:36:45 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:36:46.399838 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:46.400511 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:36:46.408345 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:46.408899 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:46.409344 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:46.410209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:46.410820 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:46.411273 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:46.444509 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:46.445113 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:46.445610 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:46.446061 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lazy-loading 'fault' on Instance uuid 2997b711-9e96-40c4-8585-9cd9184165eb {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:36:46.497452 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761a65e9beb94b95b5abaa45f19cb9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fc8304329048ef8585c037e8313eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:36:46.506764 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f221fd4d-2002-4d4e-8566-dd8515a1b997 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 200 len: 1222 microversion: 2.1 time: 0.111203 Oct 27 11:36:46.507738 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4043/7892] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:36:46 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:36:47.531142 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:47.531756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] [instance: 2997b711-9e96-40c4-8585-9cd9184165eb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:36:47.539716 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:47.540323 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:47.540806 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:47.541869 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:36:47.542463 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:36:47.542892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:36:47.557617 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] HTTP exception thrown: Instance 2997b711-9e96-40c4-8585-9cd9184165eb could not be found. Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Request method failure captured: Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb HTTP/1.1 Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: Accept: application/json Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: Accept-Encoding: identity Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: Connection: close Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: Content-Length: 0 Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: Content-Type: application/json Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: Host: 10.222.0.76 Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: Openstack-System-Scope: None Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjWmstDMjHSF1C4QPQ1tFdFnvCAArEzCIUPOuoQP2bPsKp_Sth3l9FQjNtlEZRk2EG0qKLP3QCGw2th3iPrus7bw5S2ZZFCd5r5QNcrVNkjGZmXH8JQjQW_6xt7nU6exU4oXu2j2R1jgZMd0ryFJitUhL8UNC_YJuCbQsS_8ocz3ts60Y Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Id: None Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Domain-Name: None Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Identity-Status: Confirmed Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Is-Admin-Project: True Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Id: default Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Domain-Name: Default Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Id: e5fc8304329048ef8585c037e8313eab Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Project-Name: tempest-TestShelveInstance-70329324 Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Role: member,reader Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Roles: member,reader Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e5fc8304329048ef8585c037e8313eab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e5fc8304329048ef8585c037e8313eab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e5fc8304329048ef8585c037e8313eab", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e5fc8304329048ef8585c037e8313eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant: tempest-TestShelveInstance-70329324 Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Id: e5fc8304329048ef8585c037e8313eab Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestShelveInstance-70329324 Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-User: tempest-TestShelveInstance-70329324-project Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Id: default Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Domain-Name: Default Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Id: 761a65e9beb94b95b5abaa45f19cb9ce Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: X-User-Name: tempest-TestShelveInstance-70329324-project Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: method: > Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: exception: Instance 2997b711-9e96-40c4-8585-9cd9184165eb could not be found. Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: action_args: {'id': '2997b711-9e96-40c4-8585-9cd9184165eb'} Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2997b711-9e96-40c4-8585-9cd9184165eb could not be found. Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2997b711-9e96-40c4-8585-9cd9184165eb could not be found. Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:36:47.559318 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2997b711-9e96-40c4-8585-9cd9184165eb could not be found. Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Returning 404 to user: Instance 2997b711-9e96-40c4-8585-9cd9184165eb could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e8c19d4a-f5ce-41f7-98d2-a4b3152ddec9 tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb" status: 404 len: 111 microversion: 2.1 time: 0.033658 Oct 27 11:36:47.564975 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3850/7893] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:36:47 2022] GET /compute/v2.1/servers/2997b711-9e96-40c4-8585-9cd9184165eb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:36:47.729309 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79d8f017-7c2c-4fa6-bf46-2e81203cdb6d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] Calling method '.version_select at 0x7f6d638e5940>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:36:47.768110 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79d8f017-7c2c-4fa6-bf46-2e81203cdb6d tempest-TestShelveInstance-70329324 tempest-TestShelveInstance-70329324-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-754559658" status: 202 len: 0 microversion: 2.1 time: 0.043234 Oct 27 11:36:47.768846 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4044/7894] 10.222.0.76 () {58 vars in 1251 bytes} [Thu Oct 27 11:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-754559658 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 11:37:05.220342 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:37:05.221360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=24 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:37:05.403725 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6184079b-3388-4b4f-9ad0-48019ba2733b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Action: 'create', calling method: .version_select at 0x7f6d5b474820>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1292627310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoU1N3VGOw+aykW0v8kYpGAwk6jTLXrbS4LfAB5tR61hsY7mJoRa5KnGU9Xg8gmGP2rqZLjtvVUV5743cFpzlCXh91KlYRaLMp4sYqOIhydYZcmOXqTQhue7g30qBpyOw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:37:05.420469 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6184079b-3388-4b4f-9ad0-48019ba2733b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Getting quotas for project 4af5d55118634798a5feb92041d4fa16. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:37:05.425804 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.quota [None req-6184079b-3388-4b4f-9ad0-48019ba2733b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Getting quotas for user 964244098bf5432f97499032f1684139 and project 4af5d55118634798a5feb92041d4fa16. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:37:05.457091 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6184079b-3388-4b4f-9ad0-48019ba2733b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.242029 Oct 27 11:37:05.458049 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3851/7895] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 27 11:37:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:37:06.570256 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1824920485", "imageRef": "e360a591-87a4-48a1-b578-afd9703b636a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1292627310", "security_groups": [{"name": "tempest-secgroup-smoke-433101544"}], "networks": [{"uuid": "cabec47e-b358-481a-b170-6445cdd797db"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:37:06.580914 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:37:06.581710 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:37:06.692337 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] validate_networks() for [('cabec47e-b358-481a-b170-6445cdd797db', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:37:07.100241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:37:07.100939 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:37:07.102272 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:37:07.102975 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:37:07.103543 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:37:07.116103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:07.116687 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:07.117284 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:07.118166 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:07.118634 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:07.119087 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:07.137071 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Getting quotas for project 4af5d55118634798a5feb92041d4fa16. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:37:07.142584 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Getting quotas for user 964244098bf5432f97499032f1684139 and project 4af5d55118634798a5feb92041d4fa16. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:37:07.155965 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:37:07.159145 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e360a591-87a4-48a1-b578-afd9703b636a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:37:07.211729 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-278d2883-9403-4b8d-97ec-fbebf240c23e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.645844 Oct 27 11:37:07.212380 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4045/7896] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:37:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 11:37:07.224840 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cbb96526-6a84-4403-814d-52b86c525971 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:07.225561 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cbb96526-6a84-4403-814d-52b86c525971 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:07.281786 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-cbb96526-6a84-4403-814d-52b86c525971 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:07.289153 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cbb96526-6a84-4403-814d-52b86c525971 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1249 microversion: 2.1 time: 0.069071 Oct 27 11:37:07.289778 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3852/7897] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:07 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1249 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:08.317283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:08.322845 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:08.336382 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:08.337373 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:08.337897 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:08.341875 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:08.342446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:08.342973 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:08.438114 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:08.448031 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f16452d7-d9c4-4d9a-b354-711336235399 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1309 microversion: 2.1 time: 0.138530 Oct 27 11:37:08.449035 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4046/7898] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:08 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1309 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:09.471839 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:09.472543 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:09.480444 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:09.481007 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:09.481442 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:09.482160 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:09.482608 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:09.483055 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:09.705155 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:09.713978 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c90a6922-1630-478d-9863-f9f3b846524a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1374 microversion: 2.1 time: 0.246200 Oct 27 11:37:09.714571 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3853/7899] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:09 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:10.113266 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d9148df4-b787-4334-b56d-09050cd19b08 req-e6f315bb-58a5-4c38-9a7f-593b29402592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab015ed-9f8e-4a55-9d64-833228a7863f", "tag": "0db8b5d1-47be-4a95-88d1-fee56a199ee4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:37:10.123619 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d9148df4-b787-4334-b56d-09050cd19b08 req-e6f315bb-58a5-4c38-9a7f-593b29402592 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:10.124475 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d9148df4-b787-4334-b56d-09050cd19b08 req-e6f315bb-58a5-4c38-9a7f-593b29402592 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:10.125250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d9148df4-b787-4334-b56d-09050cd19b08 req-e6f315bb-58a5-4c38-9a7f-593b29402592 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:10.137758 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d9148df4-b787-4334-b56d-09050cd19b08 req-e6f315bb-58a5-4c38-9a7f-593b29402592 service nova] Creating event network-changed:0db8b5d1-47be-4a95-88d1-fee56a199ee4 for instance 0ab015ed-9f8e-4a55-9d64-833228a7863f on n-h2-854663-10 Oct 27 11:37:10.144623 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d9148df4-b787-4334-b56d-09050cd19b08 req-e6f315bb-58a5-4c38-9a7f-593b29402592 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108850 Oct 27 11:37:10.145671 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4047/7900] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 11:37:10.738019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:10.738918 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:10.747607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:10.748236 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:10.748676 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:10.749488 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:10.749950 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:10.750362 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:10.966916 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:10.975344 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7ab41e1c-e589-44e3-9b9a-04700ba65838 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1374 microversion: 2.1 time: 0.241538 Oct 27 11:37:10.976898 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3854/7901] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:10 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1374 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:12.001678 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:12.002502 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:12.009985 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:12.010494 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:12.010949 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:12.011673 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:12.012178 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:12.012621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:12.240709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:12.249038 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1297b545-5182-4530-af6c-53f39bfceaa3 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1374 microversion: 2.1 time: 0.251774 Oct 27 11:37:12.249664 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4048/7902] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:11 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1374 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:13.273078 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:13.273758 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:13.281353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:13.281907 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:13.282345 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:13.283058 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:13.283509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:13.283931 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:13.428291 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:13.436482 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b1e0e53-1504-4acd-8e5e-edc6aa6799e1 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1374 microversion: 2.1 time: 0.167436 Oct 27 11:37:13.437214 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3855/7903] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:13 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:14.459825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:14.460468 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:14.468091 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:14.468600 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:14.469097 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:14.469808 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:14.470278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:14.470727 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:14.610476 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:14.618848 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-821e49b5-751b-48b5-b5fe-c2f91e6b1e9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1374 microversion: 2.1 time: 0.163074 Oct 27 11:37:14.619442 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4049/7904] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:14 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:15.392269 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5c7410b0-4985-4c3e-a14d-ae29414b63ba req-b38b8997-45d2-4d9c-9558-a7fa13a7dfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab015ed-9f8e-4a55-9d64-833228a7863f", "name": "network-vif-plugged", "status": "completed", "tag": "0db8b5d1-47be-4a95-88d1-fee56a199ee4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:37:15.403499 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5c7410b0-4985-4c3e-a14d-ae29414b63ba req-b38b8997-45d2-4d9c-9558-a7fa13a7dfc6 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:15.404111 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5c7410b0-4985-4c3e-a14d-ae29414b63ba req-b38b8997-45d2-4d9c-9558-a7fa13a7dfc6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:15.404568 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5c7410b0-4985-4c3e-a14d-ae29414b63ba req-b38b8997-45d2-4d9c-9558-a7fa13a7dfc6 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:15.422428 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5c7410b0-4985-4c3e-a14d-ae29414b63ba req-b38b8997-45d2-4d9c-9558-a7fa13a7dfc6 service nova] Creating event network-vif-plugged:0db8b5d1-47be-4a95-88d1-fee56a199ee4 for instance 0ab015ed-9f8e-4a55-9d64-833228a7863f on n-h2-854663-10 Oct 27 11:37:15.427589 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5c7410b0-4985-4c3e-a14d-ae29414b63ba req-b38b8997-45d2-4d9c-9558-a7fa13a7dfc6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039494 Oct 27 11:37:15.428416 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3856/7905] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:37:15.643752 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:15.644353 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:15.652961 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:15.653499 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:15.654052 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:15.654873 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:15.655348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:15.656024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:15.801088 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:15.810804 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd8cfc05-aab0-4371-9ad8-6f6c9f7ea37d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1374 microversion: 2.1 time: 0.171556 Oct 27 11:37:15.812054 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4050/7906] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:15 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:16.837241 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:16.837974 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:16.845509 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:16.846019 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:16.846477 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:16.847198 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:16.847665 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:16.848105 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:16.991475 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:16.999987 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10ebaa9d-412a-4242-989f-b948ad1eac7e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1558 microversion: 2.1 time: 0.168298 Oct 27 11:37:17.000564 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3857/7907] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:16 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:17.022671 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:37:17.023300 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:37:17.030577 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:17.031156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:17.031609 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:17.032316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:17.032821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:17.033261 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:17.126030 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:37:17.149479 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:37:17.182024 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:37:17.190528 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f72f7c0-e940-4cf4-930b-92dc834129df tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1558 microversion: 2.1 time: 0.171683 Oct 27 11:37:17.191118 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4051/7908] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:37:17 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:37:19.201841 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:37:19.257220 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-afb2335c-81e2-428c-9cb1-cb785bf4dca6 req-48243f21-4993-4d9c-9a05-cbf7f71c8e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab015ed-9f8e-4a55-9d64-833228a7863f", "tag": "0db8b5d1-47be-4a95-88d1-fee56a199ee4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:37:19.267394 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-afb2335c-81e2-428c-9cb1-cb785bf4dca6 req-48243f21-4993-4d9c-9a05-cbf7f71c8e9b service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:37:19.267873 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-afb2335c-81e2-428c-9cb1-cb785bf4dca6 req-48243f21-4993-4d9c-9a05-cbf7f71c8e9b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:37:19.268331 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-afb2335c-81e2-428c-9cb1-cb785bf4dca6 req-48243f21-4993-4d9c-9a05-cbf7f71c8e9b service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:37:19.280024 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-afb2335c-81e2-428c-9cb1-cb785bf4dca6 req-48243f21-4993-4d9c-9a05-cbf7f71c8e9b service nova] Creating event network-changed:0db8b5d1-47be-4a95-88d1-fee56a199ee4 for instance 0ab015ed-9f8e-4a55-9d64-833228a7863f on n-h2-854663-10 Oct 27 11:37:19.285504 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-afb2335c-81e2-428c-9cb1-cb785bf4dca6 req-48243f21-4993-4d9c-9a05-cbf7f71c8e9b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088406 Oct 27 11:37:19.286452 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3858/7909] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:39:14.848950 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96cdc9e5-e02f-4d91-99be-23d737d0e4ff] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 11:39:14.850037 n-d-854663-10 devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0fef263e-49f6-40e0-92a9-76f7527873a5] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 11:39:14.850890 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:14.851989 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=34 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:14.858827 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9b80c3db-c098-4916-8e90-a4c1bb81d6a7 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-212605654"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:39:14.861821 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b80c3db-c098-4916-8e90-a4c1bb81d6a7 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:14.870048 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b80c3db-c098-4916-8e90-a4c1bb81d6a7 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:14.870547 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b80c3db-c098-4916-8e90-a4c1bb81d6a7 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:14.871002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b80c3db-c098-4916-8e90-a4c1bb81d6a7 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:14.871709 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b80c3db-c098-4916-8e90-a4c1bb81d6a7 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:14.872177 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b80c3db-c098-4916-8e90-a4c1bb81d6a7 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:14.872621 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b80c3db-c098-4916-8e90-a4c1bb81d6a7 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:15.115166 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9b80c3db-c098-4916-8e90-a4c1bb81d6a7 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "POST /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f/action" status: 202 len: 0 microversion: 2.1 time: 0.268595 Oct 27 11:39:15.115841 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4052/7910] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:39:14 2022] POST /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 11:39:20.035928 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3317bcd0-7139-4b6a-a168-7c5e11e5c085] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 11:39:20.037394 n-d-854663-10 devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecd0d1de-c8ef-468a-a3de-2649f8270da1] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 11:39:20.038015 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:20.038769 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=28 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:20.039738 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:39:20.040400 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:39:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.76) !!! Oct 27 11:39:20.048398 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2085f7db-93a1-4060-82fe-93f682d36fb6 req-7f141af4-6d24-4c8a-8c59-ee678e7026d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab015ed-9f8e-4a55-9d64-833228a7863f", "name": "network-vif-plugged", "status": "completed", "tag": "0db8b5d1-47be-4a95-88d1-fee56a199ee4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:39:20.061571 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2085f7db-93a1-4060-82fe-93f682d36fb6 req-7f141af4-6d24-4c8a-8c59-ee678e7026d4 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:20.062069 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2085f7db-93a1-4060-82fe-93f682d36fb6 req-7f141af4-6d24-4c8a-8c59-ee678e7026d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:20.062480 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2085f7db-93a1-4060-82fe-93f682d36fb6 req-7f141af4-6d24-4c8a-8c59-ee678e7026d4 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:20.084111 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2085f7db-93a1-4060-82fe-93f682d36fb6 req-7f141af4-6d24-4c8a-8c59-ee678e7026d4 service nova] Creating event network-vif-plugged:0db8b5d1-47be-4a95-88d1-fee56a199ee4 for instance 0ab015ed-9f8e-4a55-9d64-833228a7863f on n-h2-854663-10 Oct 27 11:39:20.094140 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2085f7db-93a1-4060-82fe-93f682d36fb6 req-7f141af4-6d24-4c8a-8c59-ee678e7026d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059841 Oct 27 11:39:20.095856 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3859/7911] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:39:28.713366 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:28.714922 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:28.720241 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1424589732", "imageRef": "59e54a44-b4db-4d0e-adee-11568ddaaade", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1292627310", "security_groups": [{"name": "tempest-secgroup-smoke-433101544"}], "networks": [{"uuid": "cabec47e-b358-481a-b170-6445cdd797db"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:39:28.745704 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [0fef263e-49f6-40e0-92a9-76f7527873a5] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 53394. Oct 27 11:39:28.746458 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [96cdc9e5-e02f-4d91-99be-23d737d0e4ff] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 53392. Oct 27 11:39:28.845044 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] validate_networks() for [('cabec47e-b358-481a-b170-6445cdd797db', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 11:39:29.282380 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 11:39:29.282824 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 11:39:29.283316 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 11:39:29.283739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 11:39:29.284168 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 11:39:29.294080 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:29.294585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:29.295041 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:29.295785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:29.296257 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:29.296705 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:29.314209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Getting quotas for project 4af5d55118634798a5feb92041d4fa16. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 11:39:29.319686 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.quota [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Getting quotas for user 964244098bf5432f97499032f1684139 and project 4af5d55118634798a5feb92041d4fa16. Resources: {'instances', 'cores', 'ram'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 11:39:29.332948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 11:39:29.335498 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='59e54a44-b4db-4d0e-adee-11568ddaaade',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 11:39:29.393352 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9db67f99-3c3f-4d53-be8a-c118a106167c tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.682059 Oct 27 11:39:29.394022 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4053/7912] 10.222.0.76 () {60 vars in 1147 bytes} [Thu Oct 27 11:39:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 11:39:29.408637 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-daadc6c7-babc-49bd-abb0-bf8d852e970d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:29.409337 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-daadc6c7-babc-49bd-abb0-bf8d852e970d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:29.419979 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecd0d1de-c8ef-468a-a3de-2649f8270da1] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 53410. Oct 27 11:39:29.427855 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [3317bcd0-7139-4b6a-a168-7c5e11e5c085] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 53408. Oct 27 11:39:29.483301 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-daadc6c7-babc-49bd-abb0-bf8d852e970d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:29.492007 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-daadc6c7-babc-49bd-abb0-bf8d852e970d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1249 microversion: 2.1 time: 0.090445 Oct 27 11:39:29.492936 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3860/7913] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:29 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:30.521213 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:30.522470 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:30.530629 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:30.531127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:30.531569 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:30.532276 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:30.532762 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:30.533187 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:30.604624 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:30.616249 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-326092ab-b944-4359-8e7e-900f5cbb0814 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1301 microversion: 2.1 time: 0.102223 Oct 27 11:39:30.628718 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4054/7914] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:30 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:31.640625 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:31.641338 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:31.645972 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:31.657714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:31.658562 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:31.659116 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:31.660171 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:31.660948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:31.661805 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:31.864934 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:31.873193 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e861ec62-5dc1-43ad-b9b0-43a9f13838cb tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.236964 Oct 27 11:39:31.874453 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3861/7915] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:31 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:32.897825 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:32.898446 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:32.905648 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:32.906136 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:32.906581 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:32.907278 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:32.907739 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:32.908172 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:33.055443 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:33.063828 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8dca8840-9ea7-4937-8222-d49e42e0bca2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.170176 Oct 27 11:39:33.064413 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4055/7916] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:32 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:34.062566 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2b86e426-ade7-4a6b-a280-c4d8e1795f69 req-26e26127-face-43b0-93f3-549a56b1cf61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab015ed-9f8e-4a55-9d64-833228a7863f", "name": "network-vif-unplugged", "status": "completed", "tag": "0db8b5d1-47be-4a95-88d1-fee56a199ee4"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:39:34.075293 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2b86e426-ade7-4a6b-a280-c4d8e1795f69 req-26e26127-face-43b0-93f3-549a56b1cf61 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:34.075892 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2b86e426-ade7-4a6b-a280-c4d8e1795f69 req-26e26127-face-43b0-93f3-549a56b1cf61 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:34.076453 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2b86e426-ade7-4a6b-a280-c4d8e1795f69 req-26e26127-face-43b0-93f3-549a56b1cf61 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:34.086795 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:34.088033 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:34.088304 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2b86e426-ade7-4a6b-a280-c4d8e1795f69 req-26e26127-face-43b0-93f3-549a56b1cf61 service nova] Creating event network-vif-unplugged:0db8b5d1-47be-4a95-88d1-fee56a199ee4 for instance 0ab015ed-9f8e-4a55-9d64-833228a7863f on n-h2-854663-10 Oct 27 11:39:34.093681 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2b86e426-ade7-4a6b-a280-c4d8e1795f69 req-26e26127-face-43b0-93f3-549a56b1cf61 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035084 Oct 27 11:39:34.094588 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3862/7917] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:39:34.096066 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:34.096564 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:34.097037 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:34.097747 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:34.098209 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:34.098642 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:34.257038 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:34.265343 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a565083-cceb-4c4f-a089-a302a367a3ef tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.182722 Oct 27 11:39:34.265931 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4056/7918] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:34 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:39:35.289621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:35.291836 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:35.298498 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:35.299202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:35.299838 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:35.300545 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:35.301255 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:35.301683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:35.454565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:35.463897 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7948fdee-0230-4f6c-b631-78ec52550340 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.179817 Oct 27 11:39:35.476324 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3863/7919] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:35 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:36.490816 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:36.492802 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:36.502297 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:36.503085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:36.503661 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:36.504535 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:36.505487 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:36.506003 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:36.651156 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:36.660389 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a153770e-d214-42e9-a546-415f14ee3082 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.174583 Oct 27 11:39:36.677332 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4057/7920] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:36 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:37.683952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:37.684599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:37.691911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:37.692389 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:37.692835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:37.693641 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:37.694095 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:37.694515 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:37.847447 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:37.856044 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f68cba28-cb43-4152-b014-fc930470c930 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.176222 Oct 27 11:39:37.856622 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3864/7921] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:37 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:38.881425 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:38.882103 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:38.889764 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:38.890263 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:38.890714 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:38.891430 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:38.891889 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:38.892351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:39.033947 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:39.042481 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-51a6df4e-0681-4bdb-a6af-76a80af8fce9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.166510 Oct 27 11:39:39.043107 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4058/7922] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:38 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:40.066468 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:40.067100 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:40.069932 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:40.075835 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:40.076326 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:40.076792 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:40.077493 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:40.077944 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:40.078365 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:40.279581 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:40.287601 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3259d9cb-dc2c-4028-8e3e-f06f32c492b6 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.225137 Oct 27 11:39:40.288196 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3865/7923] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:40 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:40.634536 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-bea23ea4-7112-46a8-8591-c07cf83fc807 req-65ccfef4-a276-4e2a-9dd8-5340eefd095f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420bb558-b640-4193-8c5e-8c32d80294f2", "tag": "fbd66d6f-ca1a-447d-a4ff-c490f9a89c94"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:39:40.640441 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:40.641135 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:39:40.648948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bea23ea4-7112-46a8-8591-c07cf83fc807 req-65ccfef4-a276-4e2a-9dd8-5340eefd095f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:40.649447 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bea23ea4-7112-46a8-8591-c07cf83fc807 req-65ccfef4-a276-4e2a-9dd8-5340eefd095f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:40.649896 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bea23ea4-7112-46a8-8591-c07cf83fc807 req-65ccfef4-a276-4e2a-9dd8-5340eefd095f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:40.661851 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-bea23ea4-7112-46a8-8591-c07cf83fc807 req-65ccfef4-a276-4e2a-9dd8-5340eefd095f service nova] Creating event network-changed:fbd66d6f-ca1a-447d-a4ff-c490f9a89c94 for instance 420bb558-b640-4193-8c5e-8c32d80294f2 on n-h1-854663-10 Oct 27 11:39:40.667793 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-bea23ea4-7112-46a8-8591-c07cf83fc807 req-65ccfef4-a276-4e2a-9dd8-5340eefd095f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037454 Oct 27 11:39:40.668402 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4059/7924] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:39:41.317783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:41.318577 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:41.326596 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:41.327086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:41.327570 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:41.328318 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:41.328817 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:41.329247 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:41.470611 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:41.478686 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-371df6c9-2f0c-4728-93cb-66d82c4a0337 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.165949 Oct 27 11:39:41.479279 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3866/7925] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:41 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:42.512085 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:42.512833 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:42.520012 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:42.520512 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:42.521002 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:42.521716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:42.522184 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:42.522626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:42.751329 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:42.759952 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae9a5469-fb1e-4b4e-b4fc-699b02ea9209 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.253197 Oct 27 11:39:42.768514 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4060/7926] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:42 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:43.786924 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:43.787833 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:43.796184 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:43.796706 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:43.797148 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:43.797848 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:43.798290 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:43.798714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:43.949952 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:43.957969 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7510e4d-049e-4735-bf87-f0eee3420a76 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.177871 Oct 27 11:39:43.958559 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3867/7927] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:43 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:44.981866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:44.982431 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:44.990019 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:44.990517 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:44.990969 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:44.991702 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:44.992147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:44.992588 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:45.140793 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:45.150585 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a0547a85-99ba-4f60-9241-94e6a7b930c2 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.172824 Oct 27 11:39:45.151187 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4061/7928] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:44 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:46.175112 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:46.175790 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:46.184136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:46.184620 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:46.185088 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:46.185780 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:46.186224 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:46.186647 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:46.332193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:46.342143 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6aa0ac50-01d2-42a6-997c-eff5dd363f9d tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.171791 Oct 27 11:39:46.342732 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3868/7929] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:46 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:46.829055 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e08685a2-a4c3-431d-87cd-0b49eee99372 req-2e7a6d23-a2d9-43e1-936b-cb1b925576d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420bb558-b640-4193-8c5e-8c32d80294f2", "name": "network-vif-plugged", "status": "completed", "tag": "fbd66d6f-ca1a-447d-a4ff-c490f9a89c94"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:39:46.840852 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e08685a2-a4c3-431d-87cd-0b49eee99372 req-2e7a6d23-a2d9-43e1-936b-cb1b925576d3 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:46.841412 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e08685a2-a4c3-431d-87cd-0b49eee99372 req-2e7a6d23-a2d9-43e1-936b-cb1b925576d3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:46.841970 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e08685a2-a4c3-431d-87cd-0b49eee99372 req-2e7a6d23-a2d9-43e1-936b-cb1b925576d3 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:46.853939 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e08685a2-a4c3-431d-87cd-0b49eee99372 req-2e7a6d23-a2d9-43e1-936b-cb1b925576d3 service nova] Creating event network-vif-plugged:fbd66d6f-ca1a-447d-a4ff-c490f9a89c94 for instance 420bb558-b640-4193-8c5e-8c32d80294f2 on n-h1-854663-10 Oct 27 11:39:46.859511 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e08685a2-a4c3-431d-87cd-0b49eee99372 req-2e7a6d23-a2d9-43e1-936b-cb1b925576d3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Oct 27 11:39:46.860128 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4062/7930] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:39:47.365820 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:47.366497 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:47.373599 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:47.374087 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:47.374522 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:47.375202 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:47.375666 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:47.376086 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:47.517710 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:47.526091 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62c37737-30f2-4735-bd42-8634bd995df4 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1374 microversion: 2.1 time: 0.164255 Oct 27 11:39:47.526676 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3869/7931] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:47 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:48.553524 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:48.554407 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:48.562716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:48.563402 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:48.563976 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:48.565054 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:48.565732 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:48.566351 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:48.778895 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:48.787196 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e0f48e8-fd5c-4dc8-8e95-695de886c37b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1559 microversion: 2.1 time: 0.240205 Oct 27 11:39:48.787787 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4063/7932] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:48 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1559 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:48.810300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:39:48.810884 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:39:48.818163 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:48.818683 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:48.819123 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:48.819849 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:48.820309 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:48.820745 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:48.966992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:39:48.975605 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73fd5db3-4ca8-416a-b67c-e1b2c3e0c75a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1559 microversion: 2.1 time: 0.169606 Oct 27 11:39:48.976181 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3870/7933] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:39:48 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:39:50.645387 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-08d9d5e8-fcea-4bcc-9a1a-9a77bcbfb99e req-3b24f0af-8882-440e-8a34-e767a3a2dab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420bb558-b640-4193-8c5e-8c32d80294f2", "tag": "fbd66d6f-ca1a-447d-a4ff-c490f9a89c94"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:39:50.655867 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-08d9d5e8-fcea-4bcc-9a1a-9a77bcbfb99e req-3b24f0af-8882-440e-8a34-e767a3a2dab5 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:39:50.656370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-08d9d5e8-fcea-4bcc-9a1a-9a77bcbfb99e req-3b24f0af-8882-440e-8a34-e767a3a2dab5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:39:50.656819 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-08d9d5e8-fcea-4bcc-9a1a-9a77bcbfb99e req-3b24f0af-8882-440e-8a34-e767a3a2dab5 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:39:50.668925 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-08d9d5e8-fcea-4bcc-9a1a-9a77bcbfb99e req-3b24f0af-8882-440e-8a34-e767a3a2dab5 service nova] Creating event network-changed:fbd66d6f-ca1a-447d-a4ff-c490f9a89c94 for instance 420bb558-b640-4193-8c5e-8c32d80294f2 on n-h1-854663-10 Oct 27 11:39:50.673900 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-08d9d5e8-fcea-4bcc-9a1a-9a77bcbfb99e req-3b24f0af-8882-440e-8a34-e767a3a2dab5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 Oct 27 11:39:50.674718 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4064/7934] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:41:18.377911 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=26 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:41:18.378690 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=56 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:41:18.380051 n-d-854663-10 devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:41:18.380716 n-d-854663-10 devstack@n-api.service[120719]: Thu Oct 27 11:41:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2/action (ip 10.222.0.76) !!! Oct 27 11:41:18.386990 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1d6db8d5-7609-4204-80b3-bc83218d6b8a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-472661418"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:41:18.388685 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1d6db8d5-7609-4204-80b3-bc83218d6b8a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:18.397688 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d6db8d5-7609-4204-80b3-bc83218d6b8a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:18.398170 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d6db8d5-7609-4204-80b3-bc83218d6b8a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:18.398601 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d6db8d5-7609-4204-80b3-bc83218d6b8a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:18.399300 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d6db8d5-7609-4204-80b3-bc83218d6b8a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:18.399746 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d6db8d5-7609-4204-80b3-bc83218d6b8a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:18.400167 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d6db8d5-7609-4204-80b3-bc83218d6b8a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:18.828393 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1d6db8d5-7609-4204-80b3-bc83218d6b8a tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "POST /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2/action" status: 202 len: 0 microversion: 2.1 time: 0.452610 Oct 27 11:41:18.829111 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3871/7935] 10.222.0.76 () {60 vars in 1278 bytes} [Thu Oct 27 11:41:18 2022] POST /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 11:41:23.297370 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:41:23.298952 n-d-854663-10 devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=56 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:41:23.304279 n-d-854663-10 devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 11:41:23.304862 n-d-854663-10 devstack@n-api.service[120720]: Thu Oct 27 11:41:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.76) !!! Oct 27 11:41:23.387670 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f63f1b1b-7810-4bb9-81a4-5712cfd2b766 req-84053b1a-d072-4d18-b04f-bb32986b46ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420bb558-b640-4193-8c5e-8c32d80294f2", "name": "network-vif-plugged", "status": "completed", "tag": "fbd66d6f-ca1a-447d-a4ff-c490f9a89c94"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:41:23.403364 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f63f1b1b-7810-4bb9-81a4-5712cfd2b766 req-84053b1a-d072-4d18-b04f-bb32986b46ad service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:23.404211 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f63f1b1b-7810-4bb9-81a4-5712cfd2b766 req-84053b1a-d072-4d18-b04f-bb32986b46ad service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:23.405147 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f63f1b1b-7810-4bb9-81a4-5712cfd2b766 req-84053b1a-d072-4d18-b04f-bb32986b46ad service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:23.417731 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f63f1b1b-7810-4bb9-81a4-5712cfd2b766 req-84053b1a-d072-4d18-b04f-bb32986b46ad service nova] Creating event network-vif-plugged:fbd66d6f-ca1a-447d-a4ff-c490f9a89c94 for instance 420bb558-b640-4193-8c5e-8c32d80294f2 on n-h1-854663-10 Oct 27 11:41:23.423617 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f63f1b1b-7810-4bb9-81a4-5712cfd2b766 req-84053b1a-d072-4d18-b04f-bb32986b46ad service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128586 Oct 27 11:41:23.425174 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4065/7936] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:41:32.539416 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:41:32.540395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 11:41:32.545623 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:32.546402 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:32.546565 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-70417d41-902d-4712-a4d9-36158e2ad06f req-fa9f70bf-d9f5-492a-88de-638982131c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420bb558-b640-4193-8c5e-8c32d80294f2", "tag": "fbd66d6f-ca1a-447d-a4ff-c490f9a89c94"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:41:32.555191 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:32.555783 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:32.556212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:32.556939 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:32.557264 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-70417d41-902d-4712-a4d9-36158e2ad06f req-fa9f70bf-d9f5-492a-88de-638982131c03 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:32.557534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:32.557894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-70417d41-902d-4712-a4d9-36158e2ad06f req-fa9f70bf-d9f5-492a-88de-638982131c03 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:32.558177 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:32.558495 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-70417d41-902d-4712-a4d9-36158e2ad06f req-fa9f70bf-d9f5-492a-88de-638982131c03 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:32.570469 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-70417d41-902d-4712-a4d9-36158e2ad06f req-fa9f70bf-d9f5-492a-88de-638982131c03 service nova] Creating event network-changed:fbd66d6f-ca1a-447d-a4ff-c490f9a89c94 for instance 420bb558-b640-4193-8c5e-8c32d80294f2 on n-h1-854663-10 Oct 27 11:41:32.578464 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-70417d41-902d-4712-a4d9-36158e2ad06f req-fa9f70bf-d9f5-492a-88de-638982131c03 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038873 Oct 27 11:41:32.581120 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4066/7937] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:41:32.588003 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:41:32.677787 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d5a33e2-7e0d-4861-8d31-04e6b51a97d5 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "DELETE /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 204 len: 0 microversion: 2.1 time: 0.141594 Oct 27 11:41:32.679218 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3872/7938] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:41:32 2022] DELETE /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:41:32.688472 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:32.689239 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:32.696585 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:32.697385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:32.698046 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:32.698780 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:32.699250 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:32.699696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:32.870331 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:41:32.878506 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30894007-a31e-4ea2-885a-2b3c8e8e880b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1684 microversion: 2.1 time: 0.194279 Oct 27 11:41:32.879308 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4067/7939] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:41:32 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:41:33.907175 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:33.908353 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:33.916799 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:33.917287 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:33.917726 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:33.918415 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:33.918860 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:33.919282 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:34.062607 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:41:34.070902 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-178f795c-d7b3-48ca-b2aa-6f28baeeee18 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1684 microversion: 2.1 time: 0.171223 Oct 27 11:41:34.071489 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3873/7940] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:41:33 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:41:34.909785 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1f527bd9-e81f-4d69-9803-9914171ba7fe req-dc1aeb9f-f31e-46c2-be55-2ced9d9d737f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420bb558-b640-4193-8c5e-8c32d80294f2", "name": "network-vif-deleted", "tag": "fbd66d6f-ca1a-447d-a4ff-c490f9a89c94"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:41:34.921696 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f527bd9-e81f-4d69-9803-9914171ba7fe req-dc1aeb9f-f31e-46c2-be55-2ced9d9d737f service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:34.922179 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f527bd9-e81f-4d69-9803-9914171ba7fe req-dc1aeb9f-f31e-46c2-be55-2ced9d9d737f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:34.922626 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f527bd9-e81f-4d69-9803-9914171ba7fe req-dc1aeb9f-f31e-46c2-be55-2ced9d9d737f service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:34.934687 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1f527bd9-e81f-4d69-9803-9914171ba7fe req-dc1aeb9f-f31e-46c2-be55-2ced9d9d737f service nova] Creating event network-vif-deleted:fbd66d6f-ca1a-447d-a4ff-c490f9a89c94 for instance 420bb558-b640-4193-8c5e-8c32d80294f2 on n-h1-854663-10 Oct 27 11:41:34.940090 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1f527bd9-e81f-4d69-9803-9914171ba7fe req-dc1aeb9f-f31e-46c2-be55-2ced9d9d737f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034139 Oct 27 11:41:34.940729 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4068/7941] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:41:35.094737 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:35.095382 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:35.102948 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:35.103426 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:35.103855 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:35.104565 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:35.105050 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:35.105795 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:35.141989 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:35.142494 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:35.142920 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:35.143361 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lazy-loading 'fault' on Instance uuid 420bb558-b640-4193-8c5e-8c32d80294f2 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:41:35.192936 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:41:35.201074 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30285027-4e92-443b-be86-a089f1120f22 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 200 len: 1339 microversion: 2.1 time: 0.110430 Oct 27 11:41:35.201666 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3874/7942] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:41:35 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:41:36.228866 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:36.229641 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 420bb558-b640-4193-8c5e-8c32d80294f2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:36.237749 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:36.238546 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:36.239072 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:36.239894 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:36.240436 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:36.240955 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:36.257169 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] HTTP exception thrown: Instance 420bb558-b640-4193-8c5e-8c32d80294f2 could not be found. Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Request method failure captured: Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 HTTP/1.1 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWm1cKmsVhifK2w2QIqLx-vl19bjNgPccaqyMh2-EIYaWxDYTa58Tjd2sR3xbwsEwV9DNQEgF0Fxt67CJvVuMCBsEECQcROQDj4YggMvQaPgvOGQDljwiuHVJN3M0hop6Gu5X55iJkxv0lpO45xOkaH10VlnPeOuXhraQJoYNkvk17j4 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 4af5d55118634798a5feb92041d4fa16 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestSnapshotPattern-2061071419 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4af5d55118634798a5feb92041d4fa16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4af5d55118634798a5feb92041d4fa16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4af5d55118634798a5feb92041d4fa16", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4af5d55118634798a5feb92041d4fa16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestSnapshotPattern-2061071419 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 4af5d55118634798a5feb92041d4fa16 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestSnapshotPattern-2061071419 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestSnapshotPattern-2061071419-project Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 964244098bf5432f97499032f1684139 Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestSnapshotPattern-2061071419-project Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 420bb558-b640-4193-8c5e-8c32d80294f2 could not be found. Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '420bb558-b640-4193-8c5e-8c32d80294f2'} Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420bb558-b640-4193-8c5e-8c32d80294f2 could not be found. Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420bb558-b640-4193-8c5e-8c32d80294f2 could not be found. Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:41:36.258813 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420bb558-b640-4193-8c5e-8c32d80294f2 could not be found. Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Returning 404 to user: Instance 420bb558-b640-4193-8c5e-8c32d80294f2 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-88ffee98-9d00-4f1f-ba78-4d446a8dd4c0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2" status: 404 len: 111 microversion: 2.1 time: 0.037811 Oct 27 11:41:36.263880 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4069/7943] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:41:36 2022] GET /compute/v2.1/servers/420bb558-b640-4193-8c5e-8c32d80294f2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:41:37.962992 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:37.963536 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:37.965392 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e6d6decf-49a1-4e95-85ad-ce9050625d8c req-fe9a565f-3846-4634-95d0-e4f60199c096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab015ed-9f8e-4a55-9d64-833228a7863f", "tag": "0db8b5d1-47be-4a95-88d1-fee56a199ee4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:41:37.970765 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:37.971243 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:37.971862 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:37.972592 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:37.973042 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:37.973460 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:37.981750 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e6d6decf-49a1-4e95-85ad-ce9050625d8c req-fe9a565f-3846-4634-95d0-e4f60199c096 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:37.982348 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e6d6decf-49a1-4e95-85ad-ce9050625d8c req-fe9a565f-3846-4634-95d0-e4f60199c096 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:37.982891 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e6d6decf-49a1-4e95-85ad-ce9050625d8c req-fe9a565f-3846-4634-95d0-e4f60199c096 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:37.996252 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e6d6decf-49a1-4e95-85ad-ce9050625d8c req-fe9a565f-3846-4634-95d0-e4f60199c096 service nova] Creating event network-changed:0db8b5d1-47be-4a95-88d1-fee56a199ee4 for instance 0ab015ed-9f8e-4a55-9d64-833228a7863f on n-h2-854663-10 Oct 27 11:41:38.001738 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e6d6decf-49a1-4e95-85ad-ce9050625d8c req-fe9a565f-3846-4634-95d0-e4f60199c096 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040239 Oct 27 11:41:38.002426 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4070/7944] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:41:38.004756 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 11:41:38.091274 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3eaab1cb-4fa3-45e6-af3e-2d5ea0a5295b tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 204 len: 0 microversion: 2.1 time: 0.131700 Oct 27 11:41:38.092072 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3875/7945] 10.222.0.76 () {58 vars in 1239 bytes} [Thu Oct 27 11:41:37 2022] DELETE /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 11:41:38.102385 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:38.103620 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:38.112484 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:38.113332 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:38.113988 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:38.115023 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:38.115716 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:38.116378 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:38.276653 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.policy [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:41:38.284744 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c3de9b64-e317-4901-93c1-2684b2c79fc0 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1682 microversion: 2.1 time: 0.187944 Oct 27 11:41:38.285335 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4071/7946] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:41:38 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:41:39.308437 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:39.309360 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:39.316714 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:39.317212 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:39.317798 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:39.318500 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:39.318946 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:39.319395 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:39.493136 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:41:39.501683 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ebe0403-7a0e-427a-898e-e3e7845992d9 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1682 microversion: 2.1 time: 0.197618 Oct 27 11:41:39.502258 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3876/7947] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:41:39 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 11:41:40.076690 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-eb7048d8-e630-4ab4-8337-4ba75db3ec02 req-4c76ee21-3dcd-4aeb-8210-55adc0fffc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab015ed-9f8e-4a55-9d64-833228a7863f", "name": "network-vif-deleted", "tag": "0db8b5d1-47be-4a95-88d1-fee56a199ee4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 11:41:40.087945 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eb7048d8-e630-4ab4-8337-4ba75db3ec02 req-4c76ee21-3dcd-4aeb-8210-55adc0fffc88 service nova] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:40.088438 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eb7048d8-e630-4ab4-8337-4ba75db3ec02 req-4c76ee21-3dcd-4aeb-8210-55adc0fffc88 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:40.088948 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eb7048d8-e630-4ab4-8337-4ba75db3ec02 req-4c76ee21-3dcd-4aeb-8210-55adc0fffc88 service nova] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:40.102236 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-eb7048d8-e630-4ab4-8337-4ba75db3ec02 req-4c76ee21-3dcd-4aeb-8210-55adc0fffc88 service nova] Creating event network-vif-deleted:0db8b5d1-47be-4a95-88d1-fee56a199ee4 for instance 0ab015ed-9f8e-4a55-9d64-833228a7863f on n-h2-854663-10 Oct 27 11:41:40.107208 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-eb7048d8-e630-4ab4-8337-4ba75db3ec02 req-4c76ee21-3dcd-4aeb-8210-55adc0fffc88 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034384 Oct 27 11:41:40.108158 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4072/7948] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 27 11:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 11:41:40.525863 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:40.526580 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:40.533933 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:40.534503 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:40.535013 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:40.535791 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:40.536452 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:40.536983 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:40.570727 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:40.571193 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:40.571621 n-d-854663-10 devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:40.572106 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lazy-loading 'fault' on Instance uuid 0ab015ed-9f8e-4a55-9d64-833228a7863f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 11:41:40.619534 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.policy [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964244098bf5432f97499032f1684139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af5d55118634798a5feb92041d4fa16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 11:41:40.626775 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4163dc26-7a2e-48c9-9356-f725ec4c4008 tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 200 len: 1339 microversion: 2.1 time: 0.104912 Oct 27 11:41:40.627370 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3877/7949] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:41:40 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 11:41:41.657283 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:41.658448 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] [instance: 0ab015ed-9f8e-4a55-9d64-833228a7863f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 11:41:41.667127 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:41.667550 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:41.668027 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:41.668761 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Acquiring lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 11:41:41.669223 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 11:41:41.669657 n-d-854663-10 devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Lock "9ce304fc-b6ad-4e74-a4d9-928e79c98b2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 11:41:41.683888 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] HTTP exception thrown: Instance 0ab015ed-9f8e-4a55-9d64-833228a7863f could not be found. Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Request method failure captured: Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f HTTP/1.1 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: Accept: application/json Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: Accept-Encoding: identity Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: Connection: close Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: Content-Length: 0 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: Content-Type: application/json Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: Host: 10.222.0.76 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: Openstack-System-Scope: None Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjWm1cKmsVhifK2w2QIqLx-vl19bjNgPccaqyMh2-EIYaWxDYTa58Tjd2sR3xbwsEwV9DNQEgF0Fxt67CJvVuMCBsEECQcROQDj4YggMvQaPgvOGQDljwiuHVJN3M0hop6Gu5X55iJkxv0lpO45xOkaH10VlnPeOuXhraQJoYNkvk17j4 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Id: None Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Domain-Name: None Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Identity-Status: Confirmed Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Is-Admin-Project: True Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Id: default Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Domain-Name: Default Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Id: 4af5d55118634798a5feb92041d4fa16 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Project-Name: tempest-TestSnapshotPattern-2061071419 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Role: member,reader Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Roles: member,reader Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4af5d55118634798a5feb92041d4fa16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4af5d55118634798a5feb92041d4fa16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4af5d55118634798a5feb92041d4fa16", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4af5d55118634798a5feb92041d4fa16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant: tempest-TestSnapshotPattern-2061071419 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Id: 4af5d55118634798a5feb92041d4fa16 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestSnapshotPattern-2061071419 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-User: tempest-TestSnapshotPattern-2061071419-project Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Id: default Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-User-Domain-Name: Default Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-User-Id: 964244098bf5432f97499032f1684139 Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: X-User-Name: tempest-TestSnapshotPattern-2061071419-project Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: method: > Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: exception: Instance 0ab015ed-9f8e-4a55-9d64-833228a7863f could not be found. Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: action_args: {'id': '0ab015ed-9f8e-4a55-9d64-833228a7863f'} Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab015ed-9f8e-4a55-9d64-833228a7863f could not be found. Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab015ed-9f8e-4a55-9d64-833228a7863f could not be found. Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 11:41:41.685602 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab015ed-9f8e-4a55-9d64-833228a7863f could not be found. Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Returning 404 to user: Instance 0ab015ed-9f8e-4a55-9d64-833228a7863f could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc977d2a-90df-466f-85b3-e8d52a637dca tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f" status: 404 len: 111 microversion: 2.1 time: 0.038846 Oct 27 11:41:41.691058 n-d-854663-10 devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4073/7950] 10.222.0.76 () {58 vars in 1236 bytes} [Thu Oct 27 11:41:41 2022] GET /compute/v2.1/servers/0ab015ed-9f8e-4a55-9d64-833228a7863f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 11:41:41.863558 n-d-854663-10 devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7106f6f9-c7b8-458d-ac49-d07fcc678b1e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] Calling method '.version_select at 0x7f6d5a92f5e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 11:41:41.892537 n-d-854663-10 devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7106f6f9-c7b8-458d-ac49-d07fcc678b1e tempest-TestSnapshotPattern-2061071419 tempest-TestSnapshotPattern-2061071419-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1292627310" status: 202 len: 0 microversion: 2.1 time: 0.032846 Oct 27 11:41:41.893122 n-d-854663-10 devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3878/7951] 10.222.0.76 () {58 vars in 1257 bytes} [Thu Oct 27 11:41:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1292627310 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)